-- Logs begin at Tue 2022-07-05 20:19:08 UTC, end at Tue 2022-07-05 22:05:22 UTC. -- Jul 05 21:06:57.667725 dv-cinder-847335-3-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jul 05 21:06:57.676840 dv-cinder-847335-3-iscsi devstack@keystone.service[107993]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 05 21:06:57.678083 dv-cinder-847335-3-iscsi devstack@keystone.service[107993]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 5 21:06:57 2022] *** Jul 05 21:06:57.678083 dv-cinder-847335-3-iscsi devstack@keystone.service[107993]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 05 21:06:57.678083 dv-cinder-847335-3-iscsi devstack@keystone.service[107993]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 05 21:06:57.678083 dv-cinder-847335-3-iscsi devstack@keystone.service[107993]: nodename: dv-cinder-847335-3-iscsi Jul 05 21:06:57.678083 dv-cinder-847335-3-iscsi devstack@keystone.service[107993]: machine: x86_64 Jul 05 21:06:57.678083 dv-cinder-847335-3-iscsi devstack@keystone.service[107993]: clock source: unix Jul 05 21:06:57.678083 dv-cinder-847335-3-iscsi devstack@keystone.service[107993]: pcre jit disabled Jul 05 21:06:57.678083 dv-cinder-847335-3-iscsi devstack@keystone.service[107993]: detected number of CPU cores: 4 Jul 05 21:06:57.678083 dv-cinder-847335-3-iscsi devstack@keystone.service[107993]: current working directory: / Jul 05 21:06:57.678083 dv-cinder-847335-3-iscsi devstack@keystone.service[107993]: detected binary path: /usr/bin/uwsgi-core Jul 05 21:06:57.678083 dv-cinder-847335-3-iscsi devstack@keystone.service[107993]: your processes number limit is 47680 Jul 05 21:06:57.678083 dv-cinder-847335-3-iscsi devstack@keystone.service[107993]: your memory page size is 4096 bytes Jul 05 21:06:57.678083 dv-cinder-847335-3-iscsi devstack@keystone.service[107993]: detected max file descriptor number: 2048 Jul 05 21:06:57.678083 dv-cinder-847335-3-iscsi devstack@keystone.service[107993]: lock engine: pthread robust mutexes Jul 05 21:06:57.679848 dv-cinder-847335-3-iscsi devstack@keystone.service[107993]: thunder lock: enabled Jul 05 21:06:57.679848 dv-cinder-847335-3-iscsi devstack@keystone.service[107993]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 05 21:06:57.679848 dv-cinder-847335-3-iscsi devstack@keystone.service[107993]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 05 21:06:57.723652 dv-cinder-847335-3-iscsi devstack@keystone.service[107993]: Python main interpreter initialized at 0x55ef3d5c39c0 Jul 05 21:06:57.723652 dv-cinder-847335-3-iscsi devstack@keystone.service[107993]: python threads support enabled Jul 05 21:06:57.723652 dv-cinder-847335-3-iscsi devstack@keystone.service[107993]: your server socket listen backlog is limited to 100 connections Jul 05 21:06:57.723652 dv-cinder-847335-3-iscsi devstack@keystone.service[107993]: your mercy for graceful operations on workers is 90 seconds Jul 05 21:06:57.724036 dv-cinder-847335-3-iscsi devstack@keystone.service[107993]: mapped 403077 bytes (393 KB) for 2 cores Jul 05 21:06:57.724111 dv-cinder-847335-3-iscsi devstack@keystone.service[107993]: *** Operational MODE: preforking *** Jul 05 21:06:57.724347 dv-cinder-847335-3-iscsi devstack@keystone.service[107993]: *** uWSGI is running in multiple interpreter mode *** Jul 05 21:06:57.724347 dv-cinder-847335-3-iscsi devstack@keystone.service[107993]: spawned uWSGI master process (pid: 107993) Jul 05 21:06:57.724555 dv-cinder-847335-3-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jul 05 21:06:57.725987 dv-cinder-847335-3-iscsi devstack@keystone.service[107993]: spawned uWSGI worker 1 (pid: 108008, cores: 1) Jul 05 21:06:57.726094 dv-cinder-847335-3-iscsi devstack@keystone.service[107993]: spawned uWSGI worker 2 (pid: 108009, cores: 1) Jul 05 21:06:57.728670 dv-cinder-847335-3-iscsi devstack@keystone.service[107993]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 05 21:07:03.226009 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 21:07:03.226009 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: from cryptography.utils import int_from_bytes Jul 05 21:07:03.226816 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 21:07:03.226816 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: from cryptography.utils import int_from_bytes Jul 05 21:07:03.226928 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 21:07:03.226928 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: from cryptography.utils import int_from_bytes Jul 05 21:07:03.227353 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 21:07:03.227353 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: from cryptography.utils import int_from_bytes Jul 05 21:07:03.275437 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 05 21:07:03.275647 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 05 21:07:03.275768 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 05 21:07:03.275899 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] command line args: [] {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 05 21:07:03.276560 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 05 21:07:03.276729 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] command line args: [] {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 05 21:07:03.276909 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 05 21:07:03.276993 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 05 21:07:03.277152 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ================================================================================ {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 05 21:07:03.277253 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ================================================================================ {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 05 21:07:03.277363 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] admin_token = **** {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.277449 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] admin_token = **** {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.277620 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] config_dir = [] {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.277696 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] config_dir = [] {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.277815 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.277903 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.278002 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] config_source = [] {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.278084 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] config_source = [] {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.278210 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] debug = True {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.278289 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] debug = True {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.278412 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.278734 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.278868 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.278965 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.279073 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] insecure_debug = False {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.279177 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] insecure_debug = False {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.279177 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.279381 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.279479 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.279574 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.279674 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] list_limit = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.279779 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] list_limit = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.279882 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] log_config_append = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.279983 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] log_config_append = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.280080 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.280181 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.280289 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] log_dir = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.280396 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] log_dir = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.280499 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] log_file = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.280595 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] log_file = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.280713 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.280788 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.280902 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.280989 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.281060 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.281175 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.281249 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.281366 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.281442 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.281566 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.281647 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.281719 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.281841 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.281917 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.282079 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.282193 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.282344 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.282427 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.282582 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.282658 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.282816 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.282940 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.283052 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.283138 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.283298 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.283378 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.283547 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] notification_format = cadf {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.283628 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] notification_format = cadf {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.283823 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.283902 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.284309 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.30/identity {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.284479 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.30/identity {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.284479 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] publish_errors = False {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.284658 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] publish_errors = False {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.284782 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.284857 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.284971 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.285049 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.285120 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.285186 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.285333 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.285429 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.285570 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.285651 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.285804 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] standard_threads = False {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.285881 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] standard_threads = False {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.286038 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] strict_password_check = False {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.286115 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] strict_password_check = False {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.286307 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.286392 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.286472 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] use_eventlog = False {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.286543 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] use_eventlog = False {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.286652 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] use_journal = False {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.286735 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] use_journal = False {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.286813 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] use_json = False {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.286889 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] use_json = False {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.287036 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] use_stderr = False {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.287109 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] use_stderr = False {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.287178 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] use_syslog = False {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.287247 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] use_syslog = False {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.287373 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] watch_log_file = False {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.287450 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] watch_log_file = False {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:07:03.287633 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.287716 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.287876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.287958 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.288140 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.288221 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.288386 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.288470 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.288642 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.288725 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.288886 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.288964 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.289138 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.289215 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.289375 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.289452 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.289629 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.289706 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.289886 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.289963 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.290150 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.290231 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.290394 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.290499 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.290645 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.290759 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.290882 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.290990 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.291134 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.291244 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.291371 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.291447 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.291647 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.291724 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.291913 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.292008 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.292177 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.292254 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.292430 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.292514 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.292676 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.292835 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.292937 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.293021 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.293303 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.293380 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.293567 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.293653 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.293825 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.293901 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.294064 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.294173 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.294329 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.294415 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.294572 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.294649 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.294815 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.294900 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.295068 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.295153 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.295325 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.295435 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.295565 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.295686 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.295804 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.295928 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.296060 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.296187 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.296316 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.296444 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.296559 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.296691 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.296814 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.296949 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.297053 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.297191 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.297295 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.297435 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.297520 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.297680 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.297770 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.297919 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.297997 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.298178 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.298260 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.298422 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.298509 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.298667 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.298746 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.298913 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.298994 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.299149 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.299226 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.299395 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.299483 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.299638 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.299727 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.299878 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.299963 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.300120 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.300202 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.300364 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.300455 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.300598 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.300705 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.300925 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.301046 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.301151 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.301258 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.301364 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.301468 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.301566 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.301663 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.301766 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.301873 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.302000 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.302114 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.302276 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.302383 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.302513 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.302627 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.302755 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.302866 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.302990 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.303107 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.303228 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.303351 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.303468 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.303627 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.303730 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.303833 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.303932 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.304038 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.304159 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.304265 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.304425 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.304529 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.304661 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.304836 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.304938 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.305034 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.305158 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.305264 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.305402 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.305534 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.305652 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.305793 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.305910 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.306026 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.306181 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.306300 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] cache.enabled = True {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.306407 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.306516 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] cache.enabled = True {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.306615 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.306711 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.306849 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.306967 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.307078 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.307218 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.307321 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.307450 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.307562 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.307779 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.307893 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.308026 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.308140 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.308269 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.308382 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.308534 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.308665 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.308783 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.308897 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.309017 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.309132 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.309246 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.309367 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.309484 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.309598 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.309713 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.309835 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.309951 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.310073 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.310208 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.310335 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.310453 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.310567 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.310682 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.310805 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.310920 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.311035 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.311848 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.311932 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.312015 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.312088 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.312159 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.312229 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.312304 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.312382 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.312462 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.312534 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.312605 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.312675 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.312745 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.312815 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.312992 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.313073 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.313240 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.313317 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.313477 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] auth.external = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.313555 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] auth.external = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.313712 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] auth.mapped = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.313790 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] auth.mapped = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.314007 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.314112 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.314271 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.314352 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.314491 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] auth.password = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.314571 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] auth.password = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.314726 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] auth.token = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.314807 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] auth.token = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.314971 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.315049 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.315208 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] catalog.caching = True {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.315294 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] catalog.caching = True {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.315460 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.315546 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.315697 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.315776 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.315947 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.316024 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.316200 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.316280 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.316436 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.316513 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.316673 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] credential.caching = True {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.316751 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] credential.caching = True {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.316927 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] credential.driver = sql {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.317006 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] credential.driver = sql {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.317179 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.317257 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.317433 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.317518 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.317674 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.317758 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.317924 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.318002 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.318187 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.318287 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.318459 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.318539 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.318719 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.318796 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.318967 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.319132 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.319210 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.319282 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.319491 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.319570 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.319741 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.319827 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.320005 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.320083 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.320251 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.320328 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.320510 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.320596 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.320750 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] federation.caching = True {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.320828 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] federation.caching = True {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.320989 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.321075 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.321240 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] federation.driver = sql {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.321327 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] federation.driver = sql {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.321495 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.321574 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.321729 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.321807 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.321983 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.322070 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.322243 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.322323 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.322506 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.322585 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.323389 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.323643 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.323725 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.323839 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.324019 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.324096 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.324174 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.324360 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] identity.caching = True {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.324570 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.324650 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.324861 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.325022 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] identity.caching = True {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.325101 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.325335 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.325468 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.325591 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] identity.driver = sql {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.325739 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.325818 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.325988 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.326076 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.326259 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.326341 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.326520 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] identity.driver = sql {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.326598 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.326763 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.326854 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.327011 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.327091 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.327249 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.327334 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.327501 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.327589 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.327740 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.327818 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.327980 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.328059 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.328219 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.328309 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.328471 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.328551 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.328726 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.328806 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.328980 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.329061 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.329220 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.329303 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.329460 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.329540 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.329705 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.329791 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.329942 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.330022 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.330207 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.330290 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.330457 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.330539 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.330697 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.330781 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.330936 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.331015 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.331176 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.331255 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.331419 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.331497 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.331663 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.331743 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.331904 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.331984 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.332144 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.332222 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.332399 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.332479 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.332638 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.332718 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.332890 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.332972 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.333126 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ldap.password = **** {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.333210 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.333372 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.333453 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.333611 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.333689 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.333857 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.333934 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.334093 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ldap.password = **** {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.334245 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.334361 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.334439 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.334604 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.334682 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.334852 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.334933 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.335087 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.335166 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.335325 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.335404 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.335579 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.335659 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.335832 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.335909 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.336067 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.336145 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.336305 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.336386 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.336544 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.336621 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.336783 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ldap.user = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.336862 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.337031 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.337110 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.337274 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.337354 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.337516 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.337594 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.337751 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ldap.user = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.337831 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.337997 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.338075 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.338277 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.338355 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.339093 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.339216 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.339463 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.339542 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.339709 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.339797 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.339951 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.340031 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.340206 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.340296 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.340440 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.340526 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.340657 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.340737 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.340899 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.340978 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.341142 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.341229 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.341379 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.341458 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.341630 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.341707 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.341869 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.341957 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.342118 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.342219 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.342384 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.342462 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.342627 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.342718 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.342862 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.342941 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.343101 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.343186 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.343341 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.343427 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.343582 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.343668 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.343823 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.343902 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.344063 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.344214 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] policy.driver = sql {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.344290 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.344361 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.344540 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.344620 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.344779 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.344866 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.345020 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] receipt.caching = True {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.345098 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] policy.driver = sql {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.345262 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.345340 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.345510 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.345597 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.345752 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.345831 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.345985 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.346063 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] receipt.caching = True {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.346246 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.346343 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.346493 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] resource.caching = True {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.346571 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.346738 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.346816 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.346975 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.347065 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] resource.driver = sql {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.347221 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.347299 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.347465 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] resource.caching = True {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.347543 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.347719 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.347806 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.347957 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] revoke.caching = True {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.348036 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] resource.driver = sql {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.348201 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.348299 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.348442 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.348528 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.348690 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] role.cache_time = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.348769 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.348927 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] revoke.caching = True {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.349005 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] role.caching = True {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.349180 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.349268 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] role.driver = sql {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.349417 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] role.list_limit = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.349495 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.349657 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] role.cache_time = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.349735 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.349898 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] role.caching = True {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.349985 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.350187 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] role.driver = sql {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.350271 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.350414 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] role.list_limit = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.350494 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.350670 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.350762 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.350921 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.351000 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.351171 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.351250 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.351422 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.351502 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.351665 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.351744 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.351914 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.351992 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.352165 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.352245 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.352416 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.352494 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.352654 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.352733 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.352906 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.353078 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.353158 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.353322 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.353401 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.353579 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.353667 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.353837 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.354045 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.354226 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.354308 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.354498 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.354590 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.354744 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.354824 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.355008 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.355087 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.355269 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.355358 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.355511 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.355592 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.355747 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.355825 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.355987 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.356075 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.356229 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.356308 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.356461 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.356538 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.356698 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.356778 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.356935 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.357014 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.357193 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.357272 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.357436 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.357515 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.357676 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] token.cache_time = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.357756 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.357917 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.357995 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] token.caching = True {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.358177 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.358261 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.358417 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] token.cache_time = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.358497 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] token.provider = fernet {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.358660 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] token.caching = True {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.358740 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.358903 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.358985 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.359155 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] token.provider = fernet {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.359235 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.359396 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.359475 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.359646 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.359725 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.359897 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.359976 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.360152 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.360230 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] trust.driver = sql {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.360394 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.360474 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.360640 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.360719 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.360881 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.360959 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] trust.driver = sql {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.361125 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.361205 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.361371 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.361450 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.361606 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.361684 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.361856 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.361936 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.362111 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.362253 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.362370 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.362449 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] database.connection = **** {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.362618 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.362708 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.362907 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.362987 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.363156 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.363236 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] database.connection = **** {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.363406 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.363494 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.363646 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.363797 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.363874 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.363946 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.364121 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.364201 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.364360 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.364447 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.364599 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.364677 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.364839 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.364918 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.365080 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.365167 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.365319 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.365397 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.365557 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.365635 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.365803 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.365890 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.366042 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.366121 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.366304 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.366383 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.366545 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.366635 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.366783 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.366862 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.366959 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=108008) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 05 21:07:03.367039 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.367247 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.367488 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:07:03.367661 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=108009) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 05 21:07:03.398663 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=108009) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.398895 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=108009) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.398979 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=108008) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.399122 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=108009) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.399207 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=108008) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.399373 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=108008) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.407958 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=108009) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.408421 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=108008) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.436203 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=108009) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.436685 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=108009) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.437067 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=108008) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.437304 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=108008) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.580302 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=108009) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.580972 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=108008) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.628367 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=108009) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.628603 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=108009) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.629907 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=108008) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.630166 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=108008) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.692480 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=108009) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.692642 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=108008) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.692726 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=108009) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.692859 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=108008) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.692944 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=108009) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.693087 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=108008) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.693180 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=108009) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.693311 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=108008) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.693395 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=108009) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.693522 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=108009) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.693604 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=108008) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.693737 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=108008) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.718700 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=108009) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.718936 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=108009) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.719021 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=108008) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.719166 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=108009) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.719249 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=108008) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.719394 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=108009) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.719479 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=108008) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.719605 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=108009) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.719689 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=108008) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.719819 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=108009) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.719913 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=108008) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.720036 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=108009) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.720120 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=108008) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.720272 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=108008) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.731214 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=108009) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.731605 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=108008) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.743846 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=108009) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.743955 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=108008) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.744105 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=108009) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.744189 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=108008) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.744333 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=108009) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.744461 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=108008) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.744543 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=108009) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.745303 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=108008) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.745405 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=108009) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.745519 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=108008) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.745640 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=108009) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.745860 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=108009) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.745941 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=108008) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.746123 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=108008) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:07:03.763168 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.763388 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 05 21:07:03.763726 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.763929 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 05 21:07:03.764011 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.764197 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.764279 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 05 21:07:03.764457 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.764539 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.764712 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.764794 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 05 21:07:03.764966 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.765057 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.765223 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.765482 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.765738 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.775747 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.776575 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.776835 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.777114 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.777389 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.777669 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.777939 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.778257 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.785400 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=108009) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:07:03.786621 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=108008) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:07:03.788671 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=108009) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:07:03.788946 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.789225 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.789503 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.789785 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.789867 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=108008) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:07:03.790045 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.790158 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.790338 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.790446 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.790609 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.790732 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.790878 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.791018 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.791151 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.791301 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.791417 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.791591 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.792085 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.792365 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.792640 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.792912 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.818537 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.820029 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.820120 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=108009) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:07:03.820399 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.821636 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=108008) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:07:03.821919 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.825669 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=108009) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:07:03.825949 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.826374 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.827257 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=108008) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:07:03.827539 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.827938 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.833602 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=108009) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:07:03.833847 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.835198 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=108008) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:07:03.835486 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.838318 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=108009) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:07:03.839178 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.839437 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.839717 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.839989 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.840264 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.840499 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=108008) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:07:03.840611 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.840782 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.840877 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.841061 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.841343 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.841617 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.841891 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.842180 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.842452 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.859387 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.859663 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.861016 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.861296 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.864238 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=108009) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:07:03.865864 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=108008) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:07:03.867876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.868169 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.869508 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.870428 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.873758 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=108009) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:07:03.875539 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=108008) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:07:03.877390 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=108009) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:07:03.879180 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=108008) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:07:03.881006 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.881304 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.881600 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.881895 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.882203 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.882489 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.882834 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.883134 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.883418 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.883711 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.884013 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.884293 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.901463 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=108009) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:07:03.901742 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.902012 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.902296 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.903473 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=108008) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:07:03.903760 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.904029 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.904303 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.910135 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.911843 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.912118 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.912212 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.913881 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.914184 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.915307 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=108009) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:07:03.915586 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.915867 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.916146 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.916470 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.917951 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=108008) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:07:03.918251 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.918535 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.918865 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.919145 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.930228 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=108009) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:07:03.930508 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.930787 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.931072 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.931349 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.932541 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=108008) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:07:03.932833 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.932955 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.933118 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.933251 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.933401 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.933694 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.935257 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.935556 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.951880 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=108009) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:07:03.954316 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=108008) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:07:03.955161 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=108009) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:07:03.957574 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=108008) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:07:03.958470 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.960197 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.960915 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.961835 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=108009) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:07:03.962115 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.962426 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.962674 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.964429 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=108008) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:07:03.964709 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.965001 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.969838 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.971481 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=108009) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:07:03.972298 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.973901 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=108008) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:07:03.974745 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.975037 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.975430 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.975709 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.977151 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.977449 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.977842 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.978122 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.985271 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=108009) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:07:03.985560 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.985846 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.987814 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=108008) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:07:03.988102 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.988382 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.993665 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=108009) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:07:03.993944 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.994247 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.994525 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.995347 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.995903 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.996187 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.996466 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.996742 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.996921 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=108008) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:07:03.997002 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.997201 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.997282 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.997481 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.997570 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.997756 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.997836 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.998026 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.998115 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=108009) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.998436 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.998718 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.998992 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.999268 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.999549 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:03.999831 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:04.000122 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:04.000391 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:04.000663 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=108008) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:07:04.036098 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55ef3d5c39c0 pid: 108009 (default app) Jul 05 21:07:04.038402 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55ef3d5c39c0 pid: 108008 (default app) Jul 05 21:07:04.039503 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf7f6a-1f4b-40e0-bf06-10ae96bcacae None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:04.039798 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf7f6a-1f4b-40e0-bf06-10ae96bcacae None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:04.040076 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf7f6a-1f4b-40e0-bf06-10ae96bcacae None None] PATH_INFO: `/v3` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:04.044937 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 791 bytes} [Tue Jul 5 21:07:04 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:12.484738 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8e0bb-4fe2-47dc-8582-495278945b07 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:12.485302 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8e0bb-4fe2-47dc-8582-495278945b07 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:12.485302 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8e0bb-4fe2-47dc-8582-495278945b07 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:12.489789 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 1/2] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:07:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:07:12.495702 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9fdfec-4ba4-4f94-ac93-f3aa84037c2e None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:12.496141 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9fdfec-4ba4-4f94-ac93-f3aa84037c2e None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:12.496274 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9fdfec-4ba4-4f94-ac93-f3aa84037c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:12.566492 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: INFO dbcounter [None req-9b9fdfec-4ba4-4f94-ac93-f3aa84037c2e None None] Registered counter for database keystone Jul 05 21:07:12.587731 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG oslo_db.sqlalchemy.engines [None req-9b9fdfec-4ba4-4f94-ac93-f3aa84037c2e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108009) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 21:07:12.594508 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writer thread running {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 21:07:12.770279 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG passlib.handlers.bcrypt [None req-9b9fdfec-4ba4-4f94-ac93-f3aa84037c2e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=108009) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 05 21:07:12.770699 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG passlib.handlers.bcrypt [None req-9b9fdfec-4ba4-4f94-ac93-f3aa84037c2e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=108009) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 05 21:07:12.825369 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-9b9fdfec-4ba4-4f94-ac93-f3aa84037c2e None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:07:12.826973 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-9b9fdfec-4ba4-4f94-ac93-f3aa84037c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:07:12.947353 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 2/3] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:07:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 05 21:07:13.149520 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a8e0bb-4fe2-47dc-8582-495278945b07 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:13.221075 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: INFO dbcounter [None req-24a8e0bb-4fe2-47dc-8582-495278945b07 None None] Registered counter for database keystone Jul 05 21:07:13.240198 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG oslo_db.sqlalchemy.engines [None req-24a8e0bb-4fe2-47dc-8582-495278945b07 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108008) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 21:07:13.247088 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writer thread running {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 21:07:13.365519 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a8e0bb-4fe2-47dc-8582-495278945b07 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:13.370650 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00287c3-3f35-41a0-9a28-83d7bdb977e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '819d2c6b4ee2448890d6f7032696195a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:13.371314 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00287c3-3f35-41a0-9a28-83d7bdb977e7 admin admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:13.371601 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00287c3-3f35-41a0-9a28-83d7bdb977e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:13.371879 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00287c3-3f35-41a0-9a28-83d7bdb977e7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:13.379998 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00287c3-3f35-41a0-9a28-83d7bdb977e7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:13.433838 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a00287c3-3f35-41a0-9a28-83d7bdb977e7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 05 21:07:13.434158 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00287c3-3f35-41a0-9a28-83d7bdb977e7 admin admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:13.444283 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 2/4] 10.222.0.30 () {58 vars in 1324 bytes} [Tue Jul 5 21:07:13 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 21:07:13.451001 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9fdfec-4ba4-4f94-ac93-f3aa84037c2e None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:13.465694 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9fdfec-4ba4-4f94-ac93-f3aa84037c2e None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:13.470175 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30945f40-0ff9-4474-94fb-aecb1a587ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '819d2c6b4ee2448890d6f7032696195a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:13.471302 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30945f40-0ff9-4474-94fb-aecb1a587ffb admin admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:13.471595 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30945f40-0ff9-4474-94fb-aecb1a587ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:13.471879 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30945f40-0ff9-4474-94fb-aecb1a587ffb admin admin] PATH_INFO: `/v3/projects/819d2c6b4ee2448890d6f7032696195a` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:13.473379 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30945f40-0ff9-4474-94fb-aecb1a587ffb admin admin] RBAC: Authorizing `identity:get_project(project_id=819d2c6b4ee2448890d6f7032696195a)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:13.527231 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: WARNING keystone.common.rbac_enforcer.enforcer [None req-30945f40-0ff9-4474-94fb-aecb1a587ffb admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 05 21:07:13.527783 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30945f40-0ff9-4474-94fb-aecb1a587ffb admin admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:13.532163 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 3/5] 10.222.0.30 () {56 vars in 1207 bytes} [Tue Jul 5 21:07:13 2022] GET /identity/v3/projects/819d2c6b4ee2448890d6f7032696195a => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:15.513657 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89457449-afbe-4881-ba78-28115fb49bb9 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:15.514212 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89457449-afbe-4881-ba78-28115fb49bb9 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:15.514315 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89457449-afbe-4881-ba78-28115fb49bb9 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:15.518380 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 3/6] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:07:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:07:15.523809 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28d7fc-73df-495d-9915-a053d9c08f72 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:15.524193 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28d7fc-73df-495d-9915-a053d9c08f72 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:15.524386 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28d7fc-73df-495d-9915-a053d9c08f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:15.543964 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-ef28d7fc-73df-495d-9915-a053d9c08f72 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:07:15.545486 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-ef28d7fc-73df-495d-9915-a053d9c08f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:07:15.553329 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 4/7] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:07:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 05 21:07:15.575637 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89457449-afbe-4881-ba78-28115fb49bb9 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:15.587453 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89457449-afbe-4881-ba78-28115fb49bb9 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:15.592220 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6afbe65-3f01-40d5-b621-27e9e83f71a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '819d2c6b4ee2448890d6f7032696195a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:15.592862 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6afbe65-3f01-40d5-b621-27e9e83f71a3 admin admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:15.593153 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6afbe65-3f01-40d5-b621-27e9e83f71a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:15.593438 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6afbe65-3f01-40d5-b621-27e9e83f71a3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:15.601099 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6afbe65-3f01-40d5-b621-27e9e83f71a3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:15.602914 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6afbe65-3f01-40d5-b621-27e9e83f71a3 admin admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:15.612370 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 4/8] 10.222.0.30 () {58 vars in 1324 bytes} [Tue Jul 5 21:07:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 05 21:07:15.617569 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef28d7fc-73df-495d-9915-a053d9c08f72 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:15.626664 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef28d7fc-73df-495d-9915-a053d9c08f72 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:15.631058 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db24eb39-4654-4997-b81e-d590dcfcfdfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '819d2c6b4ee2448890d6f7032696195a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:15.631923 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24eb39-4654-4997-b81e-d590dcfcfdfa admin admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:15.632215 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24eb39-4654-4997-b81e-d590dcfcfdfa admin admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:15.632498 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24eb39-4654-4997-b81e-d590dcfcfdfa admin admin] PATH_INFO: `/v3/users/c3b4b48661074142b14910bc96e359ec` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:15.633892 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db24eb39-4654-4997-b81e-d590dcfcfdfa admin admin] RBAC: Authorizing `identity:get_user(user_id=c3b4b48661074142b14910bc96e359ec)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:15.635777 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db24eb39-4654-4997-b81e-d590dcfcfdfa admin admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:15.637329 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 5/9] 10.222.0.30 () {56 vars in 1198 bytes} [Tue Jul 5 21:07:15 2022] GET /identity/v3/users/c3b4b48661074142b14910bc96e359ec => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:17.714435 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9eb74-f849-4e08-bc9c-d27d95a62dbd None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:17.714985 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9eb74-f849-4e08-bc9c-d27d95a62dbd None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:17.714985 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9eb74-f849-4e08-bc9c-d27d95a62dbd None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:17.716398 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 5/10] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:07:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:07:17.721635 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0ae05-c7cb-49d2-95c7-02c7020e02b1 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:17.722058 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0ae05-c7cb-49d2-95c7-02c7020e02b1 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:17.722235 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0ae05-c7cb-49d2-95c7-02c7020e02b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:17.726868 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd31df1-6272-44d6-b3eb-f4446801d099 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:17.727374 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd31df1-6272-44d6-b3eb-f4446801d099 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:17.727487 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd31df1-6272-44d6-b3eb-f4446801d099 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:17.728707 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 6/11] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:07:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:07:17.734343 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15a4a0-11ab-4bbe-879c-6cb101424af4 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:17.734641 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15a4a0-11ab-4bbe-879c-6cb101424af4 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:17.734924 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15a4a0-11ab-4bbe-879c-6cb101424af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:17.739332 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-f9e0ae05-c7cb-49d2-95c7-02c7020e02b1 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:07:17.740531 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-f9e0ae05-c7cb-49d2-95c7-02c7020e02b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:07:17.774980 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG passlib.handlers.bcrypt [None req-8e15a4a0-11ab-4bbe-879c-6cb101424af4 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=108008) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 05 21:07:17.775481 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG passlib.handlers.bcrypt [None req-8e15a4a0-11ab-4bbe-879c-6cb101424af4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=108008) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 05 21:07:17.820520 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 6/12] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:07:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:07:17.821883 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-8e15a4a0-11ab-4bbe-879c-6cb101424af4 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:07:17.823832 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-8e15a4a0-11ab-4bbe-879c-6cb101424af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:07:17.844008 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e0ae05-c7cb-49d2-95c7-02c7020e02b1 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:17.868268 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:17.925976 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 7/13] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:07:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:07:17.946315 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e0ae05-c7cb-49d2-95c7-02c7020e02b1 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:17.947446 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15a4a0-11ab-4bbe-879c-6cb101424af4 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:17.980154 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff0cd3-47e6-40b9-af20-f6b74b152819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:17.980882 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff0cd3-47e6-40b9-af20-f6b74b152819 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:17.981170 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff0cd3-47e6-40b9-af20-f6b74b152819 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:17.981451 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff0cd3-47e6-40b9-af20-f6b74b152819 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:17.992872 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff0cd3-47e6-40b9-af20-f6b74b152819 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:07:18.004819 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-17ff0cd3-47e6-40b9-af20-f6b74b152819 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:07:18.004819 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:07:18.004819 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:07:18.004819 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:07:18.004819 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:07:18.004819 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:07:18.004819 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:07:18.004819 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:07:18.004819 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:07:18.004819 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:07:18.004819 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:07:18.004819 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:07:18.004819 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:07:18.004819 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:07:18.004819 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:07:18.004819 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:07:18.005924 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:07:18.005924 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:07:18.005924 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:07:18.005924 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:07:18.005924 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:07:18.005924 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:07:18.005924 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:07:18.005924 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:07:18.005924 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:07:18.005924 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:07:18.005924 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:07:18.005924 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:07:18.005924 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:07:18.005924 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:07:18.005924 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:07:18.005924 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:07:18.006970 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:07:18.006970 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:07:18.006970 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:07:18.006970 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:07:18.006970 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:07:18.006970 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:07:18.006970 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:07:18.006970 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:07:18.006970 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:07:18.006970 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:07:18.006970 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:07:18.006970 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:07:18.006970 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 7/14] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:07:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:07:18.011842 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff0cd3-47e6-40b9-af20-f6b74b152819 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:18.050909 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15a4a0-11ab-4bbe-879c-6cb101424af4 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:18.053198 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:18.087195 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c5988-b994-4da7-bb4f-b92988c5f4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:18.088090 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c5988-b994-4da7-bb4f-b92988c5f4cc None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:18.088928 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c5988-b994-4da7-bb4f-b92988c5f4cc None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:18.089217 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c5988-b994-4da7-bb4f-b92988c5f4cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:18.093845 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:18.112294 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff0cd3-47e6-40b9-af20-f6b74b152819 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:18.146356 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5882d-8f39-40a0-b7cc-88709c860ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:18.147034 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5882d-8f39-40a0-b7cc-88709c860ae7 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:18.147329 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5882d-8f39-40a0-b7cc-88709c860ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:18.147799 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5882d-8f39-40a0-b7cc-88709c860ae7 None admin] PATH_INFO: `/v3/roles` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:18.148566 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5882d-8f39-40a0-b7cc-88709c860ae7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:07:18.148888 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5882d-8f39-40a0-b7cc-88709c860ae7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:18.150339 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5882d-8f39-40a0-b7cc-88709c860ae7 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:18.160852 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c5988-b994-4da7-bb4f-b92988c5f4cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:18.163421 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 8/15] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:07:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:07:18.164982 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c5988-b994-4da7-bb4f-b92988c5f4cc None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:18.169547 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5882d-8f39-40a0-b7cc-88709c860ae7 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:18.266703 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 8/16] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:07:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:07:18.268738 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5882d-8f39-40a0-b7cc-88709c860ae7 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:18.272052 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c5988-b994-4da7-bb4f-b92988c5f4cc None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:18.274792 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:18.303015 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a4bf8-0ec5-4350-ab5b-6f8a94dc91af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:18.303906 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a4bf8-0ec5-4350-ab5b-6f8a94dc91af None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:18.304189 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a4bf8-0ec5-4350-ab5b-6f8a94dc91af None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:18.304469 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a4bf8-0ec5-4350-ab5b-6f8a94dc91af None admin] PATH_INFO: `/v3/users/c3b4b48661074142b14910bc96e359ec` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:18.305709 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a4bf8-0ec5-4350-ab5b-6f8a94dc91af None admin] RBAC: Authorizing `identity:get_user(user_id=c3b4b48661074142b14910bc96e359ec)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:18.307208 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a4bf8-0ec5-4350-ab5b-6f8a94dc91af None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:18.309199 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 9/17] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:07:18 2022] GET /identity/v3/users/c3b4b48661074142b14910bc96e359ec => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:07:18.314539 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a4bf8-0ec5-4350-ab5b-6f8a94dc91af None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:18.329411 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:18.369958 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c5988-b994-4da7-bb4f-b92988c5f4cc None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:18.403537 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3530dfc7-9937-42ae-bf71-18e8e81135cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:18.404343 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3530dfc7-9937-42ae-bf71-18e8e81135cb None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:18.404634 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3530dfc7-9937-42ae-bf71-18e8e81135cb None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:18.404916 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3530dfc7-9937-42ae-bf71-18e8e81135cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:18.410772 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a4bf8-0ec5-4350-ab5b-6f8a94dc91af None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:18.424272 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3530dfc7-9937-42ae-bf71-18e8e81135cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:18.425759 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3530dfc7-9937-42ae-bf71-18e8e81135cb None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:18.444886 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec43989-48e2-4e97-bbe0-29f5809c63e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:18.445690 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec43989-48e2-4e97-bbe0-29f5809c63e5 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:18.445982 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec43989-48e2-4e97-bbe0-29f5809c63e5 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:18.446298 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec43989-48e2-4e97-bbe0-29f5809c63e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:18.447495 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec43989-48e2-4e97-bbe0-29f5809c63e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:18.449458 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-3530dfc7-9937-42ae-bf71-18e8e81135cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:07:18.449458 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:07:18.449458 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:07:18.449458 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:07:18.449458 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:07:18.449458 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:07:18.449458 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:07:18.449458 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:07:18.449458 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:07:18.449458 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:07:18.449458 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:07:18.449458 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:07:18.449458 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:07:18.449458 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:07:18.449458 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:07:18.450403 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:07:18.450403 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:07:18.450403 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:07:18.450403 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:07:18.450403 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:07:18.450403 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:07:18.450403 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:07:18.450403 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:07:18.450403 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:07:18.450403 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:07:18.450403 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:07:18.450403 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:07:18.450403 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:07:18.450403 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:07:18.450403 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:07:18.450403 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:07:18.450403 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:07:18.452226 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:07:18.452226 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:07:18.452226 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:07:18.452226 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:07:18.452449 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec43989-48e2-4e97-bbe0-29f5809c63e5 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:18.452513 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 9/18] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:07:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:07:18.453079 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 10/19] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:07:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:07:18.456609 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3530dfc7-9937-42ae-bf71-18e8e81135cb None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:18.458541 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec43989-48e2-4e97-bbe0-29f5809c63e5 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:18.513607 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:18.539107 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:18.557980 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec43989-48e2-4e97-bbe0-29f5809c63e5 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:18.558167 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3530dfc7-9937-42ae-bf71-18e8e81135cb None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:18.592434 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b974e213-8496-41b8-a68d-2ff9d6692987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:18.592604 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638363e-8efe-4527-866e-adea37c06cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:18.593102 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b974e213-8496-41b8-a68d-2ff9d6692987 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:18.593196 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638363e-8efe-4527-866e-adea37c06cbb None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:18.593390 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b974e213-8496-41b8-a68d-2ff9d6692987 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:18.593478 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638363e-8efe-4527-866e-adea37c06cbb None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:18.593669 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b974e213-8496-41b8-a68d-2ff9d6692987 None admin] PATH_INFO: `/v3/domains` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:18.593756 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638363e-8efe-4527-866e-adea37c06cbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:18.594435 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b974e213-8496-41b8-a68d-2ff9d6692987 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:07:18.594576 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a638363e-8efe-4527-866e-adea37c06cbb None admin] RBAC: Adding query filter params (role.id=101b93f94624407f8c812ab86ebec32a, scope.domain.id=default, user.id=c3b4b48661074142b14910bc96e359ec) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:07:18.594748 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b974e213-8496-41b8-a68d-2ff9d6692987 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:18.594891 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a638363e-8efe-4527-866e-adea37c06cbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:18.596142 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b974e213-8496-41b8-a68d-2ff9d6692987 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:18.596328 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a638363e-8efe-4527-866e-adea37c06cbb None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:18.602975 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 11/20] 10.222.0.30 () {56 vars in 1322 bytes} [Tue Jul 5 21:07:18 2022] GET /identity/v3/role_assignments?user.id=c3b4b48661074142b14910bc96e359ec&scope.domain.id=default&role.id=101b93f94624407f8c812ab86ebec32a => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:07:18.616740 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 10/21] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:07:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:07:21.022949 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458bec40-f6f0-497b-a975-82c98891143a None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:21.023457 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458bec40-f6f0-497b-a975-82c98891143a None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:21.023530 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458bec40-f6f0-497b-a975-82c98891143a None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:21.025255 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 12/22] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:07:21.031590 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43380e20-c353-4402-9a12-32db43bc7e6c None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:21.032025 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43380e20-c353-4402-9a12-32db43bc7e6c None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:21.032204 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43380e20-c353-4402-9a12-32db43bc7e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:21.036040 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a11c3-f6d0-4c96-99fd-1b8755563a7d None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:21.036331 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a11c3-f6d0-4c96-99fd-1b8755563a7d None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:21.036613 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a11c3-f6d0-4c96-99fd-1b8755563a7d None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:21.038252 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 13/23] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:07:21.042795 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f93710-66b9-4259-baf9-a489e0c42c4c None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:21.043087 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f93710-66b9-4259-baf9-a489e0c42c4c None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:21.043367 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f93710-66b9-4259-baf9-a489e0c42c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:21.063143 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-43380e20-c353-4402-9a12-32db43bc7e6c None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:07:21.064338 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-43380e20-c353-4402-9a12-32db43bc7e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:07:21.071190 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-02f93710-66b9-4259-baf9-a489e0c42c4c None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:07:21.072376 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-02f93710-66b9-4259-baf9-a489e0c42c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:07:21.223085 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 14/24] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:07:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:07:21.225294 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 11/25] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:07:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:07:21.260220 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f93710-66b9-4259-baf9-a489e0c42c4c None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:21.265133 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43380e20-c353-4402-9a12-32db43bc7e6c None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:21.375348 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:21.412504 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:21.464122 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43380e20-c353-4402-9a12-32db43bc7e6c None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:21.484301 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f93710-66b9-4259-baf9-a489e0c42c4c None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:21.504794 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c5bfd2-c1c8-49df-ab74-d89ff95ba652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:21.505838 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5bfd2-c1c8-49df-ab74-d89ff95ba652 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:21.506325 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5bfd2-c1c8-49df-ab74-d89ff95ba652 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:21.506761 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5bfd2-c1c8-49df-ab74-d89ff95ba652 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:21.531458 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c5bfd2-c1c8-49df-ab74-d89ff95ba652 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:07:21.541747 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-02c5bfd2-c1c8-49df-ab74-d89ff95ba652 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:07:21.541747 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:07:21.541747 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:07:21.541747 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:07:21.541747 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:07:21.541747 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:07:21.541747 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:07:21.541747 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:07:21.541747 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:07:21.541747 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:07:21.541747 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:07:21.541747 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:07:21.541747 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:07:21.541747 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:07:21.541747 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:07:21.541747 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:07:21.542789 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:07:21.542789 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:07:21.542789 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:07:21.542789 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:07:21.542789 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:07:21.542789 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:07:21.542789 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:07:21.542789 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:07:21.542789 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:07:21.542789 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:07:21.542789 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:07:21.542789 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:07:21.542789 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:07:21.542789 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:07:21.542789 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:07:21.542789 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:07:21.543733 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:07:21.543733 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:07:21.543733 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:07:21.543733 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:07:21.543733 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:07:21.543733 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:07:21.543733 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:07:21.543733 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:07:21.543733 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:07:21.543733 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:07:21.543733 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:07:21.543733 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:07:21.553192 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc1f3c-a345-40de-b9cd-c4f8f932c6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:21.554068 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc1f3c-a345-40de-b9cd-c4f8f932c6ce None admin] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:21.554975 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc1f3c-a345-40de-b9cd-c4f8f932c6ce None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:21.555400 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc1f3c-a345-40de-b9cd-c4f8f932c6ce None admin] PATH_INFO: `/v3/roles` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:21.556303 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dc1f3c-a345-40de-b9cd-c4f8f932c6ce None admin] RBAC: Authorizing `identity:create_role()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:21.558470 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dc1f3c-a345-40de-b9cd-c4f8f932c6ce None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:21.558900 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 12/26] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:07:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:07:21.560736 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58484310-a322-496b-8db1-c7b4ed2a04e8 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:21.563822 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58484310-a322-496b-8db1-c7b4ed2a04e8 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:21.564254 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58484310-a322-496b-8db1-c7b4ed2a04e8 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:21.565708 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 13/27] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:07:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:07:21.566585 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58484310-a322-496b-8db1-c7b4ed2a04e8 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:21.697169 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58484310-a322-496b-8db1-c7b4ed2a04e8 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:21.705269 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:21.733465 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a926d4-1b88-49ad-b359-5718ecf655a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:21.734390 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a926d4-1b88-49ad-b359-5718ecf655a6 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:21.734860 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a926d4-1b88-49ad-b359-5718ecf655a6 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:21.735294 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a926d4-1b88-49ad-b359-5718ecf655a6 None admin] PATH_INFO: `/v3/roles` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:21.736193 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a926d4-1b88-49ad-b359-5718ecf655a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:07:21.736644 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a926d4-1b88-49ad-b359-5718ecf655a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:21.738207 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a926d4-1b88-49ad-b359-5718ecf655a6 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:21.751623 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 14/28] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:07:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:21.753170 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d5b4d-c300-43fe-999f-89a367ea40b7 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:21.753602 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d5b4d-c300-43fe-999f-89a367ea40b7 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:21.754041 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d5b4d-c300-43fe-999f-89a367ea40b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:21.772489 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-b96d5b4d-c300-43fe-999f-89a367ea40b7 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:07:21.773915 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-b96d5b4d-c300-43fe-999f-89a367ea40b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:07:21.788235 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 15/29] 10.222.0.30 () {60 vars in 1131 bytes} [Tue Jul 5 21:07:21 2022] POST /identity/v3/roles => generated 219 bytes in 529 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:07:21.794742 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e95f44-cb7a-4eab-b191-f933bee8a29f None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:21.794742 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e95f44-cb7a-4eab-b191-f933bee8a29f None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:21.794742 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e95f44-cb7a-4eab-b191-f933bee8a29f None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:21.796008 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 16/30] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:07:21.796970 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e95f44-cb7a-4eab-b191-f933bee8a29f None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:21.911724 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 15/31] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:07:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:07:21.913767 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929e404-d6e3-4d66-911f-17c4cd36168c None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:21.914061 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929e404-d6e3-4d66-911f-17c4cd36168c None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:21.914368 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929e404-d6e3-4d66-911f-17c4cd36168c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:21.951299 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-9929e404-d6e3-4d66-911f-17c4cd36168c None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:07:21.952537 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-9929e404-d6e3-4d66-911f-17c4cd36168c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:07:21.967570 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e95f44-cb7a-4eab-b191-f933bee8a29f None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:22.028673 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ae923-14d2-4703-a56f-f367a9c6480c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:22.031017 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ae923-14d2-4703-a56f-f367a9c6480c None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:22.031565 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ae923-14d2-4703-a56f-f367a9c6480c None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:22.032175 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ae923-14d2-4703-a56f-f367a9c6480c None admin] PATH_INFO: `/v3/users/c3b4b48661074142b14910bc96e359ec` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:22.034867 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ae923-14d2-4703-a56f-f367a9c6480c None admin] RBAC: Authorizing `identity:get_user(user_id=c3b4b48661074142b14910bc96e359ec)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:22.037625 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ae923-14d2-4703-a56f-f367a9c6480c None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:22.040242 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 17/32] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:07:21 2022] GET /identity/v3/users/c3b4b48661074142b14910bc96e359ec => generated 247 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:22.041373 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ae923-14d2-4703-a56f-f367a9c6480c None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:22.044416 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 16/33] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:07:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:07:22.045504 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:22.051137 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9929e404-d6e3-4d66-911f-17c4cd36168c None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:22.098824 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:22.177353 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ae923-14d2-4703-a56f-f367a9c6480c None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:22.184976 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9929e404-d6e3-4d66-911f-17c4cd36168c None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:22.218951 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae655be2-0b72-47c0-b2a0-36c3fbfbd6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:22.219642 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae655be2-0b72-47c0-b2a0-36c3fbfbd6f9 None admin] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:22.219935 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae655be2-0b72-47c0-b2a0-36c3fbfbd6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:22.220225 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae655be2-0b72-47c0-b2a0-36c3fbfbd6f9 None admin] PATH_INFO: `/v3/roles` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:22.220989 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae655be2-0b72-47c0-b2a0-36c3fbfbd6f9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:22.222431 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae655be2-0b72-47c0-b2a0-36c3fbfbd6f9 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:22.224110 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762e151-5848-44ee-8d29-4686fd53bc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:22.225370 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762e151-5848-44ee-8d29-4686fd53bc59 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:22.225964 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762e151-5848-44ee-8d29-4686fd53bc59 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:22.226496 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762e151-5848-44ee-8d29-4686fd53bc59 None admin] PATH_INFO: `/v3/domains/default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:22.228282 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762e151-5848-44ee-8d29-4686fd53bc59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:22.230562 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762e151-5848-44ee-8d29-4686fd53bc59 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:22.232773 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 17/34] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:07:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:22.233744 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762e151-5848-44ee-8d29-4686fd53bc59 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:22.297920 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 18/35] 10.222.0.30 () {60 vars in 1131 bytes} [Tue Jul 5 21:07:22 2022] POST /identity/v3/roles => generated 225 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:07:22.298610 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae655be2-0b72-47c0-b2a0-36c3fbfbd6f9 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:22.365125 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:22.372920 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762e151-5848-44ee-8d29-4686fd53bc59 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:22.417076 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59566e16-f232-4357-bc74-8d3c137a30a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:22.418255 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59566e16-f232-4357-bc74-8d3c137a30a3 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:22.418591 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59566e16-f232-4357-bc74-8d3c137a30a3 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:22.418915 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59566e16-f232-4357-bc74-8d3c137a30a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:22.433332 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59566e16-f232-4357-bc74-8d3c137a30a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:22.435469 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59566e16-f232-4357-bc74-8d3c137a30a3 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:22.457105 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:22.463108 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-59566e16-f232-4357-bc74-8d3c137a30a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:07:22.463108 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:07:22.463108 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:07:22.463108 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:07:22.463108 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:07:22.463108 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:07:22.463108 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:07:22.463108 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:07:22.463108 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:07:22.463108 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:07:22.463108 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:07:22.463108 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:07:22.463108 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:07:22.463108 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:07:22.463108 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:07:22.464722 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:07:22.464722 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:07:22.464722 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:07:22.464722 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:07:22.464722 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:07:22.464722 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:07:22.464722 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:07:22.464722 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:07:22.464722 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:07:22.464722 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:07:22.464722 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:07:22.464722 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:07:22.464722 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:07:22.464722 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:07:22.464722 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:07:22.464722 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:07:22.464722 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:07:22.465554 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:07:22.465554 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:07:22.465554 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:07:22.465554 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:07:22.465554 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 18/36] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:07:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:07:22.467716 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf3b33-10ef-489f-b263-681e0d5d37bf None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:22.468046 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf3b33-10ef-489f-b263-681e0d5d37bf None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:22.468305 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf3b33-10ef-489f-b263-681e0d5d37bf None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:22.474175 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 19/37] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:07:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:07:22.474175 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55daf8f6-a57e-49d3-aaa1-55330e7be5dd None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:22.474175 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55daf8f6-a57e-49d3-aaa1-55330e7be5dd None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:22.474175 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55daf8f6-a57e-49d3-aaa1-55330e7be5dd None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:22.474175 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 20/38] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:07:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:07:22.478219 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55daf8f6-a57e-49d3-aaa1-55330e7be5dd None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:22.516065 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae655be2-0b72-47c0-b2a0-36c3fbfbd6f9 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:22.556927 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157f2ae-d89c-4830-a86a-2f50e4ef0750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:22.558027 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157f2ae-d89c-4830-a86a-2f50e4ef0750 None admin] REQUEST_METHOD: `PUT` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:22.558846 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157f2ae-d89c-4830-a86a-2f50e4ef0750 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:22.559137 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157f2ae-d89c-4830-a86a-2f50e4ef0750 None admin] PATH_INFO: `/v3/domains/default/users/c3b4b48661074142b14910bc96e359ec/roles/101b93f94624407f8c812ab86ebec32a` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:22.561321 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157f2ae-d89c-4830-a86a-2f50e4ef0750 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=c3b4b48661074142b14910bc96e359ec, role_id=101b93f94624407f8c812ab86ebec32a)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:22.563096 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157f2ae-d89c-4830-a86a-2f50e4ef0750 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:22.593356 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55daf8f6-a57e-49d3-aaa1-55330e7be5dd None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:22.626035 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63790d5-b8a5-4fba-bc79-061659a6c9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:22.626750 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63790d5-b8a5-4fba-bc79-061659a6c9d8 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:22.627036 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63790d5-b8a5-4fba-bc79-061659a6c9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:22.627426 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63790d5-b8a5-4fba-bc79-061659a6c9d8 None admin] PATH_INFO: `/v3/domains` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:22.628153 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63790d5-b8a5-4fba-bc79-061659a6c9d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:07:22.628465 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63790d5-b8a5-4fba-bc79-061659a6c9d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:22.629856 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63790d5-b8a5-4fba-bc79-061659a6c9d8 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:22.640079 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 19/39] 10.222.0.30 () {58 vars in 1361 bytes} [Tue Jul 5 21:07:22 2022] PUT /identity/v3/domains/default/users/c3b4b48661074142b14910bc96e359ec/roles/101b93f94624407f8c812ab86ebec32a => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:07:22.641458 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11244830-86ad-4b51-8882-dad55127c258 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:22.641790 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11244830-86ad-4b51-8882-dad55127c258 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:22.642082 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11244830-86ad-4b51-8882-dad55127c258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:22.649608 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 21/40] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:07:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:22.649608 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea272a-f24d-4dc4-99bb-4cc459575382 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:22.649608 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea272a-f24d-4dc4-99bb-4cc459575382 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:22.649608 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea272a-f24d-4dc4-99bb-4cc459575382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:22.668781 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-24ea272a-f24d-4dc4-99bb-4cc459575382 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:07:22.669567 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-11244830-86ad-4b51-8882-dad55127c258 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:07:22.670023 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-24ea272a-f24d-4dc4-99bb-4cc459575382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:07:22.671271 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-11244830-86ad-4b51-8882-dad55127c258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:07:22.672592 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:22.746166 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 22/41] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:07:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:07:22.747017 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea272a-f24d-4dc4-99bb-4cc459575382 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:22.773820 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 20/42] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:07:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:07:22.774752 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11244830-86ad-4b51-8882-dad55127c258 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:22.873306 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea272a-f24d-4dc4-99bb-4cc459575382 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:22.911131 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eefb36f-cb01-48b3-8c68-8c4e609c279d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:22.911833 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eefb36f-cb01-48b3-8c68-8c4e609c279d None admin] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:22.912125 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eefb36f-cb01-48b3-8c68-8c4e609c279d None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:22.912404 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eefb36f-cb01-48b3-8c68-8c4e609c279d None admin] PATH_INFO: `/v3/projects` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:22.913132 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eefb36f-cb01-48b3-8c68-8c4e609c279d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:22.914633 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eefb36f-cb01-48b3-8c68-8c4e609c279d None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:22.925804 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:22.945942 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:22.992671 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11244830-86ad-4b51-8882-dad55127c258 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:23.026782 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2885a-cee3-42ec-8576-c1661bc5c1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:23.027514 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2885a-cee3-42ec-8576-c1661bc5c1e6 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:23.027808 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2885a-cee3-42ec-8576-c1661bc5c1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:23.028090 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2885a-cee3-42ec-8576-c1661bc5c1e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:23.029283 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2885a-cee3-42ec-8576-c1661bc5c1e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:23.030799 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2885a-cee3-42ec-8576-c1661bc5c1e6 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:23.032441 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 21/43] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:07:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:23.034365 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2885a-cee3-42ec-8576-c1661bc5c1e6 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:23.138975 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2885a-cee3-42ec-8576-c1661bc5c1e6 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:23.155300 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 23/44] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Jul 5 21:07:22 2022] POST /identity/v3/projects => generated 301 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:07:23.160837 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:23.163645 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eefb36f-cb01-48b3-8c68-8c4e609c279d None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:23.188686 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78328d3-fff4-4f83-9913-4480416704cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:23.189380 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78328d3-fff4-4f83-9913-4480416704cd None admin] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:23.189674 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78328d3-fff4-4f83-9913-4480416704cd None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:23.189965 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78328d3-fff4-4f83-9913-4480416704cd None admin] PATH_INFO: `/v3/roles` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:23.191322 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78328d3-fff4-4f83-9913-4480416704cd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:23.192802 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78328d3-fff4-4f83-9913-4480416704cd None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:23.264058 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 22/45] 10.222.0.30 () {60 vars in 1131 bytes} [Tue Jul 5 21:07:23 2022] POST /identity/v3/roles => generated 223 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:07:23.294198 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eefb36f-cb01-48b3-8c68-8c4e609c279d None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:23.337422 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f230f191-f4cd-4c9c-8521-3ffeb63fabfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:23.338153 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230f191-f4cd-4c9c-8521-3ffeb63fabfb None admin] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:23.338454 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230f191-f4cd-4c9c-8521-3ffeb63fabfb None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:23.338736 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230f191-f4cd-4c9c-8521-3ffeb63fabfb None admin] PATH_INFO: `/v3/projects` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:23.339469 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f230f191-f4cd-4c9c-8521-3ffeb63fabfb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:23.341180 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f230f191-f4cd-4c9c-8521-3ffeb63fabfb None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:23.431067 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 24/46] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Jul 5 21:07:23 2022] POST /identity/v3/projects => generated 312 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:07:24.705465 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ab5a8-1130-4373-ac47-ebf33e6b4e26 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:24.706007 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ab5a8-1130-4373-ac47-ebf33e6b4e26 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:24.706100 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ab5a8-1130-4373-ac47-ebf33e6b4e26 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:24.707436 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 23/47] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:07:24.712889 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68983b1c-713c-45c3-8e18-d08a8b40bad6 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:24.713305 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68983b1c-713c-45c3-8e18-d08a8b40bad6 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:24.714167 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68983b1c-713c-45c3-8e18-d08a8b40bad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:24.731706 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-68983b1c-713c-45c3-8e18-d08a8b40bad6 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:07:24.733227 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-68983b1c-713c-45c3-8e18-d08a8b40bad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:07:24.766975 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:24.909738 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 25/48] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:07:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:07:24.933022 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ab5a8-1130-4373-ac47-ebf33e6b4e26 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:25.039371 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ab5a8-1130-4373-ac47-ebf33e6b4e26 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:25.073462 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2fba92-cfb0-401e-8c59-7bb2b3cbd262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:25.074306 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2fba92-cfb0-401e-8c59-7bb2b3cbd262 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:25.074599 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2fba92-cfb0-401e-8c59-7bb2b3cbd262 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:25.074882 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2fba92-cfb0-401e-8c59-7bb2b3cbd262 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:25.085173 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2fba92-cfb0-401e-8c59-7bb2b3cbd262 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:07:25.093609 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-ea2fba92-cfb0-401e-8c59-7bb2b3cbd262 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:07:25.093609 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:07:25.093609 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:07:25.093609 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:07:25.093609 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:07:25.093609 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:07:25.093609 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:07:25.093609 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:07:25.093609 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:07:25.093609 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:07:25.093609 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:07:25.093609 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:07:25.093609 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:07:25.093609 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:07:25.093609 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:07:25.093609 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:07:25.094679 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:07:25.094679 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:07:25.094679 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:07:25.094679 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:07:25.094679 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:07:25.094679 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:07:25.094679 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:07:25.094679 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:07:25.094679 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:07:25.094679 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:07:25.094679 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:07:25.094679 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:07:25.094679 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:07:25.094679 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:07:25.094679 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:07:25.094679 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:07:25.095622 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:07:25.095622 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:07:25.095622 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:07:25.095622 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:07:25.095622 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:07:25.095622 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:07:25.095622 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:07:25.095622 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:07:25.095622 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:07:25.095622 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:07:25.095622 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:07:25.095622 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:07:25.095622 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 24/49] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:07:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:07:25.102567 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68983b1c-713c-45c3-8e18-d08a8b40bad6 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:25.201953 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68983b1c-713c-45c3-8e18-d08a8b40bad6 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:25.234973 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d297f-6a7e-495c-83fc-a63c6d4c0668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:25.235655 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d297f-6a7e-495c-83fc-a63c6d4c0668 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:25.235946 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d297f-6a7e-495c-83fc-a63c6d4c0668 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:25.236231 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d297f-6a7e-495c-83fc-a63c6d4c0668 None admin] PATH_INFO: `/v3/roles` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:25.236981 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078d297f-6a7e-495c-83fc-a63c6d4c0668 None admin] RBAC: Adding query filter params (name=admin) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:07:25.237297 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078d297f-6a7e-495c-83fc-a63c6d4c0668 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:25.238736 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078d297f-6a7e-495c-83fc-a63c6d4c0668 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:25.247308 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 26/50] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:07:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:25.252904 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2fba92-cfb0-401e-8c59-7bb2b3cbd262 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:25.296943 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:25.356909 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2fba92-cfb0-401e-8c59-7bb2b3cbd262 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:25.391366 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40809432-4e96-475f-8d90-35bf200f670c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:25.392251 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40809432-4e96-475f-8d90-35bf200f670c None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:25.392545 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40809432-4e96-475f-8d90-35bf200f670c None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:25.392832 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40809432-4e96-475f-8d90-35bf200f670c None admin] PATH_INFO: `/v3/users/c3b4b48661074142b14910bc96e359ec` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:25.394073 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40809432-4e96-475f-8d90-35bf200f670c None admin] RBAC: Authorizing `identity:get_user(user_id=c3b4b48661074142b14910bc96e359ec)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:25.395565 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40809432-4e96-475f-8d90-35bf200f670c None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:25.397214 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 25/51] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:07:25 2022] GET /identity/v3/users/c3b4b48661074142b14910bc96e359ec => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:25.402677 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d297f-6a7e-495c-83fc-a63c6d4c0668 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:25.437370 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:25.458632 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009dfe8b-3b4e-4f1c-8658-de25fdc0eda3 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:25.458932 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009dfe8b-3b4e-4f1c-8658-de25fdc0eda3 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:25.459225 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009dfe8b-3b4e-4f1c-8658-de25fdc0eda3 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:25.460596 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 26/52] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:07:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:07:25.465504 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76714e4b-8656-48a7-bde6-0d238b287e64 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:25.465806 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76714e4b-8656-48a7-bde6-0d238b287e64 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:25.466091 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76714e4b-8656-48a7-bde6-0d238b287e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:25.483218 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-76714e4b-8656-48a7-bde6-0d238b287e64 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:07:25.484430 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-76714e4b-8656-48a7-bde6-0d238b287e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:07:25.504015 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d297f-6a7e-495c-83fc-a63c6d4c0668 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:25.538428 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06733ba-5d89-4f70-b272-a49ffaad52ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:25.539231 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06733ba-5d89-4f70-b272-a49ffaad52ae None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:25.539521 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06733ba-5d89-4f70-b272-a49ffaad52ae None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:25.539801 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06733ba-5d89-4f70-b272-a49ffaad52ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:25.540997 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06733ba-5d89-4f70-b272-a49ffaad52ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:25.542538 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06733ba-5d89-4f70-b272-a49ffaad52ae None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:25.544154 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 27/53] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:07:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:25.549857 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06733ba-5d89-4f70-b272-a49ffaad52ae None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:25.551351 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 27/54] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:07:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:07:25.575266 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76714e4b-8656-48a7-bde6-0d238b287e64 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:25.613123 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:25.649041 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06733ba-5d89-4f70-b272-a49ffaad52ae None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:25.650608 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:25.673076 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76714e4b-8656-48a7-bde6-0d238b287e64 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:25.683719 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88bd6d3-e701-405e-8023-bdbd145d6396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:25.684386 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88bd6d3-e701-405e-8023-bdbd145d6396 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:25.684673 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88bd6d3-e701-405e-8023-bdbd145d6396 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:25.684957 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88bd6d3-e701-405e-8023-bdbd145d6396 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:25.685791 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88bd6d3-e701-405e-8023-bdbd145d6396 None admin] RBAC: Adding query filter params (role.id=101b93f94624407f8c812ab86ebec32a, scope.domain.id=default, user.id=c3b4b48661074142b14910bc96e359ec) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:07:25.686106 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88bd6d3-e701-405e-8023-bdbd145d6396 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:25.687874 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88bd6d3-e701-405e-8023-bdbd145d6396 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:25.696461 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 28/55] 10.222.0.30 () {56 vars in 1322 bytes} [Tue Jul 5 21:07:25 2022] GET /identity/v3/role_assignments?user.id=c3b4b48661074142b14910bc96e359ec&scope.domain.id=default&role.id=101b93f94624407f8c812ab86ebec32a => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:07:25.707382 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5046edc-2077-4462-83cc-d36983d40894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:25.708221 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5046edc-2077-4462-83cc-d36983d40894 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:25.708518 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5046edc-2077-4462-83cc-d36983d40894 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:25.708806 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5046edc-2077-4462-83cc-d36983d40894 None admin] PATH_INFO: `/v3/domains/default` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:25.710098 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5046edc-2077-4462-83cc-d36983d40894 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:25.711633 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5046edc-2077-4462-83cc-d36983d40894 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:25.713464 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 28/56] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:07:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:07:25.719313 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88bd6d3-e701-405e-8023-bdbd145d6396 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:25.827758 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88bd6d3-e701-405e-8023-bdbd145d6396 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:25.863082 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f12b6e-8bba-4a0c-8bd4-b7ed2b331a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:25.863758 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f12b6e-8bba-4a0c-8bd4-b7ed2b331a23 None admin] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:25.864051 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f12b6e-8bba-4a0c-8bd4-b7ed2b331a23 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:25.864339 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f12b6e-8bba-4a0c-8bd4-b7ed2b331a23 None admin] PATH_INFO: `/v3/projects` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:25.865068 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f12b6e-8bba-4a0c-8bd4-b7ed2b331a23 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:25.866616 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f12b6e-8bba-4a0c-8bd4-b7ed2b331a23 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:25.949622 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 29/57] 10.222.0.30 () {60 vars in 1140 bytes} [Tue Jul 5 21:07:25 2022] POST /identity/v3/projects => generated 298 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:07:27.962857 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52061018-4419-4d44-b8df-656641c0a47b None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:27.963415 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52061018-4419-4d44-b8df-656641c0a47b None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:27.963501 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52061018-4419-4d44-b8df-656641c0a47b None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:27.965325 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 29/58] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:07:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:07:27.970529 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668bc3a-b252-44c9-b556-8880f01b6ec7 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:27.970952 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668bc3a-b252-44c9-b556-8880f01b6ec7 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:27.971118 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668bc3a-b252-44c9-b556-8880f01b6ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:27.988673 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-c668bc3a-b252-44c9-b556-8880f01b6ec7 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:07:27.989886 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-c668bc3a-b252-44c9-b556-8880f01b6ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:07:28.002878 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:28.061231 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 30/59] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:07:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:07:28.085958 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52061018-4419-4d44-b8df-656641c0a47b None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:28.185617 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52061018-4419-4d44-b8df-656641c0a47b None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:28.193054 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:28.219488 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbcef8c-e2f5-44a1-ab04-441615cb6417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:28.220306 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcef8c-e2f5-44a1-ab04-441615cb6417 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:28.220629 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcef8c-e2f5-44a1-ab04-441615cb6417 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:28.220914 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcef8c-e2f5-44a1-ab04-441615cb6417 None admin] PATH_INFO: `/v3/domains/default` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:28.222114 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbcef8c-e2f5-44a1-ab04-441615cb6417 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:28.223616 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbcef8c-e2f5-44a1-ab04-441615cb6417 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:28.225221 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 30/60] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:07:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:28.231046 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668bc3a-b252-44c9-b556-8880f01b6ec7 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:28.328992 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668bc3a-b252-44c9-b556-8880f01b6ec7 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:28.361907 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e80f0-4375-4fb2-b977-cfa9f2284845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:28.362619 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e80f0-4375-4fb2-b977-cfa9f2284845 None admin] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:28.362911 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e80f0-4375-4fb2-b977-cfa9f2284845 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:28.363194 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e80f0-4375-4fb2-b977-cfa9f2284845 None admin] PATH_INFO: `/v3/users` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:28.363956 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289e80f0-4375-4fb2-b977-cfa9f2284845 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:28.365508 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289e80f0-4375-4fb2-b977-cfa9f2284845 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:28.462294 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 31/61] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:07:28 2022] POST /identity/v3/users => generated 275 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:07:31.637866 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d4ee0-53cc-441e-8f43-17cb226792d9 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:31.638897 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d4ee0-53cc-441e-8f43-17cb226792d9 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:31.639416 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d4ee0-53cc-441e-8f43-17cb226792d9 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:31.641033 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 31/62] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:07:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:07:31.646343 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae1c80-4896-4c68-bf8c-8e097fd2abae None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:31.647184 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae1c80-4896-4c68-bf8c-8e097fd2abae None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:31.647672 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae1c80-4896-4c68-bf8c-8e097fd2abae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:31.656913 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:31.671190 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-37ae1c80-4896-4c68-bf8c-8e097fd2abae None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:07:31.672408 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-37ae1c80-4896-4c68-bf8c-8e097fd2abae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:07:31.752682 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 32/63] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:07:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:07:31.775900 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4efda-83e1-4953-b66e-9f5e3a1ab273 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:31.776514 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4efda-83e1-4953-b66e-9f5e3a1ab273 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:31.777022 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4efda-83e1-4953-b66e-9f5e3a1ab273 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:31.778647 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 32/64] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:07:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:07:31.784134 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d88faf-9b7f-458c-ab14-b3d5ab2d75e4 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:31.784441 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d88faf-9b7f-458c-ab14-b3d5ab2d75e4 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:31.784732 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d88faf-9b7f-458c-ab14-b3d5ab2d75e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:31.788402 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4efda-83e1-4953-b66e-9f5e3a1ab273 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:31.811367 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-67d88faf-9b7f-458c-ab14-b3d5ab2d75e4 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:07:31.813824 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-67d88faf-9b7f-458c-ab14-b3d5ab2d75e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:07:31.908180 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 33/65] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:07:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:07:31.910120 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbecb978-dc05-4b43-8b8a-bec5dc4cf1c2 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:31.910704 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbecb978-dc05-4b43-8b8a-bec5dc4cf1c2 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:31.911210 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbecb978-dc05-4b43-8b8a-bec5dc4cf1c2 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:31.912666 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 34/66] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:07:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:07:31.919334 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f62620-45f4-4dd3-961d-8dc7178cce5e None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:31.919634 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f62620-45f4-4dd3-961d-8dc7178cce5e None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:31.919923 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f62620-45f4-4dd3-961d-8dc7178cce5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:31.942389 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4efda-83e1-4953-b66e-9f5e3a1ab273 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:31.948997 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-f8f62620-45f4-4dd3-961d-8dc7178cce5e None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:07:31.950591 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-f8f62620-45f4-4dd3-961d-8dc7178cce5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:07:31.984691 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479580ff-546f-40f3-b574-19b64ba2cd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:31.985529 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479580ff-546f-40f3-b574-19b64ba2cd29 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:31.985824 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479580ff-546f-40f3-b574-19b64ba2cd29 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:31.986108 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479580ff-546f-40f3-b574-19b64ba2cd29 None admin] PATH_INFO: `/v3/roles/member` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:31.998833 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479580ff-546f-40f3-b574-19b64ba2cd29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:07:32.007496 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-479580ff-546f-40f3-b574-19b64ba2cd29 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:07:32.007496 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:07:32.007496 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:07:32.007496 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:07:32.007496 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:07:32.007496 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:07:32.007496 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:07:32.007496 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:07:32.007496 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:07:32.007496 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:07:32.007496 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:07:32.007496 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:07:32.007496 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:07:32.007496 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:07:32.007496 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:07:32.007496 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:07:32.008358 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:07:32.008358 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:07:32.008358 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:07:32.008358 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:07:32.008358 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:07:32.008358 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:07:32.008358 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:07:32.008358 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:07:32.008358 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:07:32.008358 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:07:32.008358 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:07:32.008358 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:07:32.008358 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:07:32.008358 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:07:32.008358 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:07:32.008358 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:07:32.009140 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:07:32.009140 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:07:32.009140 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:07:32.009140 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:07:32.009140 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:07:32.009140 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:07:32.009140 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:07:32.009140 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:07:32.009140 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:07:32.009140 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:07:32.009140 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:07:32.009140 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:07:32.012655 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 33/67] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:07:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:07:32.013681 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479580ff-546f-40f3-b574-19b64ba2cd29 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:32.025368 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:32.034825 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 35/68] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:07:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:07:32.040386 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f62620-45f4-4dd3-961d-8dc7178cce5e None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:32.078578 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:32.149523 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f62620-45f4-4dd3-961d-8dc7178cce5e None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:32.157021 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479580ff-546f-40f3-b574-19b64ba2cd29 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:32.188181 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff67db-94c2-4540-8821-8c258177ed8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:32.189180 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff67db-94c2-4540-8821-8c258177ed8e None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:32.189734 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff67db-94c2-4540-8821-8c258177ed8e None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:32.190101 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff67db-94c2-4540-8821-8c258177ed8e None admin] PATH_INFO: `/v3/roles` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:32.190897 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff67db-94c2-4540-8821-8c258177ed8e None admin] RBAC: Adding query filter params (name=member) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:07:32.191223 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff67db-94c2-4540-8821-8c258177ed8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:32.192640 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff67db-94c2-4540-8821-8c258177ed8e None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:32.193439 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a49b7-44ab-4754-ad83-3d81390e877d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:32.194280 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a49b7-44ab-4754-ad83-3d81390e877d None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:32.194577 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a49b7-44ab-4754-ad83-3d81390e877d None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:32.194862 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a49b7-44ab-4754-ad83-3d81390e877d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:32.202527 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 36/69] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:07:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:32.203581 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff67db-94c2-4540-8821-8c258177ed8e None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:32.211169 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a49b7-44ab-4754-ad83-3d81390e877d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:07:32.221031 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-049a49b7-44ab-4754-ad83-3d81390e877d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:07:32.221031 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:07:32.221031 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:07:32.221031 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:07:32.221031 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:07:32.221031 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:07:32.221031 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:07:32.221031 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:07:32.221031 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:07:32.221031 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:07:32.221031 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:07:32.221031 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:07:32.221031 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:07:32.221031 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:07:32.221031 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:07:32.221031 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:07:32.222108 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:07:32.222108 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:07:32.222108 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:07:32.222108 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:07:32.222108 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:07:32.222108 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:07:32.222108 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:07:32.222108 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:07:32.222108 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:07:32.222108 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:07:32.222108 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:07:32.222108 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:07:32.222108 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:07:32.222108 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:07:32.222108 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:07:32.222108 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:07:32.222929 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:07:32.222929 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:07:32.222929 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:07:32.222929 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:07:32.222929 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:07:32.222929 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:07:32.222929 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:07:32.222929 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:07:32.222929 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:07:32.222929 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:07:32.222929 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:07:32.222929 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:07:32.222929 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 34/70] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:07:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:07:32.223560 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65d1ef-a4ae-4462-ad9e-4ea27fb1ff4e None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:32.223622 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65d1ef-a4ae-4462-ad9e-4ea27fb1ff4e None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:32.224121 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65d1ef-a4ae-4462-ad9e-4ea27fb1ff4e None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:32.225351 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 35/71] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:07:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:07:32.229752 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65d1ef-a4ae-4462-ad9e-4ea27fb1ff4e None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:32.274030 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:32.325429 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff67db-94c2-4540-8821-8c258177ed8e None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:32.327713 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:32.335149 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65d1ef-a4ae-4462-ad9e-4ea27fb1ff4e None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:32.358656 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f5a3ed-8f67-43a9-a78d-1523393d8695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:32.359482 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5a3ed-8f67-43a9-a78d-1523393d8695 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:32.359778 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5a3ed-8f67-43a9-a78d-1523393d8695 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:32.361902 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5a3ed-8f67-43a9-a78d-1523393d8695 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:32.367796 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8e0a5-0ea1-436c-a53d-a0691cfaf00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:32.368673 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8e0a5-0ea1-436c-a53d-a0691cfaf00c None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:32.369010 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8e0a5-0ea1-436c-a53d-a0691cfaf00c None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:32.369340 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8e0a5-0ea1-436c-a53d-a0691cfaf00c None admin] PATH_INFO: `/v3/users/f904c02f9f084df4917f5d2d38174f29` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:32.370817 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f5a3ed-8f67-43a9-a78d-1523393d8695 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:07:32.379085 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-36f5a3ed-8f67-43a9-a78d-1523393d8695 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:07:32.379085 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:07:32.379085 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:07:32.379085 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:07:32.379085 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:07:32.379085 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:07:32.379085 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:07:32.379085 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:07:32.379085 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:07:32.379085 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:07:32.379085 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:07:32.379085 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:07:32.379085 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:07:32.379085 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:07:32.379085 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:07:32.379085 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:07:32.380171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:07:32.380171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:07:32.380171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:07:32.380171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:07:32.380171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:07:32.380171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:07:32.380171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:07:32.380171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:07:32.380171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:07:32.380171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:07:32.380171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:07:32.380171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:07:32.380171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:07:32.380171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:07:32.380171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:07:32.380171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:07:32.380963 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:07:32.380963 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:07:32.380963 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:07:32.380963 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:07:32.380963 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:07:32.380963 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:07:32.380963 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:07:32.380963 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:07:32.380963 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:07:32.380963 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:07:32.380963 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:07:32.380963 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:07:32.380963 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 37/72] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:07:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:07:32.381606 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f5a3ed-8f67-43a9-a78d-1523393d8695 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:32.387687 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd8e0a5-0ea1-436c-a53d-a0691cfaf00c None admin] RBAC: Authorizing `identity:get_user(user_id=f904c02f9f084df4917f5d2d38174f29)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:32.389181 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd8e0a5-0ea1-436c-a53d-a0691cfaf00c None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:32.390999 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 36/73] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:07:32 2022] GET /identity/v3/users/f904c02f9f084df4917f5d2d38174f29 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:32.392396 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c86ad-287c-46fe-8cfc-f6d25e1b6289 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:32.392696 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c86ad-287c-46fe-8cfc-f6d25e1b6289 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:32.392984 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c86ad-287c-46fe-8cfc-f6d25e1b6289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:32.408794 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-057c86ad-287c-46fe-8cfc-f6d25e1b6289 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:07:32.409999 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-057c86ad-287c-46fe-8cfc-f6d25e1b6289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:07:32.476668 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 37/74] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:07:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:07:32.477973 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8315d-b8b4-495f-8bf5-b1ddf158cc5a None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:32.478307 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8315d-b8b4-495f-8bf5-b1ddf158cc5a None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:32.478590 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8315d-b8b4-495f-8bf5-b1ddf158cc5a None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:32.482162 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 38/75] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:07:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:07:32.482162 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8315d-b8b4-495f-8bf5-b1ddf158cc5a None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:32.482358 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f5a3ed-8f67-43a9-a78d-1523393d8695 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:32.499282 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:32.517498 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a126b3-bfa3-4184-9304-5b382dbc2e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:32.518157 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a126b3-bfa3-4184-9304-5b382dbc2e4a None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:32.518603 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a126b3-bfa3-4184-9304-5b382dbc2e4a None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:32.518791 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a126b3-bfa3-4184-9304-5b382dbc2e4a None admin] PATH_INFO: `/v3/roles` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:32.519853 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a126b3-bfa3-4184-9304-5b382dbc2e4a None admin] RBAC: Adding query filter params (name=admin) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:07:32.520468 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a126b3-bfa3-4184-9304-5b382dbc2e4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:32.522268 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a126b3-bfa3-4184-9304-5b382dbc2e4a None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:32.530412 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 38/76] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:07:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:32.531288 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a126b3-bfa3-4184-9304-5b382dbc2e4a None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:32.577339 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:32.596119 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8315d-b8b4-495f-8bf5-b1ddf158cc5a None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:32.629839 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a126b3-bfa3-4184-9304-5b382dbc2e4a None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:32.631551 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71e803-5337-4d65-abc0-33f09d5cbda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:32.632222 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71e803-5337-4d65-abc0-33f09d5cbda0 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:32.632513 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71e803-5337-4d65-abc0-33f09d5cbda0 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:32.632795 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71e803-5337-4d65-abc0-33f09d5cbda0 None admin] PATH_INFO: `/v3/roles` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:32.633540 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd71e803-5337-4d65-abc0-33f09d5cbda0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:07:32.633853 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd71e803-5337-4d65-abc0-33f09d5cbda0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:32.635859 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd71e803-5337-4d65-abc0-33f09d5cbda0 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:32.643703 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 39/77] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:07:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:32.644889 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19973585-c8ac-47b5-9319-9fbc4ae550fc None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:32.645180 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19973585-c8ac-47b5-9319-9fbc4ae550fc None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:32.645460 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19973585-c8ac-47b5-9319-9fbc4ae550fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:32.661181 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-19973585-c8ac-47b5-9319-9fbc4ae550fc None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:07:32.662420 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-19973585-c8ac-47b5-9319-9fbc4ae550fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:07:32.667699 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6bac65-59a7-4a84-9ce5-5df3dd8be8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:32.668385 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bac65-59a7-4a84-9ce5-5df3dd8be8a3 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:32.668661 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bac65-59a7-4a84-9ce5-5df3dd8be8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:32.668952 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bac65-59a7-4a84-9ce5-5df3dd8be8a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:32.714818 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:32.728422 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 40/78] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:07:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:07:32.730078 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19973585-c8ac-47b5-9319-9fbc4ae550fc None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:32.749477 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6bac65-59a7-4a84-9ce5-5df3dd8be8a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:32.751052 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6bac65-59a7-4a84-9ce5-5df3dd8be8a3 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:32.804451 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:32.827901 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19973585-c8ac-47b5-9319-9fbc4ae550fc None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:32.848661 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 39/79] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:07:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:07:32.848661 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6bac65-59a7-4a84-9ce5-5df3dd8be8a3 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:32.861955 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f59ecf-54ba-4e96-93d3-4fdbb5832363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:32.862798 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f59ecf-54ba-4e96-93d3-4fdbb5832363 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:32.863088 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f59ecf-54ba-4e96-93d3-4fdbb5832363 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:32.863370 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f59ecf-54ba-4e96-93d3-4fdbb5832363 None admin] PATH_INFO: `/v3/domains/default` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:32.864566 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f59ecf-54ba-4e96-93d3-4fdbb5832363 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:32.866026 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f59ecf-54ba-4e96-93d3-4fdbb5832363 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:32.867807 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 41/80] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:07:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:32.868421 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f59ecf-54ba-4e96-93d3-4fdbb5832363 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:32.927839 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:32.951883 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6bac65-59a7-4a84-9ce5-5df3dd8be8a3 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:32.967003 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f59ecf-54ba-4e96-93d3-4fdbb5832363 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:32.985531 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59471f4a-27a1-424a-a809-498a4a93f160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:32.986391 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59471f4a-27a1-424a-a809-498a4a93f160 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:32.986690 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59471f4a-27a1-424a-a809-498a4a93f160 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:32.986976 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59471f4a-27a1-424a-a809-498a4a93f160 None admin] PATH_INFO: `/v3/users/c3b4b48661074142b14910bc96e359ec` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:32.988414 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59471f4a-27a1-424a-a809-498a4a93f160 None admin] RBAC: Authorizing `identity:get_user(user_id=c3b4b48661074142b14910bc96e359ec)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:32.989891 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59471f4a-27a1-424a-a809-498a4a93f160 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:32.991569 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 40/81] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:07:32 2022] GET /identity/v3/users/c3b4b48661074142b14910bc96e359ec => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:32.992343 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59471f4a-27a1-424a-a809-498a4a93f160 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:33.004427 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a1a2e-3df6-4d02-894a-472d25cad600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:33.005310 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a1a2e-3df6-4d02-894a-472d25cad600 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:33.005599 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a1a2e-3df6-4d02-894a-472d25cad600 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:33.005883 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a1a2e-3df6-4d02-894a-472d25cad600 None admin] PATH_INFO: `/v3/users/f904c02f9f084df4917f5d2d38174f29` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:33.007127 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752a1a2e-3df6-4d02-894a-472d25cad600 None admin] RBAC: Authorizing `identity:get_user(user_id=f904c02f9f084df4917f5d2d38174f29)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:33.008585 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752a1a2e-3df6-4d02-894a-472d25cad600 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:33.010295 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 42/82] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:07:32 2022] GET /identity/v3/users/f904c02f9f084df4917f5d2d38174f29 => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:33.015123 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a1a2e-3df6-4d02-894a-472d25cad600 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:33.027692 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:33.094439 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59471f4a-27a1-424a-a809-498a4a93f160 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:33.115723 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a1a2e-3df6-4d02-894a-472d25cad600 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:33.127475 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d095ed94-50a1-4406-9cbb-738a01782700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:33.128282 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095ed94-50a1-4406-9cbb-738a01782700 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:33.128572 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095ed94-50a1-4406-9cbb-738a01782700 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:33.128851 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095ed94-50a1-4406-9cbb-738a01782700 None admin] PATH_INFO: `/v3/roles/member` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:33.139131 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d095ed94-50a1-4406-9cbb-738a01782700 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:07:33.146874 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-d095ed94-50a1-4406-9cbb-738a01782700 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:07:33.146874 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:07:33.146874 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:07:33.146874 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:07:33.146874 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:07:33.146874 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:07:33.146874 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:07:33.146874 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:07:33.146874 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:07:33.146874 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:07:33.146874 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:07:33.146874 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:07:33.146874 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:07:33.146874 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:07:33.146874 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:07:33.146874 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:07:33.147758 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:07:33.147758 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:07:33.147758 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:07:33.147758 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:07:33.147758 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:07:33.147758 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:07:33.147758 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:07:33.147758 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:07:33.147758 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:07:33.147758 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:07:33.147758 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:07:33.147758 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:07:33.147758 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:07:33.147758 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:07:33.147758 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:07:33.147758 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:07:33.148586 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:07:33.148586 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:07:33.148586 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:07:33.148586 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:07:33.148586 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:07:33.148586 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:07:33.148586 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:07:33.148586 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:07:33.148586 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:07:33.148586 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:07:33.148586 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:07:33.148586 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:07:33.148586 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 41/83] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:07:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:07:33.149218 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d5e734-c275-44e2-8646-0fa4947b914e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:33.149298 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d095ed94-50a1-4406-9cbb-738a01782700 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:33.149976 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5e734-c275-44e2-8646-0fa4947b914e None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:33.149976 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5e734-c275-44e2-8646-0fa4947b914e None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:33.150280 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5e734-c275-44e2-8646-0fa4947b914e None admin] PATH_INFO: `/v3/projects/3665952118af4106b09bd445a38d53e5` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:33.151711 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d5e734-c275-44e2-8646-0fa4947b914e None admin] RBAC: Authorizing `identity:get_project(project_id=3665952118af4106b09bd445a38d53e5)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:33.153193 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d5e734-c275-44e2-8646-0fa4947b914e None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:33.154951 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 43/84] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:07:33 2022] GET /identity/v3/projects/3665952118af4106b09bd445a38d53e5 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:33.155729 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d5e734-c275-44e2-8646-0fa4947b914e None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:33.158306 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:33.235833 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:33.249222 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d095ed94-50a1-4406-9cbb-738a01782700 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:33.257995 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d5e734-c275-44e2-8646-0fa4947b914e None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:33.281301 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d55ba-854a-4b4a-b633-dc580dcd41f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:33.281977 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d55ba-854a-4b4a-b633-dc580dcd41f0 None admin] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:33.282297 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d55ba-854a-4b4a-b633-dc580dcd41f0 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:33.282579 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d55ba-854a-4b4a-b633-dc580dcd41f0 None admin] PATH_INFO: `/v3/users` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:33.283301 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69d55ba-854a-4b4a-b633-dc580dcd41f0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:33.284750 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69d55ba-854a-4b4a-b633-dc580dcd41f0 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:33.292712 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57606029-4d15-46be-9543-cf80c58ff675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:33.293369 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57606029-4d15-46be-9543-cf80c58ff675 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:33.293666 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57606029-4d15-46be-9543-cf80c58ff675 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:33.293954 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57606029-4d15-46be-9543-cf80c58ff675 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:33.342869 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 42/85] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:07:33 2022] POST /identity/v3/users => generated 289 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:07:33.343966 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d55ba-854a-4b4a-b633-dc580dcd41f0 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:33.365424 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57606029-4d15-46be-9543-cf80c58ff675 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:33.367417 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57606029-4d15-46be-9543-cf80c58ff675 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:33.422654 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:33.464673 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:33.469177 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d55ba-854a-4b4a-b633-dc580dcd41f0 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:33.489649 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 44/86] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:07:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:07:33.493692 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57606029-4d15-46be-9543-cf80c58ff675 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:33.511325 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c91bf-676d-434e-932e-29b501a74a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:33.512003 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c91bf-676d-434e-932e-29b501a74a9a None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:33.512323 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c91bf-676d-434e-932e-29b501a74a9a None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:33.512578 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c91bf-676d-434e-932e-29b501a74a9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:33.599596 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c91bf-676d-434e-932e-29b501a74a9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:33.600007 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c91bf-676d-434e-932e-29b501a74a9a None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:33.612833 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57606029-4d15-46be-9543-cf80c58ff675 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:33.660077 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d74105-8f86-4e70-8e3c-e5e04543e907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:33.660765 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d74105-8f86-4e70-8e3c-e5e04543e907 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:33.661058 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d74105-8f86-4e70-8e3c-e5e04543e907 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:33.661345 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d74105-8f86-4e70-8e3c-e5e04543e907 None admin] PATH_INFO: `/v3/roles` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:33.662110 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d74105-8f86-4e70-8e3c-e5e04543e907 None admin] RBAC: Adding query filter params (name=member) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:07:33.662464 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d74105-8f86-4e70-8e3c-e5e04543e907 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:33.664406 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d74105-8f86-4e70-8e3c-e5e04543e907 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:33.675541 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 45/87] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:07:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:33.676214 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d74105-8f86-4e70-8e3c-e5e04543e907 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:33.682735 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:33.722330 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:33.739358 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 43/88] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:07:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:07:33.740642 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c91bf-676d-434e-932e-29b501a74a9a None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:33.788903 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d74105-8f86-4e70-8e3c-e5e04543e907 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:33.826811 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdbd544-8f24-498b-bd99-275ff1cd3949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:33.827555 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbd544-8f24-498b-bd99-275ff1cd3949 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:33.827848 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbd544-8f24-498b-bd99-275ff1cd3949 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:33.828187 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbd544-8f24-498b-bd99-275ff1cd3949 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:33.829223 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdbd544-8f24-498b-bd99-275ff1cd3949 None admin] RBAC: Adding query filter params (role.id=f9389c8fc7a74300aed4cf6490fb672b, scope.project.id=3665952118af4106b09bd445a38d53e5, user.id=f904c02f9f084df4917f5d2d38174f29) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:07:33.830090 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdbd544-8f24-498b-bd99-275ff1cd3949 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:33.831889 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdbd544-8f24-498b-bd99-275ff1cd3949 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:33.840521 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 46/89] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:07:33 2022] GET /identity/v3/role_assignments?user.id=f904c02f9f084df4917f5d2d38174f29&scope.project.id=3665952118af4106b09bd445a38d53e5&role.id=f9389c8fc7a74300aed4cf6490fb672b => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:33.841385 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdbd544-8f24-498b-bd99-275ff1cd3949 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:33.897493 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c91bf-676d-434e-932e-29b501a74a9a None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:33.981655 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9cc07-5227-4b69-8fca-10d3591f1e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:33.983000 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9cc07-5227-4b69-8fca-10d3591f1e49 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:33.983492 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9cc07-5227-4b69-8fca-10d3591f1e49 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:33.984027 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9cc07-5227-4b69-8fca-10d3591f1e49 None admin] PATH_INFO: `/v3/projects/3665952118af4106b09bd445a38d53e5` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:33.985629 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d9cc07-5227-4b69-8fca-10d3591f1e49 None admin] RBAC: Authorizing `identity:get_project(project_id=3665952118af4106b09bd445a38d53e5)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:33.987414 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d9cc07-5227-4b69-8fca-10d3591f1e49 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:33.989884 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 44/90] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:07:33 2022] GET /identity/v3/projects/3665952118af4106b09bd445a38d53e5 => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:33.990959 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9cc07-5227-4b69-8fca-10d3591f1e49 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:34.025579 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:34.031596 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdbd544-8f24-498b-bd99-275ff1cd3949 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:34.043301 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:34.070447 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea61e4-2074-4bec-b339-b0e0b06ecb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:34.071345 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea61e4-2074-4bec-b339-b0e0b06ecb4e None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:34.071634 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea61e4-2074-4bec-b339-b0e0b06ecb4e None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:34.071915 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea61e4-2074-4bec-b339-b0e0b06ecb4e None admin] PATH_INFO: `/v3/users/f904c02f9f084df4917f5d2d38174f29` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:34.073897 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aea61e4-2074-4bec-b339-b0e0b06ecb4e None admin] RBAC: Authorizing `identity:get_user(user_id=f904c02f9f084df4917f5d2d38174f29)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:34.075427 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aea61e4-2074-4bec-b339-b0e0b06ecb4e None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:34.077277 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 47/91] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:07:33 2022] GET /identity/v3/users/f904c02f9f084df4917f5d2d38174f29 => generated 275 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:34.077879 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea61e4-2074-4bec-b339-b0e0b06ecb4e None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:34.144345 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9cc07-5227-4b69-8fca-10d3591f1e49 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:34.209095 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea61e4-2074-4bec-b339-b0e0b06ecb4e None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:34.238531 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf1ab0a-cbe3-4892-886c-cef9665a2229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:34.239422 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1ab0a-cbe3-4892-886c-cef9665a2229 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:34.239712 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1ab0a-cbe3-4892-886c-cef9665a2229 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:34.239996 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1ab0a-cbe3-4892-886c-cef9665a2229 None admin] PATH_INFO: `/v3/projects/3665952118af4106b09bd445a38d53e5` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:34.242775 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf1ab0a-cbe3-4892-886c-cef9665a2229 None admin] RBAC: Authorizing `identity:get_project(project_id=3665952118af4106b09bd445a38d53e5)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:34.244208 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf1ab0a-cbe3-4892-886c-cef9665a2229 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:34.246911 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 45/92] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:07:33 2022] GET /identity/v3/projects/3665952118af4106b09bd445a38d53e5 => generated 298 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:34.252576 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf1ab0a-cbe3-4892-886c-cef9665a2229 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:34.275448 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8dfc9-523f-4523-928b-6de62f2c0dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:34.276931 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8dfc9-523f-4523-928b-6de62f2c0dc7 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:34.277335 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8dfc9-523f-4523-928b-6de62f2c0dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:34.277631 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8dfc9-523f-4523-928b-6de62f2c0dc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:34.278630 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac8dfc9-523f-4523-928b-6de62f2c0dc7 None admin] RBAC: Adding query filter params (role.id=101b93f94624407f8c812ab86ebec32a, scope.project.id=3665952118af4106b09bd445a38d53e5, user.id=c3b4b48661074142b14910bc96e359ec) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:07:34.278954 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac8dfc9-523f-4523-928b-6de62f2c0dc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:34.280511 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac8dfc9-523f-4523-928b-6de62f2c0dc7 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:34.295507 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 48/93] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:07:34 2022] GET /identity/v3/role_assignments?user.id=c3b4b48661074142b14910bc96e359ec&scope.project.id=3665952118af4106b09bd445a38d53e5&role.id=101b93f94624407f8c812ab86ebec32a => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:34.296373 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8dfc9-523f-4523-928b-6de62f2c0dc7 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:34.374585 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf1ab0a-cbe3-4892-886c-cef9665a2229 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:34.376518 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:34.390545 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:34.447000 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32517de-2031-476a-8869-4de5b35d4466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:34.447768 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32517de-2031-476a-8869-4de5b35d4466 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:34.448069 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32517de-2031-476a-8869-4de5b35d4466 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:34.448354 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32517de-2031-476a-8869-4de5b35d4466 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:34.495099 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8dfc9-523f-4523-928b-6de62f2c0dc7 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:34.565086 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3bd78f-544f-4187-97f4-42ab137e22ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:34.566117 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3bd78f-544f-4187-97f4-42ab137e22ae None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:34.567580 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3bd78f-544f-4187-97f4-42ab137e22ae None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:34.568795 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3bd78f-544f-4187-97f4-42ab137e22ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:34.569834 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3bd78f-544f-4187-97f4-42ab137e22ae None admin] RBAC: Adding query filter params (role.id=49943dd485174ef39fdd0368de241417, scope.project.id=3665952118af4106b09bd445a38d53e5, user.id=f904c02f9f084df4917f5d2d38174f29) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:07:34.571784 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3bd78f-544f-4187-97f4-42ab137e22ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:34.573563 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3bd78f-544f-4187-97f4-42ab137e22ae None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:34.589710 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 49/94] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:07:34 2022] GET /identity/v3/role_assignments?user.id=f904c02f9f084df4917f5d2d38174f29&scope.project.id=3665952118af4106b09bd445a38d53e5&role.id=49943dd485174ef39fdd0368de241417 => generated 259 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:34.595120 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32517de-2031-476a-8869-4de5b35d4466 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:34.596928 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32517de-2031-476a-8869-4de5b35d4466 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:34.730595 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:34.734488 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 46/95] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:07:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:07:34.740322 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3bd78f-544f-4187-97f4-42ab137e22ae None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:34.868338 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:34.876800 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3bd78f-544f-4187-97f4-42ab137e22ae None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:34.921154 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e322157-6e77-4254-92ef-88771c12b56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:34.922049 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e322157-6e77-4254-92ef-88771c12b56e None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:34.922363 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e322157-6e77-4254-92ef-88771c12b56e None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:34.922649 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e322157-6e77-4254-92ef-88771c12b56e None admin] PATH_INFO: `/v3/projects/6e317cb137cf47618e2ff86ba53ec2c4` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:34.923917 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e322157-6e77-4254-92ef-88771c12b56e None admin] RBAC: Authorizing `identity:get_project(project_id=6e317cb137cf47618e2ff86ba53ec2c4)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:34.925422 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e322157-6e77-4254-92ef-88771c12b56e None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:34.927218 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 50/96] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:07:34 2022] GET /identity/v3/projects/6e317cb137cf47618e2ff86ba53ec2c4 => generated 312 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:34.933918 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32517de-2031-476a-8869-4de5b35d4466 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:35.046057 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32517de-2031-476a-8869-4de5b35d4466 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:35.081396 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585d235-7f5d-4813-958e-5ff1cc71bc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:35.082075 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585d235-7f5d-4813-958e-5ff1cc71bc4d None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:35.082398 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585d235-7f5d-4813-958e-5ff1cc71bc4d None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:35.082681 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585d235-7f5d-4813-958e-5ff1cc71bc4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:35.083527 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585d235-7f5d-4813-958e-5ff1cc71bc4d None admin] RBAC: Adding query filter params (role.id=f9389c8fc7a74300aed4cf6490fb672b, scope.project.id=6e317cb137cf47618e2ff86ba53ec2c4, user.id=f904c02f9f084df4917f5d2d38174f29) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:07:35.083849 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585d235-7f5d-4813-958e-5ff1cc71bc4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:35.085314 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585d235-7f5d-4813-958e-5ff1cc71bc4d None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:35.098565 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 47/97] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:07:34 2022] GET /identity/v3/role_assignments?user.id=f904c02f9f084df4917f5d2d38174f29&scope.project.id=6e317cb137cf47618e2ff86ba53ec2c4&role.id=f9389c8fc7a74300aed4cf6490fb672b => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:35.723642 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572282c5-4262-403c-9083-863b479ddc93 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:35.724049 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572282c5-4262-403c-9083-863b479ddc93 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:35.724229 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572282c5-4262-403c-9083-863b479ddc93 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:35.725907 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 51/98] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:07:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:07:35.732338 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72d506-861b-45a9-9f10-58fff1afe6e7 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:35.732798 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72d506-861b-45a9-9f10-58fff1afe6e7 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:35.732904 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72d506-861b-45a9-9f10-58fff1afe6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:35.758486 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-cb72d506-861b-45a9-9f10-58fff1afe6e7 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:07:35.759572 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029ae66-41bc-450e-adfe-4d4fa3486f35 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:35.759994 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-cb72d506-861b-45a9-9f10-58fff1afe6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:07:35.760517 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029ae66-41bc-450e-adfe-4d4fa3486f35 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:35.761021 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029ae66-41bc-450e-adfe-4d4fa3486f35 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:35.762706 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 52/99] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:07:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:07:35.767866 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8400f2-fe61-4985-bd68-dd8f016d8ce9 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:35.768390 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8400f2-fe61-4985-bd68-dd8f016d8ce9 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:35.768886 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8400f2-fe61-4985-bd68-dd8f016d8ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:35.791096 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-5c8400f2-fe61-4985-bd68-dd8f016d8ce9 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:07:35.792731 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-5c8400f2-fe61-4985-bd68-dd8f016d8ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:07:35.839799 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:35.858763 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 48/100] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:07:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:07:35.894865 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72d506-861b-45a9-9f10-58fff1afe6e7 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:35.909856 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 53/101] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:07:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:07:35.952190 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8400f2-fe61-4985-bd68-dd8f016d8ce9 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:36.075688 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72d506-861b-45a9-9f10-58fff1afe6e7 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:36.129073 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:36.135911 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8400f2-fe61-4985-bd68-dd8f016d8ce9 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:36.150413 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9317b5a-c91b-4c60-8713-a4f15ca8947e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:36.151644 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9317b5a-c91b-4c60-8713-a4f15ca8947e None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:36.152081 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9317b5a-c91b-4c60-8713-a4f15ca8947e None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:36.152553 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9317b5a-c91b-4c60-8713-a4f15ca8947e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:36.186184 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9317b5a-c91b-4c60-8713-a4f15ca8947e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:07:36.194943 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-c9317b5a-c91b-4c60-8713-a4f15ca8947e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:07:36.194943 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:07:36.194943 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:07:36.194943 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:07:36.194943 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:07:36.194943 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:07:36.194943 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:07:36.194943 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:07:36.194943 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:07:36.194943 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:07:36.194943 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:07:36.194943 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:07:36.194943 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:07:36.194943 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:07:36.194943 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:07:36.194943 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:07:36.195797 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:07:36.195797 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:07:36.195797 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:07:36.195797 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:07:36.195797 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:07:36.195797 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:07:36.195797 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:07:36.195797 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:07:36.195797 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:07:36.195797 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:07:36.195797 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:07:36.195797 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:07:36.195797 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:07:36.195797 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:07:36.195797 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:07:36.195797 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:07:36.196566 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:07:36.196566 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:07:36.196566 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:07:36.196566 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:07:36.196566 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:07:36.196566 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:07:36.196566 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:07:36.196566 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:07:36.196566 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:07:36.196566 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:07:36.196566 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:07:36.196566 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:07:36.203937 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 49/102] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:07:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:07:36.205393 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9317b5a-c91b-4c60-8713-a4f15ca8947e None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:36.211831 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a420b-7d91-4ca0-ae21-2600c6b9191d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:36.212658 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a420b-7d91-4ca0-ae21-2600c6b9191d None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:36.212949 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a420b-7d91-4ca0-ae21-2600c6b9191d None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:36.213257 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a420b-7d91-4ca0-ae21-2600c6b9191d None admin] PATH_INFO: `/v3/domains/default` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:36.216213 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a420b-7d91-4ca0-ae21-2600c6b9191d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:36.217714 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a420b-7d91-4ca0-ae21-2600c6b9191d None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:36.219381 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 54/103] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:07:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:07:36.225890 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a420b-7d91-4ca0-ae21-2600c6b9191d None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:36.286553 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:36.381570 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9317b5a-c91b-4c60-8713-a4f15ca8947e None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:36.413678 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a420b-7d91-4ca0-ae21-2600c6b9191d None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:36.451807 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31bb7be-dcd3-4666-b757-38a4ff815e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:36.452510 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bb7be-dcd3-4666-b757-38a4ff815e8e None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:36.452811 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bb7be-dcd3-4666-b757-38a4ff815e8e None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:36.453103 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bb7be-dcd3-4666-b757-38a4ff815e8e None admin] PATH_INFO: `/v3/roles` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:36.453866 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31bb7be-dcd3-4666-b757-38a4ff815e8e None admin] RBAC: Adding query filter params (name=reader) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:07:36.454215 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31bb7be-dcd3-4666-b757-38a4ff815e8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:36.455940 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31bb7be-dcd3-4666-b757-38a4ff815e8e None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:36.473858 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 50/104] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:07:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:07:36.481532 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31bb7be-dcd3-4666-b757-38a4ff815e8e None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:36.485867 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738261e9-dd55-4044-aa88-4db98a776013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:36.486577 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738261e9-dd55-4044-aa88-4db98a776013 None admin] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:36.486873 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738261e9-dd55-4044-aa88-4db98a776013 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:36.487162 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738261e9-dd55-4044-aa88-4db98a776013 None admin] PATH_INFO: `/v3/projects` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:36.487896 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738261e9-dd55-4044-aa88-4db98a776013 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:36.489367 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738261e9-dd55-4044-aa88-4db98a776013 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:36.603713 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 55/105] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Jul 5 21:07:36 2022] POST /identity/v3/projects => generated 302 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:07:36.646360 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31bb7be-dcd3-4666-b757-38a4ff815e8e None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:36.666032 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:36.695837 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f4b6fe-282d-456d-9102-28b63f7cb06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:36.696959 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4b6fe-282d-456d-9102-28b63f7cb06c None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:36.697494 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4b6fe-282d-456d-9102-28b63f7cb06c None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:36.702686 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4b6fe-282d-456d-9102-28b63f7cb06c None admin] PATH_INFO: `/v3/users/d1a731c426ef4a1a99e014fe9c1895d2` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:36.722437 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f4b6fe-282d-456d-9102-28b63f7cb06c None admin] RBAC: Authorizing `identity:get_user(user_id=d1a731c426ef4a1a99e014fe9c1895d2)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:36.724021 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f4b6fe-282d-456d-9102-28b63f7cb06c None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:36.725905 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 51/106] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:07:36 2022] GET /identity/v3/users/d1a731c426ef4a1a99e014fe9c1895d2 => generated 289 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:36.731874 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738261e9-dd55-4044-aa88-4db98a776013 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:36.755540 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:36.864088 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738261e9-dd55-4044-aa88-4db98a776013 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:36.913442 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af73c9-8a69-4822-9bba-61293db2772a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:36.914171 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af73c9-8a69-4822-9bba-61293db2772a None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:36.914493 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af73c9-8a69-4822-9bba-61293db2772a None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:36.914782 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af73c9-8a69-4822-9bba-61293db2772a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:37.005780 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af73c9-8a69-4822-9bba-61293db2772a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:37.007314 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af73c9-8a69-4822-9bba-61293db2772a None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:37.026564 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:37.128218 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 56/107] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:07:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:07:37.134035 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f4b6fe-282d-456d-9102-28b63f7cb06c None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:37.303399 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f4b6fe-282d-456d-9102-28b63f7cb06c None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:37.346212 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d84c2b-f3fa-4f2b-a1e5-0f51ac215658 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:37.346520 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d84c2b-f3fa-4f2b-a1e5-0f51ac215658 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:37.346796 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d84c2b-f3fa-4f2b-a1e5-0f51ac215658 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:37.348479 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 57/108] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:07:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:07:37.353354 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddec277-339d-4235-937a-97575d686208 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:37.353658 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddec277-339d-4235-937a-97575d686208 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:37.354514 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddec277-339d-4235-937a-97575d686208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:37.354619 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82679a7c-8a2b-4d54-b489-258e7904d2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:37.355531 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82679a7c-8a2b-4d54-b489-258e7904d2ad None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:37.355827 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82679a7c-8a2b-4d54-b489-258e7904d2ad None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:37.356115 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82679a7c-8a2b-4d54-b489-258e7904d2ad None admin] PATH_INFO: `/v3/projects/3665952118af4106b09bd445a38d53e5` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:37.362911 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82679a7c-8a2b-4d54-b489-258e7904d2ad None admin] RBAC: Authorizing `identity:get_project(project_id=3665952118af4106b09bd445a38d53e5)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:37.364648 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82679a7c-8a2b-4d54-b489-258e7904d2ad None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:37.366644 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 52/109] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:07:37 2022] GET /identity/v3/projects/3665952118af4106b09bd445a38d53e5 => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:37.373045 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82679a7c-8a2b-4d54-b489-258e7904d2ad None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:37.391206 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-1ddec277-339d-4235-937a-97575d686208 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:07:37.392444 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-1ddec277-339d-4235-937a-97575d686208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:07:37.466521 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:37.499794 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 58/110] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:07:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:07:37.513904 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d0aa3-9c4e-4d35-bf20-e46cd3a5df13 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:37.514231 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d0aa3-9c4e-4d35-bf20-e46cd3a5df13 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:37.514524 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d0aa3-9c4e-4d35-bf20-e46cd3a5df13 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:37.515903 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 59/111] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:07:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:07:37.524967 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d0aa3-9c4e-4d35-bf20-e46cd3a5df13 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:37.585127 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82679a7c-8a2b-4d54-b489-258e7904d2ad None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:37.594584 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:37.642852 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b30ea95-379a-4f52-81c8-fc909190c1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:37.643592 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30ea95-379a-4f52-81c8-fc909190c1b8 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:37.643884 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30ea95-379a-4f52-81c8-fc909190c1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:37.645314 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30ea95-379a-4f52-81c8-fc909190c1b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:37.646207 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b30ea95-379a-4f52-81c8-fc909190c1b8 None admin] RBAC: Adding query filter params (role.id=e8b0e7643206483385c49640e21e33d7, scope.project.id=3665952118af4106b09bd445a38d53e5, user.id=d1a731c426ef4a1a99e014fe9c1895d2) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:07:37.646536 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b30ea95-379a-4f52-81c8-fc909190c1b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:37.648009 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b30ea95-379a-4f52-81c8-fc909190c1b8 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:37.656462 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d0aa3-9c4e-4d35-bf20-e46cd3a5df13 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:37.663808 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 53/112] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:07:37 2022] GET /identity/v3/role_assignments?user.id=d1a731c426ef4a1a99e014fe9c1895d2&scope.project.id=3665952118af4106b09bd445a38d53e5&role.id=e8b0e7643206483385c49640e21e33d7 => generated 259 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:07:37.664933 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4db8a-6f76-4660-938d-67201a84946d None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:37.665236 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4db8a-6f76-4660-938d-67201a84946d None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:37.668971 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4db8a-6f76-4660-938d-67201a84946d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:37.706653 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-3da4db8a-6f76-4660-938d-67201a84946d None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:07:37.707905 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-3da4db8a-6f76-4660-938d-67201a84946d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:07:37.735025 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c200c93-2c27-4a44-a026-f0989f145b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:37.735926 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c200c93-2c27-4a44-a026-f0989f145b7d None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:37.736222 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c200c93-2c27-4a44-a026-f0989f145b7d None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:37.736506 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c200c93-2c27-4a44-a026-f0989f145b7d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:37.758381 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c200c93-2c27-4a44-a026-f0989f145b7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:07:37.773441 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-4c200c93-2c27-4a44-a026-f0989f145b7d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:07:37.773441 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:07:37.773441 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:07:37.773441 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:07:37.773441 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:07:37.773441 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:07:37.773441 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:07:37.773441 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:07:37.773441 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:07:37.773441 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:07:37.773441 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:07:37.773441 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:07:37.773441 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:07:37.773441 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:07:37.773441 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:07:37.773441 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:07:37.774390 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:07:37.774390 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:07:37.774390 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:07:37.774390 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:07:37.774390 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:07:37.774390 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:07:37.774390 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:07:37.774390 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:07:37.774390 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:07:37.774390 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:07:37.774390 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:07:37.774390 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:07:37.774390 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:07:37.774390 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:07:37.774390 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:07:37.774390 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:07:37.775154 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:07:37.775154 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:07:37.775154 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:07:37.775154 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:07:37.775154 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:07:37.775154 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:07:37.775154 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:07:37.775154 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:07:37.775154 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:07:37.775154 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:07:37.775154 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:07:37.775154 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:07:37.779353 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 60/113] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:07:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:07:37.790200 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c200c93-2c27-4a44-a026-f0989f145b7d None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:37.853493 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 54/114] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:07:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:07:37.925034 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da4db8a-6f76-4660-938d-67201a84946d None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:37.946579 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c200c93-2c27-4a44-a026-f0989f145b7d None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:37.979766 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:37.999418 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:38.007694 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbabff0-8567-4430-97ae-1f8bc4b852f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:38.008725 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbabff0-8567-4430-97ae-1f8bc4b852f2 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:38.009160 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbabff0-8567-4430-97ae-1f8bc4b852f2 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:38.009585 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbabff0-8567-4430-97ae-1f8bc4b852f2 None admin] PATH_INFO: `/v3/roles` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:38.010747 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbabff0-8567-4430-97ae-1f8bc4b852f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:07:38.011296 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbabff0-8567-4430-97ae-1f8bc4b852f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:38.013715 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbabff0-8567-4430-97ae-1f8bc4b852f2 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:38.037038 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 61/115] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:07:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:38.038186 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbabff0-8567-4430-97ae-1f8bc4b852f2 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:38.100703 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da4db8a-6f76-4660-938d-67201a84946d None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:38.144917 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d2c4f-710d-4dad-8dcf-f13084cf2f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:38.146979 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d2c4f-710d-4dad-8dcf-f13084cf2f08 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:38.147704 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d2c4f-710d-4dad-8dcf-f13084cf2f08 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:38.148167 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d2c4f-710d-4dad-8dcf-f13084cf2f08 None admin] PATH_INFO: `/v3/roles/member` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:38.160333 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825d2c4f-710d-4dad-8dcf-f13084cf2f08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:07:38.168839 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-825d2c4f-710d-4dad-8dcf-f13084cf2f08 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:07:38.168839 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:07:38.168839 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:07:38.168839 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:07:38.168839 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:07:38.168839 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:07:38.168839 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:07:38.168839 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:07:38.168839 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:07:38.168839 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:07:38.168839 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:07:38.168839 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:07:38.168839 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:07:38.168839 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:07:38.168839 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:07:38.168839 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:07:38.169901 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:07:38.169901 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:07:38.169901 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:07:38.169901 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:07:38.169901 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:07:38.169901 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:07:38.169901 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:07:38.169901 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:07:38.169901 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:07:38.169901 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:07:38.169901 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:07:38.169901 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:07:38.169901 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:07:38.169901 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:07:38.169901 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:07:38.169901 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:07:38.170900 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:07:38.170900 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:07:38.170900 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:07:38.170900 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:07:38.170900 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:07:38.170900 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:07:38.170900 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:07:38.170900 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:07:38.170900 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:07:38.170900 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:07:38.170900 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:07:38.170900 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:07:38.173800 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 55/116] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:07:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:07:38.175400 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71866f80-1834-4b76-af13-d0451dbb670f None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:38.175837 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71866f80-1834-4b76-af13-d0451dbb670f None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:38.176252 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71866f80-1834-4b76-af13-d0451dbb670f None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:38.177666 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 56/117] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:07:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:07:38.178967 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da3e0b-58a5-4375-abd9-ff370ab70151 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:38.179401 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da3e0b-58a5-4375-abd9-ff370ab70151 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:38.179827 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da3e0b-58a5-4375-abd9-ff370ab70151 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:38.181546 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 57/118] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:07:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:07:38.184663 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da3e0b-58a5-4375-abd9-ff370ab70151 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:38.208629 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbabff0-8567-4430-97ae-1f8bc4b852f2 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:38.245244 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86257ed-0c1f-4856-b597-88708464e5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:38.246423 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86257ed-0c1f-4856-b597-88708464e5d3 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:38.246856 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86257ed-0c1f-4856-b597-88708464e5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:38.247304 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86257ed-0c1f-4856-b597-88708464e5d3 None admin] PATH_INFO: `/v3/users/c3b4b48661074142b14910bc96e359ec` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:38.248769 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86257ed-0c1f-4856-b597-88708464e5d3 None admin] RBAC: Authorizing `identity:get_user(user_id=c3b4b48661074142b14910bc96e359ec)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:38.250399 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86257ed-0c1f-4856-b597-88708464e5d3 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:38.252410 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 62/119] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:07:38 2022] GET /identity/v3/users/c3b4b48661074142b14910bc96e359ec => generated 247 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:38.253764 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c90e3b-81a9-480d-8d48-259a8bba1dfb None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:38.254335 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c90e3b-81a9-480d-8d48-259a8bba1dfb None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:38.254836 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c90e3b-81a9-480d-8d48-259a8bba1dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:38.273316 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-94c90e3b-81a9-480d-8d48-259a8bba1dfb None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:07:38.274897 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-94c90e3b-81a9-480d-8d48-259a8bba1dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:07:38.298587 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:38.312797 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:38.318036 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da3e0b-58a5-4375-abd9-ff370ab70151 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:38.355512 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412aea16-ee81-4057-be12-030a94e784f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:38.356674 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412aea16-ee81-4057-be12-030a94e784f8 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:38.357145 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412aea16-ee81-4057-be12-030a94e784f8 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:38.357436 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412aea16-ee81-4057-be12-030a94e784f8 None admin] PATH_INFO: `/v3/roles` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:38.358300 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412aea16-ee81-4057-be12-030a94e784f8 None admin] RBAC: Adding query filter params (name=member) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:07:38.358769 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412aea16-ee81-4057-be12-030a94e784f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:38.366147 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412aea16-ee81-4057-be12-030a94e784f8 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:38.367150 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 63/120] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:07:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:07:38.368773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d4175-4a53-4766-aca6-3fce566b9035 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:38.369058 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d4175-4a53-4766-aca6-3fce566b9035 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:38.369342 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d4175-4a53-4766-aca6-3fce566b9035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:38.380404 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 58/121] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:07:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:38.381020 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412aea16-ee81-4057-be12-030a94e784f8 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:38.391221 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-0f2d4175-4a53-4766-aca6-3fce566b9035 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:07:38.392426 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-0f2d4175-4a53-4766-aca6-3fce566b9035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:07:38.479991 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 64/122] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:07:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:07:38.480897 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d4175-4a53-4766-aca6-3fce566b9035 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:38.497126 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412aea16-ee81-4057-be12-030a94e784f8 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:38.544305 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d624a1-20d3-4b01-958e-8f4fec43d6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:38.545182 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d624a1-20d3-4b01-958e-8f4fec43d6b6 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:38.545474 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d624a1-20d3-4b01-958e-8f4fec43d6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:38.545759 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d624a1-20d3-4b01-958e-8f4fec43d6b6 None admin] PATH_INFO: `/v3/projects/3665952118af4106b09bd445a38d53e5` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:38.547053 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d624a1-20d3-4b01-958e-8f4fec43d6b6 None admin] RBAC: Authorizing `identity:get_project(project_id=3665952118af4106b09bd445a38d53e5)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:38.548510 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d624a1-20d3-4b01-958e-8f4fec43d6b6 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:38.550470 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 59/123] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:07:38 2022] GET /identity/v3/projects/3665952118af4106b09bd445a38d53e5 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:38.551066 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d624a1-20d3-4b01-958e-8f4fec43d6b6 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:38.588805 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:38.598801 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:38.603229 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d4175-4a53-4766-aca6-3fce566b9035 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:38.639813 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad87fd-7267-48bd-9d8a-321070e30c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:38.641130 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad87fd-7267-48bd-9d8a-321070e30c63 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:38.641492 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad87fd-7267-48bd-9d8a-321070e30c63 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:38.641846 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad87fd-7267-48bd-9d8a-321070e30c63 None admin] PATH_INFO: `/v3/users/f904c02f9f084df4917f5d2d38174f29` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:38.643325 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad87fd-7267-48bd-9d8a-321070e30c63 None admin] RBAC: Authorizing `identity:get_user(user_id=f904c02f9f084df4917f5d2d38174f29)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:38.645038 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad87fd-7267-48bd-9d8a-321070e30c63 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:38.647184 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 65/124] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:07:38 2022] GET /identity/v3/users/f904c02f9f084df4917f5d2d38174f29 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:38.648060 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad87fd-7267-48bd-9d8a-321070e30c63 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:38.693774 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d624a1-20d3-4b01-958e-8f4fec43d6b6 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:38.729684 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315eaf5d-a44a-4809-a01b-628321962dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:38.730717 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315eaf5d-a44a-4809-a01b-628321962dee None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:38.730970 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315eaf5d-a44a-4809-a01b-628321962dee None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:38.731333 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315eaf5d-a44a-4809-a01b-628321962dee None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:38.746834 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315eaf5d-a44a-4809-a01b-628321962dee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:07:38.758151 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-315eaf5d-a44a-4809-a01b-628321962dee None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:07:38.758151 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:07:38.758151 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:07:38.758151 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:07:38.758151 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:07:38.758151 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:07:38.758151 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:07:38.758151 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:07:38.758151 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:07:38.758151 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:07:38.758151 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:07:38.758151 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:07:38.758151 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:07:38.758151 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:07:38.758151 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:07:38.758151 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:07:38.759007 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:07:38.759007 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:07:38.759007 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:07:38.759007 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:07:38.759007 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:07:38.759007 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:07:38.759007 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:07:38.759007 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:07:38.759007 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:07:38.759007 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:07:38.759007 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:07:38.759007 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:07:38.759007 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:07:38.759007 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:07:38.759007 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:07:38.759007 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:07:38.759761 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:07:38.759761 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:07:38.759761 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:07:38.759761 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:07:38.759761 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:07:38.759761 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:07:38.759761 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:07:38.759761 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:07:38.759761 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:07:38.759761 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:07:38.759761 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:07:38.759761 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:07:38.762491 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 60/125] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:07:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:07:38.763395 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315eaf5d-a44a-4809-a01b-628321962dee None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:38.781067 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad87fd-7267-48bd-9d8a-321070e30c63 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:38.828870 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffce31-29aa-4dd7-b5e4-5186da3091f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:38.830499 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffce31-29aa-4dd7-b5e4-5186da3091f2 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:38.830791 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffce31-29aa-4dd7-b5e4-5186da3091f2 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:38.831073 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffce31-29aa-4dd7-b5e4-5186da3091f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:38.845784 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bffce31-29aa-4dd7-b5e4-5186da3091f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:07:38.856146 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:38.858844 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-9bffce31-29aa-4dd7-b5e4-5186da3091f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:07:38.858844 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:07:38.858844 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:07:38.858844 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:07:38.858844 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:07:38.858844 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:07:38.858844 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:07:38.858844 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:07:38.858844 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:07:38.858844 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:07:38.858844 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:07:38.858844 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:07:38.858844 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:07:38.858844 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:07:38.858844 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:07:38.858844 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:07:38.859886 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:07:38.859886 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:07:38.859886 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:07:38.859886 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:07:38.859886 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:07:38.859886 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:07:38.859886 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:07:38.859886 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:07:38.859886 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:07:38.859886 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:07:38.859886 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:07:38.859886 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:07:38.859886 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:07:38.859886 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:07:38.859886 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:07:38.859886 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:07:38.860924 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:07:38.860924 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:07:38.860924 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:07:38.860924 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:07:38.860924 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:07:38.860924 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:07:38.860924 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:07:38.860924 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:07:38.860924 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:07:38.860924 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:07:38.860924 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:07:38.860924 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:07:38.863389 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 66/126] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:07:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:07:38.868496 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffce31-29aa-4dd7-b5e4-5186da3091f2 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:38.879798 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315eaf5d-a44a-4809-a01b-628321962dee None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:38.899984 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:38.921192 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749fb3e6-39d7-4571-98ab-6f109ed7a205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:38.922956 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fb3e6-39d7-4571-98ab-6f109ed7a205 None admin] REQUEST_METHOD: `PUT` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:38.923522 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fb3e6-39d7-4571-98ab-6f109ed7a205 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:38.923956 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fb3e6-39d7-4571-98ab-6f109ed7a205 None admin] PATH_INFO: `/v3/projects/3665952118af4106b09bd445a38d53e5/users/c3b4b48661074142b14910bc96e359ec/roles/101b93f94624407f8c812ab86ebec32a` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:38.927190 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749fb3e6-39d7-4571-98ab-6f109ed7a205 None admin] RBAC: Authorizing `identity:create_grant(project_id=3665952118af4106b09bd445a38d53e5, user_id=c3b4b48661074142b14910bc96e359ec, role_id=101b93f94624407f8c812ab86ebec32a)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:38.929472 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749fb3e6-39d7-4571-98ab-6f109ed7a205 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:38.981655 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffce31-29aa-4dd7-b5e4-5186da3091f2 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:38.986097 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 61/127] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:07:38 2022] PUT /identity/v3/projects/3665952118af4106b09bd445a38d53e5/users/c3b4b48661074142b14910bc96e359ec/roles/101b93f94624407f8c812ab86ebec32a => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:07:38.991427 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749fb3e6-39d7-4571-98ab-6f109ed7a205 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:39.040029 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a9a93e-615f-4517-8e19-f3767d62f287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:39.041098 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9a93e-615f-4517-8e19-f3767d62f287 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:39.041494 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9a93e-615f-4517-8e19-f3767d62f287 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:39.041791 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9a93e-615f-4517-8e19-f3767d62f287 None admin] PATH_INFO: `/v3/projects/3665952118af4106b09bd445a38d53e5` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:39.043107 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a9a93e-615f-4517-8e19-f3767d62f287 None admin] RBAC: Authorizing `identity:get_project(project_id=3665952118af4106b09bd445a38d53e5)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:39.044751 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a9a93e-615f-4517-8e19-f3767d62f287 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:39.046813 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 67/128] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:07:38 2022] GET /identity/v3/projects/3665952118af4106b09bd445a38d53e5 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:39.047489 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a9a93e-615f-4517-8e19-f3767d62f287 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:39.149817 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749fb3e6-39d7-4571-98ab-6f109ed7a205 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:39.233279 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b9379-5f08-419b-9161-a40505137629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:39.233898 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b9379-5f08-419b-9161-a40505137629 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:39.234220 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b9379-5f08-419b-9161-a40505137629 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:39.234513 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b9379-5f08-419b-9161-a40505137629 None admin] PATH_INFO: `/v3/roles` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:39.235707 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109b9379-5f08-419b-9161-a40505137629 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:07:39.235707 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109b9379-5f08-419b-9161-a40505137629 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:39.237111 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109b9379-5f08-419b-9161-a40505137629 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:39.246223 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 62/129] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:07:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:39.247095 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b9379-5f08-419b-9161-a40505137629 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:39.256347 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:39.263236 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:39.270352 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a9a93e-615f-4517-8e19-f3767d62f287 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:39.322338 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e74df-1460-47fc-a4df-e61b94647c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:39.324116 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e74df-1460-47fc-a4df-e61b94647c03 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:39.324777 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e74df-1460-47fc-a4df-e61b94647c03 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:39.325278 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e74df-1460-47fc-a4df-e61b94647c03 None admin] PATH_INFO: `/v3/roles` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:39.326288 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e74df-1460-47fc-a4df-e61b94647c03 None admin] RBAC: Adding query filter params (name=member) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:07:39.326804 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e74df-1460-47fc-a4df-e61b94647c03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:39.328417 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e74df-1460-47fc-a4df-e61b94647c03 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:39.343519 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 68/130] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:07:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:39.344688 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e74df-1460-47fc-a4df-e61b94647c03 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:39.374155 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b9379-5f08-419b-9161-a40505137629 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:39.401651 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd7342-568c-452c-adfe-21c888454696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:39.402584 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd7342-568c-452c-adfe-21c888454696 None admin] REQUEST_METHOD: `PUT` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:39.402879 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd7342-568c-452c-adfe-21c888454696 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:39.403165 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd7342-568c-452c-adfe-21c888454696 None admin] PATH_INFO: `/v3/projects/3665952118af4106b09bd445a38d53e5/users/f904c02f9f084df4917f5d2d38174f29/roles/f9389c8fc7a74300aed4cf6490fb672b` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:39.405934 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd7342-568c-452c-adfe-21c888454696 None admin] RBAC: Authorizing `identity:create_grant(project_id=3665952118af4106b09bd445a38d53e5, user_id=f904c02f9f084df4917f5d2d38174f29, role_id=f9389c8fc7a74300aed4cf6490fb672b)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:39.409881 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd7342-568c-452c-adfe-21c888454696 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:39.477246 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e74df-1460-47fc-a4df-e61b94647c03 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:39.504469 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 63/131] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:07:39 2022] PUT /identity/v3/projects/3665952118af4106b09bd445a38d53e5/users/f904c02f9f084df4917f5d2d38174f29/roles/f9389c8fc7a74300aed4cf6490fb672b => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:07:39.505054 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd7342-568c-452c-adfe-21c888454696 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:39.514798 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be8e6d-94a8-45c4-be37-a6e0448d48ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:39.516108 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be8e6d-94a8-45c4-be37-a6e0448d48ec None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:39.516628 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be8e6d-94a8-45c4-be37-a6e0448d48ec None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:39.517107 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be8e6d-94a8-45c4-be37-a6e0448d48ec None admin] PATH_INFO: `/v3/users/f904c02f9f084df4917f5d2d38174f29` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:39.518674 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64be8e6d-94a8-45c4-be37-a6e0448d48ec None admin] RBAC: Authorizing `identity:get_user(user_id=f904c02f9f084df4917f5d2d38174f29)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:39.520359 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64be8e6d-94a8-45c4-be37-a6e0448d48ec None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:39.522230 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 69/132] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:07:39 2022] GET /identity/v3/users/f904c02f9f084df4917f5d2d38174f29 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:39.529046 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be8e6d-94a8-45c4-be37-a6e0448d48ec None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:39.579173 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:39.691495 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:39.693309 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be8e6d-94a8-45c4-be37-a6e0448d48ec None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:39.735447 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd7342-568c-452c-adfe-21c888454696 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:39.774841 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0625ab64-550c-4cef-b246-6c86a2d7ffe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:39.776285 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625ab64-550c-4cef-b246-6c86a2d7ffe9 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:39.776669 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400b4911-fc77-4dff-8a1a-80e05bac8d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:39.776786 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625ab64-550c-4cef-b246-6c86a2d7ffe9 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:39.777216 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625ab64-550c-4cef-b246-6c86a2d7ffe9 None admin] PATH_INFO: `/v3/users/f904c02f9f084df4917f5d2d38174f29` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:39.778189 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b4911-fc77-4dff-8a1a-80e05bac8d2b None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:39.778523 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0625ab64-550c-4cef-b246-6c86a2d7ffe9 None admin] RBAC: Authorizing `identity:get_user(user_id=f904c02f9f084df4917f5d2d38174f29)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:39.778904 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b4911-fc77-4dff-8a1a-80e05bac8d2b None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:39.779385 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b4911-fc77-4dff-8a1a-80e05bac8d2b None admin] PATH_INFO: `/v3/projects/3665952118af4106b09bd445a38d53e5` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:39.780014 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0625ab64-550c-4cef-b246-6c86a2d7ffe9 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:39.781007 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400b4911-fc77-4dff-8a1a-80e05bac8d2b None admin] RBAC: Authorizing `identity:get_project(project_id=3665952118af4106b09bd445a38d53e5)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:39.781679 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 64/133] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:07:39 2022] GET /identity/v3/users/f904c02f9f084df4917f5d2d38174f29 => generated 275 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:39.786213 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3b32d-a6a7-4b24-b8d2-fba26cbad96b None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:39.786213 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3b32d-a6a7-4b24-b8d2-fba26cbad96b None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:39.786213 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3b32d-a6a7-4b24-b8d2-fba26cbad96b None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:39.786213 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 65/134] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:07:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:07:39.787595 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400b4911-fc77-4dff-8a1a-80e05bac8d2b None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:39.789606 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 70/135] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:07:39 2022] GET /identity/v3/projects/3665952118af4106b09bd445a38d53e5 => generated 298 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:07:39.789809 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3b32d-a6a7-4b24-b8d2-fba26cbad96b None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:39.791769 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73464631-e9bc-4086-aab7-b16f0e4c3496 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:39.792268 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73464631-e9bc-4086-aab7-b16f0e4c3496 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:39.792762 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73464631-e9bc-4086-aab7-b16f0e4c3496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:39.820530 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-73464631-e9bc-4086-aab7-b16f0e4c3496 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:07:39.822051 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-73464631-e9bc-4086-aab7-b16f0e4c3496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:07:39.918315 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3b32d-a6a7-4b24-b8d2-fba26cbad96b None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:39.955743 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2cd2bf-74d7-4594-978d-f14b538b0112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:39.956663 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cd2bf-74d7-4594-978d-f14b538b0112 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:39.956966 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cd2bf-74d7-4594-978d-f14b538b0112 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:39.957259 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cd2bf-74d7-4594-978d-f14b538b0112 None admin] PATH_INFO: `/v3/projects/6e317cb137cf47618e2ff86ba53ec2c4` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:39.958511 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2cd2bf-74d7-4594-978d-f14b538b0112 None admin] RBAC: Authorizing `identity:get_project(project_id=6e317cb137cf47618e2ff86ba53ec2c4)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:39.958820 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 71/136] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:07:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:07:39.960202 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73464631-e9bc-4086-aab7-b16f0e4c3496 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:39.965511 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2cd2bf-74d7-4594-978d-f14b538b0112 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:39.967303 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 66/137] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:07:39 2022] GET /identity/v3/projects/6e317cb137cf47618e2ff86ba53ec2c4 => generated 312 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:39.972863 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2cd2bf-74d7-4594-978d-f14b538b0112 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:40.000190 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:40.001203 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:40.101743 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2cd2bf-74d7-4594-978d-f14b538b0112 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:40.141474 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f094b8-60d9-4e45-ab15-6f511bd11655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:40.142793 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f094b8-60d9-4e45-ab15-6f511bd11655 None admin] REQUEST_METHOD: `PUT` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:40.143611 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f094b8-60d9-4e45-ab15-6f511bd11655 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:40.144145 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f094b8-60d9-4e45-ab15-6f511bd11655 None admin] PATH_INFO: `/v3/projects/6e317cb137cf47618e2ff86ba53ec2c4/users/f904c02f9f084df4917f5d2d38174f29/roles/f9389c8fc7a74300aed4cf6490fb672b` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:40.146342 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f094b8-60d9-4e45-ab15-6f511bd11655 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e317cb137cf47618e2ff86ba53ec2c4, user_id=f904c02f9f084df4917f5d2d38174f29, role_id=f9389c8fc7a74300aed4cf6490fb672b)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:40.148253 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f094b8-60d9-4e45-ab15-6f511bd11655 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:40.149782 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73464631-e9bc-4086-aab7-b16f0e4c3496 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:40.188506 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9fb99c-e88b-45a6-ba4a-086d5feacce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:40.189538 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9fb99c-e88b-45a6-ba4a-086d5feacce0 None admin] REQUEST_METHOD: `PUT` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:40.189895 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9fb99c-e88b-45a6-ba4a-086d5feacce0 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:40.190276 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9fb99c-e88b-45a6-ba4a-086d5feacce0 None admin] PATH_INFO: `/v3/projects/3665952118af4106b09bd445a38d53e5/users/f904c02f9f084df4917f5d2d38174f29/roles/49943dd485174ef39fdd0368de241417` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:40.192881 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9fb99c-e88b-45a6-ba4a-086d5feacce0 None admin] RBAC: Authorizing `identity:create_grant(project_id=3665952118af4106b09bd445a38d53e5, user_id=f904c02f9f084df4917f5d2d38174f29, role_id=49943dd485174ef39fdd0368de241417)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:40.197259 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9fb99c-e88b-45a6-ba4a-086d5feacce0 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:40.222777 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 67/138] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:07:39 2022] PUT /identity/v3/projects/6e317cb137cf47618e2ff86ba53ec2c4/users/f904c02f9f084df4917f5d2d38174f29/roles/f9389c8fc7a74300aed4cf6490fb672b => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:07:40.224424 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f094b8-60d9-4e45-ab15-6f511bd11655 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:40.303061 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 72/139] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:07:39 2022] PUT /identity/v3/projects/3665952118af4106b09bd445a38d53e5/users/f904c02f9f084df4917f5d2d38174f29/roles/49943dd485174ef39fdd0368de241417 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:07:40.318000 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca221908-d3db-40e5-a45f-2b2bff9e5cbd None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:40.318000 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca221908-d3db-40e5-a45f-2b2bff9e5cbd None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:40.318000 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca221908-d3db-40e5-a45f-2b2bff9e5cbd None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:40.318000 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 73/140] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:07:40.318000 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0415228-e580-448b-9d7e-cfd12e39bc51 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:40.318000 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0415228-e580-448b-9d7e-cfd12e39bc51 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:40.319578 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0415228-e580-448b-9d7e-cfd12e39bc51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:40.335229 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:40.361439 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-a0415228-e580-448b-9d7e-cfd12e39bc51 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:07:40.362643 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-a0415228-e580-448b-9d7e-cfd12e39bc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:07:40.430651 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f094b8-60d9-4e45-ab15-6f511bd11655 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:40.504222 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 74/141] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:07:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:07:40.516490 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7bc4d5-a607-4fe9-97ad-d68d8928bfb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:40.517357 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7bc4d5-a607-4fe9-97ad-d68d8928bfb8 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:40.517654 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7bc4d5-a607-4fe9-97ad-d68d8928bfb8 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:40.517945 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7bc4d5-a607-4fe9-97ad-d68d8928bfb8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:40.519434 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7bc4d5-a607-4fe9-97ad-d68d8928bfb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:40.521132 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7bc4d5-a607-4fe9-97ad-d68d8928bfb8 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:40.523228 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 68/142] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:07:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:40.529387 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0415228-e580-448b-9d7e-cfd12e39bc51 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:40.551010 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7bc4d5-a607-4fe9-97ad-d68d8928bfb8 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:40.557636 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:40.663216 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0415228-e580-448b-9d7e-cfd12e39bc51 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:40.710034 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c82193-cad5-404b-bc1b-5678d4d89c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:40.710755 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c82193-cad5-404b-bc1b-5678d4d89c03 None admin] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:40.711062 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c82193-cad5-404b-bc1b-5678d4d89c03 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:40.711349 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c82193-cad5-404b-bc1b-5678d4d89c03 None admin] PATH_INFO: `/v3/users` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:40.712089 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c82193-cad5-404b-bc1b-5678d4d89c03 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:40.713877 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c82193-cad5-404b-bc1b-5678d4d89c03 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:40.766572 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7bc4d5-a607-4fe9-97ad-d68d8928bfb8 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:40.803998 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:40.812059 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f486d-4e8a-4f7b-ac14-114a0007d3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:40.813147 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f486d-4e8a-4f7b-ac14-114a0007d3bf None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:40.813443 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f486d-4e8a-4f7b-ac14-114a0007d3bf None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:40.813735 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f486d-4e8a-4f7b-ac14-114a0007d3bf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:40.825236 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0f486d-4e8a-4f7b-ac14-114a0007d3bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:07:40.837633 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 75/143] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:07:40 2022] POST /identity/v3/users => generated 283 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:07:40.844843 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-8c0f486d-4e8a-4f7b-ac14-114a0007d3bf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:07:40.844843 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:07:40.844843 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:07:40.844843 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:07:40.844843 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:07:40.844843 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:07:40.844843 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:07:40.844843 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:07:40.844843 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:07:40.844843 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:07:40.844843 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:07:40.844843 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:07:40.844843 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:07:40.844843 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:07:40.844843 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:07:40.844843 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:07:40.845840 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:07:40.845840 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:07:40.845840 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:07:40.845840 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:07:40.845840 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:07:40.845840 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:07:40.845840 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:07:40.845840 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:07:40.845840 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:07:40.845840 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:07:40.845840 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:07:40.845840 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:07:40.845840 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:07:40.845840 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:07:40.845840 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:07:40.845840 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:07:40.846794 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:07:40.846794 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:07:40.846794 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:07:40.846794 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:07:40.846794 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:07:40.846794 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:07:40.846794 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:07:40.846794 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:07:40.846794 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:07:40.846794 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:07:40.846794 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:07:40.846794 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:07:40.852561 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 69/144] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:07:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:07:40.853605 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c82193-cad5-404b-bc1b-5678d4d89c03 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:40.980289 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:41.022948 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c82193-cad5-404b-bc1b-5678d4d89c03 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:41.071439 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e326b72-5415-4ab0-abb0-fb75a9c9c5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:41.072140 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e326b72-5415-4ab0-abb0-fb75a9c9c5e3 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:41.072434 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e326b72-5415-4ab0-abb0-fb75a9c9c5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:41.072875 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e326b72-5415-4ab0-abb0-fb75a9c9c5e3 None admin] PATH_INFO: `/v3/roles` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:41.073871 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e326b72-5415-4ab0-abb0-fb75a9c9c5e3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:07:41.074222 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e326b72-5415-4ab0-abb0-fb75a9c9c5e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:41.075664 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e326b72-5415-4ab0-abb0-fb75a9c9c5e3 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:41.087668 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 76/145] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:07:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:41.093962 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f486d-4e8a-4f7b-ac14-114a0007d3bf None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:41.212780 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f486d-4e8a-4f7b-ac14-114a0007d3bf None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:41.253691 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4478fd-497d-42bd-a7a1-84dea033a7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:41.254544 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4478fd-497d-42bd-a7a1-84dea033a7f5 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:41.254846 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4478fd-497d-42bd-a7a1-84dea033a7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:41.255150 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4478fd-497d-42bd-a7a1-84dea033a7f5 None admin] PATH_INFO: `/v3/users/d1a731c426ef4a1a99e014fe9c1895d2` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:41.256381 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4478fd-497d-42bd-a7a1-84dea033a7f5 None admin] RBAC: Authorizing `identity:get_user(user_id=d1a731c426ef4a1a99e014fe9c1895d2)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:41.257864 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4478fd-497d-42bd-a7a1-84dea033a7f5 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:41.259533 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 70/146] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:07:41 2022] GET /identity/v3/users/d1a731c426ef4a1a99e014fe9c1895d2 => generated 289 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:41.265179 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e326b72-5415-4ab0-abb0-fb75a9c9c5e3 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:41.398694 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e326b72-5415-4ab0-abb0-fb75a9c9c5e3 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:41.439783 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:41.446787 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06cc21b-6d53-4372-9435-695ab1eadf54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:41.448258 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06cc21b-6d53-4372-9435-695ab1eadf54 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:41.449067 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06cc21b-6d53-4372-9435-695ab1eadf54 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:41.449067 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06cc21b-6d53-4372-9435-695ab1eadf54 None admin] PATH_INFO: `/v3/projects/3665952118af4106b09bd445a38d53e5` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:41.454901 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06cc21b-6d53-4372-9435-695ab1eadf54 None admin] RBAC: Authorizing `identity:get_project(project_id=3665952118af4106b09bd445a38d53e5)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:41.456404 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06cc21b-6d53-4372-9435-695ab1eadf54 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:41.458509 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 77/147] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:07:41 2022] GET /identity/v3/projects/3665952118af4106b09bd445a38d53e5 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:41.467205 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4478fd-497d-42bd-a7a1-84dea033a7f5 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:41.570573 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:41.641026 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4478fd-497d-42bd-a7a1-84dea033a7f5 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:41.701395 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fdc2d2-ef48-4d2d-b2d1-b015bf28190c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:41.702715 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdc2d2-ef48-4d2d-b2d1-b015bf28190c None admin] REQUEST_METHOD: `PUT` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:41.703216 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdc2d2-ef48-4d2d-b2d1-b015bf28190c None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:41.703711 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdc2d2-ef48-4d2d-b2d1-b015bf28190c None admin] PATH_INFO: `/v3/projects/3665952118af4106b09bd445a38d53e5/users/d1a731c426ef4a1a99e014fe9c1895d2/roles/e8b0e7643206483385c49640e21e33d7` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:41.711554 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fdc2d2-ef48-4d2d-b2d1-b015bf28190c None admin] RBAC: Authorizing `identity:create_grant(project_id=3665952118af4106b09bd445a38d53e5, user_id=d1a731c426ef4a1a99e014fe9c1895d2, role_id=e8b0e7643206483385c49640e21e33d7)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:41.713953 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fdc2d2-ef48-4d2d-b2d1-b015bf28190c None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:41.796674 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 71/148] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:07:41 2022] PUT /identity/v3/projects/3665952118af4106b09bd445a38d53e5/users/d1a731c426ef4a1a99e014fe9c1895d2/roles/e8b0e7643206483385c49640e21e33d7 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:07:41.928056 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98db254-c8ce-46e4-9fcd-949d85346040 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:41.928355 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98db254-c8ce-46e4-9fcd-949d85346040 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:41.928556 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98db254-c8ce-46e4-9fcd-949d85346040 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:41.930034 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 78/149] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:07:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:07:41.942327 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b75fa-0939-45c2-a38e-2a3ad7f00eec None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:41.942986 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b75fa-0939-45c2-a38e-2a3ad7f00eec None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:41.943472 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b75fa-0939-45c2-a38e-2a3ad7f00eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:41.971340 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-a55b75fa-0939-45c2-a38e-2a3ad7f00eec None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:07:41.972954 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-a55b75fa-0939-45c2-a38e-2a3ad7f00eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:07:42.036774 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0fdaf-f42c-409d-8c8c-51db3703a80b None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:42.037737 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0fdaf-f42c-409d-8c8c-51db3703a80b None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:42.038252 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0fdaf-f42c-409d-8c8c-51db3703a80b None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:42.039876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 79/150] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:07:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:07:42.045751 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c06b6f-6e8d-4152-be5f-32daf339a9e1 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:42.046350 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c06b6f-6e8d-4152-be5f-32daf339a9e1 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:42.046865 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c06b6f-6e8d-4152-be5f-32daf339a9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:42.078940 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-40c06b6f-6e8d-4152-be5f-32daf339a9e1 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:07:42.080525 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-40c06b6f-6e8d-4152-be5f-32daf339a9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:07:42.096596 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 72/151] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:07:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:07:42.166989 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b75fa-0939-45c2-a38e-2a3ad7f00eec None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:42.179220 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 80/152] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:07:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:07:42.214983 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c06b6f-6e8d-4152-be5f-32daf339a9e1 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:42.251622 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:42.347924 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b75fa-0939-45c2-a38e-2a3ad7f00eec None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:42.412907 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c06b6f-6e8d-4152-be5f-32daf339a9e1 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:42.425588 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a506b5-f40f-45cc-85a4-93b8aef64de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:42.426439 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a506b5-f40f-45cc-85a4-93b8aef64de1 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:42.426728 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a506b5-f40f-45cc-85a4-93b8aef64de1 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:42.427007 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a506b5-f40f-45cc-85a4-93b8aef64de1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:42.447077 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a506b5-f40f-45cc-85a4-93b8aef64de1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:07:42.459546 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-b6a506b5-f40f-45cc-85a4-93b8aef64de1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:07:42.459546 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:07:42.459546 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:07:42.459546 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:07:42.459546 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:07:42.459546 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:07:42.459546 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:07:42.459546 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:07:42.459546 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:07:42.459546 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:07:42.459546 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:07:42.459546 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:07:42.459546 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:07:42.459546 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:07:42.459546 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:07:42.459546 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:07:42.460453 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:07:42.460453 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:07:42.460453 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:07:42.460453 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:07:42.460453 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:07:42.460453 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:07:42.460453 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:07:42.460453 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:07:42.460453 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:07:42.460453 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:07:42.460453 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:07:42.460453 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:07:42.460453 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:07:42.460453 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:07:42.460453 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:07:42.460453 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:07:42.461810 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:07:42.461810 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:07:42.461810 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:07:42.461810 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:07:42.461810 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:07:42.461810 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:07:42.461810 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:07:42.461810 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:07:42.461810 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:07:42.461810 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:07:42.461810 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:07:42.461810 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:07:42.461810 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 73/153] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:07:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:07:42.468504 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a506b5-f40f-45cc-85a4-93b8aef64de1 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:42.495982 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:42.526982 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0191a7d2-408c-4cf8-86d0-584e135f63f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:42.527901 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191a7d2-408c-4cf8-86d0-584e135f63f8 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:42.528196 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191a7d2-408c-4cf8-86d0-584e135f63f8 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:42.528483 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191a7d2-408c-4cf8-86d0-584e135f63f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:42.551175 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0191a7d2-408c-4cf8-86d0-584e135f63f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:07:42.560065 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-0191a7d2-408c-4cf8-86d0-584e135f63f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:07:42.560065 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:07:42.560065 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:07:42.560065 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:07:42.560065 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:07:42.560065 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:07:42.560065 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:07:42.560065 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:07:42.560065 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:07:42.560065 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:07:42.560065 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:07:42.560065 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:07:42.560065 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:07:42.560065 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:07:42.560065 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:07:42.560065 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:07:42.562882 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:07:42.562882 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:07:42.562882 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:07:42.562882 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:07:42.562882 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:07:42.562882 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:07:42.562882 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:07:42.562882 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:07:42.562882 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:07:42.562882 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:07:42.562882 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:07:42.562882 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:07:42.562882 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:07:42.562882 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:07:42.562882 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:07:42.562882 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:07:42.564888 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:07:42.564888 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:07:42.564888 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:07:42.564888 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:07:42.564888 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:07:42.564888 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:07:42.564888 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:07:42.564888 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:07:42.564888 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:07:42.564888 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:07:42.564888 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:07:42.564888 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:07:42.564888 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 81/154] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:07:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:07:42.572437 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0191a7d2-408c-4cf8-86d0-584e135f63f8 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:42.669358 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a506b5-f40f-45cc-85a4-93b8aef64de1 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:42.685230 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:42.724344 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f06c3dd-dbe0-433a-a6b1-8679898ad443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:42.725413 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06c3dd-dbe0-433a-a6b1-8679898ad443 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:42.725974 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06c3dd-dbe0-433a-a6b1-8679898ad443 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:42.726282 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06c3dd-dbe0-433a-a6b1-8679898ad443 None admin] PATH_INFO: `/v3/roles` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:42.727309 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f06c3dd-dbe0-433a-a6b1-8679898ad443 None admin] RBAC: Adding query filter params (name=admin) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:07:42.728029 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f06c3dd-dbe0-433a-a6b1-8679898ad443 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:42.730565 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f06c3dd-dbe0-433a-a6b1-8679898ad443 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:42.745942 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 74/155] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:07:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:07:42.751784 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f06c3dd-dbe0-433a-a6b1-8679898ad443 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:42.808654 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0191a7d2-408c-4cf8-86d0-584e135f63f8 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:42.886534 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c6b39-8d02-4b57-b264-491746d6a976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:42.887220 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c6b39-8d02-4b57-b264-491746d6a976 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:42.887507 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c6b39-8d02-4b57-b264-491746d6a976 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:42.887787 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c6b39-8d02-4b57-b264-491746d6a976 None admin] PATH_INFO: `/v3/roles` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:42.888546 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c6b39-8d02-4b57-b264-491746d6a976 None admin] RBAC: Adding query filter params (name=member) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:07:42.888857 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c6b39-8d02-4b57-b264-491746d6a976 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:42.890286 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c6b39-8d02-4b57-b264-491746d6a976 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:42.899895 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 82/156] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:07:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:07:42.905383 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c6b39-8d02-4b57-b264-491746d6a976 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:42.914602 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f06c3dd-dbe0-433a-a6b1-8679898ad443 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:42.990243 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:43.001798 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba862a-8f33-4f75-9a89-510ee5fe7ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:43.002777 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba862a-8f33-4f75-9a89-510ee5fe7ba3 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:43.003068 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba862a-8f33-4f75-9a89-510ee5fe7ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:43.003353 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba862a-8f33-4f75-9a89-510ee5fe7ba3 None admin] PATH_INFO: `/v3/users/c3b4b48661074142b14910bc96e359ec` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:43.004816 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ba862a-8f33-4f75-9a89-510ee5fe7ba3 None admin] RBAC: Authorizing `identity:get_user(user_id=c3b4b48661074142b14910bc96e359ec)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:43.010584 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ba862a-8f33-4f75-9a89-510ee5fe7ba3 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:43.010584 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 75/157] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:07:42 2022] GET /identity/v3/users/c3b4b48661074142b14910bc96e359ec => generated 247 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:43.030122 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba862a-8f33-4f75-9a89-510ee5fe7ba3 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:43.054443 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c6b39-8d02-4b57-b264-491746d6a976 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:43.094693 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b6bc58-c0a1-4925-8709-9e8489e26c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:43.095951 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6bc58-c0a1-4925-8709-9e8489e26c3d None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:43.096438 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6bc58-c0a1-4925-8709-9e8489e26c3d None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:43.096916 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6bc58-c0a1-4925-8709-9e8489e26c3d None admin] PATH_INFO: `/v3/users/f904c02f9f084df4917f5d2d38174f29` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:43.098373 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b6bc58-c0a1-4925-8709-9e8489e26c3d None admin] RBAC: Authorizing `identity:get_user(user_id=f904c02f9f084df4917f5d2d38174f29)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:43.100047 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b6bc58-c0a1-4925-8709-9e8489e26c3d None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:43.102053 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 83/158] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:07:42 2022] GET /identity/v3/users/f904c02f9f084df4917f5d2d38174f29 => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:43.108359 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:43.108669 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b6bc58-c0a1-4925-8709-9e8489e26c3d None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:43.192595 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba862a-8f33-4f75-9a89-510ee5fe7ba3 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:43.227882 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e155a7-0b5c-456f-92ff-2d8e05e15ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:43.228598 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e155a7-0b5c-456f-92ff-2d8e05e15ddc None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:43.229411 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e155a7-0b5c-456f-92ff-2d8e05e15ddc None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:43.230048 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e155a7-0b5c-456f-92ff-2d8e05e15ddc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:43.233084 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b6bc58-c0a1-4925-8709-9e8489e26c3d None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:43.256445 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:43.284055 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e9a1c-defe-43a8-b9b6-05ab1cbd6d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:43.284880 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e9a1c-defe-43a8-b9b6-05ab1cbd6d3d None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:43.290519 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e9a1c-defe-43a8-b9b6-05ab1cbd6d3d None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:43.290925 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e9a1c-defe-43a8-b9b6-05ab1cbd6d3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:43.304145 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e155a7-0b5c-456f-92ff-2d8e05e15ddc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:43.305946 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e155a7-0b5c-456f-92ff-2d8e05e15ddc None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:43.350505 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:43.412696 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e9a1c-defe-43a8-b9b6-05ab1cbd6d3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:43.413218 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 76/159] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:07:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:07:43.418153 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e9a1c-defe-43a8-b9b6-05ab1cbd6d3d None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:43.422915 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e155a7-0b5c-456f-92ff-2d8e05e15ddc None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:43.536534 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e155a7-0b5c-456f-92ff-2d8e05e15ddc None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:43.570160 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 84/160] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:07:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:07:43.571569 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2c433-e8c6-48e8-9de6-fa09806404da None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:43.571866 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2c433-e8c6-48e8-9de6-fa09806404da None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:43.572151 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2c433-e8c6-48e8-9de6-fa09806404da None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:43.574201 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 85/161] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:07:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:07:43.583824 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7a0e9-cd8a-4f7e-9103-86272a56f6dd None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:43.584119 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7a0e9-cd8a-4f7e-9103-86272a56f6dd None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:43.584407 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7a0e9-cd8a-4f7e-9103-86272a56f6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:43.597841 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878f9dc-cad9-452b-91b7-9b119144f6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:43.598790 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878f9dc-cad9-452b-91b7-9b119144f6c4 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:43.599079 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878f9dc-cad9-452b-91b7-9b119144f6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:43.599359 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878f9dc-cad9-452b-91b7-9b119144f6c4 None admin] PATH_INFO: `/v3/projects/3665952118af4106b09bd445a38d53e5` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:43.602863 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1878f9dc-cad9-452b-91b7-9b119144f6c4 None admin] RBAC: Authorizing `identity:get_project(project_id=3665952118af4106b09bd445a38d53e5)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:43.604936 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1878f9dc-cad9-452b-91b7-9b119144f6c4 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:43.607225 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 77/162] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:07:43 2022] GET /identity/v3/projects/3665952118af4106b09bd445a38d53e5 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:07:43.608190 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878f9dc-cad9-452b-91b7-9b119144f6c4 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:43.617088 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-1ac7a0e9-cd8a-4f7e-9103-86272a56f6dd None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:07:43.617604 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-1ac7a0e9-cd8a-4f7e-9103-86272a56f6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:07:43.622857 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:43.643404 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:43.711546 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 86/163] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:07:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:07:43.712234 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac7a0e9-cd8a-4f7e-9103-86272a56f6dd None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:43.825319 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878f9dc-cad9-452b-91b7-9b119144f6c4 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:43.854347 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac7a0e9-cd8a-4f7e-9103-86272a56f6dd None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:43.910479 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec9808-788f-49ab-90c8-7b4b6667b861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:43.911357 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec9808-788f-49ab-90c8-7b4b6667b861 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:43.911654 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec9808-788f-49ab-90c8-7b4b6667b861 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:43.911938 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec9808-788f-49ab-90c8-7b4b6667b861 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:43.912789 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec9808-788f-49ab-90c8-7b4b6667b861 None admin] RBAC: Adding query filter params (role.id=101b93f94624407f8c812ab86ebec32a, scope.project.id=3665952118af4106b09bd445a38d53e5, user.id=c3b4b48661074142b14910bc96e359ec) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:07:43.913106 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec9808-788f-49ab-90c8-7b4b6667b861 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:43.914695 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec9808-788f-49ab-90c8-7b4b6667b861 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:43.919416 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca60f300-6fb0-4679-b2ee-7f9f736558fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:43.920392 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60f300-6fb0-4679-b2ee-7f9f736558fe None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:43.920686 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60f300-6fb0-4679-b2ee-7f9f736558fe None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:43.920967 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60f300-6fb0-4679-b2ee-7f9f736558fe None admin] PATH_INFO: `/v3/projects/3665952118af4106b09bd445a38d53e5` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:43.921145 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 87/164] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:07:43 2022] GET /identity/v3/role_assignments?user.id=c3b4b48661074142b14910bc96e359ec&scope.project.id=3665952118af4106b09bd445a38d53e5&role.id=101b93f94624407f8c812ab86ebec32a => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:43.926981 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec9808-788f-49ab-90c8-7b4b6667b861 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:43.931124 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca60f300-6fb0-4679-b2ee-7f9f736558fe None admin] RBAC: Authorizing `identity:get_project(project_id=3665952118af4106b09bd445a38d53e5)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:43.932722 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca60f300-6fb0-4679-b2ee-7f9f736558fe None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:43.935028 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 78/165] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:07:43 2022] GET /identity/v3/projects/3665952118af4106b09bd445a38d53e5 => generated 298 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:43.942456 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca60f300-6fb0-4679-b2ee-7f9f736558fe None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:43.949650 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:44.070033 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:44.087810 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec9808-788f-49ab-90c8-7b4b6667b861 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:44.115806 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca60f300-6fb0-4679-b2ee-7f9f736558fe None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:44.144641 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a76e3d-6bb8-4215-9ff0-58c213f98ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:44.151642 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a76e3d-6bb8-4215-9ff0-58c213f98ef1 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:44.151972 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a76e3d-6bb8-4215-9ff0-58c213f98ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:44.152288 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a76e3d-6bb8-4215-9ff0-58c213f98ef1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:44.167919 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a76e3d-6bb8-4215-9ff0-58c213f98ef1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:07:44.176639 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-b1a76e3d-6bb8-4215-9ff0-58c213f98ef1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:07:44.176639 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:07:44.176639 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:07:44.176639 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:07:44.176639 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:07:44.176639 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:07:44.176639 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:07:44.176639 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:07:44.176639 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:07:44.176639 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:07:44.176639 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:07:44.176639 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:07:44.176639 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:07:44.176639 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:07:44.176639 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:07:44.176639 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:07:44.177591 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:07:44.177591 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:07:44.177591 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:07:44.177591 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:07:44.177591 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:07:44.177591 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:07:44.177591 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:07:44.177591 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:07:44.177591 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:07:44.177591 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:07:44.177591 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:07:44.177591 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:07:44.177591 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:07:44.177591 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:07:44.177591 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:07:44.177591 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:07:44.178608 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:07:44.178608 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:07:44.178608 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:07:44.178608 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:07:44.178608 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:07:44.178608 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:07:44.178608 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:07:44.178608 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:07:44.178608 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:07:44.178608 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:07:44.178608 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:07:44.178608 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:07:44.179209 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86685aac-1885-41c0-9ddc-09ef69e680d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:44.179802 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86685aac-1885-41c0-9ddc-09ef69e680d1 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:44.179802 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86685aac-1885-41c0-9ddc-09ef69e680d1 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:44.179949 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86685aac-1885-41c0-9ddc-09ef69e680d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:44.180744 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86685aac-1885-41c0-9ddc-09ef69e680d1 None admin] RBAC: Adding query filter params (role.id=f9389c8fc7a74300aed4cf6490fb672b, scope.project.id=3665952118af4106b09bd445a38d53e5, user.id=f904c02f9f084df4917f5d2d38174f29) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:07:44.181070 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86685aac-1885-41c0-9ddc-09ef69e680d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:44.182597 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 88/166] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:07:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:07:44.183643 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86685aac-1885-41c0-9ddc-09ef69e680d1 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:44.195543 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 79/167] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:07:43 2022] GET /identity/v3/role_assignments?user.id=f904c02f9f084df4917f5d2d38174f29&scope.project.id=3665952118af4106b09bd445a38d53e5&role.id=f9389c8fc7a74300aed4cf6490fb672b => generated 608 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:44.196729 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a76e3d-6bb8-4215-9ff0-58c213f98ef1 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:44.352810 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:44.401135 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a76e3d-6bb8-4215-9ff0-58c213f98ef1 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:44.405875 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf5f0a-d890-4922-8966-8555d2340134 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:44.406381 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf5f0a-d890-4922-8966-8555d2340134 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:44.406464 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf5f0a-d890-4922-8966-8555d2340134 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:44.407852 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 80/168] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:07:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:07:44.418900 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce781bd2-00d7-4935-89df-5c6d26f77362 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:44.419187 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce781bd2-00d7-4935-89df-5c6d26f77362 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:44.419474 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce781bd2-00d7-4935-89df-5c6d26f77362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:44.454156 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-ce781bd2-00d7-4935-89df-5c6d26f77362 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:07:44.455395 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-ce781bd2-00d7-4935-89df-5c6d26f77362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:07:44.459020 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece81f14-a5f8-4d60-ae3c-4a31b5ab9bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:44.459710 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece81f14-a5f8-4d60-ae3c-4a31b5ab9bf7 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:44.459994 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece81f14-a5f8-4d60-ae3c-4a31b5ab9bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:44.460321 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece81f14-a5f8-4d60-ae3c-4a31b5ab9bf7 None admin] PATH_INFO: `/v3/roles` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:44.461083 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece81f14-a5f8-4d60-ae3c-4a31b5ab9bf7 None admin] RBAC: Adding query filter params (name=member) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:07:44.461394 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece81f14-a5f8-4d60-ae3c-4a31b5ab9bf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:44.462822 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece81f14-a5f8-4d60-ae3c-4a31b5ab9bf7 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:44.480933 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 89/169] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:07:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:44.487124 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece81f14-a5f8-4d60-ae3c-4a31b5ab9bf7 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:44.605980 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 81/170] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:07:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:07:44.667238 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece81f14-a5f8-4d60-ae3c-4a31b5ab9bf7 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:44.690097 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce781bd2-00d7-4935-89df-5c6d26f77362 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:44.732805 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae7a5e-34cd-4b1f-8dd0-88a7159336c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:44.733692 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae7a5e-34cd-4b1f-8dd0-88a7159336c6 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:44.733981 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae7a5e-34cd-4b1f-8dd0-88a7159336c6 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:44.734300 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae7a5e-34cd-4b1f-8dd0-88a7159336c6 None admin] PATH_INFO: `/v3/users/f904c02f9f084df4917f5d2d38174f29` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:44.735662 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae7a5e-34cd-4b1f-8dd0-88a7159336c6 None admin] RBAC: Authorizing `identity:get_user(user_id=f904c02f9f084df4917f5d2d38174f29)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:44.738303 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae7a5e-34cd-4b1f-8dd0-88a7159336c6 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:44.739950 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 90/171] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:07:44 2022] GET /identity/v3/users/f904c02f9f084df4917f5d2d38174f29 => generated 275 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:07:44.747509 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae7a5e-34cd-4b1f-8dd0-88a7159336c6 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:44.754469 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:44.811128 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:44.858630 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce781bd2-00d7-4935-89df-5c6d26f77362 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:44.907657 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598c70c-8504-44d8-9a70-2b1c5d9898ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:44.908481 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598c70c-8504-44d8-9a70-2b1c5d9898ab None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:44.908763 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598c70c-8504-44d8-9a70-2b1c5d9898ab None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:44.909042 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598c70c-8504-44d8-9a70-2b1c5d9898ab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:44.909626 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae7a5e-34cd-4b1f-8dd0-88a7159336c6 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:44.925963 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8598c70c-8504-44d8-9a70-2b1c5d9898ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:07:44.935378 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-8598c70c-8504-44d8-9a70-2b1c5d9898ab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:07:44.935378 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:07:44.935378 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:07:44.935378 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:07:44.935378 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:07:44.935378 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:07:44.935378 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:07:44.935378 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:07:44.935378 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:07:44.935378 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:07:44.935378 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:07:44.935378 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:07:44.935378 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:07:44.935378 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:07:44.935378 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:07:44.935378 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:07:44.936299 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:07:44.936299 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:07:44.936299 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:07:44.936299 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:07:44.936299 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:07:44.936299 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:07:44.936299 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:07:44.936299 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:07:44.936299 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:07:44.936299 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:07:44.936299 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:07:44.936299 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:07:44.936299 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:07:44.936299 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:07:44.936299 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:07:44.936299 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:07:44.937782 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:07:44.937782 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:07:44.937782 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:07:44.937782 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:07:44.937782 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:07:44.937782 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:07:44.937782 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:07:44.937782 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:07:44.937782 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:07:44.937782 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:07:44.937782 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:07:44.937782 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:07:44.937782 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 82/172] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:07:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:07:44.942834 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598c70c-8504-44d8-9a70-2b1c5d9898ab None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:44.947183 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d717b054-1e1d-4326-96d0-7b717e3a3af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:44.948006 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717b054-1e1d-4326-96d0-7b717e3a3af9 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:44.948728 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717b054-1e1d-4326-96d0-7b717e3a3af9 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:44.948728 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717b054-1e1d-4326-96d0-7b717e3a3af9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:45.027303 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d717b054-1e1d-4326-96d0-7b717e3a3af9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:45.028798 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d717b054-1e1d-4326-96d0-7b717e3a3af9 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:45.030786 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:45.112690 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598c70c-8504-44d8-9a70-2b1c5d9898ab None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:45.144237 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:45.158410 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176045e-1948-4174-8afd-83609910a592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:45.159560 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176045e-1948-4174-8afd-83609910a592 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:45.160049 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176045e-1948-4174-8afd-83609910a592 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:45.160544 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176045e-1948-4174-8afd-83609910a592 None admin] PATH_INFO: `/v3/roles` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:45.161508 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3176045e-1948-4174-8afd-83609910a592 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:07:45.162036 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3176045e-1948-4174-8afd-83609910a592 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:45.163681 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3176045e-1948-4174-8afd-83609910a592 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:45.175294 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 83/173] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:07:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:45.180426 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176045e-1948-4174-8afd-83609910a592 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:45.202816 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 91/174] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:07:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:07:45.209663 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d717b054-1e1d-4326-96d0-7b717e3a3af9 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:45.332366 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d717b054-1e1d-4326-96d0-7b717e3a3af9 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:45.333914 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:45.355969 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176045e-1948-4174-8afd-83609910a592 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:45.399216 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9fe55-715d-44b6-8c9e-d2cc9d378062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:45.400017 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9fe55-715d-44b6-8c9e-d2cc9d378062 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:45.400303 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9fe55-715d-44b6-8c9e-d2cc9d378062 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:45.400579 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9fe55-715d-44b6-8c9e-d2cc9d378062 None admin] PATH_INFO: `/v3/projects/6e317cb137cf47618e2ff86ba53ec2c4` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:45.402543 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9fe55-715d-44b6-8c9e-d2cc9d378062 None admin] RBAC: Authorizing `identity:get_project(project_id=6e317cb137cf47618e2ff86ba53ec2c4)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:45.404009 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9fe55-715d-44b6-8c9e-d2cc9d378062 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:45.405717 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 92/175] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:07:45 2022] GET /identity/v3/projects/6e317cb137cf47618e2ff86ba53ec2c4 => generated 312 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:07:45.412673 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9fe55-715d-44b6-8c9e-d2cc9d378062 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:45.423912 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b9cb6-bdfe-4050-8f67-f1fedb3be1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:45.424808 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b9cb6-bdfe-4050-8f67-f1fedb3be1d1 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:45.425092 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b9cb6-bdfe-4050-8f67-f1fedb3be1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:45.425370 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b9cb6-bdfe-4050-8f67-f1fedb3be1d1 None admin] PATH_INFO: `/v3/users/f904c02f9f084df4917f5d2d38174f29` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:45.426643 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b9cb6-bdfe-4050-8f67-f1fedb3be1d1 None admin] RBAC: Authorizing `identity:get_user(user_id=f904c02f9f084df4917f5d2d38174f29)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:45.428087 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b9cb6-bdfe-4050-8f67-f1fedb3be1d1 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:45.429768 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 84/176] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:07:45 2022] GET /identity/v3/users/f904c02f9f084df4917f5d2d38174f29 => generated 275 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:07:45.435160 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b9cb6-bdfe-4050-8f67-f1fedb3be1d1 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:45.571541 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:45.639635 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9fe55-715d-44b6-8c9e-d2cc9d378062 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:45.653316 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b9cb6-bdfe-4050-8f67-f1fedb3be1d1 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:45.690463 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd0ff6f-7d1f-4a51-82f1-38c5f9bb9e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:45.691281 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0ff6f-7d1f-4a51-82f1-38c5f9bb9e86 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:45.691582 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0ff6f-7d1f-4a51-82f1-38c5f9bb9e86 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:45.691866 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0ff6f-7d1f-4a51-82f1-38c5f9bb9e86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:45.754115 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace732b-2ac9-4ce5-baae-7b9b4d1283dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:45.755106 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace732b-2ac9-4ce5-baae-7b9b4d1283dd None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:45.755402 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace732b-2ac9-4ce5-baae-7b9b4d1283dd None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:45.755697 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace732b-2ac9-4ce5-baae-7b9b4d1283dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:45.757035 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cace732b-2ac9-4ce5-baae-7b9b4d1283dd None admin] RBAC: Adding query filter params (role.id=f9389c8fc7a74300aed4cf6490fb672b, scope.project.id=6e317cb137cf47618e2ff86ba53ec2c4, user.id=f904c02f9f084df4917f5d2d38174f29) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:07:45.757366 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cace732b-2ac9-4ce5-baae-7b9b4d1283dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:45.759348 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cace732b-2ac9-4ce5-baae-7b9b4d1283dd None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:45.767381 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd0ff6f-7d1f-4a51-82f1-38c5f9bb9e86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:45.769025 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd0ff6f-7d1f-4a51-82f1-38c5f9bb9e86 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:45.774480 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 93/177] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:07:45 2022] GET /identity/v3/role_assignments?user.id=f904c02f9f084df4917f5d2d38174f29&scope.project.id=6e317cb137cf47618e2ff86ba53ec2c4&role.id=f9389c8fc7a74300aed4cf6490fb672b => generated 608 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:45.777084 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f9a0d-ba6d-47bc-9dfe-5b8c327da955 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:45.777390 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f9a0d-ba6d-47bc-9dfe-5b8c327da955 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:45.777676 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f9a0d-ba6d-47bc-9dfe-5b8c327da955 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:45.779125 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 94/178] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:07:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:07:45.780351 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3935635-e190-4356-958c-a8b72b9152a9 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:45.780643 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3935635-e190-4356-958c-a8b72b9152a9 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:45.780929 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3935635-e190-4356-958c-a8b72b9152a9 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:45.782557 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 95/179] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:07:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:07:45.788619 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905aca4c-ab4d-4b4d-8da2-ae7dfeeb5f7a None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:45.788919 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905aca4c-ab4d-4b4d-8da2-ae7dfeeb5f7a None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:45.789202 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905aca4c-ab4d-4b4d-8da2-ae7dfeeb5f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:45.808627 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-905aca4c-ab4d-4b4d-8da2-ae7dfeeb5f7a None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:07:45.810561 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-905aca4c-ab4d-4b4d-8da2-ae7dfeeb5f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:07:45.874539 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:45.910603 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:45.950101 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 96/180] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:07:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:07:45.951631 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af4dc9-2b3c-4556-8c92-e2a43bcc58f3 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:45.951931 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af4dc9-2b3c-4556-8c92-e2a43bcc58f3 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:45.952214 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af4dc9-2b3c-4556-8c92-e2a43bcc58f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:45.969374 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-e7af4dc9-2b3c-4556-8c92-e2a43bcc58f3 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:07:45.970639 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-e7af4dc9-2b3c-4556-8c92-e2a43bcc58f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:07:45.988886 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 85/181] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:07:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 21:07:45.999175 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd0ff6f-7d1f-4a51-82f1-38c5f9bb9e86 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:46.045231 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 97/182] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:07:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:07:46.046106 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af4dc9-2b3c-4556-8c92-e2a43bcc58f3 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:46.126473 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd0ff6f-7d1f-4a51-82f1-38c5f9bb9e86 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:46.169372 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3a8df-ab1d-4989-87c5-45a7f810a34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:46.170653 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3a8df-ab1d-4989-87c5-45a7f810a34f None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:46.170955 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3a8df-ab1d-4989-87c5-45a7f810a34f None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:46.171240 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3a8df-ab1d-4989-87c5-45a7f810a34f None admin] PATH_INFO: `/v3/projects/3665952118af4106b09bd445a38d53e5` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:46.172764 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f3a8df-ab1d-4989-87c5-45a7f810a34f None admin] RBAC: Authorizing `identity:get_project(project_id=3665952118af4106b09bd445a38d53e5)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:46.174272 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f3a8df-ab1d-4989-87c5-45a7f810a34f None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:46.177240 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 86/183] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:07:45 2022] GET /identity/v3/projects/3665952118af4106b09bd445a38d53e5 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:46.177691 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:46.178209 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3a8df-ab1d-4989-87c5-45a7f810a34f None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:46.186061 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af4dc9-2b3c-4556-8c92-e2a43bcc58f3 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:46.212339 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:46.230926 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf386d-c0f8-4632-8999-c193b87fb60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:46.232010 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf386d-c0f8-4632-8999-c193b87fb60d None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:46.232300 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf386d-c0f8-4632-8999-c193b87fb60d None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:46.232735 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf386d-c0f8-4632-8999-c193b87fb60d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:46.247074 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf386d-c0f8-4632-8999-c193b87fb60d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:07:46.256953 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-cbaf386d-c0f8-4632-8999-c193b87fb60d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:07:46.256953 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:07:46.256953 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:07:46.256953 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:07:46.256953 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:07:46.256953 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:07:46.256953 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:07:46.256953 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:07:46.256953 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:07:46.256953 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:07:46.256953 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:07:46.256953 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:07:46.256953 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:07:46.256953 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:07:46.256953 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:07:46.256953 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:07:46.257823 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:07:46.257823 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:07:46.257823 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:07:46.257823 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:07:46.257823 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:07:46.257823 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:07:46.257823 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:07:46.257823 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:07:46.257823 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:07:46.257823 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:07:46.257823 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:07:46.257823 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:07:46.257823 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:07:46.257823 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:07:46.257823 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:07:46.257823 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:07:46.258641 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:07:46.258641 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:07:46.258641 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:07:46.258641 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:07:46.258641 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:07:46.258641 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:07:46.258641 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:07:46.258641 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:07:46.258641 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:07:46.258641 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:07:46.258641 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:07:46.258641 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:07:46.259264 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 98/184] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:07:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:07:46.265267 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51003bf-0b38-4160-a3c0-d3a4cafd1436 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:46.265267 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51003bf-0b38-4160-a3c0-d3a4cafd1436 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:46.265267 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51003bf-0b38-4160-a3c0-d3a4cafd1436 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:46.265267 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 99/185] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:07:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:07:46.266940 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51003bf-0b38-4160-a3c0-d3a4cafd1436 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:46.290417 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3a8df-ab1d-4989-87c5-45a7f810a34f None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:46.327032 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332bf593-6e4b-4421-a3b5-6b7defe12a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:46.327850 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332bf593-6e4b-4421-a3b5-6b7defe12a82 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:46.328136 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332bf593-6e4b-4421-a3b5-6b7defe12a82 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:46.328412 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332bf593-6e4b-4421-a3b5-6b7defe12a82 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:46.338872 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332bf593-6e4b-4421-a3b5-6b7defe12a82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:07:46.346703 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-332bf593-6e4b-4421-a3b5-6b7defe12a82 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:07:46.346703 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:07:46.346703 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:07:46.346703 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:07:46.346703 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:07:46.346703 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:07:46.346703 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:07:46.346703 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:07:46.346703 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:07:46.346703 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:07:46.346703 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:07:46.346703 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:07:46.346703 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:07:46.346703 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:07:46.346703 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:07:46.346703 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:07:46.347611 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:07:46.347611 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:07:46.347611 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:07:46.347611 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:07:46.347611 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:07:46.347611 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:07:46.347611 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:07:46.347611 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:07:46.347611 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:07:46.347611 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:07:46.347611 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:07:46.347611 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:07:46.347611 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:07:46.347611 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:07:46.347611 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:07:46.347611 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:07:46.348435 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:07:46.348435 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:07:46.348435 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:07:46.348435 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:07:46.348435 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:07:46.348435 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:07:46.348435 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:07:46.348435 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:07:46.348435 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:07:46.348435 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:07:46.348435 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:07:46.348435 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:07:46.348435 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 87/186] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:07:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:07:46.349210 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332bf593-6e4b-4421-a3b5-6b7defe12a82 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:46.382304 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51003bf-0b38-4160-a3c0-d3a4cafd1436 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:46.415668 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80761d6-8653-4b8f-93bd-594bbe79f0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:46.416393 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80761d6-8653-4b8f-93bd-594bbe79f0cc None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:46.416825 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80761d6-8653-4b8f-93bd-594bbe79f0cc None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:46.417108 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80761d6-8653-4b8f-93bd-594bbe79f0cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:46.417944 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80761d6-8653-4b8f-93bd-594bbe79f0cc None admin] RBAC: Adding query filter params (role.id=49943dd485174ef39fdd0368de241417, scope.project.id=3665952118af4106b09bd445a38d53e5, user.id=f904c02f9f084df4917f5d2d38174f29) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:07:46.418303 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80761d6-8653-4b8f-93bd-594bbe79f0cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:46.419816 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80761d6-8653-4b8f-93bd-594bbe79f0cc None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:46.425673 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 100/187] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:07:46 2022] GET /identity/v3/role_assignments?user.id=f904c02f9f084df4917f5d2d38174f29&scope.project.id=3665952118af4106b09bd445a38d53e5&role.id=49943dd485174ef39fdd0368de241417 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:46.426703 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc1927-8675-4a41-9076-0f3663ddd62c None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:46.426992 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc1927-8675-4a41-9076-0f3663ddd62c None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:46.427276 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc1927-8675-4a41-9076-0f3663ddd62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:46.445419 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:46.452571 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-62dc1927-8675-4a41-9076-0f3663ddd62c None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:07:46.454287 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-62dc1927-8675-4a41-9076-0f3663ddd62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:07:46.466241 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332bf593-6e4b-4421-a3b5-6b7defe12a82 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:46.470089 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:46.508189 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e6a20-4e2f-4939-acc5-2faeb8a0f51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:46.508994 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e6a20-4e2f-4939-acc5-2faeb8a0f51a None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:46.509285 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e6a20-4e2f-4939-acc5-2faeb8a0f51a None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:46.509570 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e6a20-4e2f-4939-acc5-2faeb8a0f51a None admin] PATH_INFO: `/v3/roles` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:46.510967 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e6a20-4e2f-4939-acc5-2faeb8a0f51a None admin] RBAC: Adding query filter params (name=admin) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:07:46.511286 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e6a20-4e2f-4939-acc5-2faeb8a0f51a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:46.512750 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e6a20-4e2f-4939-acc5-2faeb8a0f51a None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:46.522206 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 88/188] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:07:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:46.523075 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e6a20-4e2f-4939-acc5-2faeb8a0f51a None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:46.543973 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 101/189] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:07:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:07:46.551606 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f55f5-23fd-443f-8b11-fb4c73457dc7 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:46.551606 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f55f5-23fd-443f-8b11-fb4c73457dc7 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:46.551606 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f55f5-23fd-443f-8b11-fb4c73457dc7 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:46.551606 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 102/190] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:07:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:07:46.551606 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f55f5-23fd-443f-8b11-fb4c73457dc7 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:46.650940 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e6a20-4e2f-4939-acc5-2faeb8a0f51a None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:46.674329 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f55f5-23fd-443f-8b11-fb4c73457dc7 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:46.686712 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9079fb8-e47c-4907-90f0-79a81aaab130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:46.687392 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9079fb8-e47c-4907-90f0-79a81aaab130 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:46.687937 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9079fb8-e47c-4907-90f0-79a81aaab130 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:46.688218 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9079fb8-e47c-4907-90f0-79a81aaab130 None admin] PATH_INFO: `/v3/roles` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:46.688967 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9079fb8-e47c-4907-90f0-79a81aaab130 None admin] RBAC: Adding query filter params (name=reader) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:07:46.689276 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9079fb8-e47c-4907-90f0-79a81aaab130 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:46.690688 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9079fb8-e47c-4907-90f0-79a81aaab130 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:46.699226 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 89/191] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:07:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:46.700442 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a515cb0-d680-4b7c-9f9e-09c33792fa35 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:46.700740 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a515cb0-d680-4b7c-9f9e-09c33792fa35 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:46.701025 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a515cb0-d680-4b7c-9f9e-09c33792fa35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:46.712346 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4de20-1806-4a9e-aa5f-aad4fd0d3b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:46.713321 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4de20-1806-4a9e-aa5f-aad4fd0d3b9f None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:46.713617 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4de20-1806-4a9e-aa5f-aad4fd0d3b9f None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:46.713895 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4de20-1806-4a9e-aa5f-aad4fd0d3b9f None admin] PATH_INFO: `/v3/users/e5aeaa3fc39b47aebbb86a6eceaf4e93` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:46.716796 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-2a515cb0-d680-4b7c-9f9e-09c33792fa35 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:07:46.717987 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-2a515cb0-d680-4b7c-9f9e-09c33792fa35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:07:46.720734 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:46.727060 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e4de20-1806-4a9e-aa5f-aad4fd0d3b9f None admin] RBAC: Authorizing `identity:get_user(user_id=e5aeaa3fc39b47aebbb86a6eceaf4e93)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:46.728535 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e4de20-1806-4a9e-aa5f-aad4fd0d3b9f None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:46.730875 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 103/192] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:07:46 2022] GET /identity/v3/users/e5aeaa3fc39b47aebbb86a6eceaf4e93 => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:46.731646 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4de20-1806-4a9e-aa5f-aad4fd0d3b9f None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:46.741242 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:46.785887 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 90/193] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:07:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:07:46.787115 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a515cb0-d680-4b7c-9f9e-09c33792fa35 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:46.833424 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4de20-1806-4a9e-aa5f-aad4fd0d3b9f None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:46.866558 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d88efc-f76d-4e1b-b5b6-fc19ebac6847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:46.867357 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d88efc-f76d-4e1b-b5b6-fc19ebac6847 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:46.867649 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d88efc-f76d-4e1b-b5b6-fc19ebac6847 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:46.867937 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d88efc-f76d-4e1b-b5b6-fc19ebac6847 None admin] PATH_INFO: `/v3/domains/default` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:46.869115 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d88efc-f76d-4e1b-b5b6-fc19ebac6847 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:46.871291 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d88efc-f76d-4e1b-b5b6-fc19ebac6847 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:46.877324 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 104/194] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:07:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:46.877324 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d88efc-f76d-4e1b-b5b6-fc19ebac6847 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:46.893791 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a515cb0-d680-4b7c-9f9e-09c33792fa35 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:46.927397 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de175c5b-5c8f-4879-be74-88829cb99592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:46.928210 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de175c5b-5c8f-4879-be74-88829cb99592 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:46.928493 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de175c5b-5c8f-4879-be74-88829cb99592 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:46.928771 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de175c5b-5c8f-4879-be74-88829cb99592 None admin] PATH_INFO: `/v3/users/d1a731c426ef4a1a99e014fe9c1895d2` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:46.929951 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de175c5b-5c8f-4879-be74-88829cb99592 None admin] RBAC: Authorizing `identity:get_user(user_id=d1a731c426ef4a1a99e014fe9c1895d2)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:46.931417 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de175c5b-5c8f-4879-be74-88829cb99592 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:46.933163 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 91/195] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:07:46 2022] GET /identity/v3/users/d1a731c426ef4a1a99e014fe9c1895d2 => generated 289 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:46.935021 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de175c5b-5c8f-4879-be74-88829cb99592 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:46.945230 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:46.950413 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:46.974589 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d88efc-f76d-4e1b-b5b6-fc19ebac6847 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:47.008841 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8549bb9c-06c7-426e-9737-52bdedc20767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:47.009507 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549bb9c-06c7-426e-9737-52bdedc20767 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:47.009799 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549bb9c-06c7-426e-9737-52bdedc20767 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:47.010175 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549bb9c-06c7-426e-9737-52bdedc20767 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:47.031498 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de175c5b-5c8f-4879-be74-88829cb99592 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:47.065294 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e5390-b352-4d36-8bf9-afa51d42c791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:47.066099 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e5390-b352-4d36-8bf9-afa51d42c791 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:47.066417 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e5390-b352-4d36-8bf9-afa51d42c791 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:47.066699 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e5390-b352-4d36-8bf9-afa51d42c791 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:47.076741 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e5390-b352-4d36-8bf9-afa51d42c791 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:07:47.077554 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8549bb9c-06c7-426e-9737-52bdedc20767 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:47.079059 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8549bb9c-06c7-426e-9737-52bdedc20767 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:47.084936 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-062e5390-b352-4d36-8bf9-afa51d42c791 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:07:47.084936 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:07:47.084936 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:07:47.084936 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:07:47.084936 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:07:47.084936 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:07:47.084936 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:07:47.084936 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:07:47.084936 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:07:47.084936 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:07:47.084936 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:07:47.084936 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:07:47.084936 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:07:47.084936 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:07:47.084936 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:07:47.084936 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:07:47.085829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:07:47.085829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:07:47.085829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:07:47.085829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:07:47.085829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:07:47.085829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:07:47.085829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:07:47.085829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:07:47.085829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:07:47.085829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:07:47.085829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:07:47.085829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:07:47.085829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:07:47.085829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:07:47.085829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:07:47.085829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:07:47.086812 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:07:47.086812 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:07:47.086812 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:07:47.086812 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:07:47.086812 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:07:47.086812 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:07:47.086812 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:07:47.086812 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:07:47.086812 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:07:47.086812 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:07:47.086812 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:07:47.086812 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:07:47.086812 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 92/196] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:07:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:07:47.088880 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e5390-b352-4d36-8bf9-afa51d42c791 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:47.152503 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:47.157151 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:47.176528 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 105/197] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:07:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:07:47.178674 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8549bb9c-06c7-426e-9737-52bdedc20767 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:47.190593 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e5390-b352-4d36-8bf9-afa51d42c791 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:47.223873 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7545b4c-b727-4a6d-b834-8bdc14ff0e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:47.224543 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7545b4c-b727-4a6d-b834-8bdc14ff0e5a None admin] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:47.224830 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7545b4c-b727-4a6d-b834-8bdc14ff0e5a None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:47.225105 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7545b4c-b727-4a6d-b834-8bdc14ff0e5a None admin] PATH_INFO: `/v3/users` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:47.225820 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7545b4c-b727-4a6d-b834-8bdc14ff0e5a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:47.227307 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7545b4c-b727-4a6d-b834-8bdc14ff0e5a None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:47.275916 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8549bb9c-06c7-426e-9737-52bdedc20767 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:47.309487 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e9b80-9742-4415-8959-c7718ab709cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:47.310159 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e9b80-9742-4415-8959-c7718ab709cd None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:47.310463 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e9b80-9742-4415-8959-c7718ab709cd None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:47.310751 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e9b80-9742-4415-8959-c7718ab709cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:47.315318 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 93/198] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:07:47 2022] POST /identity/v3/users => generated 297 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:07:47.319790 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7545b4c-b727-4a6d-b834-8bdc14ff0e5a None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:47.374048 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:47.406510 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e9b80-9742-4415-8959-c7718ab709cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:47.408172 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e9b80-9742-4415-8959-c7718ab709cd None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:47.428343 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7545b4c-b727-4a6d-b834-8bdc14ff0e5a None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:47.455100 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:47.467228 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068c190-e1f8-429e-886c-6a4160559f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:47.467911 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068c190-e1f8-429e-886c-6a4160559f6e None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:47.475820 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068c190-e1f8-429e-886c-6a4160559f6e None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:47.475820 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068c190-e1f8-429e-886c-6a4160559f6e None admin] PATH_INFO: `/v3/roles` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:47.475820 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7068c190-e1f8-429e-886c-6a4160559f6e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:07:47.475820 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7068c190-e1f8-429e-886c-6a4160559f6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:47.475820 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7068c190-e1f8-429e-886c-6a4160559f6e None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:47.480310 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 94/199] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:07:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:47.481998 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068c190-e1f8-429e-886c-6a4160559f6e None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:47.532892 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 106/200] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:07:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:07:47.533752 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e9b80-9742-4415-8959-c7718ab709cd None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:47.612681 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068c190-e1f8-429e-886c-6a4160559f6e None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:47.627060 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:47.654616 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e9b80-9742-4415-8959-c7718ab709cd None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:47.654818 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa0da9-754d-4e34-bb2c-199c0bff6afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:47.655728 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa0da9-754d-4e34-bb2c-199c0bff6afa None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:47.656022 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa0da9-754d-4e34-bb2c-199c0bff6afa None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:47.656315 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa0da9-754d-4e34-bb2c-199c0bff6afa None admin] PATH_INFO: `/v3/projects/9d370c4b5282475484b01c328ffd7864` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:47.657548 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa0da9-754d-4e34-bb2c-199c0bff6afa None admin] RBAC: Authorizing `identity:get_project(project_id=9d370c4b5282475484b01c328ffd7864)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:47.659072 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa0da9-754d-4e34-bb2c-199c0bff6afa None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:47.660799 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 95/201] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:07:47 2022] GET /identity/v3/projects/9d370c4b5282475484b01c328ffd7864 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:47.661581 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa0da9-754d-4e34-bb2c-199c0bff6afa None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:47.700085 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e3ac1-d0a7-4877-866f-a3bec2808786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:47.701374 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e3ac1-d0a7-4877-866f-a3bec2808786 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:47.701668 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e3ac1-d0a7-4877-866f-a3bec2808786 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:47.701951 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e3ac1-d0a7-4877-866f-a3bec2808786 None admin] PATH_INFO: `/v3/users/e5aeaa3fc39b47aebbb86a6eceaf4e93` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:47.704178 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378e3ac1-d0a7-4877-866f-a3bec2808786 None admin] RBAC: Authorizing `identity:get_user(user_id=e5aeaa3fc39b47aebbb86a6eceaf4e93)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:47.705733 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378e3ac1-d0a7-4877-866f-a3bec2808786 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:47.707436 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 107/202] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:07:47 2022] GET /identity/v3/users/e5aeaa3fc39b47aebbb86a6eceaf4e93 => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:47.708216 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e3ac1-d0a7-4877-866f-a3bec2808786 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:47.731848 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:47.777919 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa0da9-754d-4e34-bb2c-199c0bff6afa None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:47.813882 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432ca91-fbe7-4737-9dc4-c76d2de9c8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:47.814884 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432ca91-fbe7-4737-9dc4-c76d2de9c8e2 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:47.815250 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432ca91-fbe7-4737-9dc4-c76d2de9c8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:47.815603 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432ca91-fbe7-4737-9dc4-c76d2de9c8e2 None admin] PATH_INFO: `/v3/projects/3665952118af4106b09bd445a38d53e5` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:47.816914 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2432ca91-fbe7-4737-9dc4-c76d2de9c8e2 None admin] RBAC: Authorizing `identity:get_project(project_id=3665952118af4106b09bd445a38d53e5)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:47.818499 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2432ca91-fbe7-4737-9dc4-c76d2de9c8e2 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:47.820475 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 96/203] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:07:47 2022] GET /identity/v3/projects/3665952118af4106b09bd445a38d53e5 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:47.821151 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432ca91-fbe7-4737-9dc4-c76d2de9c8e2 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:47.825697 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e3ac1-d0a7-4877-866f-a3bec2808786 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:47.861807 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22535f1f-d4c4-4ab1-8ffd-b3544131a8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:47.862527 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22535f1f-d4c4-4ab1-8ffd-b3544131a8c7 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:47.862814 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22535f1f-d4c4-4ab1-8ffd-b3544131a8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:47.863096 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22535f1f-d4c4-4ab1-8ffd-b3544131a8c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:47.863942 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22535f1f-d4c4-4ab1-8ffd-b3544131a8c7 None admin] RBAC: Adding query filter params (role.id=101b93f94624407f8c812ab86ebec32a, scope.project.id=9d370c4b5282475484b01c328ffd7864, user.id=e5aeaa3fc39b47aebbb86a6eceaf4e93) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:07:47.864258 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22535f1f-d4c4-4ab1-8ffd-b3544131a8c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:47.865721 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22535f1f-d4c4-4ab1-8ffd-b3544131a8c7 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:47.872578 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 108/204] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:07:47 2022] GET /identity/v3/role_assignments?user.id=e5aeaa3fc39b47aebbb86a6eceaf4e93&scope.project.id=9d370c4b5282475484b01c328ffd7864&role.id=101b93f94624407f8c812ab86ebec32a => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:47.873422 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22535f1f-d4c4-4ab1-8ffd-b3544131a8c7 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:47.895938 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:47.934159 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432ca91-fbe7-4737-9dc4-c76d2de9c8e2 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:47.969368 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:47.980383 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae9cb4b-f069-4188-9e84-fd52286f14bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:47.981387 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9cb4b-f069-4188-9e84-fd52286f14bb None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:47.981858 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9cb4b-f069-4188-9e84-fd52286f14bb None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:47.982464 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9cb4b-f069-4188-9e84-fd52286f14bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:48.062189 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae9cb4b-f069-4188-9e84-fd52286f14bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:48.064552 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae9cb4b-f069-4188-9e84-fd52286f14bb None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:48.130689 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22535f1f-d4c4-4ab1-8ffd-b3544131a8c7 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:48.265927 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 97/205] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:07:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:07:48.274530 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae9cb4b-f069-4188-9e84-fd52286f14bb None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:48.288845 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c045f-74ab-41cd-8b87-d0c06621719a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:48.289516 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c045f-74ab-41cd-8b87-d0c06621719a None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:48.289824 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c045f-74ab-41cd-8b87-d0c06621719a None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:48.290154 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c045f-74ab-41cd-8b87-d0c06621719a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:48.290955 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c045f-74ab-41cd-8b87-d0c06621719a None admin] RBAC: Adding query filter params (role.id=e8b0e7643206483385c49640e21e33d7, scope.project.id=3665952118af4106b09bd445a38d53e5, user.id=d1a731c426ef4a1a99e014fe9c1895d2) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:07:48.291803 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c045f-74ab-41cd-8b87-d0c06621719a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:48.293490 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c045f-74ab-41cd-8b87-d0c06621719a None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:48.305843 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 109/206] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:07:47 2022] GET /identity/v3/role_assignments?user.id=d1a731c426ef4a1a99e014fe9c1895d2&scope.project.id=3665952118af4106b09bd445a38d53e5&role.id=e8b0e7643206483385c49640e21e33d7 => generated 608 bytes in 433 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:48.316785 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:48.403152 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae9cb4b-f069-4188-9e84-fd52286f14bb None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:48.457837 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065eaeb-fe78-4e98-930e-327cc5ec8064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:48.458764 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065eaeb-fe78-4e98-930e-327cc5ec8064 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:48.459050 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065eaeb-fe78-4e98-930e-327cc5ec8064 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:48.459330 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065eaeb-fe78-4e98-930e-327cc5ec8064 None admin] PATH_INFO: `/v3/projects/9d370c4b5282475484b01c328ffd7864` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:48.460550 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1065eaeb-fe78-4e98-930e-327cc5ec8064 None admin] RBAC: Authorizing `identity:get_project(project_id=9d370c4b5282475484b01c328ffd7864)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:48.462079 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1065eaeb-fe78-4e98-930e-327cc5ec8064 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:48.464542 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 98/207] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:07:48 2022] GET /identity/v3/projects/9d370c4b5282475484b01c328ffd7864 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:48.470633 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c045f-74ab-41cd-8b87-d0c06621719a None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:48.603286 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:48.647613 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c045f-74ab-41cd-8b87-d0c06621719a None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:48.695370 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e253d-7f61-4259-9a04-2e39820adbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:48.696504 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e253d-7f61-4259-9a04-2e39820adbbf None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:48.696993 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e253d-7f61-4259-9a04-2e39820adbbf None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:48.697539 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e253d-7f61-4259-9a04-2e39820adbbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:48.698666 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36e253d-7f61-4259-9a04-2e39820adbbf None admin] RBAC: Adding query filter params (role.id=49943dd485174ef39fdd0368de241417, scope.project.id=9d370c4b5282475484b01c328ffd7864, user.id=e5aeaa3fc39b47aebbb86a6eceaf4e93) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:07:48.699205 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36e253d-7f61-4259-9a04-2e39820adbbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:48.700863 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36e253d-7f61-4259-9a04-2e39820adbbf None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:48.711840 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 110/208] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:07:48 2022] GET /identity/v3/role_assignments?user.id=e5aeaa3fc39b47aebbb86a6eceaf4e93&scope.project.id=9d370c4b5282475484b01c328ffd7864&role.id=49943dd485174ef39fdd0368de241417 => generated 259 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:49.660991 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae00d2-50a9-4067-abc0-dc7ae0b22909 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:49.661489 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae00d2-50a9-4067-abc0-dc7ae0b22909 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:49.661489 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae00d2-50a9-4067-abc0-dc7ae0b22909 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:49.663142 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 99/209] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:07:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:07:49.669121 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a611ef-daef-4499-844c-a2a81e7fd49d None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:49.669556 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a611ef-daef-4499-844c-a2a81e7fd49d None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:49.669765 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a611ef-daef-4499-844c-a2a81e7fd49d None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:49.671235 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ebfddb-5c9b-48e5-8d28-5453e151e478 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:49.671455 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 111/210] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:07:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:07:49.671928 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ebfddb-5c9b-48e5-8d28-5453e151e478 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:49.672615 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ebfddb-5c9b-48e5-8d28-5453e151e478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:49.676244 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d13ee-417b-4314-9fd4-bd929155766e None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:49.676581 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d13ee-417b-4314-9fd4-bd929155766e None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:49.676869 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d13ee-417b-4314-9fd4-bd929155766e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:49.692542 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-78ebfddb-5c9b-48e5-8d28-5453e151e478 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:07:49.693890 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-941d13ee-417b-4314-9fd4-bd929155766e None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:07:49.694403 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-78ebfddb-5c9b-48e5-8d28-5453e151e478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:07:49.695119 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-941d13ee-417b-4314-9fd4-bd929155766e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:07:49.771437 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 100/211] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:07:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:07:49.771644 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 112/212] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:07:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:07:49.793964 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ebfddb-5c9b-48e5-8d28-5453e151e478 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:49.795514 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d13ee-417b-4314-9fd4-bd929155766e None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:49.820166 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:49.866687 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:49.906158 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ebfddb-5c9b-48e5-8d28-5453e151e478 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:49.914591 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d13ee-417b-4314-9fd4-bd929155766e None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:49.939914 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ded0d-ee4f-487f-9934-5feb35bcba95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:49.940730 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ded0d-ee4f-487f-9934-5feb35bcba95 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:49.941016 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ded0d-ee4f-487f-9934-5feb35bcba95 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:49.941293 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ded0d-ee4f-487f-9934-5feb35bcba95 None admin] PATH_INFO: `/v3/roles/member` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:49.952621 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78ded0d-ee4f-487f-9934-5feb35bcba95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:07:49.954681 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112f03a-25f6-4362-afbd-792cc922681b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:49.955595 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112f03a-25f6-4362-afbd-792cc922681b None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:49.955986 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112f03a-25f6-4362-afbd-792cc922681b None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:49.956370 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112f03a-25f6-4362-afbd-792cc922681b None admin] PATH_INFO: `/v3/domains/default` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:49.957670 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c112f03a-25f6-4362-afbd-792cc922681b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:49.959295 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c112f03a-25f6-4362-afbd-792cc922681b None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:49.960592 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-f78ded0d-ee4f-487f-9934-5feb35bcba95 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:07:49.960592 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:07:49.960592 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:07:49.960592 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:07:49.960592 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:07:49.960592 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:07:49.960592 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:07:49.960592 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:07:49.960592 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:07:49.960592 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:07:49.960592 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:07:49.960592 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:07:49.960592 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:07:49.960592 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:07:49.960592 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:07:49.960592 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:07:49.961523 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:07:49.961523 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:07:49.961523 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:07:49.961523 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:07:49.961523 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:07:49.961523 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:07:49.961523 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:07:49.961523 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:07:49.961523 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:07:49.961523 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:07:49.961523 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:07:49.961523 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:07:49.961523 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:07:49.961523 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:07:49.961523 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:07:49.961523 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:07:49.962367 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:07:49.962367 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:07:49.962367 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:07:49.962367 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:07:49.962367 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:07:49.962367 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:07:49.962367 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:07:49.962367 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:07:49.962367 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:07:49.962367 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:07:49.962367 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:07:49.962367 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:07:49.963184 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 113/213] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:07:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:07:49.963266 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 101/214] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:07:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:07:49.968288 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112f03a-25f6-4362-afbd-792cc922681b None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:49.969827 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ded0d-ee4f-487f-9934-5feb35bcba95 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:50.055502 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:50.076770 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ded0d-ee4f-487f-9934-5feb35bcba95 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:50.080706 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112f03a-25f6-4362-afbd-792cc922681b None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:50.112442 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:50.112610 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb510c43-8267-4ae7-ac69-d1d4b9f04929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:50.113168 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb510c43-8267-4ae7-ac69-d1d4b9f04929 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:50.113456 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb510c43-8267-4ae7-ac69-d1d4b9f04929 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:50.113742 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb510c43-8267-4ae7-ac69-d1d4b9f04929 None admin] PATH_INFO: `/v3/roles` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:50.114532 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb510c43-8267-4ae7-ac69-d1d4b9f04929 None admin] RBAC: Adding query filter params (name=member) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:07:50.114851 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb510c43-8267-4ae7-ac69-d1d4b9f04929 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:50.116242 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb510c43-8267-4ae7-ac69-d1d4b9f04929 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:50.118839 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a5e9c4-527a-47b1-a30b-2ba7cfbba3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:50.119737 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a5e9c4-527a-47b1-a30b-2ba7cfbba3d7 None admin] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:50.120203 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a5e9c4-527a-47b1-a30b-2ba7cfbba3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:50.120651 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a5e9c4-527a-47b1-a30b-2ba7cfbba3d7 None admin] PATH_INFO: `/v3/users` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:50.121662 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a5e9c4-527a-47b1-a30b-2ba7cfbba3d7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:50.123421 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a5e9c4-527a-47b1-a30b-2ba7cfbba3d7 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:50.124594 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 102/215] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:07:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:07:50.125845 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6fa1c-19ec-4847-beb3-d5ee07b16794 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:50.126169 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6fa1c-19ec-4847-beb3-d5ee07b16794 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:50.126447 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6fa1c-19ec-4847-beb3-d5ee07b16794 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:50.128926 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 103/216] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:07:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:07:50.130783 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b6fa1c-19ec-4847-beb3-d5ee07b16794 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:50.239292 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b6fa1c-19ec-4847-beb3-d5ee07b16794 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:50.262719 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 114/217] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:07:49 2022] POST /identity/v3/users => generated 297 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:07:50.267754 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d129f-0e26-4eb8-a554-7597dcd91feb None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:50.268083 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d129f-0e26-4eb8-a554-7597dcd91feb None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:50.268502 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d129f-0e26-4eb8-a554-7597dcd91feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:50.288114 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-214d129f-0e26-4eb8-a554-7597dcd91feb None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:07:50.289476 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-214d129f-0e26-4eb8-a554-7597dcd91feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:07:50.294742 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d211c-18cf-43ae-8541-a244583c4663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:50.296069 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d211c-18cf-43ae-8541-a244583c4663 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:50.296545 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d211c-18cf-43ae-8541-a244583c4663 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:50.297006 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d211c-18cf-43ae-8541-a244583c4663 None admin] PATH_INFO: `/v3/users/6a648fc35db14568bfaf30037782facc` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:50.314017 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:50.317104 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d211c-18cf-43ae-8541-a244583c4663 None admin] RBAC: Authorizing `identity:get_user(user_id=6a648fc35db14568bfaf30037782facc)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:50.318988 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d211c-18cf-43ae-8541-a244583c4663 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:50.321351 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 104/218] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:07:50 2022] GET /identity/v3/users/6a648fc35db14568bfaf30037782facc => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:07:50.328583 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d211c-18cf-43ae-8541-a244583c4663 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:50.370679 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 115/219] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:07:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:07:50.393757 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d129f-0e26-4eb8-a554-7597dcd91feb None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:50.468483 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d211c-18cf-43ae-8541-a244583c4663 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:50.508095 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d99c1a2-b010-4a4d-8ec2-4403bcc132a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:50.508695 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d99c1a2-b010-4a4d-8ec2-4403bcc132a2 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:50.508986 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d99c1a2-b010-4a4d-8ec2-4403bcc132a2 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:50.509267 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d99c1a2-b010-4a4d-8ec2-4403bcc132a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:50.515698 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d129f-0e26-4eb8-a554-7597dcd91feb None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:50.537908 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:50.564875 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87899d92-2062-4010-9b29-c802a0e039dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:50.565709 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87899d92-2062-4010-9b29-c802a0e039dd None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:50.566005 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87899d92-2062-4010-9b29-c802a0e039dd None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:50.566649 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87899d92-2062-4010-9b29-c802a0e039dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:50.580489 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87899d92-2062-4010-9b29-c802a0e039dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:07:50.589145 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-87899d92-2062-4010-9b29-c802a0e039dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:07:50.589145 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:07:50.589145 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:07:50.589145 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:07:50.589145 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:07:50.589145 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:07:50.589145 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:07:50.589145 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:07:50.589145 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:07:50.589145 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:07:50.589145 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:07:50.589145 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:07:50.589145 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:07:50.589145 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:07:50.589145 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:07:50.589145 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:07:50.590063 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:07:50.590063 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:07:50.590063 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:07:50.590063 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:07:50.590063 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:07:50.590063 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:07:50.590063 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:07:50.590063 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:07:50.590063 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:07:50.590063 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:07:50.590063 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:07:50.590063 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:07:50.590063 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:07:50.590063 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:07:50.590063 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:07:50.590063 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:07:50.590893 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:07:50.590893 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:07:50.590893 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:07:50.590893 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:07:50.590893 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:07:50.590893 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:07:50.590893 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:07:50.590893 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:07:50.590893 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:07:50.590893 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:07:50.590893 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:07:50.590893 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:07:50.591494 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:50.591708 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 116/220] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:07:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:07:50.593807 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d99c1a2-b010-4a4d-8ec2-4403bcc132a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:50.595566 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d99c1a2-b010-4a4d-8ec2-4403bcc132a2 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:50.597393 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87899d92-2062-4010-9b29-c802a0e039dd None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:50.711316 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 105/221] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:07:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:07:50.716917 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87899d92-2062-4010-9b29-c802a0e039dd None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:50.717789 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d99c1a2-b010-4a4d-8ec2-4403bcc132a2 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:50.765316 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b67f31-4851-4def-8abd-93f47d88001b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:50.766104 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b67f31-4851-4def-8abd-93f47d88001b None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:50.766517 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b67f31-4851-4def-8abd-93f47d88001b None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:50.766900 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b67f31-4851-4def-8abd-93f47d88001b None admin] PATH_INFO: `/v3/roles` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:50.768247 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b67f31-4851-4def-8abd-93f47d88001b None admin] RBAC: Adding query filter params (name=admin) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:07:50.768681 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b67f31-4851-4def-8abd-93f47d88001b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:50.770924 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b67f31-4851-4def-8abd-93f47d88001b None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:50.783968 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 117/222] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:07:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:50.789319 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b67f31-4851-4def-8abd-93f47d88001b None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:50.830011 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:50.833568 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d99c1a2-b010-4a4d-8ec2-4403bcc132a2 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:50.834602 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:50.870513 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754198ed-148a-4745-a589-d4fb9855990d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:50.872196 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754198ed-148a-4745-a589-d4fb9855990d None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:50.872660 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754198ed-148a-4745-a589-d4fb9855990d None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:50.873143 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754198ed-148a-4745-a589-d4fb9855990d None admin] PATH_INFO: `/v3/projects/9d370c4b5282475484b01c328ffd7864` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:50.874579 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754198ed-148a-4745-a589-d4fb9855990d None admin] RBAC: Authorizing `identity:get_project(project_id=9d370c4b5282475484b01c328ffd7864)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:50.876207 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754198ed-148a-4745-a589-d4fb9855990d None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:50.879423 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 106/223] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:07:50 2022] GET /identity/v3/projects/9d370c4b5282475484b01c328ffd7864 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:07:50.891310 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754198ed-148a-4745-a589-d4fb9855990d None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:50.904993 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b67f31-4851-4def-8abd-93f47d88001b None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:50.944730 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c04dc-14c8-4901-8f2c-361f56481266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:50.945864 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c04dc-14c8-4901-8f2c-361f56481266 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:50.946258 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c04dc-14c8-4901-8f2c-361f56481266 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:50.946612 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c04dc-14c8-4901-8f2c-361f56481266 None admin] PATH_INFO: `/v3/users/e5aeaa3fc39b47aebbb86a6eceaf4e93` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:50.948511 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015c04dc-14c8-4901-8f2c-361f56481266 None admin] RBAC: Authorizing `identity:get_user(user_id=e5aeaa3fc39b47aebbb86a6eceaf4e93)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:50.949992 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015c04dc-14c8-4901-8f2c-361f56481266 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:50.951980 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 118/224] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:07:50 2022] GET /identity/v3/users/e5aeaa3fc39b47aebbb86a6eceaf4e93 => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:07:50.957576 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c04dc-7ad8-4688-85df-f64444d3080d None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:50.957860 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c04dc-7ad8-4688-85df-f64444d3080d None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:50.958168 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c04dc-7ad8-4688-85df-f64444d3080d None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:50.959709 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 119/225] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:07:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:07:50.963889 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c04dc-7ad8-4688-85df-f64444d3080d None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:51.019859 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754198ed-148a-4745-a589-d4fb9855990d None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:51.056179 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e3686-899a-432e-b88d-ecd34c660823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:51.057760 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e3686-899a-432e-b88d-ecd34c660823 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:51.058493 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e3686-899a-432e-b88d-ecd34c660823 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:51.058972 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e3686-899a-432e-b88d-ecd34c660823 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:51.060057 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e3686-899a-432e-b88d-ecd34c660823 None admin] RBAC: Adding query filter params (role.id=f9389c8fc7a74300aed4cf6490fb672b, scope.project.id=9d370c4b5282475484b01c328ffd7864, user.id=6a648fc35db14568bfaf30037782facc) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:07:51.060586 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e3686-899a-432e-b88d-ecd34c660823 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:51.062263 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e3686-899a-432e-b88d-ecd34c660823 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:51.066151 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c04dc-7ad8-4688-85df-f64444d3080d None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:51.069336 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 107/226] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:07:50 2022] GET /identity/v3/role_assignments?user.id=6a648fc35db14568bfaf30037782facc&scope.project.id=9d370c4b5282475484b01c328ffd7864&role.id=f9389c8fc7a74300aed4cf6490fb672b => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:51.070849 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24da7e1-c0ec-4b12-aaf6-627775ea0fe9 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:51.071409 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24da7e1-c0ec-4b12-aaf6-627775ea0fe9 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:51.071903 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24da7e1-c0ec-4b12-aaf6-627775ea0fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:51.084188 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:51.093325 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-f24da7e1-c0ec-4b12-aaf6-627775ea0fe9 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:07:51.095009 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-f24da7e1-c0ec-4b12-aaf6-627775ea0fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:07:51.126217 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02364bc-8a2c-4b71-8f79-61c17f4cc60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:51.127195 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02364bc-8a2c-4b71-8f79-61c17f4cc60a None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:51.127569 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02364bc-8a2c-4b71-8f79-61c17f4cc60a None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:51.127913 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02364bc-8a2c-4b71-8f79-61c17f4cc60a None admin] PATH_INFO: `/v3/projects/9d370c4b5282475484b01c328ffd7864` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:51.129252 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02364bc-8a2c-4b71-8f79-61c17f4cc60a None admin] RBAC: Authorizing `identity:get_project(project_id=9d370c4b5282475484b01c328ffd7864)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:51.131398 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02364bc-8a2c-4b71-8f79-61c17f4cc60a None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:51.133887 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 120/227] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:07:50 2022] GET /identity/v3/projects/9d370c4b5282475484b01c328ffd7864 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:51.139283 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02364bc-8a2c-4b71-8f79-61c17f4cc60a None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:51.150165 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:51.243729 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 108/228] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:07:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:07:51.292122 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24da7e1-c0ec-4b12-aaf6-627775ea0fe9 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:51.312390 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02364bc-8a2c-4b71-8f79-61c17f4cc60a None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:51.358498 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf8b2e-a31e-4c2f-a34f-8503727a669f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:51.359410 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf8b2e-a31e-4c2f-a34f-8503727a669f None admin] REQUEST_METHOD: `PUT` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:51.359700 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf8b2e-a31e-4c2f-a34f-8503727a669f None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:51.359994 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf8b2e-a31e-4c2f-a34f-8503727a669f None admin] PATH_INFO: `/v3/projects/9d370c4b5282475484b01c328ffd7864/users/e5aeaa3fc39b47aebbb86a6eceaf4e93/roles/101b93f94624407f8c812ab86ebec32a` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:51.362350 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf8b2e-a31e-4c2f-a34f-8503727a669f None admin] RBAC: Authorizing `identity:create_grant(project_id=9d370c4b5282475484b01c328ffd7864, user_id=e5aeaa3fc39b47aebbb86a6eceaf4e93, role_id=101b93f94624407f8c812ab86ebec32a)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:51.363815 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf8b2e-a31e-4c2f-a34f-8503727a669f None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:51.411721 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 121/229] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:07:51 2022] PUT /identity/v3/projects/9d370c4b5282475484b01c328ffd7864/users/e5aeaa3fc39b47aebbb86a6eceaf4e93/roles/101b93f94624407f8c812ab86ebec32a => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:07:51.439735 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24da7e1-c0ec-4b12-aaf6-627775ea0fe9 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:51.482344 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af40f9-10e3-455f-9b3e-0e77912a3fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:51.483267 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af40f9-10e3-455f-9b3e-0e77912a3fa9 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:51.483610 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af40f9-10e3-455f-9b3e-0e77912a3fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:51.483935 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af40f9-10e3-455f-9b3e-0e77912a3fa9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:51.507128 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af40f9-10e3-455f-9b3e-0e77912a3fa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:07:51.516201 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-55af40f9-10e3-455f-9b3e-0e77912a3fa9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:07:51.516201 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:07:51.516201 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:07:51.516201 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:07:51.516201 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:07:51.516201 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:07:51.516201 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:07:51.516201 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:07:51.516201 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:07:51.516201 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:07:51.516201 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:07:51.516201 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:07:51.516201 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:07:51.516201 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:07:51.516201 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:07:51.516201 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:07:51.517167 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:07:51.517167 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:07:51.517167 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:07:51.517167 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:07:51.517167 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:07:51.517167 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:07:51.517167 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:07:51.517167 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:07:51.517167 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:07:51.517167 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:07:51.517167 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:07:51.517167 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:07:51.517167 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:07:51.517167 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:07:51.517167 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:07:51.517167 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:07:51.517984 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:07:51.517984 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:07:51.517984 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:07:51.517984 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:07:51.517984 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:07:51.517984 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:07:51.517984 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:07:51.517984 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:07:51.517984 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:07:51.517984 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:07:51.517984 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:07:51.517984 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:07:51.517984 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 109/230] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:07:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:07:51.524052 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf8b2e-a31e-4c2f-a34f-8503727a669f None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:51.575436 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:51.645597 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf8b2e-a31e-4c2f-a34f-8503727a669f None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:51.681786 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21b566-0bc4-4b9e-822d-2f38651874fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:51.683124 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21b566-0bc4-4b9e-822d-2f38651874fc None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:51.683422 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21b566-0bc4-4b9e-822d-2f38651874fc None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:51.683798 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21b566-0bc4-4b9e-822d-2f38651874fc None admin] PATH_INFO: `/v3/roles` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:51.684563 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef21b566-0bc4-4b9e-822d-2f38651874fc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:07:51.684876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef21b566-0bc4-4b9e-822d-2f38651874fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:51.686364 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef21b566-0bc4-4b9e-822d-2f38651874fc None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:51.695442 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 122/231] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:07:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:51.701591 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af40f9-10e3-455f-9b3e-0e77912a3fa9 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:51.728816 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:51.842896 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af40f9-10e3-455f-9b3e-0e77912a3fa9 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:51.894466 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271bb64e-747a-40d6-86d4-7683aafe26bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:51.895713 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bb64e-747a-40d6-86d4-7683aafe26bd None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:51.896207 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bb64e-747a-40d6-86d4-7683aafe26bd None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:51.896714 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bb64e-747a-40d6-86d4-7683aafe26bd None admin] PATH_INFO: `/v3/users/e5aeaa3fc39b47aebbb86a6eceaf4e93` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:51.899118 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271bb64e-747a-40d6-86d4-7683aafe26bd None admin] RBAC: Authorizing `identity:get_user(user_id=e5aeaa3fc39b47aebbb86a6eceaf4e93)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:51.900918 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271bb64e-747a-40d6-86d4-7683aafe26bd None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:51.903460 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 110/232] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:07:51 2022] GET /identity/v3/users/e5aeaa3fc39b47aebbb86a6eceaf4e93 => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:51.908704 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21b566-0bc4-4b9e-822d-2f38651874fc None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:52.054703 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:52.058329 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21b566-0bc4-4b9e-822d-2f38651874fc None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:52.105640 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61aa7f7-83cf-400a-8cab-316cd2ad9a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:52.106657 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61aa7f7-83cf-400a-8cab-316cd2ad9a25 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:52.106951 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61aa7f7-83cf-400a-8cab-316cd2ad9a25 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:52.107233 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61aa7f7-83cf-400a-8cab-316cd2ad9a25 None admin] PATH_INFO: `/v3/projects/9d370c4b5282475484b01c328ffd7864` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:52.108462 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61aa7f7-83cf-400a-8cab-316cd2ad9a25 None admin] RBAC: Authorizing `identity:get_project(project_id=9d370c4b5282475484b01c328ffd7864)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:52.109937 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61aa7f7-83cf-400a-8cab-316cd2ad9a25 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:52.111975 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 123/233] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:07:51 2022] GET /identity/v3/projects/9d370c4b5282475484b01c328ffd7864 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:52.117735 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271bb64e-747a-40d6-86d4-7683aafe26bd None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:52.233064 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:52.243591 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271bb64e-747a-40d6-86d4-7683aafe26bd None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:52.279081 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc333a-7b54-4a48-934a-5db02183e45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:52.280261 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc333a-7b54-4a48-934a-5db02183e45d None admin] REQUEST_METHOD: `PUT` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:52.280752 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc333a-7b54-4a48-934a-5db02183e45d None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:52.281213 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc333a-7b54-4a48-934a-5db02183e45d None admin] PATH_INFO: `/v3/projects/9d370c4b5282475484b01c328ffd7864/users/e5aeaa3fc39b47aebbb86a6eceaf4e93/roles/49943dd485174ef39fdd0368de241417` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:52.283738 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fc333a-7b54-4a48-934a-5db02183e45d None admin] RBAC: Authorizing `identity:create_grant(project_id=9d370c4b5282475484b01c328ffd7864, user_id=e5aeaa3fc39b47aebbb86a6eceaf4e93, role_id=49943dd485174ef39fdd0368de241417)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:52.285392 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fc333a-7b54-4a48-934a-5db02183e45d None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:52.394874 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 111/234] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:07:52 2022] PUT /identity/v3/projects/9d370c4b5282475484b01c328ffd7864/users/e5aeaa3fc39b47aebbb86a6eceaf4e93/roles/49943dd485174ef39fdd0368de241417 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:07:53.027703 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efbaaa-3542-4f25-891f-d399ffe5d2d8 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:53.028273 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efbaaa-3542-4f25-891f-d399ffe5d2d8 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:53.028273 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efbaaa-3542-4f25-891f-d399ffe5d2d8 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:53.030161 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 124/235] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:07:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:07:53.035571 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64fa17-9cb1-4d5b-9ff8-be08ca09c745 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:53.036016 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64fa17-9cb1-4d5b-9ff8-be08ca09c745 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:53.036227 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64fa17-9cb1-4d5b-9ff8-be08ca09c745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:53.038521 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c656e-a94f-46cb-8c89-61a7ace4d03d None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:53.038818 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c656e-a94f-46cb-8c89-61a7ace4d03d None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:53.039105 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c656e-a94f-46cb-8c89-61a7ace4d03d None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:53.040681 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 125/236] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:07:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:07:53.050347 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c174c-95df-4547-92be-0150a390e6ee None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:53.050647 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c174c-95df-4547-92be-0150a390e6ee None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:53.050935 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c174c-95df-4547-92be-0150a390e6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:53.054451 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-6f64fa17-9cb1-4d5b-9ff8-be08ca09c745 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:07:53.055675 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-6f64fa17-9cb1-4d5b-9ff8-be08ca09c745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:07:53.080044 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-6f2c174c-95df-4547-92be-0150a390e6ee None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:07:53.081260 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-6f2c174c-95df-4547-92be-0150a390e6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:07:53.148833 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 112/237] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:07:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:07:53.176302 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64fa17-9cb1-4d5b-9ff8-be08ca09c745 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:53.211803 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 126/238] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:07:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:07:53.251330 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c174c-95df-4547-92be-0150a390e6ee None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:53.326523 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:53.334736 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64fa17-9cb1-4d5b-9ff8-be08ca09c745 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:53.386412 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6372203b-4710-462d-bbc3-0a19635179ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:53.387278 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372203b-4710-462d-bbc3-0a19635179ce None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:53.387579 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372203b-4710-462d-bbc3-0a19635179ce None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:53.387868 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372203b-4710-462d-bbc3-0a19635179ce None admin] PATH_INFO: `/v3/roles/reader` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:53.398900 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6372203b-4710-462d-bbc3-0a19635179ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:07:53.412961 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-6372203b-4710-462d-bbc3-0a19635179ce None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:07:53.412961 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:07:53.412961 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:07:53.412961 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:07:53.412961 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:07:53.412961 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:07:53.412961 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:07:53.412961 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:07:53.412961 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:07:53.412961 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:07:53.412961 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:07:53.412961 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:07:53.412961 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:07:53.412961 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:07:53.412961 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:07:53.412961 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:07:53.413926 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:07:53.413926 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:07:53.413926 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:07:53.413926 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:07:53.413926 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:07:53.413926 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:07:53.413926 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:07:53.413926 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:07:53.413926 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:07:53.413926 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:07:53.413926 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:07:53.413926 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:07:53.413926 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:07:53.413926 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:07:53.413926 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:07:53.413926 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:07:53.415041 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:07:53.415041 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:07:53.415041 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:07:53.415041 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:07:53.415041 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:07:53.415041 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:07:53.415041 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:07:53.415041 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:07:53.415041 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:07:53.415041 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:07:53.415041 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:07:53.415041 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:07:53.415041 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 113/239] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:07:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:07:53.422492 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:53.423931 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6372203b-4710-462d-bbc3-0a19635179ce None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:53.428970 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c174c-95df-4547-92be-0150a390e6ee None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:53.471722 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f3150-d131-4676-a437-a6487321f9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:53.472536 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f3150-d131-4676-a437-a6487321f9eb None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:53.472826 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f3150-d131-4676-a437-a6487321f9eb None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:53.473103 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f3150-d131-4676-a437-a6487321f9eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:53.475273 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792f3150-d131-4676-a437-a6487321f9eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:53.476762 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792f3150-d131-4676-a437-a6487321f9eb None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:53.478440 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 127/240] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:07:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:07:53.486458 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f3150-d131-4676-a437-a6487321f9eb None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:53.590543 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6372203b-4710-462d-bbc3-0a19635179ce None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:53.622866 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f3150-d131-4676-a437-a6487321f9eb None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:53.626753 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9cfca2-c3d9-45a0-85e5-1da7cc773d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:53.627436 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9cfca2-c3d9-45a0-85e5-1da7cc773d64 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:53.627725 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9cfca2-c3d9-45a0-85e5-1da7cc773d64 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:53.628003 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9cfca2-c3d9-45a0-85e5-1da7cc773d64 None admin] PATH_INFO: `/v3/roles` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:53.628753 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9cfca2-c3d9-45a0-85e5-1da7cc773d64 None admin] RBAC: Adding query filter params (name=reader) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:07:53.629061 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9cfca2-c3d9-45a0-85e5-1da7cc773d64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:53.630466 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9cfca2-c3d9-45a0-85e5-1da7cc773d64 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:53.640284 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 114/241] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:07:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:53.647084 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9cfca2-c3d9-45a0-85e5-1da7cc773d64 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:53.649895 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:53.710863 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f01de2-6f72-4b39-922c-da6b70842ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:53.711614 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f01de2-6f72-4b39-922c-da6b70842ef8 None admin] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:53.711914 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f01de2-6f72-4b39-922c-da6b70842ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:53.712198 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f01de2-6f72-4b39-922c-da6b70842ef8 None admin] PATH_INFO: `/v3/users` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:53.712935 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f01de2-6f72-4b39-922c-da6b70842ef8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:53.714836 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f01de2-6f72-4b39-922c-da6b70842ef8 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:53.754102 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9cfca2-c3d9-45a0-85e5-1da7cc773d64 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:53.789025 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee9b94d-9613-4583-9590-c54d7340c597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:53.789917 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9b94d-9613-4583-9590-c54d7340c597 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:53.790231 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9b94d-9613-4583-9590-c54d7340c597 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:53.790512 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9b94d-9613-4583-9590-c54d7340c597 None admin] PATH_INFO: `/v3/users/b740dca9d83c4ec8a38713f75f1c2505` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:53.804389 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee9b94d-9613-4583-9590-c54d7340c597 None admin] RBAC: Authorizing `identity:get_user(user_id=b740dca9d83c4ec8a38713f75f1c2505)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:53.805857 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee9b94d-9613-4583-9590-c54d7340c597 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:53.806090 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 128/242] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:07:53 2022] POST /identity/v3/users => generated 293 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:07:53.808135 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8617275-73d9-4b10-ae55-f871de9a0be2 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:53.815772 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8617275-73d9-4b10-ae55-f871de9a0be2 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:53.815772 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8617275-73d9-4b10-ae55-f871de9a0be2 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:53.816000 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 115/243] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:07:53 2022] GET /identity/v3/users/b740dca9d83c4ec8a38713f75f1c2505 => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:53.816077 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 129/244] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:07:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:07:53.816143 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee9b94d-9613-4583-9590-c54d7340c597 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:53.816236 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bf183-27ae-4cc6-a3fc-31e8dc97aa08 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:53.816519 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bf183-27ae-4cc6-a3fc-31e8dc97aa08 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:53.816787 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bf183-27ae-4cc6-a3fc-31e8dc97aa08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:53.836142 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-a82bf183-27ae-4cc6-a3fc-31e8dc97aa08 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:07:53.837414 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-a82bf183-27ae-4cc6-a3fc-31e8dc97aa08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:07:53.874840 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:53.883159 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:53.928519 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee9b94d-9613-4583-9590-c54d7340c597 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:53.968296 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc3f3e-5d43-4fd6-8f55-e50ab68b99b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:53.968964 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc3f3e-5d43-4fd6-8f55-e50ab68b99b0 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:53.969251 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc3f3e-5d43-4fd6-8f55-e50ab68b99b0 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:53.969534 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc3f3e-5d43-4fd6-8f55-e50ab68b99b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:53.988829 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 130/245] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:07:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:07:54.014530 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82bf183-27ae-4cc6-a3fc-31e8dc97aa08 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:54.052074 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc3f3e-5d43-4fd6-8f55-e50ab68b99b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:54.053566 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc3f3e-5d43-4fd6-8f55-e50ab68b99b0 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:54.126946 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:54.148293 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82bf183-27ae-4cc6-a3fc-31e8dc97aa08 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:54.178810 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 116/246] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:07:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:07:54.180046 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cd02d-0cdf-4052-b1e6-5cd877a4efe4 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:54.180350 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cd02d-0cdf-4052-b1e6-5cd877a4efe4 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:54.180638 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cd02d-0cdf-4052-b1e6-5cd877a4efe4 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:54.184041 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 117/247] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:07:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:07:54.190534 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9198aa9-e518-47c9-a3f5-8a6ce77be6ff None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:54.190934 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9198aa9-e518-47c9-a3f5-8a6ce77be6ff None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:54.191298 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9198aa9-e518-47c9-a3f5-8a6ce77be6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:54.198800 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4632b5-9870-4696-903a-e5587f417c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:54.200048 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4632b5-9870-4696-903a-e5587f417c54 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:54.200501 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4632b5-9870-4696-903a-e5587f417c54 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:54.200967 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4632b5-9870-4696-903a-e5587f417c54 None admin] PATH_INFO: `/v3/roles/member` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:54.208424 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-d9198aa9-e518-47c9-a3f5-8a6ce77be6ff None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:07:54.209666 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-d9198aa9-e518-47c9-a3f5-8a6ce77be6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:07:54.215447 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4632b5-9870-4696-903a-e5587f417c54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:07:54.225161 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-6c4632b5-9870-4696-903a-e5587f417c54 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:07:54.225161 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:07:54.225161 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:07:54.225161 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:07:54.225161 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:07:54.225161 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:07:54.225161 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:07:54.225161 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:07:54.225161 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:07:54.225161 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:07:54.225161 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:07:54.225161 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:07:54.225161 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:07:54.225161 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:07:54.225161 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:07:54.225161 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:07:54.226526 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:07:54.226526 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:07:54.226526 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:07:54.226526 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:07:54.226526 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:07:54.226526 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:07:54.226526 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:07:54.226526 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:07:54.226526 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:07:54.226526 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:07:54.226526 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:07:54.226526 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:07:54.226526 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:07:54.226526 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:07:54.226526 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:07:54.226526 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:07:54.227342 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:07:54.227342 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:07:54.227342 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:07:54.227342 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:07:54.227342 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:07:54.227342 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:07:54.227342 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:07:54.227342 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:07:54.227342 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:07:54.227342 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:07:54.227342 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:07:54.227342 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:07:54.228495 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 131/248] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:07:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:07:54.231187 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4632b5-9870-4696-903a-e5587f417c54 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:54.247346 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:54.309232 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 118/249] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:07:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:07:54.310957 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9198aa9-e518-47c9-a3f5-8a6ce77be6ff None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:54.365724 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4632b5-9870-4696-903a-e5587f417c54 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:54.412171 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f1f8c-7d28-4ef4-a2ad-6dcabf987789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:54.413004 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f1f8c-7d28-4ef4-a2ad-6dcabf987789 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:54.413301 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f1f8c-7d28-4ef4-a2ad-6dcabf987789 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:54.413582 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f1f8c-7d28-4ef4-a2ad-6dcabf987789 None admin] PATH_INFO: `/v3/projects/9d370c4b5282475484b01c328ffd7864` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:54.416505 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0f1f8c-7d28-4ef4-a2ad-6dcabf987789 None admin] RBAC: Authorizing `identity:get_project(project_id=9d370c4b5282475484b01c328ffd7864)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:54.418054 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0f1f8c-7d28-4ef4-a2ad-6dcabf987789 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:54.420015 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 132/250] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:07:54 2022] GET /identity/v3/projects/9d370c4b5282475484b01c328ffd7864 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:54.420688 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f1f8c-7d28-4ef4-a2ad-6dcabf987789 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:54.462487 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:54.481245 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9198aa9-e518-47c9-a3f5-8a6ce77be6ff None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:54.534750 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce7505b-d1b2-4548-a4ee-82ea7a124a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:54.535443 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7505b-d1b2-4548-a4ee-82ea7a124a23 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:54.535735 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7505b-d1b2-4548-a4ee-82ea7a124a23 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:54.536014 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7505b-d1b2-4548-a4ee-82ea7a124a23 None admin] PATH_INFO: `/v3/roles` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:54.537265 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce7505b-d1b2-4548-a4ee-82ea7a124a23 None admin] RBAC: Adding query filter params (name=member) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:07:54.537578 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce7505b-d1b2-4548-a4ee-82ea7a124a23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:54.539015 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce7505b-d1b2-4548-a4ee-82ea7a124a23 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:54.560736 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 119/251] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:07:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:54.561680 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce7505b-d1b2-4548-a4ee-82ea7a124a23 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:54.571208 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:54.595491 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f1f8c-7d28-4ef4-a2ad-6dcabf987789 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:54.638168 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1500a273-9ffb-4cc9-88d7-90b36eca40ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:54.639174 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500a273-9ffb-4cc9-88d7-90b36eca40ec None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:54.639560 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500a273-9ffb-4cc9-88d7-90b36eca40ec None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:54.639937 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500a273-9ffb-4cc9-88d7-90b36eca40ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:54.652728 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1500a273-9ffb-4cc9-88d7-90b36eca40ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:07:54.661104 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-1500a273-9ffb-4cc9-88d7-90b36eca40ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:07:54.661104 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:07:54.661104 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:07:54.661104 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:07:54.661104 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:07:54.661104 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:07:54.661104 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:07:54.661104 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:07:54.661104 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:07:54.661104 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:07:54.661104 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:07:54.661104 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:07:54.661104 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:07:54.661104 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:07:54.661104 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:07:54.661104 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:07:54.662257 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:07:54.662257 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:07:54.662257 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:07:54.662257 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:07:54.662257 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:07:54.662257 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:07:54.662257 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:07:54.662257 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:07:54.662257 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:07:54.662257 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:07:54.662257 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:07:54.662257 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:07:54.662257 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:07:54.662257 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:07:54.662257 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:07:54.662257 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:07:54.663082 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:07:54.663082 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:07:54.663082 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:07:54.663082 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:07:54.663082 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:07:54.663082 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:07:54.663082 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:07:54.663082 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:07:54.663082 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:07:54.663082 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:07:54.663082 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:07:54.663082 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:07:54.663705 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 133/252] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:07:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:07:54.670572 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1500a273-9ffb-4cc9-88d7-90b36eca40ec None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:54.796055 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1500a273-9ffb-4cc9-88d7-90b36eca40ec None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:54.809752 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce7505b-d1b2-4548-a4ee-82ea7a124a23 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:54.836218 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28c7ca-11f3-4b0a-af9d-2900fd9828b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:54.837116 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28c7ca-11f3-4b0a-af9d-2900fd9828b2 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:54.837405 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28c7ca-11f3-4b0a-af9d-2900fd9828b2 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:54.837685 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28c7ca-11f3-4b0a-af9d-2900fd9828b2 None admin] PATH_INFO: `/v3/users/6a648fc35db14568bfaf30037782facc` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:54.844071 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c28c7ca-11f3-4b0a-af9d-2900fd9828b2 None admin] RBAC: Authorizing `identity:get_user(user_id=6a648fc35db14568bfaf30037782facc)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:54.845570 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c28c7ca-11f3-4b0a-af9d-2900fd9828b2 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:54.847292 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 134/253] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:07:54 2022] GET /identity/v3/users/6a648fc35db14568bfaf30037782facc => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:54.848079 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28c7ca-11f3-4b0a-af9d-2900fd9828b2 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:54.864574 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:54.894603 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece3adc-67a3-4cd1-93e5-e53ee2667724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:54.895284 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece3adc-67a3-4cd1-93e5-e53ee2667724 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:54.895571 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece3adc-67a3-4cd1-93e5-e53ee2667724 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:54.895855 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece3adc-67a3-4cd1-93e5-e53ee2667724 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:54.896698 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece3adc-67a3-4cd1-93e5-e53ee2667724 None admin] RBAC: Adding query filter params (role.id=e8b0e7643206483385c49640e21e33d7, scope.project.id=9d370c4b5282475484b01c328ffd7864, user.id=b740dca9d83c4ec8a38713f75f1c2505) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:07:54.897073 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece3adc-67a3-4cd1-93e5-e53ee2667724 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:54.898576 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece3adc-67a3-4cd1-93e5-e53ee2667724 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:54.913905 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 120/254] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:07:54 2022] GET /identity/v3/role_assignments?user.id=b740dca9d83c4ec8a38713f75f1c2505&scope.project.id=9d370c4b5282475484b01c328ffd7864&role.id=e8b0e7643206483385c49640e21e33d7 => generated 259 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:54.914633 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece3adc-67a3-4cd1-93e5-e53ee2667724 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:54.954538 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:54.979450 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28c7ca-11f3-4b0a-af9d-2900fd9828b2 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:55.059613 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46981f-fcd3-4da4-90bf-1e0b352d4f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:55.060320 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46981f-fcd3-4da4-90bf-1e0b352d4f85 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:55.060612 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46981f-fcd3-4da4-90bf-1e0b352d4f85 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:55.060895 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46981f-fcd3-4da4-90bf-1e0b352d4f85 None admin] PATH_INFO: `/v3/roles` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:55.061668 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f46981f-fcd3-4da4-90bf-1e0b352d4f85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:07:55.061986 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f46981f-fcd3-4da4-90bf-1e0b352d4f85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:55.063692 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f46981f-fcd3-4da4-90bf-1e0b352d4f85 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:55.074067 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 135/255] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:07:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:55.083251 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46981f-fcd3-4da4-90bf-1e0b352d4f85 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:55.157275 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece3adc-67a3-4cd1-93e5-e53ee2667724 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:55.200029 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8a3cb-02e1-43d5-8d99-de040b3c44b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:55.200972 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8a3cb-02e1-43d5-8d99-de040b3c44b0 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:55.201296 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8a3cb-02e1-43d5-8d99-de040b3c44b0 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:55.201583 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8a3cb-02e1-43d5-8d99-de040b3c44b0 None admin] PATH_INFO: `/v3/projects/9d370c4b5282475484b01c328ffd7864` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:55.207022 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e8a3cb-02e1-43d5-8d99-de040b3c44b0 None admin] RBAC: Authorizing `identity:get_project(project_id=9d370c4b5282475484b01c328ffd7864)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:55.208602 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e8a3cb-02e1-43d5-8d99-de040b3c44b0 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:55.212850 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 121/256] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:07:54 2022] GET /identity/v3/projects/9d370c4b5282475484b01c328ffd7864 => generated 302 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:55.214622 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d31eb5-3664-4ce1-9428-85ae53abb41c None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:55.217656 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d31eb5-3664-4ce1-9428-85ae53abb41c None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:55.217983 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d31eb5-3664-4ce1-9428-85ae53abb41c None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:55.219859 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 122/257] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:07:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:07:55.221012 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d31eb5-3664-4ce1-9428-85ae53abb41c None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:55.271391 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:55.322677 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46981f-fcd3-4da4-90bf-1e0b352d4f85 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:55.373414 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e79f3c-c25a-497b-b677-ee2137e0cce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:55.374354 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e79f3c-c25a-497b-b677-ee2137e0cce0 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:55.374639 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e79f3c-c25a-497b-b677-ee2137e0cce0 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:55.374920 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e79f3c-c25a-497b-b677-ee2137e0cce0 None admin] PATH_INFO: `/v3/users/e5aeaa3fc39b47aebbb86a6eceaf4e93` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:55.376342 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e79f3c-c25a-497b-b677-ee2137e0cce0 None admin] RBAC: Authorizing `identity:get_user(user_id=e5aeaa3fc39b47aebbb86a6eceaf4e93)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:55.377813 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e79f3c-c25a-497b-b677-ee2137e0cce0 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:55.380491 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 136/258] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:07:55 2022] GET /identity/v3/users/e5aeaa3fc39b47aebbb86a6eceaf4e93 => generated 283 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:55.381721 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11e93b-3681-455e-8530-77597b0dcf3f None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:55.382014 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11e93b-3681-455e-8530-77597b0dcf3f None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:55.382322 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11e93b-3681-455e-8530-77597b0dcf3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:55.390946 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:55.408605 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d31eb5-3664-4ce1-9428-85ae53abb41c None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:55.411086 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-9a11e93b-3681-455e-8530-77597b0dcf3f None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:07:55.412278 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-9a11e93b-3681-455e-8530-77597b0dcf3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:07:55.482214 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1439aad1-4f3f-4aa0-8903-965d9961d43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:55.483030 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439aad1-4f3f-4aa0-8903-965d9961d43c None admin] REQUEST_METHOD: `PUT` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:55.483317 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439aad1-4f3f-4aa0-8903-965d9961d43c None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:55.483594 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439aad1-4f3f-4aa0-8903-965d9961d43c None admin] PATH_INFO: `/v3/projects/9d370c4b5282475484b01c328ffd7864/users/6a648fc35db14568bfaf30037782facc/roles/f9389c8fc7a74300aed4cf6490fb672b` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:55.492425 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1439aad1-4f3f-4aa0-8903-965d9961d43c None admin] RBAC: Authorizing `identity:create_grant(project_id=9d370c4b5282475484b01c328ffd7864, user_id=6a648fc35db14568bfaf30037782facc, role_id=f9389c8fc7a74300aed4cf6490fb672b)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:55.493896 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1439aad1-4f3f-4aa0-8903-965d9961d43c None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:55.525174 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 137/259] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:07:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:07:55.526661 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a11e93b-3681-455e-8530-77597b0dcf3f None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:55.577906 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 123/260] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:07:55 2022] PUT /identity/v3/projects/9d370c4b5282475484b01c328ffd7864/users/6a648fc35db14568bfaf30037782facc/roles/f9389c8fc7a74300aed4cf6490fb672b => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:07:55.578680 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1439aad1-4f3f-4aa0-8903-965d9961d43c None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:55.621124 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:55.660800 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a11e93b-3681-455e-8530-77597b0dcf3f None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:55.698741 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187977fd-4353-4b0a-aed1-720687f95ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:55.699414 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187977fd-4353-4b0a-aed1-720687f95ebc None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:55.699706 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187977fd-4353-4b0a-aed1-720687f95ebc None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:55.699991 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187977fd-4353-4b0a-aed1-720687f95ebc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:55.775357 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187977fd-4353-4b0a-aed1-720687f95ebc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:55.777090 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187977fd-4353-4b0a-aed1-720687f95ebc None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:55.790012 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1439aad1-4f3f-4aa0-8903-965d9961d43c None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:55.874564 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:55.884397 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 138/261] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:07:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:07:55.890529 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187977fd-4353-4b0a-aed1-720687f95ebc None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:55.898306 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8206e5a3-f710-43a1-b100-1ff4f321cbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:55.900409 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206e5a3-f710-43a1-b100-1ff4f321cbe0 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:55.900409 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206e5a3-f710-43a1-b100-1ff4f321cbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:55.900409 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206e5a3-f710-43a1-b100-1ff4f321cbe0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:55.927134 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8206e5a3-f710-43a1-b100-1ff4f321cbe0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:07:55.944118 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-8206e5a3-f710-43a1-b100-1ff4f321cbe0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:07:55.944118 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:07:55.944118 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:07:55.944118 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:07:55.944118 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:07:55.944118 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:07:55.944118 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:07:55.944118 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:07:55.944118 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:07:55.944118 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:07:55.944118 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:07:55.944118 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:07:55.944118 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:07:55.944118 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:07:55.944118 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:07:55.944118 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:07:55.945112 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:07:55.945112 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:07:55.945112 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:07:55.945112 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:07:55.945112 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:07:55.945112 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:07:55.945112 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:07:55.945112 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:07:55.945112 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:07:55.945112 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:07:55.945112 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:07:55.945112 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:07:55.945112 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:07:55.945112 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:07:55.945112 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:07:55.945112 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:07:55.946367 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:07:55.946367 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:07:55.946367 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:07:55.946367 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:07:55.946367 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:07:55.946367 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:07:55.946367 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:07:55.946367 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:07:55.946367 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:07:55.946367 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:07:55.946367 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:07:55.946367 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:07:55.946367 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 124/262] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:07:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:07:55.958862 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8206e5a3-f710-43a1-b100-1ff4f321cbe0 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:55.966190 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:56.004334 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187977fd-4353-4b0a-aed1-720687f95ebc None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:56.040666 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aea5ec-3940-448b-9bb0-04b09bac7ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:56.042046 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aea5ec-3940-448b-9bb0-04b09bac7ecd None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:56.042454 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aea5ec-3940-448b-9bb0-04b09bac7ecd None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:56.042845 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aea5ec-3940-448b-9bb0-04b09bac7ecd None admin] PATH_INFO: `/v3/projects/9d370c4b5282475484b01c328ffd7864` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:56.044135 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aea5ec-3940-448b-9bb0-04b09bac7ecd None admin] RBAC: Authorizing `identity:get_project(project_id=9d370c4b5282475484b01c328ffd7864)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:56.045758 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aea5ec-3940-448b-9bb0-04b09bac7ecd None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:56.048248 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 139/263] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:07:55 2022] GET /identity/v3/projects/9d370c4b5282475484b01c328ffd7864 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:07:56.054580 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aea5ec-3940-448b-9bb0-04b09bac7ecd None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:56.094754 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:56.146562 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8206e5a3-f710-43a1-b100-1ff4f321cbe0 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:56.163411 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aea5ec-3940-448b-9bb0-04b09bac7ecd None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:56.213933 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce44b7-0b48-40ba-9f7c-d05a671d92a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:56.218841 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd78564-ff27-49f4-8b07-6d3d4d6a5322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:56.219526 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd78564-ff27-49f4-8b07-6d3d4d6a5322 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:56.219818 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd78564-ff27-49f4-8b07-6d3d4d6a5322 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:56.220105 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd78564-ff27-49f4-8b07-6d3d4d6a5322 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:56.220960 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd78564-ff27-49f4-8b07-6d3d4d6a5322 None admin] RBAC: Adding query filter params (role.id=101b93f94624407f8c812ab86ebec32a, scope.project.id=9d370c4b5282475484b01c328ffd7864, user.id=e5aeaa3fc39b47aebbb86a6eceaf4e93) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:07:56.221281 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd78564-ff27-49f4-8b07-6d3d4d6a5322 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:56.222793 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd78564-ff27-49f4-8b07-6d3d4d6a5322 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:56.225351 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce44b7-0b48-40ba-9f7c-d05a671d92a0 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:56.225646 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce44b7-0b48-40ba-9f7c-d05a671d92a0 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:56.225927 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce44b7-0b48-40ba-9f7c-d05a671d92a0 None admin] PATH_INFO: `/v3/roles` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:56.226738 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce44b7-0b48-40ba-9f7c-d05a671d92a0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:07:56.227059 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce44b7-0b48-40ba-9f7c-d05a671d92a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:56.228464 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce44b7-0b48-40ba-9f7c-d05a671d92a0 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:56.236396 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 140/264] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:07:56 2022] GET /identity/v3/role_assignments?user.id=e5aeaa3fc39b47aebbb86a6eceaf4e93&scope.project.id=9d370c4b5282475484b01c328ffd7864&role.id=101b93f94624407f8c812ab86ebec32a => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:56.253666 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 125/265] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:07:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:07:56.259233 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd78564-ff27-49f4-8b07-6d3d4d6a5322 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:56.418565 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:56.424429 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd78564-ff27-49f4-8b07-6d3d4d6a5322 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:56.466067 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb78903f-6ee5-44b2-8dde-7de50c6b9945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:56.467014 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78903f-6ee5-44b2-8dde-7de50c6b9945 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:56.467302 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78903f-6ee5-44b2-8dde-7de50c6b9945 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:56.467585 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78903f-6ee5-44b2-8dde-7de50c6b9945 None admin] PATH_INFO: `/v3/users/e5aeaa3fc39b47aebbb86a6eceaf4e93` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:56.468843 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb78903f-6ee5-44b2-8dde-7de50c6b9945 None admin] RBAC: Authorizing `identity:get_user(user_id=e5aeaa3fc39b47aebbb86a6eceaf4e93)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:56.470354 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb78903f-6ee5-44b2-8dde-7de50c6b9945 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:56.472322 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 141/266] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:07:56 2022] GET /identity/v3/users/e5aeaa3fc39b47aebbb86a6eceaf4e93 => generated 283 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:56.477401 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce44b7-0b48-40ba-9f7c-d05a671d92a0 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:56.567724 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:56.616716 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce44b7-0b48-40ba-9f7c-d05a671d92a0 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:56.660777 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f23c5-e8e3-4b29-b244-a7db1d9920c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:56.661454 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f23c5-e8e3-4b29-b244-a7db1d9920c6 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:56.661746 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f23c5-e8e3-4b29-b244-a7db1d9920c6 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:56.662035 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f23c5-e8e3-4b29-b244-a7db1d9920c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:56.753583 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794f23c5-e8e3-4b29-b244-a7db1d9920c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:56.755086 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794f23c5-e8e3-4b29-b244-a7db1d9920c6 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:56.832898 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:56.880213 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 126/267] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:07:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:07:56.885581 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb78903f-6ee5-44b2-8dde-7de50c6b9945 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:57.010838 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb78903f-6ee5-44b2-8dde-7de50c6b9945 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:57.059850 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13623a3-cacd-4662-bc4a-7041f3794131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:57.060735 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13623a3-cacd-4662-bc4a-7041f3794131 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:57.061027 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13623a3-cacd-4662-bc4a-7041f3794131 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:57.061311 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13623a3-cacd-4662-bc4a-7041f3794131 None admin] PATH_INFO: `/v3/projects/9d370c4b5282475484b01c328ffd7864` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:57.062567 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13623a3-cacd-4662-bc4a-7041f3794131 None admin] RBAC: Authorizing `identity:get_project(project_id=9d370c4b5282475484b01c328ffd7864)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:57.064335 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13623a3-cacd-4662-bc4a-7041f3794131 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:57.066322 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 142/268] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:07:56 2022] GET /identity/v3/projects/9d370c4b5282475484b01c328ffd7864 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:57.071818 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f23c5-e8e3-4b29-b244-a7db1d9920c6 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:57.194763 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f23c5-e8e3-4b29-b244-a7db1d9920c6 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:57.235141 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e8e5f-b85a-4ecc-9883-801173c892ef None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:57.235459 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e8e5f-b85a-4ecc-9883-801173c892ef None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:57.235709 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e8e5f-b85a-4ecc-9883-801173c892ef None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:57.237086 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 143/269] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:07:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:07:57.243292 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c0763-6b5b-478c-acff-73c454acaedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:57.244624 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6383c80-5afd-417c-a9a5-df6686fa1993 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:57.244806 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6383c80-5afd-417c-a9a5-df6686fa1993 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:57.245091 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6383c80-5afd-417c-a9a5-df6686fa1993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:57.250534 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c0763-6b5b-478c-acff-73c454acaedf None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:57.250821 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c0763-6b5b-478c-acff-73c454acaedf None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:57.251099 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c0763-6b5b-478c-acff-73c454acaedf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:57.251951 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c0763-6b5b-478c-acff-73c454acaedf None admin] RBAC: Adding query filter params (role.id=49943dd485174ef39fdd0368de241417, scope.project.id=9d370c4b5282475484b01c328ffd7864, user.id=e5aeaa3fc39b47aebbb86a6eceaf4e93) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:07:57.252268 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c0763-6b5b-478c-acff-73c454acaedf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:57.253741 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c0763-6b5b-478c-acff-73c454acaedf None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:57.269073 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-f6383c80-5afd-417c-a9a5-df6686fa1993 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:07:57.270300 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-f6383c80-5afd-417c-a9a5-df6686fa1993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:07:57.274401 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 127/270] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:07:57 2022] GET /identity/v3/role_assignments?user.id=e5aeaa3fc39b47aebbb86a6eceaf4e93&scope.project.id=9d370c4b5282475484b01c328ffd7864&role.id=49943dd485174ef39fdd0368de241417 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:57.308714 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:57.365349 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c127a-1c68-473a-9b6d-4f638216d89b None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:57.365705 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c127a-1c68-473a-9b6d-4f638216d89b None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:57.365917 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c127a-1c68-473a-9b6d-4f638216d89b None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:57.367383 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 128/271] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:07:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:07:57.373705 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3973933-486f-47f8-9578-7c4f75e5910f None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:57.374010 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3973933-486f-47f8-9578-7c4f75e5910f None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:57.374309 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3973933-486f-47f8-9578-7c4f75e5910f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:57.379574 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 144/272] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:07:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:07:57.405217 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6383c80-5afd-417c-a9a5-df6686fa1993 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:57.409647 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-d3973933-486f-47f8-9578-7c4f75e5910f None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:07:57.410966 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-d3973933-486f-47f8-9578-7c4f75e5910f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:07:57.464004 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:57.519409 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 129/273] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:07:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 05 21:07:57.543237 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6383c80-5afd-417c-a9a5-df6686fa1993 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:57.545769 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3973933-486f-47f8-9578-7c4f75e5910f None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:57.589503 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d31a83-bf83-4068-be88-3f220629dc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:57.590337 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d31a83-bf83-4068-be88-3f220629dc2c None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:57.592348 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d31a83-bf83-4068-be88-3f220629dc2c None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:57.592807 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d31a83-bf83-4068-be88-3f220629dc2c None admin] PATH_INFO: `/v3/domains/default` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:57.594570 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d31a83-bf83-4068-be88-3f220629dc2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:57.595538 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d31a83-bf83-4068-be88-3f220629dc2c None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:57.597202 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 145/274] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:07:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:07:57.600078 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d4966-4012-49e5-a9ad-25c599eaa3c7 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:57.600527 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d4966-4012-49e5-a9ad-25c599eaa3c7 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:57.600947 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d4966-4012-49e5-a9ad-25c599eaa3c7 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:57.602384 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 146/275] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:07:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:07:57.608143 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2d4966-4012-49e5-a9ad-25c599eaa3c7 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:57.643247 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:57.671476 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3973933-486f-47f8-9578-7c4f75e5910f None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:57.710090 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ca1a2-042a-4ca0-80aa-9f6afeb2437c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:57.710928 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ca1a2-042a-4ca0-80aa-9f6afeb2437c None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:57.711272 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ca1a2-042a-4ca0-80aa-9f6afeb2437c None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:57.711560 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ca1a2-042a-4ca0-80aa-9f6afeb2437c None admin] PATH_INFO: `/v3/roles/member` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:57.715333 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2d4966-4012-49e5-a9ad-25c599eaa3c7 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:57.721901 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ca1a2-042a-4ca0-80aa-9f6afeb2437c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:07:57.729901 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-fd5ca1a2-042a-4ca0-80aa-9f6afeb2437c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:07:57.729901 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:07:57.729901 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:07:57.729901 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:07:57.729901 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:07:57.729901 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:07:57.729901 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:07:57.729901 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:07:57.729901 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:07:57.729901 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:07:57.729901 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:07:57.729901 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:07:57.729901 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:07:57.729901 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:07:57.729901 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:07:57.729901 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:07:57.731025 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:07:57.731025 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:07:57.731025 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:07:57.731025 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:07:57.731025 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:07:57.731025 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:07:57.731025 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:07:57.731025 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:07:57.731025 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:07:57.731025 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:07:57.731025 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:07:57.731025 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:07:57.731025 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:07:57.731025 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:07:57.731025 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:07:57.731025 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:07:57.731846 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:07:57.731846 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:07:57.731846 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:07:57.731846 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:07:57.731846 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:07:57.731846 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:07:57.731846 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:07:57.731846 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:07:57.731846 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:07:57.731846 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:07:57.731846 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:07:57.731846 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:07:57.731846 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 130/276] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:07:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:07:57.732574 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78434d0b-cac7-45fe-a458-d0953284ed2e None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:57.732662 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78434d0b-cac7-45fe-a458-d0953284ed2e None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:57.732947 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78434d0b-cac7-45fe-a458-d0953284ed2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:57.750070 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-78434d0b-cac7-45fe-a458-d0953284ed2e None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:07:57.751265 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-78434d0b-cac7-45fe-a458-d0953284ed2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:07:57.758212 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa48032-538a-40bf-95e3-1bf98aef2113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:57.759420 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa48032-538a-40bf-95e3-1bf98aef2113 None admin] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:57.759882 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa48032-538a-40bf-95e3-1bf98aef2113 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:57.760357 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa48032-538a-40bf-95e3-1bf98aef2113 None admin] PATH_INFO: `/v3/users` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:57.761581 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa48032-538a-40bf-95e3-1bf98aef2113 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:57.763835 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa48032-538a-40bf-95e3-1bf98aef2113 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:57.765514 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:57.818877 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 131/277] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:07:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:07:57.823322 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78434d0b-cac7-45fe-a458-d0953284ed2e None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:57.868458 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 147/278] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:07:57 2022] POST /identity/v3/users => generated 293 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:07:57.868458 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa48032-538a-40bf-95e3-1bf98aef2113 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:57.944448 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78434d0b-cac7-45fe-a458-d0953284ed2e None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:57.987339 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760bf421-4261-4a72-bee8-de514f403601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:57.987978 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760bf421-4261-4a72-bee8-de514f403601 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:57.988300 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760bf421-4261-4a72-bee8-de514f403601 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:57.988587 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760bf421-4261-4a72-bee8-de514f403601 None admin] PATH_INFO: `/v3/roles` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:57.989354 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760bf421-4261-4a72-bee8-de514f403601 None admin] RBAC: Adding query filter params (name=member) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:07:57.989666 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760bf421-4261-4a72-bee8-de514f403601 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:57.991189 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760bf421-4261-4a72-bee8-de514f403601 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:57.996925 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:58.005565 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 132/279] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:07:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:58.006579 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760bf421-4261-4a72-bee8-de514f403601 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:58.012270 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa48032-538a-40bf-95e3-1bf98aef2113 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:58.023979 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:58.051908 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c8bb47-e43e-496a-96b8-071c09beb7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:58.054176 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8bb47-e43e-496a-96b8-071c09beb7e4 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:58.054176 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8bb47-e43e-496a-96b8-071c09beb7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:58.054176 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8bb47-e43e-496a-96b8-071c09beb7e4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:58.065580 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c8bb47-e43e-496a-96b8-071c09beb7e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:07:58.074864 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-70c8bb47-e43e-496a-96b8-071c09beb7e4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:07:58.074864 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:07:58.074864 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:07:58.074864 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:07:58.074864 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:07:58.074864 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:07:58.074864 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:07:58.074864 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:07:58.074864 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:07:58.074864 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:07:58.074864 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:07:58.074864 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:07:58.074864 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:07:58.074864 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:07:58.074864 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:07:58.074864 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:07:58.075865 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:07:58.075865 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:07:58.075865 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:07:58.075865 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:07:58.075865 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:07:58.075865 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:07:58.075865 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:07:58.075865 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:07:58.075865 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:07:58.075865 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:07:58.075865 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:07:58.075865 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:07:58.075865 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:07:58.075865 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:07:58.075865 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:07:58.075865 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:07:58.077535 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:07:58.077535 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:07:58.077535 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:07:58.077535 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:07:58.077535 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:07:58.077535 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:07:58.077535 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:07:58.077535 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:07:58.077535 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:07:58.077535 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:07:58.077535 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:07:58.077535 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:07:58.077535 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 148/280] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:07:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:07:58.082265 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c8bb47-e43e-496a-96b8-071c09beb7e4 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:58.137932 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760bf421-4261-4a72-bee8-de514f403601 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:58.209955 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d6eee-a50c-4aa5-8c96-be96be223ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:58.210896 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d6eee-a50c-4aa5-8c96-be96be223ba4 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:58.211187 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d6eee-a50c-4aa5-8c96-be96be223ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:58.211472 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d6eee-a50c-4aa5-8c96-be96be223ba4 None admin] PATH_INFO: `/v3/users/49b8584dde47454d865042f45fa5d6cf` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:58.234789 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488d6eee-a50c-4aa5-8c96-be96be223ba4 None admin] RBAC: Authorizing `identity:get_user(user_id=49b8584dde47454d865042f45fa5d6cf)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:58.236626 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488d6eee-a50c-4aa5-8c96-be96be223ba4 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:58.238951 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 133/281] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:07:58 2022] GET /identity/v3/users/49b8584dde47454d865042f45fa5d6cf => generated 293 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:58.245189 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d6eee-a50c-4aa5-8c96-be96be223ba4 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:58.251907 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c8bb47-e43e-496a-96b8-071c09beb7e4 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:58.291364 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b803b7a-dd59-49a8-b3d9-2fc968c88405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:58.292055 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b803b7a-dd59-49a8-b3d9-2fc968c88405 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:58.292340 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b803b7a-dd59-49a8-b3d9-2fc968c88405 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:58.292620 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b803b7a-dd59-49a8-b3d9-2fc968c88405 None admin] PATH_INFO: `/v3/roles` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:58.293377 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b803b7a-dd59-49a8-b3d9-2fc968c88405 None admin] RBAC: Adding query filter params (name=reader) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:07:58.293691 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b803b7a-dd59-49a8-b3d9-2fc968c88405 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:58.295102 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b803b7a-dd59-49a8-b3d9-2fc968c88405 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:58.321243 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 149/282] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:07:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:58.327954 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b803b7a-dd59-49a8-b3d9-2fc968c88405 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:58.337956 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:58.343699 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:58.371141 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d6eee-a50c-4aa5-8c96-be96be223ba4 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:58.408185 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f258e2-a242-4af9-913a-a4c8352ef1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:58.408864 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f258e2-a242-4af9-913a-a4c8352ef1a9 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:58.409153 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f258e2-a242-4af9-913a-a4c8352ef1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:58.409431 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f258e2-a242-4af9-913a-a4c8352ef1a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:58.411435 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f258e2-a242-4af9-913a-a4c8352ef1a9 None admin] RBAC: Adding query filter params (role.id=f9389c8fc7a74300aed4cf6490fb672b, user.id=49b8584dde47454d865042f45fa5d6cf, scope.system=all) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:07:58.411769 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f258e2-a242-4af9-913a-a4c8352ef1a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:58.413294 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f258e2-a242-4af9-913a-a4c8352ef1a9 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:58.419907 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 134/283] 10.222.0.30 () {56 vars in 1308 bytes} [Tue Jul 5 21:07:58 2022] GET /identity/v3/role_assignments?user.id=49b8584dde47454d865042f45fa5d6cf&scope.system=all&role.id=f9389c8fc7a74300aed4cf6490fb672b => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:07:58.421304 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d46e2b-f8ee-41ff-8dda-9f2509aad3e5 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:58.421603 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d46e2b-f8ee-41ff-8dda-9f2509aad3e5 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:58.421882 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d46e2b-f8ee-41ff-8dda-9f2509aad3e5 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:58.423463 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 135/284] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:07:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:07:58.428601 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd92ab2-6d2c-4598-b48f-40fe431cf8f1 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:58.428902 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd92ab2-6d2c-4598-b48f-40fe431cf8f1 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:58.429192 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd92ab2-6d2c-4598-b48f-40fe431cf8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:58.437414 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b803b7a-dd59-49a8-b3d9-2fc968c88405 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:58.448416 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-9bd92ab2-6d2c-4598-b48f-40fe431cf8f1 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:07:58.449779 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-9bd92ab2-6d2c-4598-b48f-40fe431cf8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:07:58.480371 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2389236-9aef-47eb-b2fe-53cb18eec329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:58.481182 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2389236-9aef-47eb-b2fe-53cb18eec329 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:58.481467 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2389236-9aef-47eb-b2fe-53cb18eec329 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:58.481744 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2389236-9aef-47eb-b2fe-53cb18eec329 None admin] PATH_INFO: `/v3/users/b740dca9d83c4ec8a38713f75f1c2505` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:58.488595 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2389236-9aef-47eb-b2fe-53cb18eec329 None admin] RBAC: Authorizing `identity:get_user(user_id=b740dca9d83c4ec8a38713f75f1c2505)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:58.488595 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2389236-9aef-47eb-b2fe-53cb18eec329 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:58.489169 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 150/285] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:07:58 2022] GET /identity/v3/users/b740dca9d83c4ec8a38713f75f1c2505 => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:58.495269 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2389236-9aef-47eb-b2fe-53cb18eec329 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:58.589845 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 136/286] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:07:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:07:58.615257 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd92ab2-6d2c-4598-b48f-40fe431cf8f1 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:58.646507 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:58.668243 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2389236-9aef-47eb-b2fe-53cb18eec329 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:58.718580 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:58.745170 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c12c8b8-8335-4675-8dc6-6a7f2be85ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:58.745561 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12c8b8-8335-4675-8dc6-6a7f2be85ef6 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:58.745851 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12c8b8-8335-4675-8dc6-6a7f2be85ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:58.746146 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12c8b8-8335-4675-8dc6-6a7f2be85ef6 None admin] PATH_INFO: `/v3/projects/9d370c4b5282475484b01c328ffd7864` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:58.748307 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c12c8b8-8335-4675-8dc6-6a7f2be85ef6 None admin] RBAC: Authorizing `identity:get_project(project_id=9d370c4b5282475484b01c328ffd7864)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:58.749765 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c12c8b8-8335-4675-8dc6-6a7f2be85ef6 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:58.751515 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 151/287] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:07:58 2022] GET /identity/v3/projects/9d370c4b5282475484b01c328ffd7864 => generated 302 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:58.759056 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c12c8b8-8335-4675-8dc6-6a7f2be85ef6 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:58.769967 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd92ab2-6d2c-4598-b48f-40fe431cf8f1 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:58.831340 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad06fd8-3c50-40db-9a8d-ed1176de4e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:58.832165 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad06fd8-3c50-40db-9a8d-ed1176de4e70 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:58.832453 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad06fd8-3c50-40db-9a8d-ed1176de4e70 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:58.832735 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad06fd8-3c50-40db-9a8d-ed1176de4e70 None admin] PATH_INFO: `/v3/roles/member` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:58.845688 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad06fd8-3c50-40db-9a8d-ed1176de4e70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:07:58.855905 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-bad06fd8-3c50-40db-9a8d-ed1176de4e70 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:07:58.855905 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:07:58.855905 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:07:58.855905 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:07:58.855905 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:07:58.855905 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:07:58.855905 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:07:58.855905 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:07:58.855905 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:07:58.855905 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:07:58.855905 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:07:58.855905 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:07:58.855905 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:07:58.855905 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:07:58.855905 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:07:58.855905 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:07:58.856786 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:07:58.856786 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:07:58.856786 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:07:58.856786 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:07:58.856786 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:07:58.856786 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:07:58.856786 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:07:58.856786 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:07:58.856786 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:07:58.856786 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:07:58.856786 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:07:58.856786 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:07:58.856786 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:07:58.856786 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:07:58.856786 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:07:58.856786 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:07:58.857602 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:07:58.857602 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:07:58.857602 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:07:58.857602 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:07:58.857602 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:07:58.857602 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:07:58.857602 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:07:58.857602 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:07:58.857602 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:07:58.857602 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:07:58.857602 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:07:58.857602 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:07:58.857602 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 137/288] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:07:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:07:58.863116 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad06fd8-3c50-40db-9a8d-ed1176de4e70 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:58.982308 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c12c8b8-8335-4675-8dc6-6a7f2be85ef6 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:59.022701 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5794cc3-66b8-4477-9bc9-d5add9c4c02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:59.023529 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5794cc3-66b8-4477-9bc9-d5add9c4c02d None admin] REQUEST_METHOD: `PUT` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:59.023815 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5794cc3-66b8-4477-9bc9-d5add9c4c02d None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:59.024092 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5794cc3-66b8-4477-9bc9-d5add9c4c02d None admin] PATH_INFO: `/v3/projects/9d370c4b5282475484b01c328ffd7864/users/b740dca9d83c4ec8a38713f75f1c2505/roles/e8b0e7643206483385c49640e21e33d7` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:59.029433 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5794cc3-66b8-4477-9bc9-d5add9c4c02d None admin] RBAC: Authorizing `identity:create_grant(project_id=9d370c4b5282475484b01c328ffd7864, user_id=b740dca9d83c4ec8a38713f75f1c2505, role_id=e8b0e7643206483385c49640e21e33d7)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:59.030931 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5794cc3-66b8-4477-9bc9-d5add9c4c02d None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:59.045935 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad06fd8-3c50-40db-9a8d-ed1176de4e70 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:59.071638 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:59.083029 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70769b66-84aa-4911-bac4-b13098408714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:59.083721 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70769b66-84aa-4911-bac4-b13098408714 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:59.084011 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70769b66-84aa-4911-bac4-b13098408714 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:59.084294 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70769b66-84aa-4911-bac4-b13098408714 None admin] PATH_INFO: `/v3/roles` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:59.085046 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70769b66-84aa-4911-bac4-b13098408714 None admin] RBAC: Adding query filter params (name=member) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:07:59.085358 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70769b66-84aa-4911-bac4-b13098408714 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:59.086853 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70769b66-84aa-4911-bac4-b13098408714 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:59.097506 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 138/289] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:07:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:59.102865 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70769b66-84aa-4911-bac4-b13098408714 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:59.130889 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 152/290] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:07:58 2022] PUT /identity/v3/projects/9d370c4b5282475484b01c328ffd7864/users/b740dca9d83c4ec8a38713f75f1c2505/roles/e8b0e7643206483385c49640e21e33d7 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:07:59.225242 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70769b66-84aa-4911-bac4-b13098408714 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:59.263798 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd322662-21ea-46d1-9a3a-88a6a8142474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:59.264722 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd322662-21ea-46d1-9a3a-88a6a8142474 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:59.265013 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd322662-21ea-46d1-9a3a-88a6a8142474 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:59.265296 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd322662-21ea-46d1-9a3a-88a6a8142474 None admin] PATH_INFO: `/v3/users/6a648fc35db14568bfaf30037782facc` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:59.266663 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd322662-21ea-46d1-9a3a-88a6a8142474 None admin] RBAC: Authorizing `identity:get_user(user_id=6a648fc35db14568bfaf30037782facc)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:59.268152 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd322662-21ea-46d1-9a3a-88a6a8142474 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:59.270189 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 139/291] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:07:59 2022] GET /identity/v3/users/6a648fc35db14568bfaf30037782facc => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:59.276445 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5794cc3-66b8-4477-9bc9-d5add9c4c02d None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:59.285996 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:59.416142 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5794cc3-66b8-4477-9bc9-d5add9c4c02d None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:59.465826 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ae8cb-08a3-443c-ae73-c44fd915a3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:59.466538 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ae8cb-08a3-443c-ae73-c44fd915a3ae None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:59.466832 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ae8cb-08a3-443c-ae73-c44fd915a3ae None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:59.467116 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ae8cb-08a3-443c-ae73-c44fd915a3ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:59.546941 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ae8cb-08a3-443c-ae73-c44fd915a3ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:59.548810 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ae8cb-08a3-443c-ae73-c44fd915a3ae None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:59.557859 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:59.660237 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 153/292] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:07:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:07:59.667113 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd322662-21ea-46d1-9a3a-88a6a8142474 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:59.736917 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:59.788880 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd322662-21ea-46d1-9a3a-88a6a8142474 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:59.824341 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f1631-667f-469f-bf1b-e52f33010328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:59.825530 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f1631-667f-469f-bf1b-e52f33010328 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:59.826061 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f1631-667f-469f-bf1b-e52f33010328 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:59.826565 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f1631-667f-469f-bf1b-e52f33010328 None admin] PATH_INFO: `/v3/projects/9d370c4b5282475484b01c328ffd7864` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:59.828055 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f1631-667f-469f-bf1b-e52f33010328 None admin] RBAC: Authorizing `identity:get_project(project_id=9d370c4b5282475484b01c328ffd7864)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:59.829751 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f1631-667f-469f-bf1b-e52f33010328 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:59.831739 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 140/293] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:07:59 2022] GET /identity/v3/projects/9d370c4b5282475484b01c328ffd7864 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:07:59.837732 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ae8cb-08a3-443c-ae73-c44fd915a3ae None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:59.940635 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ae8cb-08a3-443c-ae73-c44fd915a3ae None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:59.966622 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:59.976697 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26295e-46b8-4c42-9356-4b18604c9e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:59.977591 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26295e-46b8-4c42-9356-4b18604c9e2c None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:59.978043 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26295e-46b8-4c42-9356-4b18604c9e2c None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:59.978509 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26295e-46b8-4c42-9356-4b18604c9e2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:59.979768 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c26295e-46b8-4c42-9356-4b18604c9e2c None admin] RBAC: Adding query filter params (role.id=f9389c8fc7a74300aed4cf6490fb672b, scope.project.id=9d370c4b5282475484b01c328ffd7864, user.id=6a648fc35db14568bfaf30037782facc) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:07:59.984540 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c26295e-46b8-4c42-9356-4b18604c9e2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:59.984540 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c26295e-46b8-4c42-9356-4b18604c9e2c None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:59.988605 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 154/294] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:07:59 2022] GET /identity/v3/role_assignments?user.id=6a648fc35db14568bfaf30037782facc&scope.project.id=9d370c4b5282475484b01c328ffd7864&role.id=f9389c8fc7a74300aed4cf6490fb672b => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:00.542747 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e2847-b38b-45bb-aa7f-6f831989349e None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:00.543776 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e2847-b38b-45bb-aa7f-6f831989349e None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:00.544270 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e2847-b38b-45bb-aa7f-6f831989349e None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:00.546096 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 141/295] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:00.551833 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f288fd1-cb68-4293-931e-090c819c42f7 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:00.552368 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f288fd1-cb68-4293-931e-090c819c42f7 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:00.552873 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f288fd1-cb68-4293-931e-090c819c42f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:00.571208 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-5f288fd1-cb68-4293-931e-090c819c42f7 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:00.572742 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-5f288fd1-cb68-4293-931e-090c819c42f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:00.592940 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64b0dd-40c7-42c6-bcca-6152ee7e418b None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:00.593237 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64b0dd-40c7-42c6-bcca-6152ee7e418b None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:00.593501 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64b0dd-40c7-42c6-bcca-6152ee7e418b None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:00.595170 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 142/296] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:00.600137 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f6c2b-4d01-4dc2-9b22-34794b359436 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:00.600427 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f6c2b-4d01-4dc2-9b22-34794b359436 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:00.600727 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f6c2b-4d01-4dc2-9b22-34794b359436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:00.619992 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-093f6c2b-4d01-4dc2-9b22-34794b359436 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:00.621592 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-093f6c2b-4d01-4dc2-9b22-34794b359436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:00.655335 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 155/297] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:08:00.679448 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f288fd1-cb68-4293-931e-090c819c42f7 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:00.699187 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 143/298] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:08:00.722057 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f6c2b-4d01-4dc2-9b22-34794b359436 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:00.789447 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:00.798568 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:00.801518 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f288fd1-cb68-4293-931e-090c819c42f7 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:00.837256 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f6c2b-4d01-4dc2-9b22-34794b359436 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:00.842520 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d0cbd-d643-482f-bdc5-740b1f676a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:00.843341 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d0cbd-d643-482f-bdc5-740b1f676a9a None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:00.843635 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d0cbd-d643-482f-bdc5-740b1f676a9a None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:00.844080 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d0cbd-d643-482f-bdc5-740b1f676a9a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:00.856082 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d0cbd-d643-482f-bdc5-740b1f676a9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:08:00.864059 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-525d0cbd-d643-482f-bdc5-740b1f676a9a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:08:00.864059 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:00.864059 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:00.864059 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:00.864059 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:00.864059 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:00.864059 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:00.864059 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:00.864059 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:00.864059 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:00.864059 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:00.864059 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:00.864059 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:08:00.864059 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:08:00.864059 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:08:00.864059 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:08:00.864991 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:08:00.864991 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:08:00.864991 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:08:00.864991 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:08:00.864991 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:00.864991 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:00.864991 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:00.864991 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:00.864991 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:00.864991 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:00.864991 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:00.864991 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:00.864991 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:00.864991 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:00.864991 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:00.864991 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:00.865784 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:00.865784 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:00.865784 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:00.865784 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:00.865784 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:08:00.865784 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:08:00.865784 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:08:00.865784 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:08:00.865784 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:08:00.865784 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:08:00.865784 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:08:00.865784 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:00.865784 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 156/299] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:08:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:00.867123 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92189c3f-4a13-43d0-ba59-973098ac4758 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:00.867123 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92189c3f-4a13-43d0-ba59-973098ac4758 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:00.867123 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92189c3f-4a13-43d0-ba59-973098ac4758 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:00.868764 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 157/300] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:00.873642 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92189c3f-4a13-43d0-ba59-973098ac4758 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:00.879521 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7e989-ed98-4fda-881e-bdde33cd97a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:00.880327 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7e989-ed98-4fda-881e-bdde33cd97a2 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:00.880609 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7e989-ed98-4fda-881e-bdde33cd97a2 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:00.880886 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7e989-ed98-4fda-881e-bdde33cd97a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:00.882050 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da7e989-ed98-4fda-881e-bdde33cd97a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:00.883533 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da7e989-ed98-4fda-881e-bdde33cd97a2 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:00.885685 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 144/301] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:00.886952 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4525a-14a1-4e8a-8b48-b38d331f9e64 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:00.887239 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4525a-14a1-4e8a-8b48-b38d331f9e64 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:00.887519 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4525a-14a1-4e8a-8b48-b38d331f9e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:00.905025 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-e0c4525a-14a1-4e8a-8b48-b38d331f9e64 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:00.906214 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-e0c4525a-14a1-4e8a-8b48-b38d331f9e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:00.984450 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92189c3f-4a13-43d0-ba59-973098ac4758 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:00.985666 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 145/302] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:08:00.987643 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4525a-14a1-4e8a-8b48-b38d331f9e64 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:01.024346 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c59f7-fea3-4026-9e69-1ce81df5d8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:01.025035 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c59f7-fea3-4026-9e69-1ce81df5d8c3 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:01.025333 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c59f7-fea3-4026-9e69-1ce81df5d8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:01.025674 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c59f7-fea3-4026-9e69-1ce81df5d8c3 None admin] PATH_INFO: `/v3/roles` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:01.026756 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c59f7-fea3-4026-9e69-1ce81df5d8c3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:01.027071 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c59f7-fea3-4026-9e69-1ce81df5d8c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:01.028466 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c59f7-fea3-4026-9e69-1ce81df5d8c3 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:01.036751 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 158/303] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:08:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:01.037549 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c59f7-fea3-4026-9e69-1ce81df5d8c3 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:01.053955 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:01.066284 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:01.107339 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4525a-14a1-4e8a-8b48-b38d331f9e64 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:01.142634 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53a101-2db8-462e-8bdb-216ae42a78b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:01.143311 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53a101-2db8-462e-8bdb-216ae42a78b4 None admin] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:01.143597 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53a101-2db8-462e-8bdb-216ae42a78b4 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:01.143872 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53a101-2db8-462e-8bdb-216ae42a78b4 None admin] PATH_INFO: `/v3/groups` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:01.144575 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da53a101-2db8-462e-8bdb-216ae42a78b4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:01.145998 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da53a101-2db8-462e-8bdb-216ae42a78b4 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:01.146875 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c59f7-fea3-4026-9e69-1ce81df5d8c3 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:01.182831 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ca861-97cf-47e1-b1df-7a0a06a77243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:01.183631 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ca861-97cf-47e1-b1df-7a0a06a77243 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:01.183923 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ca861-97cf-47e1-b1df-7a0a06a77243 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:01.184207 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ca861-97cf-47e1-b1df-7a0a06a77243 None admin] PATH_INFO: `/v3/roles/member` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:01.194946 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ca861-97cf-47e1-b1df-7a0a06a77243 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:08:01.203249 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-c02ca861-97cf-47e1-b1df-7a0a06a77243 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:08:01.203249 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:01.203249 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:01.203249 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:01.203249 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:01.203249 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:01.203249 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:01.203249 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:01.203249 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:01.203249 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:01.203249 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:01.203249 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:01.203249 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:08:01.203249 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:08:01.203249 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:08:01.203249 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:08:01.204308 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:08:01.204308 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:08:01.204308 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:08:01.204308 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:08:01.204308 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:01.204308 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:01.204308 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:01.204308 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:01.204308 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:01.204308 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:01.204308 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:01.204308 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:01.204308 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:01.204308 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:01.204308 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:01.204308 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:01.205377 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:01.205377 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:01.205377 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:01.205377 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:01.205377 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:08:01.205377 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:08:01.205377 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:08:01.205377 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:08:01.205377 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:08:01.205377 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:08:01.205377 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:08:01.205377 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:01.205377 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 159/304] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:08:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:01.205377 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ca861-97cf-47e1-b1df-7a0a06a77243 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:01.230524 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 146/305] 10.222.0.30 () {60 vars in 1134 bytes} [Tue Jul 5 21:08:00 2022] POST /identity/v3/groups => generated 229 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:08:01.230524 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53a101-2db8-462e-8bdb-216ae42a78b4 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:01.328152 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:01.357786 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ca861-97cf-47e1-b1df-7a0a06a77243 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:01.363203 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53a101-2db8-462e-8bdb-216ae42a78b4 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:01.376713 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:01.408847 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e3e9e-9495-4fbb-ab1e-8df09de37244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:01.410002 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e3e9e-9495-4fbb-ab1e-8df09de37244 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:01.410900 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e3e9e-9495-4fbb-ab1e-8df09de37244 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:01.411521 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86faf60-852e-49b0-8caf-96a27e14ebec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:01.412484 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86faf60-852e-49b0-8caf-96a27e14ebec None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:01.412794 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86faf60-852e-49b0-8caf-96a27e14ebec None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:01.413074 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86faf60-852e-49b0-8caf-96a27e14ebec None admin] PATH_INFO: `/v3/users/e55c7279c58f49a4b0296514d921d2de` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:01.413904 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e3e9e-9495-4fbb-ab1e-8df09de37244 None admin] PATH_INFO: `/v3/roles` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:01.414696 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426e3e9e-9495-4fbb-ab1e-8df09de37244 None admin] RBAC: Adding query filter params (name=member) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:01.415007 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426e3e9e-9495-4fbb-ab1e-8df09de37244 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:01.417060 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426e3e9e-9495-4fbb-ab1e-8df09de37244 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:01.430839 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 147/306] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:08:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:01.435742 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86faf60-852e-49b0-8caf-96a27e14ebec None admin] RBAC: Authorizing `identity:get_user(user_id=e55c7279c58f49a4b0296514d921d2de)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:01.436418 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e3e9e-9495-4fbb-ab1e-8df09de37244 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:01.437432 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86faf60-852e-49b0-8caf-96a27e14ebec None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:01.439850 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 160/307] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:08:01 2022] GET /identity/v3/users/e55c7279c58f49a4b0296514d921d2de => generated 293 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:01.445397 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86faf60-852e-49b0-8caf-96a27e14ebec None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:01.554791 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86faf60-852e-49b0-8caf-96a27e14ebec None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:01.567551 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e3e9e-9495-4fbb-ab1e-8df09de37244 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:01.593188 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa298b14-3e32-4e8c-930f-784c08fbc0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:01.594288 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa298b14-3e32-4e8c-930f-784c08fbc0d6 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:01.594790 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa298b14-3e32-4e8c-930f-784c08fbc0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:01.595264 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa298b14-3e32-4e8c-930f-784c08fbc0d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:01.596291 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa298b14-3e32-4e8c-930f-784c08fbc0d6 None admin] RBAC: Adding query filter params (role.id=e8b0e7643206483385c49640e21e33d7, user.id=e55c7279c58f49a4b0296514d921d2de, scope.system=all) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:01.596801 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa298b14-3e32-4e8c-930f-784c08fbc0d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:01.598531 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa298b14-3e32-4e8c-930f-784c08fbc0d6 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:01.610250 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 161/308] 10.222.0.30 () {56 vars in 1308 bytes} [Tue Jul 5 21:08:01 2022] GET /identity/v3/role_assignments?user.id=e55c7279c58f49a4b0296514d921d2de&scope.system=all&role.id=e8b0e7643206483385c49640e21e33d7 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:08:01.614197 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4480240-e145-429c-9244-e19ba4270d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:01.615115 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4480240-e145-429c-9244-e19ba4270d08 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:01.615400 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4480240-e145-429c-9244-e19ba4270d08 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:01.615676 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4480240-e145-429c-9244-e19ba4270d08 None admin] PATH_INFO: `/v3/users/49b8584dde47454d865042f45fa5d6cf` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:01.616958 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4480240-e145-429c-9244-e19ba4270d08 None admin] RBAC: Authorizing `identity:get_user(user_id=49b8584dde47454d865042f45fa5d6cf)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:01.618524 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4480240-e145-429c-9244-e19ba4270d08 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:01.621312 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 148/309] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:08:01 2022] GET /identity/v3/users/49b8584dde47454d865042f45fa5d6cf => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:01.626966 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa298b14-3e32-4e8c-930f-784c08fbc0d6 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:01.631106 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:01.687928 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7eefe-6e20-4c24-be48-a35fbf3162ae None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:01.688509 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7eefe-6e20-4c24-be48-a35fbf3162ae None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:01.688734 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7eefe-6e20-4c24-be48-a35fbf3162ae None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:01.690331 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 149/310] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:08:01.696022 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3752e-4455-44d9-9b83-52a9f392f0c3 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:01.696337 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3752e-4455-44d9-9b83-52a9f392f0c3 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:01.696583 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3752e-4455-44d9-9b83-52a9f392f0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:01.717908 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-80a3752e-4455-44d9-9b83-52a9f392f0c3 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:01.719188 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-80a3752e-4455-44d9-9b83-52a9f392f0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:01.757298 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa298b14-3e32-4e8c-930f-784c08fbc0d6 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:01.766468 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:01.812398 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88dc10-af3d-4526-aea3-16d478072cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:01.812768 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 150/311] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:08:01.813728 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88dc10-af3d-4526-aea3-16d478072cfa None admin] REQUEST_METHOD: `PUT` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:01.814020 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88dc10-af3d-4526-aea3-16d478072cfa None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:01.814428 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88dc10-af3d-4526-aea3-16d478072cfa None admin] PATH_INFO: `/v3/system/users/49b8584dde47454d865042f45fa5d6cf/roles/f9389c8fc7a74300aed4cf6490fb672b` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:01.815945 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88dc10-af3d-4526-aea3-16d478072cfa None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=49b8584dde47454d865042f45fa5d6cf, role_id=f9389c8fc7a74300aed4cf6490fb672b)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:01.817337 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88dc10-af3d-4526-aea3-16d478072cfa None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:01.836055 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a3752e-4455-44d9-9b83-52a9f392f0c3 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:01.904626 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 162/312] 10.222.0.30 () {58 vars in 1334 bytes} [Tue Jul 5 21:08:01 2022] PUT /identity/v3/system/users/49b8584dde47454d865042f45fa5d6cf/roles/f9389c8fc7a74300aed4cf6490fb672b => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:08:01.956290 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a3752e-4455-44d9-9b83-52a9f392f0c3 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:01.998801 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c22aa-4ace-4ddf-a984-a0ad431405df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:02.000014 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c22aa-4ace-4ddf-a984-a0ad431405df None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:02.000535 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c22aa-4ace-4ddf-a984-a0ad431405df None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:02.001011 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c22aa-4ace-4ddf-a984-a0ad431405df None admin] PATH_INFO: `/v3/roles/reader` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:02.013761 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c22aa-4ace-4ddf-a984-a0ad431405df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:08:02.022616 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-4e7c22aa-4ace-4ddf-a984-a0ad431405df None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:08:02.022616 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:02.022616 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:02.022616 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:02.022616 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:02.022616 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:02.022616 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:02.022616 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:02.022616 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:02.022616 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:02.022616 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:02.022616 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:02.022616 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:08:02.022616 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:08:02.022616 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:08:02.022616 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:08:02.023597 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:08:02.023597 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:08:02.023597 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:08:02.023597 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:08:02.023597 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:02.023597 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:02.023597 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:02.023597 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:02.023597 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:02.023597 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:02.023597 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:02.023597 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:02.023597 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:02.023597 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:02.023597 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:02.023597 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:02.024424 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:02.024424 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:02.024424 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:02.024424 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:02.024424 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:08:02.024424 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:08:02.024424 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:08:02.024424 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:08:02.024424 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:08:02.024424 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:08:02.024424 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:08:02.024424 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:02.027948 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 151/313] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:08:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:08:02.035337 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88dc10-af3d-4526-aea3-16d478072cfa None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:02.114686 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:02.148485 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88dc10-af3d-4526-aea3-16d478072cfa None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:02.184138 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c244ab-5a88-49b9-bc2e-2c585c8d9707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:02.184745 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c244ab-5a88-49b9-bc2e-2c585c8d9707 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:02.185029 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c244ab-5a88-49b9-bc2e-2c585c8d9707 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:02.185307 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c244ab-5a88-49b9-bc2e-2c585c8d9707 None admin] PATH_INFO: `/v3/roles` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:02.186063 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c244ab-5a88-49b9-bc2e-2c585c8d9707 None admin] RBAC: Adding query filter params (name=reader) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:02.186403 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c244ab-5a88-49b9-bc2e-2c585c8d9707 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:02.187787 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c244ab-5a88-49b9-bc2e-2c585c8d9707 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:02.196904 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 163/314] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:08:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:02.202293 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c22aa-4ace-4ddf-a984-a0ad431405df None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:02.235991 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:02.313867 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c22aa-4ace-4ddf-a984-a0ad431405df None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:02.349966 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc631b-28e4-41f3-afc9-87d6e17b95bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:02.350887 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc631b-28e4-41f3-afc9-87d6e17b95bf None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:02.351173 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc631b-28e4-41f3-afc9-87d6e17b95bf None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:02.351450 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc631b-28e4-41f3-afc9-87d6e17b95bf None admin] PATH_INFO: `/v3/users/b740dca9d83c4ec8a38713f75f1c2505` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:02.352668 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edc631b-28e4-41f3-afc9-87d6e17b95bf None admin] RBAC: Authorizing `identity:get_user(user_id=b740dca9d83c4ec8a38713f75f1c2505)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:02.354290 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edc631b-28e4-41f3-afc9-87d6e17b95bf None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:02.356327 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 152/315] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:08:02 2022] GET /identity/v3/users/b740dca9d83c4ec8a38713f75f1c2505 => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:02.361448 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c244ab-5a88-49b9-bc2e-2c585c8d9707 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:02.473998 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c244ab-5a88-49b9-bc2e-2c585c8d9707 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:02.503268 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:02.509231 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3893f-1768-40b8-914d-2fe7a047bd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:02.510608 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3893f-1768-40b8-914d-2fe7a047bd72 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:02.510741 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3893f-1768-40b8-914d-2fe7a047bd72 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:02.511020 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3893f-1768-40b8-914d-2fe7a047bd72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:02.580986 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3893f-1768-40b8-914d-2fe7a047bd72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:02.582496 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3893f-1768-40b8-914d-2fe7a047bd72 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:02.684981 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 164/316] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:08:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:08:02.690782 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc631b-28e4-41f3-afc9-87d6e17b95bf None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:02.792079 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:02.796847 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc631b-28e4-41f3-afc9-87d6e17b95bf None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:02.832868 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb6d02-8777-423b-b397-1ac7a34dae8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:02.833735 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb6d02-8777-423b-b397-1ac7a34dae8b None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:02.834019 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb6d02-8777-423b-b397-1ac7a34dae8b None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:02.834326 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb6d02-8777-423b-b397-1ac7a34dae8b None admin] PATH_INFO: `/v3/projects/9d370c4b5282475484b01c328ffd7864` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:02.835518 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb6d02-8777-423b-b397-1ac7a34dae8b None admin] RBAC: Authorizing `identity:get_project(project_id=9d370c4b5282475484b01c328ffd7864)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:02.836964 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb6d02-8777-423b-b397-1ac7a34dae8b None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:02.839915 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 153/317] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:08:02 2022] GET /identity/v3/projects/9d370c4b5282475484b01c328ffd7864 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:02.845721 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3893f-1768-40b8-914d-2fe7a047bd72 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:02.882472 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:02.952298 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3893f-1768-40b8-914d-2fe7a047bd72 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:02.988638 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2718e64d-3aa4-4486-bacc-f5e68052a44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:02.989355 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718e64d-3aa4-4486-bacc-f5e68052a44e None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:02.989649 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718e64d-3aa4-4486-bacc-f5e68052a44e None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:02.989931 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718e64d-3aa4-4486-bacc-f5e68052a44e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:02.990828 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2718e64d-3aa4-4486-bacc-f5e68052a44e None admin] RBAC: Adding query filter params (role.id=e8b0e7643206483385c49640e21e33d7, scope.project.id=9d370c4b5282475484b01c328ffd7864, user.id=b740dca9d83c4ec8a38713f75f1c2505) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:02.991151 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2718e64d-3aa4-4486-bacc-f5e68052a44e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:02.992755 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2718e64d-3aa4-4486-bacc-f5e68052a44e None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:03.000175 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 165/318] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:08:02 2022] GET /identity/v3/role_assignments?user.id=b740dca9d83c4ec8a38713f75f1c2505&scope.project.id=9d370c4b5282475484b01c328ffd7864&role.id=e8b0e7643206483385c49640e21e33d7 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:03.388760 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fb41f-d94b-4523-9612-8c8a70d77b18 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:03.389082 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fb41f-d94b-4523-9612-8c8a70d77b18 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:03.389328 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fb41f-d94b-4523-9612-8c8a70d77b18 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:03.390897 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 154/319] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:03.395793 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1de516-c083-4416-ac8b-8e2e0b9b51fe None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:03.396093 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1de516-c083-4416-ac8b-8e2e0b9b51fe None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:03.396380 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1de516-c083-4416-ac8b-8e2e0b9b51fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:03.413805 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-ce1de516-c083-4416-ac8b-8e2e0b9b51fe None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:03.415039 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-ce1de516-c083-4416-ac8b-8e2e0b9b51fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:03.485534 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 166/320] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:08:03.508361 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51fb41f-d94b-4523-9612-8c8a70d77b18 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:03.614689 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51fb41f-d94b-4523-9612-8c8a70d77b18 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:03.648873 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194b81fe-a015-4bad-9bf7-360f1bb94825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:03.649692 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b81fe-a015-4bad-9bf7-360f1bb94825 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:03.649987 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b81fe-a015-4bad-9bf7-360f1bb94825 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:03.650314 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b81fe-a015-4bad-9bf7-360f1bb94825 None admin] PATH_INFO: `/v3/domains/default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:03.652197 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194b81fe-a015-4bad-9bf7-360f1bb94825 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:03.653675 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194b81fe-a015-4bad-9bf7-360f1bb94825 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:03.659737 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 155/321] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:03.660965 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1de516-c083-4416-ac8b-8e2e0b9b51fe None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:03.687028 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:03.738946 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6c358-4a5e-492e-b01b-e4a053b1d97e None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:03.739471 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6c358-4a5e-492e-b01b-e4a053b1d97e None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:03.739547 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6c358-4a5e-492e-b01b-e4a053b1d97e None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:03.740986 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 156/322] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:08:03.746032 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738f537-083e-4ba1-98aa-dd222edd4a8b None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:03.746358 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738f537-083e-4ba1-98aa-dd222edd4a8b None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:03.746639 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738f537-083e-4ba1-98aa-dd222edd4a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:03.762963 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-a738f537-083e-4ba1-98aa-dd222edd4a8b None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:03.764160 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-a738f537-083e-4ba1-98aa-dd222edd4a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:03.764685 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1de516-c083-4416-ac8b-8e2e0b9b51fe None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:03.793370 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:03.804821 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2843178f-620c-4bdf-a962-9c0c696d1554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:03.805494 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843178f-620c-4bdf-a962-9c0c696d1554 None admin] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:03.807700 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843178f-620c-4bdf-a962-9c0c696d1554 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:03.807700 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843178f-620c-4bdf-a962-9c0c696d1554 None admin] PATH_INFO: `/v3/groups` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:03.807700 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2843178f-620c-4bdf-a962-9c0c696d1554 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:03.808712 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2843178f-620c-4bdf-a962-9c0c696d1554 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:03.835316 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 157/323] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:08:03.858084 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a738f537-083e-4ba1-98aa-dd222edd4a8b None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:03.937726 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 167/324] 10.222.0.30 () {60 vars in 1134 bytes} [Tue Jul 5 21:08:03 2022] POST /identity/v3/groups => generated 226 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:08:03.970011 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a738f537-083e-4ba1-98aa-dd222edd4a8b None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:04.007433 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dfc180-5ef7-4806-bb98-5a6129bdffa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:04.008294 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dfc180-5ef7-4806-bb98-5a6129bdffa5 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:04.008578 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dfc180-5ef7-4806-bb98-5a6129bdffa5 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:04.008855 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dfc180-5ef7-4806-bb98-5a6129bdffa5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:04.014439 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115459b-2d99-4dac-98db-0658b6add0e7 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:04.014722 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115459b-2d99-4dac-98db-0658b6add0e7 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:04.015009 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115459b-2d99-4dac-98db-0658b6add0e7 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:04.016420 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 168/325] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:08:04.021929 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b96fd7-1c53-4708-abf3-6291ef2d11a3 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:04.022252 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b96fd7-1c53-4708-abf3-6291ef2d11a3 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:04.022541 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b96fd7-1c53-4708-abf3-6291ef2d11a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:04.022760 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dfc180-5ef7-4806-bb98-5a6129bdffa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:08:04.031597 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-90dfc180-5ef7-4806-bb98-5a6129bdffa5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:08:04.031597 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:04.031597 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:04.031597 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:04.031597 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:04.031597 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:04.031597 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:04.031597 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:04.031597 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:04.031597 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:04.031597 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:04.031597 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:04.031597 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:08:04.031597 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:08:04.031597 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:08:04.031597 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:08:04.032540 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:08:04.032540 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:08:04.032540 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:08:04.032540 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:08:04.032540 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:04.032540 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:04.032540 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:04.032540 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:04.032540 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:04.032540 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:04.032540 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:04.032540 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:04.032540 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:04.032540 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:04.032540 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:04.032540 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:04.033338 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:04.033338 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:04.033338 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:04.033338 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:04.033338 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:08:04.033338 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:08:04.033338 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:08:04.033338 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:08:04.033338 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:08:04.033338 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:08:04.033338 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:08:04.033338 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:04.035586 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 158/326] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:08:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:08:04.040203 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-94b96fd7-1c53-4708-abf3-6291ef2d11a3 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:04.041464 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-94b96fd7-1c53-4708-abf3-6291ef2d11a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:04.042147 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dfc180-5ef7-4806-bb98-5a6129bdffa5 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:04.075382 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:04.119015 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 169/327] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:08:04.143112 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b96fd7-1c53-4708-abf3-6291ef2d11a3 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:04.164909 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dfc180-5ef7-4806-bb98-5a6129bdffa5 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:04.165799 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:04.205297 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295942f-b4d0-44ac-8140-c9f2e261212c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:04.207790 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295942f-b4d0-44ac-8140-c9f2e261212c None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:04.207790 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295942f-b4d0-44ac-8140-c9f2e261212c None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:04.207790 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295942f-b4d0-44ac-8140-c9f2e261212c None admin] PATH_INFO: `/v3/roles` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:04.207790 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a295942f-b4d0-44ac-8140-c9f2e261212c None admin] RBAC: Adding query filter params (name=reader) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:04.207790 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a295942f-b4d0-44ac-8140-c9f2e261212c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:04.209015 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a295942f-b4d0-44ac-8140-c9f2e261212c None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:04.218595 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 159/328] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:08:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:04.226486 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295942f-b4d0-44ac-8140-c9f2e261212c None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:04.280698 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b96fd7-1c53-4708-abf3-6291ef2d11a3 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:04.324350 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285bd6c5-8c8f-4e38-9bba-0510ed7e13cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:04.325404 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285bd6c5-8c8f-4e38-9bba-0510ed7e13cb None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:04.325833 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285bd6c5-8c8f-4e38-9bba-0510ed7e13cb None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:04.326592 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285bd6c5-8c8f-4e38-9bba-0510ed7e13cb None admin] PATH_INFO: `/v3/roles/member` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:04.335457 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:04.342020 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285bd6c5-8c8f-4e38-9bba-0510ed7e13cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:08:04.351876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-285bd6c5-8c8f-4e38-9bba-0510ed7e13cb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:08:04.351876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:04.351876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:04.351876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:04.351876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:04.351876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:04.351876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:04.351876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:04.351876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:04.351876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:04.351876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:04.351876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:04.351876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:08:04.351876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:08:04.351876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:08:04.351876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:08:04.352823 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:08:04.352823 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:08:04.352823 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:08:04.352823 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:08:04.352823 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:04.352823 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:04.352823 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:04.352823 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:04.352823 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:04.352823 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:04.352823 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:04.352823 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:04.352823 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:04.352823 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:04.352823 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:04.352823 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:04.353705 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:04.353705 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:04.353705 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:04.353705 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:04.353705 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:08:04.353705 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:08:04.353705 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:08:04.353705 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:08:04.353705 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:08:04.353705 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:08:04.353705 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:08:04.353705 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:04.354493 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295942f-b4d0-44ac-8140-c9f2e261212c None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:04.354566 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 170/329] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:08:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:08:04.363224 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285bd6c5-8c8f-4e38-9bba-0510ed7e13cb None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:04.393990 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b471f-bccf-4f83-b8e2-e5a8ec104f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:04.394909 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b471f-bccf-4f83-b8e2-e5a8ec104f3e None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:04.395192 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b471f-bccf-4f83-b8e2-e5a8ec104f3e None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:04.395471 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b471f-bccf-4f83-b8e2-e5a8ec104f3e None admin] PATH_INFO: `/v3/users/e55c7279c58f49a4b0296514d921d2de` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:04.396917 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867b471f-bccf-4f83-b8e2-e5a8ec104f3e None admin] RBAC: Authorizing `identity:get_user(user_id=e55c7279c58f49a4b0296514d921d2de)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:04.398403 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867b471f-bccf-4f83-b8e2-e5a8ec104f3e None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:04.401207 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 160/330] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:08:04 2022] GET /identity/v3/users/e55c7279c58f49a4b0296514d921d2de => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:04.407458 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b471f-bccf-4f83-b8e2-e5a8ec104f3e None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:04.452986 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:04.480595 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285bd6c5-8c8f-4e38-9bba-0510ed7e13cb None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:04.528672 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a22462-97bb-4ee7-9a4d-aa054bf4292c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:04.530025 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a22462-97bb-4ee7-9a4d-aa054bf4292c None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:04.530547 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a22462-97bb-4ee7-9a4d-aa054bf4292c None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:04.531124 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a22462-97bb-4ee7-9a4d-aa054bf4292c None admin] PATH_INFO: `/v3/roles` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:04.532218 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a22462-97bb-4ee7-9a4d-aa054bf4292c None admin] RBAC: Adding query filter params (name=member) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:04.532866 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a22462-97bb-4ee7-9a4d-aa054bf4292c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:04.535231 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a22462-97bb-4ee7-9a4d-aa054bf4292c None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:04.536491 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b471f-bccf-4f83-b8e2-e5a8ec104f3e None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:04.547955 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 171/331] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:08:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:04.552680 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a22462-97bb-4ee7-9a4d-aa054bf4292c None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:04.587212 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf01901-20a8-43b5-a87f-d73ca3ca34d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:04.588482 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf01901-20a8-43b5-a87f-d73ca3ca34d4 None admin] REQUEST_METHOD: `PUT` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:04.588873 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf01901-20a8-43b5-a87f-d73ca3ca34d4 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:04.589140 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf01901-20a8-43b5-a87f-d73ca3ca34d4 None admin] PATH_INFO: `/v3/system/users/e55c7279c58f49a4b0296514d921d2de/roles/e8b0e7643206483385c49640e21e33d7` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:04.590765 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf01901-20a8-43b5-a87f-d73ca3ca34d4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e55c7279c58f49a4b0296514d921d2de, role_id=e8b0e7643206483385c49640e21e33d7)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:04.592443 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf01901-20a8-43b5-a87f-d73ca3ca34d4 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:04.657293 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 161/332] 10.222.0.30 () {58 vars in 1334 bytes} [Tue Jul 5 21:08:04 2022] PUT /identity/v3/system/users/e55c7279c58f49a4b0296514d921d2de/roles/e8b0e7643206483385c49640e21e33d7 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:08:04.674037 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a22462-97bb-4ee7-9a4d-aa054bf4292c None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:04.717677 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef48673-3269-41a7-84d8-7bfac5af9750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:04.719121 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef48673-3269-41a7-84d8-7bfac5af9750 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:04.719624 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef48673-3269-41a7-84d8-7bfac5af9750 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:04.720106 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef48673-3269-41a7-84d8-7bfac5af9750 None admin] PATH_INFO: `/v3/users/49b8584dde47454d865042f45fa5d6cf` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:04.723547 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef48673-3269-41a7-84d8-7bfac5af9750 None admin] RBAC: Authorizing `identity:get_user(user_id=49b8584dde47454d865042f45fa5d6cf)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:04.725367 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef48673-3269-41a7-84d8-7bfac5af9750 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:04.727720 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 172/333] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:08:04 2022] GET /identity/v3/users/49b8584dde47454d865042f45fa5d6cf => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:08:04.734692 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf01901-20a8-43b5-a87f-d73ca3ca34d4 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:04.757241 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:04.852760 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf01901-20a8-43b5-a87f-d73ca3ca34d4 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:04.892243 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade5710-7778-4d03-8fec-c995c27a2000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:04.892917 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade5710-7778-4d03-8fec-c995c27a2000 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:04.893208 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade5710-7778-4d03-8fec-c995c27a2000 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:04.893491 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade5710-7778-4d03-8fec-c995c27a2000 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:04.894360 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade5710-7778-4d03-8fec-c995c27a2000 None admin] RBAC: Adding query filter params (role.id=f9389c8fc7a74300aed4cf6490fb672b, user.id=49b8584dde47454d865042f45fa5d6cf, scope.system=all) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:04.894680 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade5710-7778-4d03-8fec-c995c27a2000 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:04.896138 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade5710-7778-4d03-8fec-c995c27a2000 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:04.913925 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 162/334] 10.222.0.30 () {56 vars in 1308 bytes} [Tue Jul 5 21:08:04 2022] GET /identity/v3/role_assignments?user.id=49b8584dde47454d865042f45fa5d6cf&scope.system=all&role.id=f9389c8fc7a74300aed4cf6490fb672b => generated 510 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:06.328590 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a2c44-0cdb-464e-bc3e-a02b571b0ca3 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:06.329526 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a2c44-0cdb-464e-bc3e-a02b571b0ca3 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:06.330028 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a2c44-0cdb-464e-bc3e-a02b571b0ca3 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:06.331890 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 173/335] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:06.337556 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97195b2d-223f-4a27-bbf7-eba5d1dc21c7 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:06.338472 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97195b2d-223f-4a27-bbf7-eba5d1dc21c7 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:06.338950 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97195b2d-223f-4a27-bbf7-eba5d1dc21c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:06.357696 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-97195b2d-223f-4a27-bbf7-eba5d1dc21c7 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:06.359347 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-97195b2d-223f-4a27-bbf7-eba5d1dc21c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:06.434481 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 163/336] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:08:06.456122 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989a2c44-0cdb-464e-bc3e-a02b571b0ca3 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:06.460496 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:06.569336 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989a2c44-0cdb-464e-bc3e-a02b571b0ca3 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:06.606288 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832850a-323e-4a39-a67c-ad4ffe001b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:06.607457 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832850a-323e-4a39-a67c-ad4ffe001b3f None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:06.607954 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832850a-323e-4a39-a67c-ad4ffe001b3f None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:06.608425 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832850a-323e-4a39-a67c-ad4ffe001b3f None admin] PATH_INFO: `/v3/roles/member` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:06.619361 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8832850a-323e-4a39-a67c-ad4ffe001b3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:08:06.627748 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-8832850a-323e-4a39-a67c-ad4ffe001b3f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:08:06.627748 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:06.627748 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:06.627748 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:06.627748 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:06.627748 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:06.627748 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:06.627748 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:06.627748 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:06.627748 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:06.627748 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:06.627748 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:06.627748 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:08:06.627748 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:08:06.627748 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:08:06.627748 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:08:06.628632 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:08:06.628632 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:08:06.628632 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:08:06.628632 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:08:06.628632 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:06.628632 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:06.628632 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:06.628632 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:06.628632 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:06.628632 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:06.628632 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:06.628632 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:06.628632 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:06.628632 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:06.628632 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:06.628632 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:06.629423 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:06.629423 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:06.629423 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:06.629423 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:06.629423 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:08:06.629423 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:08:06.629423 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:08:06.629423 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:08:06.629423 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:08:06.629423 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:08:06.629423 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:08:06.629423 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:06.636842 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 174/337] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:08:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:06.638548 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97195b2d-223f-4a27-bbf7-eba5d1dc21c7 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:06.658503 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:06.743770 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97195b2d-223f-4a27-bbf7-eba5d1dc21c7 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:06.779393 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd22b8e-d01a-47f6-8d49-4c2aa46fdba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:06.780079 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd22b8e-d01a-47f6-8d49-4c2aa46fdba7 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:06.780365 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd22b8e-d01a-47f6-8d49-4c2aa46fdba7 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:06.780641 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd22b8e-d01a-47f6-8d49-4c2aa46fdba7 None admin] PATH_INFO: `/v3/roles` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:06.781391 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd22b8e-d01a-47f6-8d49-4c2aa46fdba7 None admin] RBAC: Adding query filter params (name=member) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:06.781697 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd22b8e-d01a-47f6-8d49-4c2aa46fdba7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:06.783103 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd22b8e-d01a-47f6-8d49-4c2aa46fdba7 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:06.796171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 164/338] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:08:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:06.797549 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832850a-323e-4a39-a67c-ad4ffe001b3f None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:06.871813 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:06.903857 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832850a-323e-4a39-a67c-ad4ffe001b3f None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:06.939680 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ef1b2-a15f-4ada-9148-f18a970341fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:06.940519 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ef1b2-a15f-4ada-9148-f18a970341fc None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:06.940815 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ef1b2-a15f-4ada-9148-f18a970341fc None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:06.941096 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ef1b2-a15f-4ada-9148-f18a970341fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:07.011133 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ef1b2-a15f-4ada-9148-f18a970341fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:07.012600 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ef1b2-a15f-4ada-9148-f18a970341fc None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:07.074589 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:07.105326 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad429f9f-7c69-4246-8f54-c92ff09db366 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:07.105783 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad429f9f-7c69-4246-8f54-c92ff09db366 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:07.106070 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad429f9f-7c69-4246-8f54-c92ff09db366 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:07.108347 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 165/339] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:08:07.115026 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34639b1-4aa5-4ba9-b926-9e552f8b4bda None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:07.115432 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34639b1-4aa5-4ba9-b926-9e552f8b4bda None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:07.115833 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34639b1-4aa5-4ba9-b926-9e552f8b4bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:07.138865 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-a34639b1-4aa5-4ba9-b926-9e552f8b4bda None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:07.140612 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-a34639b1-4aa5-4ba9-b926-9e552f8b4bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:07.144333 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 175/340] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:08:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:08:07.157666 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955ed4b-7ce8-48ed-8c7f-c2a937af9e03 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:07.158230 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955ed4b-7ce8-48ed-8c7f-c2a937af9e03 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:07.158683 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955ed4b-7ce8-48ed-8c7f-c2a937af9e03 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:07.160565 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 176/341] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:07.165244 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955ed4b-7ce8-48ed-8c7f-c2a937af9e03 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:07.227604 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 166/342] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:08:07.227604 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:07.230314 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca2480-605d-4d33-86e7-b31a633a47e8 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:07.230716 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca2480-605d-4d33-86e7-b31a633a47e8 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:07.231207 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca2480-605d-4d33-86e7-b31a633a47e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:07.256515 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-c9ca2480-605d-4d33-86e7-b31a633a47e8 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:07.257682 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-c9ca2480-605d-4d33-86e7-b31a633a47e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:07.331973 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 167/343] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:08:07.332832 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca2480-605d-4d33-86e7-b31a633a47e8 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:07.403915 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955ed4b-7ce8-48ed-8c7f-c2a937af9e03 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:07.451890 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed676715-9958-4064-9f03-4bcd6252c309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:07.453152 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed676715-9958-4064-9f03-4bcd6252c309 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:07.453741 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed676715-9958-4064-9f03-4bcd6252c309 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:07.454182 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed676715-9958-4064-9f03-4bcd6252c309 None admin] PATH_INFO: `/v3/projects/3665952118af4106b09bd445a38d53e5` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:07.455797 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed676715-9958-4064-9f03-4bcd6252c309 None admin] RBAC: Authorizing `identity:get_project(project_id=3665952118af4106b09bd445a38d53e5)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:07.458034 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed676715-9958-4064-9f03-4bcd6252c309 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:07.460370 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 177/344] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:08:07 2022] GET /identity/v3/projects/3665952118af4106b09bd445a38d53e5 => generated 298 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:07.461511 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed676715-9958-4064-9f03-4bcd6252c309 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:07.502914 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:07.536363 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca2480-605d-4d33-86e7-b31a633a47e8 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:07.584883 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed676715-9958-4064-9f03-4bcd6252c309 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:07.593519 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:07.605341 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ff717-f2a5-4820-87e5-71a2542d1e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:07.609310 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ff717-f2a5-4820-87e5-71a2542d1e55 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:07.609429 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ff717-f2a5-4820-87e5-71a2542d1e55 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:07.609708 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ff717-f2a5-4820-87e5-71a2542d1e55 None admin] PATH_INFO: `/v3/roles/member` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:07.630424 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ababcb-f4f6-4141-a012-09d67d45645e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:07.631691 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ababcb-f4f6-4141-a012-09d67d45645e None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:07.632171 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ababcb-f4f6-4141-a012-09d67d45645e None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:07.632637 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ababcb-f4f6-4141-a012-09d67d45645e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:07.634156 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0ff717-f2a5-4820-87e5-71a2542d1e55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:08:07.643074 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-fa0ff717-f2a5-4820-87e5-71a2542d1e55 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:08:07.643074 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:07.643074 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:07.643074 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:07.643074 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:07.643074 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:07.643074 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:07.643074 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:07.643074 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:07.643074 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:07.643074 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:07.643074 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:07.643074 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:08:07.643074 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:08:07.643074 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:08:07.643074 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:08:07.643978 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:08:07.643978 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:08:07.643978 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:08:07.643978 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:08:07.643978 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:07.643978 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:07.643978 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:07.643978 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:07.643978 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:07.643978 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:07.643978 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:07.643978 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:07.643978 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:07.643978 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:07.643978 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:07.643978 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:07.644770 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:07.644770 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:07.644770 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:07.644770 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:07.644770 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:08:07.644770 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:08:07.644770 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:08:07.644770 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:08:07.644770 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:08:07.644770 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:08:07.644770 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:08:07.644770 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:07.657553 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 168/345] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:08:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:07.658388 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ababcb-f4f6-4141-a012-09d67d45645e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:08:07.667644 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-82ababcb-f4f6-4141-a012-09d67d45645e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:08:07.667644 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:07.667644 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:07.667644 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:07.667644 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:07.667644 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:07.667644 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:07.667644 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:07.667644 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:07.667644 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:07.667644 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:07.667644 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:07.667644 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:08:07.667644 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:08:07.667644 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:08:07.667644 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:08:07.668660 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:08:07.668660 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:08:07.668660 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:08:07.668660 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:08:07.668660 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:07.668660 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:07.668660 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:07.668660 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:07.668660 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:07.668660 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:07.668660 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:07.668660 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:07.668660 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:07.668660 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:07.668660 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:07.668660 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:07.669511 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:07.669511 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:07.669511 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:07.669511 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:07.669511 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:08:07.669511 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:08:07.669511 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:08:07.669511 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:08:07.669511 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:08:07.669511 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:08:07.669511 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:08:07.669511 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:07.671635 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ff717-f2a5-4820-87e5-71a2542d1e55 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:07.679839 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 178/346] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:08:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:07.680789 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ababcb-f4f6-4141-a012-09d67d45645e None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:07.800587 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ff717-f2a5-4820-87e5-71a2542d1e55 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:07.841154 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6286551b-f536-46d1-9d4d-a46d3207d89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:07.842440 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286551b-f536-46d1-9d4d-a46d3207d89c None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:07.842937 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286551b-f536-46d1-9d4d-a46d3207d89c None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:07.843422 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286551b-f536-46d1-9d4d-a46d3207d89c None admin] PATH_INFO: `/v3/groups/e5dbbd5132dc4f24a2e910f1a46ce656` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:07.850724 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6286551b-f536-46d1-9d4d-a46d3207d89c None admin] RBAC: Authorizing `identity:get_group(group_id=e5dbbd5132dc4f24a2e910f1a46ce656)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:07.852515 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6286551b-f536-46d1-9d4d-a46d3207d89c None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:07.855455 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 169/347] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Jul 5 21:08:07 2022] GET /identity/v3/groups/e5dbbd5132dc4f24a2e910f1a46ce656 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:07.856322 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:07.857759 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6286551b-f536-46d1-9d4d-a46d3207d89c None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:07.871171 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ababcb-f4f6-4141-a012-09d67d45645e None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:07.920389 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:07.936513 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77964f-ecd1-4a5a-be52-0435f2503be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:07.936997 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77964f-ecd1-4a5a-be52-0435f2503be5 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:07.937287 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77964f-ecd1-4a5a-be52-0435f2503be5 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:07.937571 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77964f-ecd1-4a5a-be52-0435f2503be5 None admin] PATH_INFO: `/v3/roles` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:07.938614 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77964f-ecd1-4a5a-be52-0435f2503be5 None admin] RBAC: Adding query filter params (name=member) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:07.938934 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77964f-ecd1-4a5a-be52-0435f2503be5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:07.940335 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77964f-ecd1-4a5a-be52-0435f2503be5 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:07.954183 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 179/348] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:08:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:07.955048 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77964f-ecd1-4a5a-be52-0435f2503be5 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:07.970984 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6286551b-f536-46d1-9d4d-a46d3207d89c None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:08.018860 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45228361-76b7-4b85-af23-07ddd99207ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:08.019889 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45228361-76b7-4b85-af23-07ddd99207ae None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:08.020453 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45228361-76b7-4b85-af23-07ddd99207ae None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:08.020902 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45228361-76b7-4b85-af23-07ddd99207ae None admin] PATH_INFO: `/v3/roles` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:08.021937 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45228361-76b7-4b85-af23-07ddd99207ae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:08.022629 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45228361-76b7-4b85-af23-07ddd99207ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:08.024336 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45228361-76b7-4b85-af23-07ddd99207ae None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:08.034415 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 170/349] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:08:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:08.035489 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45228361-76b7-4b85-af23-07ddd99207ae None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:08.125024 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77964f-ecd1-4a5a-be52-0435f2503be5 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:08.167644 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45228361-76b7-4b85-af23-07ddd99207ae None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:08.172305 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7204ec-ad51-470c-aaf8-ec920f886676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:08.173151 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7204ec-ad51-470c-aaf8-ec920f886676 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:08.173625 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7204ec-ad51-470c-aaf8-ec920f886676 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:08.174066 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7204ec-ad51-470c-aaf8-ec920f886676 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:08.175182 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7204ec-ad51-470c-aaf8-ec920f886676 None admin] RBAC: Adding query filter params (group.id=e5dbbd5132dc4f24a2e910f1a46ce656, role.id=f9389c8fc7a74300aed4cf6490fb672b, scope.project.id=3665952118af4106b09bd445a38d53e5) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:08.175652 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7204ec-ad51-470c-aaf8-ec920f886676 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:08.177836 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7204ec-ad51-470c-aaf8-ec920f886676 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:08.184935 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:08.187779 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 180/350] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Jul 5 21:08:07 2022] GET /identity/v3/role_assignments?group.id=e5dbbd5132dc4f24a2e910f1a46ce656&scope.project.id=3665952118af4106b09bd445a38d53e5&role.id=f9389c8fc7a74300aed4cf6490fb672b => generated 260 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:08.190038 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39343ece-3821-4284-89d4-2fed77d56758 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:08.190515 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39343ece-3821-4284-89d4-2fed77d56758 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:08.190947 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39343ece-3821-4284-89d4-2fed77d56758 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:08.193110 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 181/351] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:08.194543 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39343ece-3821-4284-89d4-2fed77d56758 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:08.208819 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64070617-4209-4fb6-af70-c0f7c79b3327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:08.209625 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64070617-4209-4fb6-af70-c0f7c79b3327 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:08.209992 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64070617-4209-4fb6-af70-c0f7c79b3327 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:08.211042 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64070617-4209-4fb6-af70-c0f7c79b3327 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:08.222744 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:08.316665 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64070617-4209-4fb6-af70-c0f7c79b3327 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:08.318421 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64070617-4209-4fb6-af70-c0f7c79b3327 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:08.360080 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39343ece-3821-4284-89d4-2fed77d56758 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:08.412555 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd9cf1-6d41-4c3f-bcfe-c6875c5d2255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:08.413221 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd9cf1-6d41-4c3f-bcfe-c6875c5d2255 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:08.413487 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd9cf1-6d41-4c3f-bcfe-c6875c5d2255 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:08.413772 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd9cf1-6d41-4c3f-bcfe-c6875c5d2255 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:08.434200 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 171/352] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:08:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:08:08.435795 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1898c-a244-484b-a388-8fa51885189f None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:08.436251 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1898c-a244-484b-a388-8fa51885189f None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:08.436667 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1898c-a244-484b-a388-8fa51885189f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:08.455461 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-cec1898c-a244-484b-a388-8fa51885189f None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:08.456906 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-cec1898c-a244-484b-a388-8fa51885189f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:08.468390 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:08.518327 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dd9cf1-6d41-4c3f-bcfe-c6875c5d2255 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:08.519850 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dd9cf1-6d41-4c3f-bcfe-c6875c5d2255 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:08.541999 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:08.543319 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 172/353] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:08:08.544658 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1898c-a244-484b-a388-8fa51885189f None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:08.638643 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 182/354] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:08:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:08:08.640197 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543b790-108f-4cd7-bbd9-9ac6518d6318 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:08.640413 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543b790-108f-4cd7-bbd9-9ac6518d6318 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:08.640704 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543b790-108f-4cd7-bbd9-9ac6518d6318 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:08.646154 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 183/355] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:08.646154 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8543b790-108f-4cd7-bbd9-9ac6518d6318 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:08.670066 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1898c-a244-484b-a388-8fa51885189f None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:08.711250 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3acec-b577-4f84-98f0-08778509e2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:08.712503 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3acec-b577-4f84-98f0-08778509e2f6 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:08.713128 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3acec-b577-4f84-98f0-08778509e2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:08.713628 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3acec-b577-4f84-98f0-08778509e2f6 None admin] PATH_INFO: `/v3/projects/9d370c4b5282475484b01c328ffd7864` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:08.715575 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee3acec-b577-4f84-98f0-08778509e2f6 None admin] RBAC: Authorizing `identity:get_project(project_id=9d370c4b5282475484b01c328ffd7864)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:08.718057 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee3acec-b577-4f84-98f0-08778509e2f6 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:08.720858 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 173/356] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:08:08 2022] GET /identity/v3/projects/9d370c4b5282475484b01c328ffd7864 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:08.722243 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3acec-b577-4f84-98f0-08778509e2f6 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:08.743378 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:08.785080 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8543b790-108f-4cd7-bbd9-9ac6518d6318 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:08.808005 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:08.831107 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06281f46-61ff-40c1-b957-0efb5f08069e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:08.832161 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06281f46-61ff-40c1-b957-0efb5f08069e None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:08.832454 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06281f46-61ff-40c1-b957-0efb5f08069e None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:08.833184 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06281f46-61ff-40c1-b957-0efb5f08069e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:08.847827 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06281f46-61ff-40c1-b957-0efb5f08069e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:08:08.860288 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-06281f46-61ff-40c1-b957-0efb5f08069e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:08:08.860288 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:08.860288 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:08.860288 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:08.860288 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:08.860288 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:08.860288 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:08.860288 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:08.860288 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:08.860288 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:08.860288 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:08.860288 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:08.860288 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:08:08.860288 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:08:08.860288 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:08:08.860288 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:08:08.861422 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:08:08.861422 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:08:08.861422 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:08:08.861422 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:08:08.861422 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:08.861422 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:08.861422 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:08.861422 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:08.861422 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:08.861422 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:08.861422 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:08.861422 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:08.861422 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:08.861422 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:08.861422 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:08.861422 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:08.862440 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:08.862440 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:08.862440 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:08.862440 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:08.862440 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:08:08.862440 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:08:08.862440 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:08:08.862440 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:08:08.862440 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:08:08.862440 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:08:08.862440 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:08:08.862440 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:08.863090 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3acec-b577-4f84-98f0-08778509e2f6 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:08.863162 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 184/357] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:08:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:08.863162 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238c63e-d63f-46b6-bb9f-987ec1037e58 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:08.863162 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238c63e-d63f-46b6-bb9f-987ec1037e58 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:08.863451 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238c63e-d63f-46b6-bb9f-987ec1037e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:08.889402 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-3238c63e-d63f-46b6-bb9f-987ec1037e58 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:08.890873 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-3238c63e-d63f-46b6-bb9f-987ec1037e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:08.921218 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86baa6b-42ec-4d13-94a8-e76fce5e2653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:08.922784 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86baa6b-42ec-4d13-94a8-e76fce5e2653 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:08.923219 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86baa6b-42ec-4d13-94a8-e76fce5e2653 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:08.923642 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86baa6b-42ec-4d13-94a8-e76fce5e2653 None admin] PATH_INFO: `/v3/projects/3665952118af4106b09bd445a38d53e5` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:08.925509 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86baa6b-42ec-4d13-94a8-e76fce5e2653 None admin] RBAC: Authorizing `identity:get_project(project_id=3665952118af4106b09bd445a38d53e5)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:08.927797 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86baa6b-42ec-4d13-94a8-e76fce5e2653 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:08.930398 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 174/358] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:08:08 2022] GET /identity/v3/projects/3665952118af4106b09bd445a38d53e5 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:08.931546 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86baa6b-42ec-4d13-94a8-e76fce5e2653 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:08.984104 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 185/359] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:08:08.987032 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238c63e-d63f-46b6-bb9f-987ec1037e58 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:09.045532 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:09.070786 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86baa6b-42ec-4d13-94a8-e76fce5e2653 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:09.116262 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238c63e-d63f-46b6-bb9f-987ec1037e58 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:09.120141 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866e47e-bf24-4c26-a8c5-052ae55b59ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:09.121024 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866e47e-bf24-4c26-a8c5-052ae55b59ba None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:09.121315 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866e47e-bf24-4c26-a8c5-052ae55b59ba None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:09.121598 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866e47e-bf24-4c26-a8c5-052ae55b59ba None admin] PATH_INFO: `/v3/groups/e5dbbd5132dc4f24a2e910f1a46ce656` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:09.122827 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866e47e-bf24-4c26-a8c5-052ae55b59ba None admin] RBAC: Authorizing `identity:get_group(group_id=e5dbbd5132dc4f24a2e910f1a46ce656)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:09.124691 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866e47e-bf24-4c26-a8c5-052ae55b59ba None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:09.126615 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 175/360] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Jul 5 21:08:08 2022] GET /identity/v3/groups/e5dbbd5132dc4f24a2e910f1a46ce656 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:09.127616 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08c140-e8b8-4c43-8227-04628ca0d4b1 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:09.127905 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08c140-e8b8-4c43-8227-04628ca0d4b1 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:09.128190 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08c140-e8b8-4c43-8227-04628ca0d4b1 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:09.129367 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:09.130966 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 176/361] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:09.134710 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e08c140-e8b8-4c43-8227-04628ca0d4b1 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:09.173757 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69cb31-c0d7-4a57-b55a-7c8f3e233724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:09.174506 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69cb31-c0d7-4a57-b55a-7c8f3e233724 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:09.174795 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69cb31-c0d7-4a57-b55a-7c8f3e233724 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:09.175080 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69cb31-c0d7-4a57-b55a-7c8f3e233724 None admin] PATH_INFO: `/v3/roles` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:09.175839 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c69cb31-c0d7-4a57-b55a-7c8f3e233724 None admin] RBAC: Adding query filter params (name=reader) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:09.176155 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c69cb31-c0d7-4a57-b55a-7c8f3e233724 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:09.177717 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c69cb31-c0d7-4a57-b55a-7c8f3e233724 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:09.190599 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 186/362] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:08:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:09.195160 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69cb31-c0d7-4a57-b55a-7c8f3e233724 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:09.268343 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e08c140-e8b8-4c43-8227-04628ca0d4b1 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:09.313516 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1dc9c-31cd-4374-b114-899f5ebd1fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:09.314931 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1dc9c-31cd-4374-b114-899f5ebd1fa9 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:09.316338 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1dc9c-31cd-4374-b114-899f5ebd1fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:09.316338 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1dc9c-31cd-4374-b114-899f5ebd1fa9 None admin] PATH_INFO: `/v3/groups/e5dbbd5132dc4f24a2e910f1a46ce656` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:09.317864 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1dc9c-31cd-4374-b114-899f5ebd1fa9 None admin] RBAC: Authorizing `identity:get_group(group_id=e5dbbd5132dc4f24a2e910f1a46ce656)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:09.320275 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1dc9c-31cd-4374-b114-899f5ebd1fa9 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:09.322247 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 177/363] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Jul 5 21:08:09 2022] GET /identity/v3/groups/e5dbbd5132dc4f24a2e910f1a46ce656 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:09.324448 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1dc9c-31cd-4374-b114-899f5ebd1fa9 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:09.324772 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69cb31-c0d7-4a57-b55a-7c8f3e233724 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:09.345262 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:09.368711 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d35a24-7d03-4d7d-a78a-54ad8273af38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:09.370531 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d35a24-7d03-4d7d-a78a-54ad8273af38 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:09.370993 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d35a24-7d03-4d7d-a78a-54ad8273af38 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:09.371413 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d35a24-7d03-4d7d-a78a-54ad8273af38 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:09.383773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d35a24-7d03-4d7d-a78a-54ad8273af38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:08:09.393226 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-03d35a24-7d03-4d7d-a78a-54ad8273af38 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:08:09.393226 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:09.393226 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:09.393226 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:09.393226 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:09.393226 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:09.393226 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:09.393226 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:09.393226 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:09.393226 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:09.393226 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:09.393226 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:09.393226 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:08:09.393226 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:08:09.393226 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:08:09.393226 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:08:09.394242 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:08:09.394242 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:08:09.394242 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:08:09.394242 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:08:09.394242 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:09.394242 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:09.394242 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:09.394242 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:09.394242 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:09.394242 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:09.394242 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:09.394242 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:09.394242 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:09.394242 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:09.394242 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:09.394242 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:09.395056 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:09.395056 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:09.395056 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:09.395056 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:09.395056 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:08:09.395056 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:08:09.395056 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:08:09.395056 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:08:09.395056 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:08:09.395056 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:08:09.395056 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:08:09.395056 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:09.395944 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 187/364] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:08:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:09.396376 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2791679-a8f6-4b64-b917-112544b59253 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:09.396672 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2791679-a8f6-4b64-b917-112544b59253 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:09.396953 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2791679-a8f6-4b64-b917-112544b59253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:09.415464 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-a2791679-a8f6-4b64-b917-112544b59253 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:09.416756 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-a2791679-a8f6-4b64-b917-112544b59253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:09.447162 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:09.461875 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1dc9c-31cd-4374-b114-899f5ebd1fa9 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:09.516047 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 188/365] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:08:09.523118 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2791679-a8f6-4b64-b917-112544b59253 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:09.530892 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201f25e-373a-4021-8951-0248b3bb2abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:09.531577 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201f25e-373a-4021-8951-0248b3bb2abf None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:09.531871 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201f25e-373a-4021-8951-0248b3bb2abf None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:09.532154 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201f25e-373a-4021-8951-0248b3bb2abf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:09.533057 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0201f25e-373a-4021-8951-0248b3bb2abf None admin] RBAC: Adding query filter params (group.id=e5dbbd5132dc4f24a2e910f1a46ce656, role.id=f9389c8fc7a74300aed4cf6490fb672b, scope.project.id=9d370c4b5282475484b01c328ffd7864) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:09.533454 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0201f25e-373a-4021-8951-0248b3bb2abf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:09.534953 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0201f25e-373a-4021-8951-0248b3bb2abf None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:09.550560 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 178/366] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Jul 5 21:08:09 2022] GET /identity/v3/role_assignments?group.id=e5dbbd5132dc4f24a2e910f1a46ce656&scope.project.id=9d370c4b5282475484b01c328ffd7864&role.id=f9389c8fc7a74300aed4cf6490fb672b => generated 260 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:09.558691 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201f25e-373a-4021-8951-0248b3bb2abf None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:09.670554 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2791679-a8f6-4b64-b917-112544b59253 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:09.678211 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:09.705910 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201f25e-373a-4021-8951-0248b3bb2abf None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:09.726861 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a7235-2f59-410b-b6c0-7571a455e134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:09.726861 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a7235-2f59-410b-b6c0-7571a455e134 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:09.727412 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a7235-2f59-410b-b6c0-7571a455e134 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:09.727946 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a7235-2f59-410b-b6c0-7571a455e134 None admin] PATH_INFO: `/v3/users/e55c7279c58f49a4b0296514d921d2de` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:09.730036 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6a7235-2f59-410b-b6c0-7571a455e134 None admin] RBAC: Authorizing `identity:get_user(user_id=e55c7279c58f49a4b0296514d921d2de)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:09.736380 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6a7235-2f59-410b-b6c0-7571a455e134 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:09.737756 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 189/367] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:08:09 2022] GET /identity/v3/users/e55c7279c58f49a4b0296514d921d2de => generated 293 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:09.738363 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a7235-2f59-410b-b6c0-7571a455e134 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:09.778998 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ddb788-f086-45a3-b01d-5f6e5545b994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:09.780068 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ddb788-f086-45a3-b01d-5f6e5545b994 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:09.780593 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ddb788-f086-45a3-b01d-5f6e5545b994 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:09.781109 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ddb788-f086-45a3-b01d-5f6e5545b994 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:09.782233 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ddb788-f086-45a3-b01d-5f6e5545b994 None admin] RBAC: Adding query filter params (group.id=e5dbbd5132dc4f24a2e910f1a46ce656, role.id=49943dd485174ef39fdd0368de241417, scope.project.id=3665952118af4106b09bd445a38d53e5) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:09.782775 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ddb788-f086-45a3-b01d-5f6e5545b994 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:09.784448 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ddb788-f086-45a3-b01d-5f6e5545b994 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:09.800614 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 179/368] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Jul 5 21:08:09 2022] GET /identity/v3/role_assignments?group.id=e5dbbd5132dc4f24a2e910f1a46ce656&scope.project.id=3665952118af4106b09bd445a38d53e5&role.id=49943dd485174ef39fdd0368de241417 => generated 260 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:09.801983 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ddb788-f086-45a3-b01d-5f6e5545b994 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:09.803528 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:09.966524 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a7235-2f59-410b-b6c0-7571a455e134 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:10.030779 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ddb788-f086-45a3-b01d-5f6e5545b994 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:10.038531 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1439c91-3607-491b-89e4-e345f2207f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:10.043500 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1439c91-3607-491b-89e4-e345f2207f3a None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:10.043940 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1439c91-3607-491b-89e4-e345f2207f3a None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:10.044329 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1439c91-3607-491b-89e4-e345f2207f3a None admin] PATH_INFO: `/v3/roles` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:10.045227 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1439c91-3607-491b-89e4-e345f2207f3a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:10.048058 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1439c91-3607-491b-89e4-e345f2207f3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:10.049045 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1439c91-3607-491b-89e4-e345f2207f3a None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:10.066245 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 190/369] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:08:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:10.068263 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1439c91-3607-491b-89e4-e345f2207f3a None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:10.128905 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa9e4a6-2b5c-4c80-8241-c742e894191e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:10.129903 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9e4a6-2b5c-4c80-8241-c742e894191e None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:10.130324 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9e4a6-2b5c-4c80-8241-c742e894191e None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:10.130707 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9e4a6-2b5c-4c80-8241-c742e894191e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:10.156961 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa9e4a6-2b5c-4c80-8241-c742e894191e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:08:10.167412 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-4aa9e4a6-2b5c-4c80-8241-c742e894191e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:08:10.167412 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:10.167412 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:10.167412 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:10.167412 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:10.167412 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:10.167412 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:10.167412 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:10.167412 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:10.167412 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:10.167412 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:10.167412 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:10.167412 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:08:10.167412 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:08:10.167412 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:08:10.167412 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:08:10.168432 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:08:10.168432 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:08:10.168432 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:08:10.168432 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:08:10.168432 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:10.168432 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:10.168432 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:10.168432 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:10.168432 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:10.168432 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:10.168432 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:10.168432 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:10.168432 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:10.168432 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:10.168432 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:10.168432 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:10.169451 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:10.169451 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:10.169451 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:10.169451 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:10.169451 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:08:10.169451 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:08:10.169451 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:08:10.169451 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:08:10.169451 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:08:10.169451 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:08:10.169451 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:08:10.169451 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:10.169451 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 180/370] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:08:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:10.170374 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa9e4a6-2b5c-4c80-8241-c742e894191e None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:10.181737 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:10.266516 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:10.282528 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1439c91-3607-491b-89e4-e345f2207f3a None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:10.321821 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e9c1c-82ce-428d-8ab5-aa326eeee7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:10.322998 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e9c1c-82ce-428d-8ab5-aa326eeee7a7 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:10.323768 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e9c1c-82ce-428d-8ab5-aa326eeee7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:10.324077 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e9c1c-82ce-428d-8ab5-aa326eeee7a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:10.324933 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e9c1c-82ce-428d-8ab5-aa326eeee7a7 None admin] RBAC: Adding query filter params (role.id=e8b0e7643206483385c49640e21e33d7, user.id=e55c7279c58f49a4b0296514d921d2de, scope.system=all) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:10.325254 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e9c1c-82ce-428d-8ab5-aa326eeee7a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:10.326738 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e9c1c-82ce-428d-8ab5-aa326eeee7a7 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:10.340517 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 191/371] 10.222.0.30 () {56 vars in 1308 bytes} [Tue Jul 5 21:08:10 2022] GET /identity/v3/role_assignments?user.id=e55c7279c58f49a4b0296514d921d2de&scope.system=all&role.id=e8b0e7643206483385c49640e21e33d7 => generated 510 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:10.341445 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e9c1c-82ce-428d-8ab5-aa326eeee7a7 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:10.349437 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa9e4a6-2b5c-4c80-8241-c742e894191e None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:10.398920 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7364b-0c32-4596-b063-3e238fbb548f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:10.399614 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7364b-0c32-4596-b063-3e238fbb548f None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:10.399906 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7364b-0c32-4596-b063-3e238fbb548f None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:10.400194 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7364b-0c32-4596-b063-3e238fbb548f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:10.458104 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e9c1c-82ce-428d-8ab5-aa326eeee7a7 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:10.497608 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c98b8-25f8-4efb-b9a9-a6400dd6f471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:10.498332 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c98b8-25f8-4efb-b9a9-a6400dd6f471 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:10.498626 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c98b8-25f8-4efb-b9a9-a6400dd6f471 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:10.498909 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c98b8-25f8-4efb-b9a9-a6400dd6f471 None admin] PATH_INFO: `/v3/roles` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:10.499684 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c98b8-25f8-4efb-b9a9-a6400dd6f471 None admin] RBAC: Adding query filter params (name=admin) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:10.500012 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c98b8-25f8-4efb-b9a9-a6400dd6f471 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:10.501436 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c98b8-25f8-4efb-b9a9-a6400dd6f471 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:10.512320 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 192/372] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:08:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:10.518615 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe7364b-0c32-4596-b063-3e238fbb548f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:10.518910 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c98b8-25f8-4efb-b9a9-a6400dd6f471 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:10.520115 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe7364b-0c32-4596-b063-3e238fbb548f None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:10.523336 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:10.538412 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:10.632466 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c98b8-25f8-4efb-b9a9-a6400dd6f471 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:10.635069 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 181/373] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:08:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:08:10.640129 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7364b-0c32-4596-b063-3e238fbb548f None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:10.702881 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6025a-8456-434a-8871-33701f26ecea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:10.703543 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6025a-8456-434a-8871-33701f26ecea None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:10.703856 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6025a-8456-434a-8871-33701f26ecea None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:10.704103 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6025a-8456-434a-8871-33701f26ecea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:10.824807 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c6025a-8456-434a-8871-33701f26ecea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:10.826655 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c6025a-8456-434a-8871-33701f26ecea None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:10.840592 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:10.872107 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7364b-0c32-4596-b063-3e238fbb548f None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:10.878099 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:10.947972 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 193/374] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:08:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 21:08:10.953328 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6025a-8456-434a-8871-33701f26ecea None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:10.975764 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c7f2d-1694-4c57-901c-b3d8647268ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:10.976662 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c7f2d-1694-4c57-901c-b3d8647268ec None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:10.976950 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c7f2d-1694-4c57-901c-b3d8647268ec None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:10.977230 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c7f2d-1694-4c57-901c-b3d8647268ec None admin] PATH_INFO: `/v3/projects/9d370c4b5282475484b01c328ffd7864` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:10.978495 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c7f2d-1694-4c57-901c-b3d8647268ec None admin] RBAC: Authorizing `identity:get_project(project_id=9d370c4b5282475484b01c328ffd7864)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:10.980513 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c7f2d-1694-4c57-901c-b3d8647268ec None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:10.986513 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 182/375] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:08:10 2022] GET /identity/v3/projects/9d370c4b5282475484b01c328ffd7864 => generated 302 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:08:10.992027 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c7f2d-1694-4c57-901c-b3d8647268ec None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:11.068381 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6025a-8456-434a-8871-33701f26ecea None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:11.083630 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:11.116108 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9033bfa-a9cd-4da8-bc18-34ed210909d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:11.116992 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9033bfa-a9cd-4da8-bc18-34ed210909d2 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:11.117278 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9033bfa-a9cd-4da8-bc18-34ed210909d2 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:11.117557 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9033bfa-a9cd-4da8-bc18-34ed210909d2 None admin] PATH_INFO: `/v3/projects/819d2c6b4ee2448890d6f7032696195a` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:11.118857 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9033bfa-a9cd-4da8-bc18-34ed210909d2 None admin] RBAC: Authorizing `identity:get_project(project_id=819d2c6b4ee2448890d6f7032696195a)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:11.120972 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9033bfa-a9cd-4da8-bc18-34ed210909d2 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:11.123130 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 194/376] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:08:10 2022] GET /identity/v3/projects/819d2c6b4ee2448890d6f7032696195a => generated 344 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:08:11.124361 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212fe20-bf15-4971-b928-8d57767e91d3 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:11.124657 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212fe20-bf15-4971-b928-8d57767e91d3 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:11.124946 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212fe20-bf15-4971-b928-8d57767e91d3 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:11.127483 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 195/377] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:11.134422 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8d82d-0451-4e7a-a7cd-f9b636663ea0 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:11.134715 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8d82d-0451-4e7a-a7cd-f9b636663ea0 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:11.135705 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8d82d-0451-4e7a-a7cd-f9b636663ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:11.155949 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-54f8d82d-0451-4e7a-a7cd-f9b636663ea0 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:11.162820 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c7f2d-1694-4c57-901c-b3d8647268ec None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:11.162971 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-54f8d82d-0451-4e7a-a7cd-f9b636663ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:11.195119 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be19b9-c641-41d0-8fd6-7420bc135766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:11.196099 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be19b9-c641-41d0-8fd6-7420bc135766 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:11.196618 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be19b9-c641-41d0-8fd6-7420bc135766 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:11.196969 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be19b9-c641-41d0-8fd6-7420bc135766 None admin] PATH_INFO: `/v3/groups/e5dbbd5132dc4f24a2e910f1a46ce656` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:11.199140 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0be19b9-c641-41d0-8fd6-7420bc135766 None admin] RBAC: Authorizing `identity:get_group(group_id=e5dbbd5132dc4f24a2e910f1a46ce656)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:11.200611 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0be19b9-c641-41d0-8fd6-7420bc135766 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:11.202734 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 183/378] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Jul 5 21:08:10 2022] GET /identity/v3/groups/e5dbbd5132dc4f24a2e910f1a46ce656 => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:08:11.203599 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be19b9-c641-41d0-8fd6-7420bc135766 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:11.236419 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 196/379] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:08:11.237362 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8d82d-0451-4e7a-a7cd-f9b636663ea0 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:11.263548 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:11.342513 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be19b9-c641-41d0-8fd6-7420bc135766 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:11.383503 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a353ba-e205-46a6-802a-5bc87fc3a748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:11.383713 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8d82d-0451-4e7a-a7cd-f9b636663ea0 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:11.384382 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a353ba-e205-46a6-802a-5bc87fc3a748 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:11.384663 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a353ba-e205-46a6-802a-5bc87fc3a748 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:11.385596 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a353ba-e205-46a6-802a-5bc87fc3a748 None admin] PATH_INFO: `/v3/groups/c6a53ac1c7c349f68b4e3ce4d399965e` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:11.391872 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a353ba-e205-46a6-802a-5bc87fc3a748 None admin] RBAC: Authorizing `identity:get_group(group_id=c6a53ac1c7c349f68b4e3ce4d399965e)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:11.393852 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a353ba-e205-46a6-802a-5bc87fc3a748 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:11.394473 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:11.401163 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 184/380] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Jul 5 21:08:11 2022] GET /identity/v3/groups/c6a53ac1c7c349f68b4e3ce4d399965e => generated 229 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:11.402038 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a353ba-e205-46a6-802a-5bc87fc3a748 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:11.424807 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57172262-4fd0-428d-9f17-1f1d5b5793c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:11.425560 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57172262-4fd0-428d-9f17-1f1d5b5793c4 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:11.425849 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57172262-4fd0-428d-9f17-1f1d5b5793c4 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:11.426146 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57172262-4fd0-428d-9f17-1f1d5b5793c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:11.427025 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57172262-4fd0-428d-9f17-1f1d5b5793c4 None admin] RBAC: Adding query filter params (group.id=e5dbbd5132dc4f24a2e910f1a46ce656, role.id=49943dd485174ef39fdd0368de241417, scope.project.id=9d370c4b5282475484b01c328ffd7864) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:11.427348 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57172262-4fd0-428d-9f17-1f1d5b5793c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:11.429612 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57172262-4fd0-428d-9f17-1f1d5b5793c4 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:11.436952 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 197/381] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Jul 5 21:08:11 2022] GET /identity/v3/role_assignments?group.id=e5dbbd5132dc4f24a2e910f1a46ce656&scope.project.id=9d370c4b5282475484b01c328ffd7864&role.id=49943dd485174ef39fdd0368de241417 => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:11.438470 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57172262-4fd0-428d-9f17-1f1d5b5793c4 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:11.554982 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a353ba-e205-46a6-802a-5bc87fc3a748 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:11.564444 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:11.576235 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57172262-4fd0-428d-9f17-1f1d5b5793c4 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:11.628873 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bcb4e5-a0a6-4e1d-bd95-97811bddbf54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:11.629874 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcb4e5-a0a6-4e1d-bd95-97811bddbf54 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:11.630408 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcb4e5-a0a6-4e1d-bd95-97811bddbf54 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:11.630927 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcb4e5-a0a6-4e1d-bd95-97811bddbf54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:11.632303 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bcb4e5-a0a6-4e1d-bd95-97811bddbf54 None admin] RBAC: Adding query filter params (group.id=c6a53ac1c7c349f68b4e3ce4d399965e, role.id=101b93f94624407f8c812ab86ebec32a, scope.project.id=819d2c6b4ee2448890d6f7032696195a) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:11.632822 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bcb4e5-a0a6-4e1d-bd95-97811bddbf54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:11.634705 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bcb4e5-a0a6-4e1d-bd95-97811bddbf54 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:11.644688 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 198/382] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Jul 5 21:08:11 2022] GET /identity/v3/role_assignments?group.id=c6a53ac1c7c349f68b4e3ce4d399965e&scope.project.id=819d2c6b4ee2448890d6f7032696195a&role.id=101b93f94624407f8c812ab86ebec32a => generated 260 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:11.667247 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490b540-2c40-4f6b-9701-597f7028f280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:11.668241 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490b540-2c40-4f6b-9701-597f7028f280 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:11.668531 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490b540-2c40-4f6b-9701-597f7028f280 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:11.668817 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490b540-2c40-4f6b-9701-597f7028f280 None admin] PATH_INFO: `/v3/roles/member` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:11.686339 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7490b540-2c40-4f6b-9701-597f7028f280 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:08:11.695450 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-7490b540-2c40-4f6b-9701-597f7028f280 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:08:11.695450 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:11.695450 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:11.695450 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:11.695450 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:11.695450 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:11.695450 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:11.695450 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:11.695450 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:11.695450 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:11.695450 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:11.695450 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:11.695450 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:08:11.695450 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:08:11.695450 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:08:11.695450 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:08:11.696476 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:08:11.696476 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:08:11.696476 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:08:11.696476 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:08:11.696476 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:11.696476 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:11.696476 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:11.696476 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:11.696476 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:11.696476 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:11.696476 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:11.696476 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:11.696476 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:11.696476 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:11.696476 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:11.696476 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:11.697910 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:11.697910 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:11.697910 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:11.697910 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:11.697910 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:08:11.697910 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:08:11.697910 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:08:11.697910 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:08:11.697910 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:08:11.697910 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:08:11.697910 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:08:11.697910 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:11.697910 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 185/383] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:08:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:11.703520 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bcb4e5-a0a6-4e1d-bd95-97811bddbf54 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:11.771605 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:11.858487 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bcb4e5-a0a6-4e1d-bd95-97811bddbf54 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:11.896310 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22de7e3-a95f-4893-8a07-8b8402ac1002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:11.896927 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22de7e3-a95f-4893-8a07-8b8402ac1002 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:11.897211 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22de7e3-a95f-4893-8a07-8b8402ac1002 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:11.897491 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22de7e3-a95f-4893-8a07-8b8402ac1002 None admin] PATH_INFO: `/v3/roles` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:11.898300 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22de7e3-a95f-4893-8a07-8b8402ac1002 None admin] RBAC: Adding query filter params (name=member) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:11.898666 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22de7e3-a95f-4893-8a07-8b8402ac1002 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:11.900182 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22de7e3-a95f-4893-8a07-8b8402ac1002 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:11.913624 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 199/384] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:08:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:11.919560 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490b540-2c40-4f6b-9701-597f7028f280 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:12.053620 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490b540-2c40-4f6b-9701-597f7028f280 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:12.093637 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fccad61-d3a1-4ccb-8864-4ca034674df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:12.094549 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccad61-d3a1-4ccb-8864-4ca034674df1 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:12.094844 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccad61-d3a1-4ccb-8864-4ca034674df1 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:12.095131 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccad61-d3a1-4ccb-8864-4ca034674df1 None admin] PATH_INFO: `/v3/groups/e5dbbd5132dc4f24a2e910f1a46ce656` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:12.096344 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fccad61-d3a1-4ccb-8864-4ca034674df1 None admin] RBAC: Authorizing `identity:get_group(group_id=e5dbbd5132dc4f24a2e910f1a46ce656)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:12.097811 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fccad61-d3a1-4ccb-8864-4ca034674df1 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:12.099706 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 186/385] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Jul 5 21:08:11 2022] GET /identity/v3/groups/e5dbbd5132dc4f24a2e910f1a46ce656 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:12.105526 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22de7e3-a95f-4893-8a07-8b8402ac1002 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:12.259301 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:12.264752 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22de7e3-a95f-4893-8a07-8b8402ac1002 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:12.312095 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4fb0a3-0b8a-4b48-8b64-cc54b7bbcf58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:12.313052 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fb0a3-0b8a-4b48-8b64-cc54b7bbcf58 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:12.313632 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fb0a3-0b8a-4b48-8b64-cc54b7bbcf58 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:12.313916 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fb0a3-0b8a-4b48-8b64-cc54b7bbcf58 None admin] PATH_INFO: `/v3/projects/3665952118af4106b09bd445a38d53e5` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:12.315200 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4fb0a3-0b8a-4b48-8b64-cc54b7bbcf58 None admin] RBAC: Authorizing `identity:get_project(project_id=3665952118af4106b09bd445a38d53e5)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:12.316685 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4fb0a3-0b8a-4b48-8b64-cc54b7bbcf58 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:12.318724 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 200/386] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:08:12 2022] GET /identity/v3/projects/3665952118af4106b09bd445a38d53e5 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:12.327219 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fccad61-d3a1-4ccb-8864-4ca034674df1 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:12.383337 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:12.476920 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fccad61-d3a1-4ccb-8864-4ca034674df1 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:12.501385 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58e0d1-81e9-44a0-af33-cdd8b5dc1daf None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:12.501698 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58e0d1-81e9-44a0-af33-cdd8b5dc1daf None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:12.501952 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58e0d1-81e9-44a0-af33-cdd8b5dc1daf None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:12.503513 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 201/387] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:12.510189 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c447c9-b42c-4404-8055-28647191541b None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:12.510528 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c447c9-b42c-4404-8055-28647191541b None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:12.510808 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c447c9-b42c-4404-8055-28647191541b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:12.524046 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be868271-c187-416e-8e54-dc0268013d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:12.525254 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be868271-c187-416e-8e54-dc0268013d9d None admin] REQUEST_METHOD: `PUT` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:12.527081 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be868271-c187-416e-8e54-dc0268013d9d None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:12.527589 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be868271-c187-416e-8e54-dc0268013d9d None admin] PATH_INFO: `/v3/projects/3665952118af4106b09bd445a38d53e5/groups/e5dbbd5132dc4f24a2e910f1a46ce656/roles/f9389c8fc7a74300aed4cf6490fb672b` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:12.529837 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be868271-c187-416e-8e54-dc0268013d9d None admin] RBAC: Authorizing `identity:create_grant(project_id=3665952118af4106b09bd445a38d53e5, group_id=e5dbbd5132dc4f24a2e910f1a46ce656, role_id=f9389c8fc7a74300aed4cf6490fb672b)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:12.531576 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be868271-c187-416e-8e54-dc0268013d9d None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:12.546592 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-58c447c9-b42c-4404-8055-28647191541b None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:12.548532 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-58c447c9-b42c-4404-8055-28647191541b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:12.608682 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 187/388] 10.222.0.30 () {58 vars in 1442 bytes} [Tue Jul 5 21:08:12 2022] PUT /identity/v3/projects/3665952118af4106b09bd445a38d53e5/groups/e5dbbd5132dc4f24a2e910f1a46ce656/roles/f9389c8fc7a74300aed4cf6490fb672b => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:08:12.610448 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0059da5-6c1e-494e-bc51-7f5211104b20 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:12.610966 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0059da5-6c1e-494e-bc51-7f5211104b20 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:12.611339 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0059da5-6c1e-494e-bc51-7f5211104b20 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:12.612926 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 188/389] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:12.621851 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79a2f0-6040-4e48-91e8-7ba6b8a872a9 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:12.622175 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79a2f0-6040-4e48-91e8-7ba6b8a872a9 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:12.622483 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79a2f0-6040-4e48-91e8-7ba6b8a872a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:12.636808 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 202/390] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:08:12.651865 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-fa79a2f0-6040-4e48-91e8-7ba6b8a872a9 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:12.653098 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-fa79a2f0-6040-4e48-91e8-7ba6b8a872a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:12.666881 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c447c9-b42c-4404-8055-28647191541b None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:12.762511 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 189/391] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:08:12.790917 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79a2f0-6040-4e48-91e8-7ba6b8a872a9 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:12.835293 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:12.837276 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:12.841529 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c447c9-b42c-4404-8055-28647191541b None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:12.880281 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb43fc-5bc2-47c3-be94-8b9a62830c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:12.881562 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb43fc-5bc2-47c3-be94-8b9a62830c85 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:12.881858 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb43fc-5bc2-47c3-be94-8b9a62830c85 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:12.882160 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb43fc-5bc2-47c3-be94-8b9a62830c85 None admin] PATH_INFO: `/v3/roles/member` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:12.896116 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcb43fc-5bc2-47c3-be94-8b9a62830c85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:08:12.905439 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-cdcb43fc-5bc2-47c3-be94-8b9a62830c85 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:08:12.905439 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:12.905439 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:12.905439 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:12.905439 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:12.905439 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:12.905439 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:12.905439 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:12.905439 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:12.905439 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:12.905439 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:12.905439 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:12.905439 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:08:12.905439 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:08:12.905439 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:08:12.905439 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:08:12.906472 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:08:12.906472 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:08:12.906472 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:08:12.906472 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:08:12.906472 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:12.906472 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:12.906472 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:12.906472 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:12.906472 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:12.906472 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:12.906472 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:12.906472 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:12.906472 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:12.906472 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:12.906472 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:12.906472 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:12.907266 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:12.907266 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:12.907266 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:12.907266 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:12.907266 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:08:12.907266 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:08:12.907266 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:08:12.907266 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:08:12.907266 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:08:12.907266 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:08:12.907266 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:08:12.907266 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:12.907266 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 203/392] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:08:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:08:12.913384 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb43fc-5bc2-47c3-be94-8b9a62830c85 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:13.017453 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79a2f0-6040-4e48-91e8-7ba6b8a872a9 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:13.031362 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb43fc-5bc2-47c3-be94-8b9a62830c85 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:13.070956 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7893e9-7c19-44ee-9344-f7050d3ed724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:13.071640 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7893e9-7c19-44ee-9344-f7050d3ed724 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:13.071983 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7893e9-7c19-44ee-9344-f7050d3ed724 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:13.072269 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7893e9-7c19-44ee-9344-f7050d3ed724 None admin] PATH_INFO: `/v3/roles` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:13.073869 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7893e9-7c19-44ee-9344-f7050d3ed724 None admin] RBAC: Adding query filter params (name=member) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:13.074211 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7893e9-7c19-44ee-9344-f7050d3ed724 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:13.076011 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7893e9-7c19-44ee-9344-f7050d3ed724 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:13.085591 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 204/393] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:08:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:13.086560 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c5d97-e810-48ad-9563-bf7279a1dc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:13.087627 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c5d97-e810-48ad-9563-bf7279a1dc50 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:13.088199 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c5d97-e810-48ad-9563-bf7279a1dc50 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:13.088688 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c5d97-e810-48ad-9563-bf7279a1dc50 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:13.091468 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7893e9-7c19-44ee-9344-f7050d3ed724 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:13.107220 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c5d97-e810-48ad-9563-bf7279a1dc50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:08:13.112783 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:13.117353 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-d88c5d97-e810-48ad-9563-bf7279a1dc50 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:08:13.117353 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:13.117353 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:13.117353 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:13.117353 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:13.117353 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:13.117353 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:13.117353 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:13.117353 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:13.117353 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:13.117353 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:13.117353 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:13.117353 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:08:13.117353 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:08:13.117353 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:08:13.117353 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:08:13.120809 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:08:13.120809 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:08:13.120809 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:08:13.120809 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:08:13.120809 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:13.120809 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:13.120809 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:13.120809 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:13.120809 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:13.120809 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:13.120809 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:13.120809 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:13.120809 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:13.120809 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:13.120809 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:13.120809 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:13.121645 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:13.121645 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:13.121645 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:13.121645 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:13.121645 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:08:13.121645 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:08:13.121645 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:08:13.121645 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:08:13.121645 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:08:13.121645 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:08:13.121645 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:08:13.121645 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:13.124299 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 190/394] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:08:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:08:13.130842 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c5d97-e810-48ad-9563-bf7279a1dc50 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:13.246625 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7893e9-7c19-44ee-9344-f7050d3ed724 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:13.292120 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65db52f9-a56c-4cca-bfac-930da89496d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:13.292915 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db52f9-a56c-4cca-bfac-930da89496d5 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:13.293204 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db52f9-a56c-4cca-bfac-930da89496d5 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:13.293491 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db52f9-a56c-4cca-bfac-930da89496d5 None admin] PATH_INFO: `/v3/groups/e5dbbd5132dc4f24a2e910f1a46ce656` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:13.294731 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65db52f9-a56c-4cca-bfac-930da89496d5 None admin] RBAC: Authorizing `identity:get_group(group_id=e5dbbd5132dc4f24a2e910f1a46ce656)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:13.296303 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65db52f9-a56c-4cca-bfac-930da89496d5 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:13.298333 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 205/395] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Jul 5 21:08:13 2022] GET /identity/v3/groups/e5dbbd5132dc4f24a2e910f1a46ce656 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:13.308698 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65db52f9-a56c-4cca-bfac-930da89496d5 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:13.324542 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:13.359169 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c5d97-e810-48ad-9563-bf7279a1dc50 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:13.401858 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebbee7-f8df-4980-859f-4cd3541b15e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:13.402690 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebbee7-f8df-4980-859f-4cd3541b15e5 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:13.402982 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebbee7-f8df-4980-859f-4cd3541b15e5 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:13.403270 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebbee7-f8df-4980-859f-4cd3541b15e5 None admin] PATH_INFO: `/v3/roles` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:13.404167 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ebbee7-f8df-4980-859f-4cd3541b15e5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:13.404484 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ebbee7-f8df-4980-859f-4cd3541b15e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:13.405958 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ebbee7-f8df-4980-859f-4cd3541b15e5 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:13.417705 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 191/396] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:08:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:13.423100 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebbee7-f8df-4980-859f-4cd3541b15e5 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:13.537884 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:13.547183 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65db52f9-a56c-4cca-bfac-930da89496d5 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:13.560389 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebbee7-f8df-4980-859f-4cd3541b15e5 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:13.616775 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b64392-b1ae-47cd-92ec-1177fd2961db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:13.617672 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b64392-b1ae-47cd-92ec-1177fd2961db None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:13.617967 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b64392-b1ae-47cd-92ec-1177fd2961db None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:13.618275 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b64392-b1ae-47cd-92ec-1177fd2961db None admin] PATH_INFO: `/v3/projects/9d370c4b5282475484b01c328ffd7864` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:13.622644 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b64392-b1ae-47cd-92ec-1177fd2961db None admin] RBAC: Authorizing `identity:get_project(project_id=9d370c4b5282475484b01c328ffd7864)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:13.624113 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b64392-b1ae-47cd-92ec-1177fd2961db None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:13.625859 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 206/397] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:08:13 2022] GET /identity/v3/projects/9d370c4b5282475484b01c328ffd7864 => generated 302 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:08:13.631215 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fea8f8-3b64-4330-99d0-77aeacdd1692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:13.632098 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fea8f8-3b64-4330-99d0-77aeacdd1692 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:13.632390 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fea8f8-3b64-4330-99d0-77aeacdd1692 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:13.632675 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fea8f8-3b64-4330-99d0-77aeacdd1692 None admin] PATH_INFO: `/v3/groups/e5dbbd5132dc4f24a2e910f1a46ce656` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:13.634063 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b64392-b1ae-47cd-92ec-1177fd2961db None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:13.635963 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fea8f8-3b64-4330-99d0-77aeacdd1692 None admin] RBAC: Authorizing `identity:get_group(group_id=e5dbbd5132dc4f24a2e910f1a46ce656)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:13.637437 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fea8f8-3b64-4330-99d0-77aeacdd1692 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:13.639394 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 192/398] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Jul 5 21:08:13 2022] GET /identity/v3/groups/e5dbbd5132dc4f24a2e910f1a46ce656 => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:08:13.646087 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fea8f8-3b64-4330-99d0-77aeacdd1692 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:13.661934 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:13.751542 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fea8f8-3b64-4330-99d0-77aeacdd1692 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:13.789911 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b35298-8a3d-46cc-a745-ccdd19200b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:13.791074 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b35298-8a3d-46cc-a745-ccdd19200b58 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:13.791871 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b35298-8a3d-46cc-a745-ccdd19200b58 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:13.792153 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b35298-8a3d-46cc-a745-ccdd19200b58 None admin] PATH_INFO: `/v3/projects/3665952118af4106b09bd445a38d53e5` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:13.793373 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b35298-8a3d-46cc-a745-ccdd19200b58 None admin] RBAC: Authorizing `identity:get_project(project_id=3665952118af4106b09bd445a38d53e5)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:13.795016 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b35298-8a3d-46cc-a745-ccdd19200b58 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:13.797027 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 193/399] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:08:13 2022] GET /identity/v3/projects/3665952118af4106b09bd445a38d53e5 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:13.807194 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b35298-8a3d-46cc-a745-ccdd19200b58 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:13.818887 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b64392-b1ae-47cd-92ec-1177fd2961db None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:13.882852 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d17069-aab2-4ea0-a5d0-61680560dcc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:13.883762 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d17069-aab2-4ea0-a5d0-61680560dcc8 None admin] REQUEST_METHOD: `PUT` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:13.884050 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d17069-aab2-4ea0-a5d0-61680560dcc8 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:13.884330 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d17069-aab2-4ea0-a5d0-61680560dcc8 None admin] PATH_INFO: `/v3/projects/9d370c4b5282475484b01c328ffd7864/groups/e5dbbd5132dc4f24a2e910f1a46ce656/roles/f9389c8fc7a74300aed4cf6490fb672b` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:13.890942 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d17069-aab2-4ea0-a5d0-61680560dcc8 None admin] RBAC: Authorizing `identity:create_grant(project_id=9d370c4b5282475484b01c328ffd7864, group_id=e5dbbd5132dc4f24a2e910f1a46ce656, role_id=f9389c8fc7a74300aed4cf6490fb672b)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:13.892415 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d17069-aab2-4ea0-a5d0-61680560dcc8 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:13.914489 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:13.924076 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b35298-8a3d-46cc-a745-ccdd19200b58 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:13.961487 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab1b768-5c95-4860-bd0e-7a8315516e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:13.962430 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1b768-5c95-4860-bd0e-7a8315516e1f None admin] REQUEST_METHOD: `PUT` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:13.962725 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1b768-5c95-4860-bd0e-7a8315516e1f None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:13.963129 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1b768-5c95-4860-bd0e-7a8315516e1f None admin] PATH_INFO: `/v3/projects/3665952118af4106b09bd445a38d53e5/groups/e5dbbd5132dc4f24a2e910f1a46ce656/roles/49943dd485174ef39fdd0368de241417` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:13.965615 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab1b768-5c95-4860-bd0e-7a8315516e1f None admin] RBAC: Authorizing `identity:create_grant(project_id=3665952118af4106b09bd445a38d53e5, group_id=e5dbbd5132dc4f24a2e910f1a46ce656, role_id=49943dd485174ef39fdd0368de241417)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:13.967158 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab1b768-5c95-4860-bd0e-7a8315516e1f None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:13.985899 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 207/400] 10.222.0.30 () {58 vars in 1442 bytes} [Tue Jul 5 21:08:13 2022] PUT /identity/v3/projects/9d370c4b5282475484b01c328ffd7864/groups/e5dbbd5132dc4f24a2e910f1a46ce656/roles/f9389c8fc7a74300aed4cf6490fb672b => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:08:14.081786 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 194/401] 10.222.0.30 () {58 vars in 1442 bytes} [Tue Jul 5 21:08:13 2022] PUT /identity/v3/projects/3665952118af4106b09bd445a38d53e5/groups/e5dbbd5132dc4f24a2e910f1a46ce656/roles/49943dd485174ef39fdd0368de241417 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:08:14.185071 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20854276-834b-46cd-b406-5ece505e175e None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:14.185529 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20854276-834b-46cd-b406-5ece505e175e None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:14.185997 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20854276-834b-46cd-b406-5ece505e175e None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:14.187853 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 208/402] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:14.193452 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed4a4b-7aff-4527-b454-91135b3c710e None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:14.193752 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed4a4b-7aff-4527-b454-91135b3c710e None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:14.194045 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed4a4b-7aff-4527-b454-91135b3c710e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:14.215799 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-16ed4a4b-7aff-4527-b454-91135b3c710e None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:14.217029 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-16ed4a4b-7aff-4527-b454-91135b3c710e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:14.319955 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 195/403] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:08:14.345014 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20854276-834b-46cd-b406-5ece505e175e None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:14.365568 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:14.491986 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20854276-834b-46cd-b406-5ece505e175e None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:14.542352 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f6f6f4-c397-447c-b316-a7ccc4c191b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:14.543188 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6f6f4-c397-447c-b316-a7ccc4c191b3 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:14.543480 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6f6f4-c397-447c-b316-a7ccc4c191b3 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:14.543761 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6f6f4-c397-447c-b316-a7ccc4c191b3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:14.554660 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f6f6f4-c397-447c-b316-a7ccc4c191b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:08:14.563712 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a23967-0f02-467c-be77-471355a9e9bb None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:14.564008 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a23967-0f02-467c-be77-471355a9e9bb None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:14.564295 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a23967-0f02-467c-be77-471355a9e9bb None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:14.565948 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 196/404] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:14.567633 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-52f6f6f4-c397-447c-b316-a7ccc4c191b3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:08:14.567633 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:14.567633 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:14.567633 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:14.567633 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:14.567633 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:14.567633 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:14.567633 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:14.567633 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:14.567633 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:14.567633 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:14.567633 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:14.567633 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:08:14.567633 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:08:14.567633 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:08:14.567633 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:08:14.568592 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:08:14.568592 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:08:14.568592 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:08:14.568592 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:08:14.568592 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:14.568592 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:14.568592 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:14.568592 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:14.568592 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:14.568592 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:14.568592 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:14.568592 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:14.568592 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:14.568592 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:14.568592 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:14.568592 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:14.569923 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:14.569923 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:14.569923 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:14.569923 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:14.569923 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:08:14.569923 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:08:14.569923 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:08:14.569923 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:08:14.569923 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:08:14.569923 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:08:14.569923 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:08:14.569923 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:14.569923 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 209/405] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:08:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:14.575303 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f6f6f4-c397-447c-b316-a7ccc4c191b3 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:14.575611 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9da622-086f-4ac5-ac88-ff0d0ff2726f None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:14.575909 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9da622-086f-4ac5-ac88-ff0d0ff2726f None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:14.576197 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9da622-086f-4ac5-ac88-ff0d0ff2726f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:14.609348 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-2a9da622-086f-4ac5-ac88-ff0d0ff2726f None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:14.610511 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-2a9da622-086f-4ac5-ac88-ff0d0ff2726f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:14.656072 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:14.691311 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f6f6f4-c397-447c-b316-a7ccc4c191b3 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:14.737763 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:14.746159 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 197/406] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:08:14.747043 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99c0b8-124a-44dd-a70a-2310d695504d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:14.747970 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99c0b8-124a-44dd-a70a-2310d695504d None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:14.748484 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99c0b8-124a-44dd-a70a-2310d695504d None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:14.748979 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99c0b8-124a-44dd-a70a-2310d695504d None admin] PATH_INFO: `/v3/roles` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:14.749937 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f99c0b8-124a-44dd-a70a-2310d695504d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:14.750545 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f99c0b8-124a-44dd-a70a-2310d695504d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:14.758255 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f99c0b8-124a-44dd-a70a-2310d695504d None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:14.768036 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 210/407] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:08:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:08:14.773211 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9da622-086f-4ac5-ac88-ff0d0ff2726f None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:14.774597 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99c0b8-124a-44dd-a70a-2310d695504d None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:14.911883 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99c0b8-124a-44dd-a70a-2310d695504d None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:14.966741 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e97abb-2645-4e99-a56b-b6297b69178f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:14.967556 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e97abb-2645-4e99-a56b-b6297b69178f None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:14.967849 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e97abb-2645-4e99-a56b-b6297b69178f None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:14.968134 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e97abb-2645-4e99-a56b-b6297b69178f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:14.970669 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9da622-086f-4ac5-ac88-ff0d0ff2726f None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:14.975287 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:14.992817 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e97abb-2645-4e99-a56b-b6297b69178f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:08:15.001886 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-41e97abb-2645-4e99-a56b-b6297b69178f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:08:15.001886 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:15.001886 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:15.001886 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:15.001886 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:15.001886 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:15.001886 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:15.001886 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:15.001886 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:15.001886 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:15.001886 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:15.001886 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:15.001886 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:08:15.001886 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:08:15.001886 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:08:15.001886 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:08:15.002822 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:08:15.002822 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:08:15.002822 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:08:15.002822 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:08:15.002822 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:15.002822 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:15.002822 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:15.002822 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:15.002822 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:15.002822 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:15.002822 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:15.002822 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:15.002822 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:15.002822 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:15.002822 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:15.002822 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:15.003643 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:15.003643 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:15.003643 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:15.003643 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:15.003643 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:08:15.003643 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:08:15.003643 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:08:15.003643 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:08:15.003643 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:08:15.003643 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:08:15.003643 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:08:15.003643 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:15.004274 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 211/408] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:08:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:15.014241 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e97abb-2645-4e99-a56b-b6297b69178f None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:15.051172 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035173a2-c7a7-4f37-832b-081a42c1f9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:15.052082 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035173a2-c7a7-4f37-832b-081a42c1f9c7 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:15.052907 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035173a2-c7a7-4f37-832b-081a42c1f9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:15.053196 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035173a2-c7a7-4f37-832b-081a42c1f9c7 None admin] PATH_INFO: `/v3/groups/e5dbbd5132dc4f24a2e910f1a46ce656` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:15.054637 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035173a2-c7a7-4f37-832b-081a42c1f9c7 None admin] RBAC: Authorizing `identity:get_group(group_id=e5dbbd5132dc4f24a2e910f1a46ce656)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:15.057551 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035173a2-c7a7-4f37-832b-081a42c1f9c7 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:15.060295 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 198/409] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Jul 5 21:08:14 2022] GET /identity/v3/groups/e5dbbd5132dc4f24a2e910f1a46ce656 => generated 226 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:15.062006 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091eddb3-a7c8-4b82-b25d-4e2a4ba24b76 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:15.062593 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091eddb3-a7c8-4b82-b25d-4e2a4ba24b76 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:15.062881 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091eddb3-a7c8-4b82-b25d-4e2a4ba24b76 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:15.065264 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 199/410] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:15.070803 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091eddb3-a7c8-4b82-b25d-4e2a4ba24b76 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:15.155524 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:15.165557 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e97abb-2645-4e99-a56b-b6297b69178f None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:15.199855 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091eddb3-a7c8-4b82-b25d-4e2a4ba24b76 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:15.211083 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e29a6-226a-4bed-9ad0-b05cd2489b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:15.211771 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e29a6-226a-4bed-9ad0-b05cd2489b85 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:15.212041 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e29a6-226a-4bed-9ad0-b05cd2489b85 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:15.212318 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e29a6-226a-4bed-9ad0-b05cd2489b85 None admin] PATH_INFO: `/v3/roles` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:15.213091 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926e29a6-226a-4bed-9ad0-b05cd2489b85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:15.213763 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926e29a6-226a-4bed-9ad0-b05cd2489b85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:15.214916 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926e29a6-226a-4bed-9ad0-b05cd2489b85 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:15.223702 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 212/411] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:08:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:15.225040 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89784ab8-7ff5-4a68-b03d-8c59eb2159b3 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:15.225549 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89784ab8-7ff5-4a68-b03d-8c59eb2159b3 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:15.225671 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89784ab8-7ff5-4a68-b03d-8c59eb2159b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:15.242876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-89784ab8-7ff5-4a68-b03d-8c59eb2159b3 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:15.243972 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-89784ab8-7ff5-4a68-b03d-8c59eb2159b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:15.249522 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f181b16-c8dd-4f0c-82ef-9b22fc8c9326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:15.250789 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f181b16-c8dd-4f0c-82ef-9b22fc8c9326 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:15.251307 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f181b16-c8dd-4f0c-82ef-9b22fc8c9326 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:15.251862 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f181b16-c8dd-4f0c-82ef-9b22fc8c9326 None admin] PATH_INFO: `/v3/projects/9d370c4b5282475484b01c328ffd7864` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:15.253851 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f181b16-c8dd-4f0c-82ef-9b22fc8c9326 None admin] RBAC: Authorizing `identity:get_project(project_id=9d370c4b5282475484b01c328ffd7864)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:15.256132 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f181b16-c8dd-4f0c-82ef-9b22fc8c9326 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:15.258003 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 200/412] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:08:15 2022] GET /identity/v3/projects/9d370c4b5282475484b01c328ffd7864 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:15.258943 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f181b16-c8dd-4f0c-82ef-9b22fc8c9326 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:15.315281 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:15.338591 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 213/413] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:08:15.339621 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89784ab8-7ff5-4a68-b03d-8c59eb2159b3 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:15.373127 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f181b16-c8dd-4f0c-82ef-9b22fc8c9326 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:15.411010 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dcbe0a-c2da-4d45-942d-93198bbb7b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:15.412210 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dcbe0a-c2da-4d45-942d-93198bbb7b94 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:15.412722 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dcbe0a-c2da-4d45-942d-93198bbb7b94 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:15.413263 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dcbe0a-c2da-4d45-942d-93198bbb7b94 None admin] PATH_INFO: `/v3/groups/c6a53ac1c7c349f68b4e3ce4d399965e` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:15.414697 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dcbe0a-c2da-4d45-942d-93198bbb7b94 None admin] RBAC: Authorizing `identity:get_group(group_id=c6a53ac1c7c349f68b4e3ce4d399965e)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:15.417058 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dcbe0a-c2da-4d45-942d-93198bbb7b94 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:15.418944 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 201/414] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Jul 5 21:08:15 2022] GET /identity/v3/groups/c6a53ac1c7c349f68b4e3ce4d399965e => generated 229 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:15.419917 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dcbe0a-c2da-4d45-942d-93198bbb7b94 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:15.423734 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:15.469402 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89784ab8-7ff5-4a68-b03d-8c59eb2159b3 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:15.507574 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f12af3-1f64-4889-90ef-1d7811c29a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:15.508704 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f12af3-1f64-4889-90ef-1d7811c29a08 None admin] REQUEST_METHOD: `PUT` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:15.509137 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f12af3-1f64-4889-90ef-1d7811c29a08 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:15.509565 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f12af3-1f64-4889-90ef-1d7811c29a08 None admin] PATH_INFO: `/v3/projects/9d370c4b5282475484b01c328ffd7864/groups/e5dbbd5132dc4f24a2e910f1a46ce656/roles/49943dd485174ef39fdd0368de241417` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:15.512893 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f12af3-1f64-4889-90ef-1d7811c29a08 None admin] RBAC: Authorizing `identity:create_grant(project_id=9d370c4b5282475484b01c328ffd7864, group_id=e5dbbd5132dc4f24a2e910f1a46ce656, role_id=49943dd485174ef39fdd0368de241417)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:15.514521 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f12af3-1f64-4889-90ef-1d7811c29a08 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:15.531791 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dcbe0a-c2da-4d45-942d-93198bbb7b94 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:15.568704 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be1d4a6-401c-49b2-b826-1a75b905c422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:15.569788 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1d4a6-401c-49b2-b826-1a75b905c422 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:15.570290 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1d4a6-401c-49b2-b826-1a75b905c422 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:15.570728 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1d4a6-401c-49b2-b826-1a75b905c422 None admin] PATH_INFO: `/v3/roles/member` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:15.582850 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 214/415] 10.222.0.30 () {58 vars in 1442 bytes} [Tue Jul 5 21:08:15 2022] PUT /identity/v3/projects/9d370c4b5282475484b01c328ffd7864/groups/e5dbbd5132dc4f24a2e910f1a46ce656/roles/49943dd485174ef39fdd0368de241417 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:08:15.590620 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be1d4a6-401c-49b2-b826-1a75b905c422 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:08:15.591716 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f12af3-1f64-4889-90ef-1d7811c29a08 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:15.600968 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-4be1d4a6-401c-49b2-b826-1a75b905c422 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:08:15.600968 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:15.600968 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:15.600968 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:15.600968 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:15.600968 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:15.600968 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:15.600968 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:15.600968 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:15.600968 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:15.600968 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:15.600968 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:15.600968 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:08:15.600968 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:08:15.600968 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:08:15.600968 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:08:15.610730 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:08:15.610730 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:08:15.610730 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:08:15.610730 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:08:15.610730 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:15.610730 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:15.610730 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:15.610730 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:15.610730 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:15.610730 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:15.610730 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:15.610730 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:15.610730 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:15.610730 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:15.610730 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:15.610730 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:15.611582 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:15.611582 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:15.611582 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:15.611582 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:15.611582 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:08:15.611582 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:08:15.611582 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:08:15.611582 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:08:15.611582 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:08:15.611582 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:08:15.611582 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:08:15.611582 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:15.611582 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 202/416] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:08:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:15.615948 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be1d4a6-401c-49b2-b826-1a75b905c422 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:15.686411 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:15.698696 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:15.745806 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be1d4a6-401c-49b2-b826-1a75b905c422 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:15.789767 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a015d1-d7db-4d42-a6c5-561e4b388a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:15.790597 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a015d1-d7db-4d42-a6c5-561e4b388a16 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:15.790888 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a015d1-d7db-4d42-a6c5-561e4b388a16 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:15.791720 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a015d1-d7db-4d42-a6c5-561e4b388a16 None admin] PATH_INFO: `/v3/roles` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:15.792728 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a015d1-d7db-4d42-a6c5-561e4b388a16 None admin] RBAC: Adding query filter params (name=member) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:15.793051 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a015d1-d7db-4d42-a6c5-561e4b388a16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:15.794731 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a015d1-d7db-4d42-a6c5-561e4b388a16 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:15.799923 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f12af3-1f64-4889-90ef-1d7811c29a08 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:15.804486 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 203/417] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:08:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:15.809638 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a015d1-d7db-4d42-a6c5-561e4b388a16 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:15.842827 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bd894d-038d-49ea-bb0f-5f56e6fb2f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:15.843945 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd894d-038d-49ea-bb0f-5f56e6fb2f29 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:15.844394 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd894d-038d-49ea-bb0f-5f56e6fb2f29 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:15.844814 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd894d-038d-49ea-bb0f-5f56e6fb2f29 None admin] PATH_INFO: `/v3/projects/819d2c6b4ee2448890d6f7032696195a` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:15.846559 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bd894d-038d-49ea-bb0f-5f56e6fb2f29 None admin] RBAC: Authorizing `identity:get_project(project_id=819d2c6b4ee2448890d6f7032696195a)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:15.848218 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bd894d-038d-49ea-bb0f-5f56e6fb2f29 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:15.850423 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 215/418] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:08:15 2022] GET /identity/v3/projects/819d2c6b4ee2448890d6f7032696195a => generated 344 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:15.859439 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bd894d-038d-49ea-bb0f-5f56e6fb2f29 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:15.927527 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a015d1-d7db-4d42-a6c5-561e4b388a16 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:15.956495 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:15.966412 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0598989-70d0-4f4d-b7a4-ee51065fdcf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:15.967374 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0598989-70d0-4f4d-b7a4-ee51065fdcf6 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:15.967867 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0598989-70d0-4f4d-b7a4-ee51065fdcf6 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:15.968351 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0598989-70d0-4f4d-b7a4-ee51065fdcf6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:16.042453 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0598989-70d0-4f4d-b7a4-ee51065fdcf6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:16.044723 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0598989-70d0-4f4d-b7a4-ee51065fdcf6 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:16.108011 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bd894d-038d-49ea-bb0f-5f56e6fb2f29 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:16.146560 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:16.153200 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 204/419] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:08:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:08:16.159429 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0598989-70d0-4f4d-b7a4-ee51065fdcf6 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:16.164776 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec5f30-ddb2-4ce5-bc2a-ff9421f17bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:16.165890 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec5f30-ddb2-4ce5-bc2a-ff9421f17bc0 None admin] REQUEST_METHOD: `PUT` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:16.166897 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec5f30-ddb2-4ce5-bc2a-ff9421f17bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:16.167360 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec5f30-ddb2-4ce5-bc2a-ff9421f17bc0 None admin] PATH_INFO: `/v3/projects/819d2c6b4ee2448890d6f7032696195a/groups/c6a53ac1c7c349f68b4e3ce4d399965e/roles/101b93f94624407f8c812ab86ebec32a` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:16.173808 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec5f30-ddb2-4ce5-bc2a-ff9421f17bc0 None admin] RBAC: Authorizing `identity:create_grant(project_id=819d2c6b4ee2448890d6f7032696195a, group_id=c6a53ac1c7c349f68b4e3ce4d399965e, role_id=101b93f94624407f8c812ab86ebec32a)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:16.175730 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec5f30-ddb2-4ce5-bc2a-ff9421f17bc0 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:16.199687 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:16.273477 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 216/420] 10.222.0.30 () {58 vars in 1442 bytes} [Tue Jul 5 21:08:15 2022] PUT /identity/v3/projects/819d2c6b4ee2448890d6f7032696195a/groups/c6a53ac1c7c349f68b4e3ce4d399965e/roles/101b93f94624407f8c812ab86ebec32a => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:08:16.282221 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0598989-70d0-4f4d-b7a4-ee51065fdcf6 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:16.347080 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dbb543-ef64-4a01-be11-97f5fb02d201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:16.347995 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dbb543-ef64-4a01-be11-97f5fb02d201 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:16.348284 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dbb543-ef64-4a01-be11-97f5fb02d201 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:16.348568 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dbb543-ef64-4a01-be11-97f5fb02d201 None admin] PATH_INFO: `/v3/projects/3665952118af4106b09bd445a38d53e5` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:16.349940 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dbb543-ef64-4a01-be11-97f5fb02d201 None admin] RBAC: Authorizing `identity:get_project(project_id=3665952118af4106b09bd445a38d53e5)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:16.351454 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dbb543-ef64-4a01-be11-97f5fb02d201 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:16.353379 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 205/421] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:08:16 2022] GET /identity/v3/projects/3665952118af4106b09bd445a38d53e5 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:16.358875 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec5f30-ddb2-4ce5-bc2a-ff9421f17bc0 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:16.449216 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725a930-2963-4516-9668-ea4e6e2abfa4 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:16.449216 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725a930-2963-4516-9668-ea4e6e2abfa4 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:16.449216 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725a930-2963-4516-9668-ea4e6e2abfa4 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:16.450139 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 206/422] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:16.456306 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac833153-e8cc-4cd8-ad25-f8148b5dc6bb None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:16.456638 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac833153-e8cc-4cd8-ad25-f8148b5dc6bb None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:16.457048 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac833153-e8cc-4cd8-ad25-f8148b5dc6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:16.478645 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-ac833153-e8cc-4cd8-ad25-f8148b5dc6bb None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:16.481294 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-ac833153-e8cc-4cd8-ad25-f8148b5dc6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:16.519931 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec5f30-ddb2-4ce5-bc2a-ff9421f17bc0 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:16.555658 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f998c6-72d8-4e1c-a169-e5028bd75419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:16.556446 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f998c6-72d8-4e1c-a169-e5028bd75419 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:16.557267 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f998c6-72d8-4e1c-a169-e5028bd75419 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:16.557548 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f998c6-72d8-4e1c-a169-e5028bd75419 None admin] PATH_INFO: `/v3/groups/e5dbbd5132dc4f24a2e910f1a46ce656` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:16.558783 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f998c6-72d8-4e1c-a169-e5028bd75419 None admin] RBAC: Authorizing `identity:get_group(group_id=e5dbbd5132dc4f24a2e910f1a46ce656)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:16.560235 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f998c6-72d8-4e1c-a169-e5028bd75419 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:16.562290 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 217/423] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Jul 5 21:08:16 2022] GET /identity/v3/groups/e5dbbd5132dc4f24a2e910f1a46ce656 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:16.567001 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 207/424] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:08:16.582156 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f998c6-72d8-4e1c-a169-e5028bd75419 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:16.604934 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac833153-e8cc-4cd8-ad25-f8148b5dc6bb None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:16.639580 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:16.642837 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:16.694880 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f998c6-72d8-4e1c-a169-e5028bd75419 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:16.733643 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac833153-e8cc-4cd8-ad25-f8148b5dc6bb None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:16.739079 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eff10b-6c8b-4f99-a49f-d556611a3867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:16.739746 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eff10b-6c8b-4f99-a49f-d556611a3867 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:16.740070 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eff10b-6c8b-4f99-a49f-d556611a3867 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:16.740401 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eff10b-6c8b-4f99-a49f-d556611a3867 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:16.741240 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eff10b-6c8b-4f99-a49f-d556611a3867 None admin] RBAC: Adding query filter params (group.id=e5dbbd5132dc4f24a2e910f1a46ce656, role.id=f9389c8fc7a74300aed4cf6490fb672b, scope.project.id=3665952118af4106b09bd445a38d53e5) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:16.741555 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eff10b-6c8b-4f99-a49f-d556611a3867 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:16.743566 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eff10b-6c8b-4f99-a49f-d556611a3867 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:16.752002 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 218/425] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Jul 5 21:08:16 2022] GET /identity/v3/role_assignments?group.id=e5dbbd5132dc4f24a2e910f1a46ce656&scope.project.id=3665952118af4106b09bd445a38d53e5&role.id=f9389c8fc7a74300aed4cf6490fb672b => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:16.753857 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d1e11-52a5-4a7f-a2a8-c04791579216 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:16.754164 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d1e11-52a5-4a7f-a2a8-c04791579216 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:16.754451 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d1e11-52a5-4a7f-a2a8-c04791579216 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:16.755781 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 219/426] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:16.763151 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e4c7a-af30-4bf0-8498-f6a448a4ca43 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:16.763528 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e4c7a-af30-4bf0-8498-f6a448a4ca43 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:16.763878 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e4c7a-af30-4bf0-8498-f6a448a4ca43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:16.778919 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5fb66-92be-44c8-8a91-9cdb09d0cc5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:16.780003 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5fb66-92be-44c8-8a91-9cdb09d0cc5c None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:16.780390 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5fb66-92be-44c8-8a91-9cdb09d0cc5c None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:16.780732 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5fb66-92be-44c8-8a91-9cdb09d0cc5c None admin] PATH_INFO: `/v3/roles/member` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:16.785897 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-1f9e4c7a-af30-4bf0-8498-f6a448a4ca43 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:16.787607 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-1f9e4c7a-af30-4bf0-8498-f6a448a4ca43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:16.794376 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e5fb66-92be-44c8-8a91-9cdb09d0cc5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:08:16.802781 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-a4e5fb66-92be-44c8-8a91-9cdb09d0cc5c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:08:16.802781 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:16.802781 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:16.802781 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:16.802781 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:16.802781 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:16.802781 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:16.802781 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:16.802781 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:16.802781 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:16.802781 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:16.802781 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:16.802781 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:08:16.802781 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:08:16.802781 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:08:16.802781 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:08:16.804034 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:08:16.804034 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:08:16.804034 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:08:16.804034 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:08:16.804034 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:16.804034 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:16.804034 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:16.804034 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:16.804034 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:16.804034 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:16.804034 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:16.804034 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:16.804034 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:16.804034 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:16.804034 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:16.804034 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:16.806030 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:16.806030 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:16.806030 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:16.806030 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:16.806030 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:08:16.806030 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:08:16.806030 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:08:16.806030 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:08:16.806030 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:08:16.806030 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:08:16.806030 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:08:16.806030 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:16.814159 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 208/427] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:08:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:16.814159 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5fb66-92be-44c8-8a91-9cdb09d0cc5c None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:16.872572 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 220/428] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:08:16.900591 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e4c7a-af30-4bf0-8498-f6a448a4ca43 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:16.951360 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:16.956762 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:16.977022 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5fb66-92be-44c8-8a91-9cdb09d0cc5c None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:17.018201 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a339b03-e01a-435b-b4f6-d060db02461f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:17.018889 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a339b03-e01a-435b-b4f6-d060db02461f None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:17.019231 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a339b03-e01a-435b-b4f6-d060db02461f None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:17.019513 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a339b03-e01a-435b-b4f6-d060db02461f None admin] PATH_INFO: `/v3/roles` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:17.020307 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a339b03-e01a-435b-b4f6-d060db02461f None admin] RBAC: Adding query filter params (name=member) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:17.020645 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a339b03-e01a-435b-b4f6-d060db02461f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:17.022058 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a339b03-e01a-435b-b4f6-d060db02461f None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:17.037267 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e4c7a-af30-4bf0-8498-f6a448a4ca43 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:17.037855 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 209/429] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:08:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:08:17.039112 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a339b03-e01a-435b-b4f6-d060db02461f None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:17.091806 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec5f86-1f18-4e19-a3be-395af46cb366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:17.093050 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec5f86-1f18-4e19-a3be-395af46cb366 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:17.094066 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec5f86-1f18-4e19-a3be-395af46cb366 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:17.094584 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec5f86-1f18-4e19-a3be-395af46cb366 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:17.112102 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec5f86-1f18-4e19-a3be-395af46cb366 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:08:17.124943 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-80ec5f86-1f18-4e19-a3be-395af46cb366 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:08:17.124943 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:17.124943 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:17.124943 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:17.124943 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:17.124943 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:17.124943 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:17.124943 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:17.124943 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:17.124943 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:17.124943 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:17.124943 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:17.124943 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:08:17.124943 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:08:17.124943 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:08:17.124943 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:08:17.125922 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:08:17.125922 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:08:17.125922 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:08:17.125922 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:08:17.125922 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:17.125922 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:17.125922 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:17.125922 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:17.125922 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:17.125922 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:17.125922 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:17.125922 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:17.125922 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:17.125922 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:17.125922 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:17.125922 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:17.126773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:17.126773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:17.126773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:17.126773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:17.126773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:08:17.126773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:08:17.126773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:08:17.126773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:08:17.126773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:08:17.126773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:08:17.126773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:08:17.126773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:17.129632 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 221/430] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:08:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:17.135955 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec5f86-1f18-4e19-a3be-395af46cb366 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:17.178246 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a339b03-e01a-435b-b4f6-d060db02461f None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:17.230872 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83c81b-db81-49d6-8afc-32fb8f5e3006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:17.231707 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83c81b-db81-49d6-8afc-32fb8f5e3006 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:17.232096 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83c81b-db81-49d6-8afc-32fb8f5e3006 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:17.232504 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83c81b-db81-49d6-8afc-32fb8f5e3006 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:17.250531 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:17.274020 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:17.279507 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec5f86-1f18-4e19-a3be-395af46cb366 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:17.311610 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd83c81b-db81-49d6-8afc-32fb8f5e3006 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:17.313796 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd83c81b-db81-49d6-8afc-32fb8f5e3006 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:17.320088 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754cbf3-a34c-4d64-a915-6cba46b25fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:17.320900 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754cbf3-a34c-4d64-a915-6cba46b25fb3 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:17.321286 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754cbf3-a34c-4d64-a915-6cba46b25fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:17.321663 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754cbf3-a34c-4d64-a915-6cba46b25fb3 None admin] PATH_INFO: `/v3/roles` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:17.322589 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9754cbf3-a34c-4d64-a915-6cba46b25fb3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:17.323002 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9754cbf3-a34c-4d64-a915-6cba46b25fb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:17.324581 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9754cbf3-a34c-4d64-a915-6cba46b25fb3 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:17.336887 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 222/431] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:08:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:17.343264 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754cbf3-a34c-4d64-a915-6cba46b25fb3 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:17.440834 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 210/432] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:08:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 21:08:17.446475 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83c81b-db81-49d6-8afc-32fb8f5e3006 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:17.471355 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754cbf3-a34c-4d64-a915-6cba46b25fb3 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:17.503260 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:17.513266 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786d54f-1eae-4e87-8dcd-a4daaaf891cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:17.514268 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786d54f-1eae-4e87-8dcd-a4daaaf891cf None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:17.518259 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786d54f-1eae-4e87-8dcd-a4daaaf891cf None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:17.518259 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786d54f-1eae-4e87-8dcd-a4daaaf891cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:17.561192 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:17.571307 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83c81b-db81-49d6-8afc-32fb8f5e3006 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:17.605468 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3786d54f-1eae-4e87-8dcd-a4daaaf891cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:17.606959 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3786d54f-1eae-4e87-8dcd-a4daaaf891cf None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:17.610297 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba2863-63b0-4576-8adf-d1b2afc3b069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:17.611225 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba2863-63b0-4576-8adf-d1b2afc3b069 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:17.611521 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba2863-63b0-4576-8adf-d1b2afc3b069 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:17.611802 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba2863-63b0-4576-8adf-d1b2afc3b069 None admin] PATH_INFO: `/v3/projects/9d370c4b5282475484b01c328ffd7864` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:17.613014 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba2863-63b0-4576-8adf-d1b2afc3b069 None admin] RBAC: Authorizing `identity:get_project(project_id=9d370c4b5282475484b01c328ffd7864)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:17.614482 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba2863-63b0-4576-8adf-d1b2afc3b069 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:17.616554 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 211/433] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:08:17 2022] GET /identity/v3/projects/9d370c4b5282475484b01c328ffd7864 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:17.622371 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba2863-63b0-4576-8adf-d1b2afc3b069 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:17.727778 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 223/434] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:08:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 21:08:17.735025 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786d54f-1eae-4e87-8dcd-a4daaaf891cf None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:17.783208 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba2863-63b0-4576-8adf-d1b2afc3b069 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:17.798619 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:17.800271 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:17.821505 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9fc6f6-46f4-4ab5-b2d6-bc74f38dea71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:17.822451 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9fc6f6-46f4-4ab5-b2d6-bc74f38dea71 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:17.822734 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9fc6f6-46f4-4ab5-b2d6-bc74f38dea71 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:17.823186 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9fc6f6-46f4-4ab5-b2d6-bc74f38dea71 None admin] PATH_INFO: `/v3/groups/e5dbbd5132dc4f24a2e910f1a46ce656` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:17.824393 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9fc6f6-46f4-4ab5-b2d6-bc74f38dea71 None admin] RBAC: Authorizing `identity:get_group(group_id=e5dbbd5132dc4f24a2e910f1a46ce656)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:17.825842 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9fc6f6-46f4-4ab5-b2d6-bc74f38dea71 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:17.827824 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 212/435] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Jul 5 21:08:17 2022] GET /identity/v3/groups/e5dbbd5132dc4f24a2e910f1a46ce656 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:17.839274 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9fc6f6-46f4-4ab5-b2d6-bc74f38dea71 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:17.846523 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786d54f-1eae-4e87-8dcd-a4daaaf891cf None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:17.892331 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f679d6a-b2e0-4fcd-999d-810c07fe816e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:17.894063 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f679d6a-b2e0-4fcd-999d-810c07fe816e None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:17.894548 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f679d6a-b2e0-4fcd-999d-810c07fe816e None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:17.895032 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f679d6a-b2e0-4fcd-999d-810c07fe816e None admin] PATH_INFO: `/v3/projects/3665952118af4106b09bd445a38d53e5` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:17.896855 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f679d6a-b2e0-4fcd-999d-810c07fe816e None admin] RBAC: Authorizing `identity:get_project(project_id=3665952118af4106b09bd445a38d53e5)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:17.899241 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f679d6a-b2e0-4fcd-999d-810c07fe816e None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:17.902878 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 224/436] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:08:17 2022] GET /identity/v3/projects/3665952118af4106b09bd445a38d53e5 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:08:17.915359 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f679d6a-b2e0-4fcd-999d-810c07fe816e None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:17.959902 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9fc6f6-46f4-4ab5-b2d6-bc74f38dea71 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:17.997158 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e93130-808f-4ca1-a279-e699fd8bbea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:17.997932 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e93130-808f-4ca1-a279-e699fd8bbea1 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:17.998306 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e93130-808f-4ca1-a279-e699fd8bbea1 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:17.998653 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e93130-808f-4ca1-a279-e699fd8bbea1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:17.999723 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e93130-808f-4ca1-a279-e699fd8bbea1 None admin] RBAC: Adding query filter params (group.id=e5dbbd5132dc4f24a2e910f1a46ce656, role.id=f9389c8fc7a74300aed4cf6490fb672b, scope.project.id=9d370c4b5282475484b01c328ffd7864) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:18.000581 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e93130-808f-4ca1-a279-e699fd8bbea1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:18.002391 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e93130-808f-4ca1-a279-e699fd8bbea1 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:18.011375 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 213/437] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Jul 5 21:08:17 2022] GET /identity/v3/role_assignments?group.id=e5dbbd5132dc4f24a2e910f1a46ce656&scope.project.id=9d370c4b5282475484b01c328ffd7864&role.id=f9389c8fc7a74300aed4cf6490fb672b => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:18.044527 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f679d6a-b2e0-4fcd-999d-810c07fe816e None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:18.076651 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:18.085133 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ba140b-53c5-400d-a215-966aa01b317e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:18.086014 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba140b-53c5-400d-a215-966aa01b317e None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:18.086328 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba140b-53c5-400d-a215-966aa01b317e None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:18.086605 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba140b-53c5-400d-a215-966aa01b317e None admin] PATH_INFO: `/v3/groups/e5dbbd5132dc4f24a2e910f1a46ce656` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:18.094395 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ba140b-53c5-400d-a215-966aa01b317e None admin] RBAC: Authorizing `identity:get_group(group_id=e5dbbd5132dc4f24a2e910f1a46ce656)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:18.094395 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ba140b-53c5-400d-a215-966aa01b317e None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:18.094395 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 225/438] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Jul 5 21:08:17 2022] GET /identity/v3/groups/e5dbbd5132dc4f24a2e910f1a46ce656 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:18.097826 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e93130-808f-4ca1-a279-e699fd8bbea1 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:18.152141 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:18.165184 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a662c59-12ab-4705-b816-8e978f78bf4e None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:18.165820 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a662c59-12ab-4705-b816-8e978f78bf4e None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:18.165820 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a662c59-12ab-4705-b816-8e978f78bf4e None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:18.168386 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 226/439] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:08:18.174488 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a848dc-ca82-49c0-84e0-9ac0d9fade0f None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:18.174908 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a848dc-ca82-49c0-84e0-9ac0d9fade0f None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:18.175635 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a848dc-ca82-49c0-84e0-9ac0d9fade0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:18.195933 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-79a848dc-ca82-49c0-84e0-9ac0d9fade0f None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:18.197142 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-79a848dc-ca82-49c0-84e0-9ac0d9fade0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:18.219039 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e93130-808f-4ca1-a279-e699fd8bbea1 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:18.266619 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31ab5d-5c12-4645-9cc1-eebc13cd00d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:18.267414 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31ab5d-5c12-4645-9cc1-eebc13cd00d7 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:18.267766 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31ab5d-5c12-4645-9cc1-eebc13cd00d7 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:18.268650 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31ab5d-5c12-4645-9cc1-eebc13cd00d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:18.269490 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31ab5d-5c12-4645-9cc1-eebc13cd00d7 None admin] RBAC: Adding query filter params (group.id=e5dbbd5132dc4f24a2e910f1a46ce656, role.id=49943dd485174ef39fdd0368de241417, scope.project.id=3665952118af4106b09bd445a38d53e5) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:18.269815 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31ab5d-5c12-4645-9cc1-eebc13cd00d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:18.271300 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31ab5d-5c12-4645-9cc1-eebc13cd00d7 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:18.279826 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 214/440] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Jul 5 21:08:18 2022] GET /identity/v3/role_assignments?group.id=e5dbbd5132dc4f24a2e910f1a46ce656&scope.project.id=3665952118af4106b09bd445a38d53e5&role.id=49943dd485174ef39fdd0368de241417 => generated 611 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:18.282948 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 227/441] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:08:18.308806 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31ab5d-5c12-4645-9cc1-eebc13cd00d7 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:18.424050 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31ab5d-5c12-4645-9cc1-eebc13cd00d7 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:18.436236 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:18.462455 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dfc22b-f28a-490f-8291-a574c69f3b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:18.464591 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfc22b-f28a-490f-8291-a574c69f3b35 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:18.465392 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfc22b-f28a-490f-8291-a574c69f3b35 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:18.465683 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfc22b-f28a-490f-8291-a574c69f3b35 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:18.476634 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dfc22b-f28a-490f-8291-a574c69f3b35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:08:18.486273 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-e4dfc22b-f28a-490f-8291-a574c69f3b35 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:08:18.486273 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:18.486273 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:18.486273 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:18.486273 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:18.486273 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:18.486273 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:18.486273 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:18.486273 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:18.486273 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:18.486273 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:18.486273 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:18.486273 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:08:18.486273 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:08:18.486273 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:08:18.486273 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:08:18.487188 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:08:18.487188 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:08:18.487188 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:08:18.487188 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:08:18.487188 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:18.487188 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:18.487188 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:18.487188 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:18.487188 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:18.487188 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:18.487188 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:18.487188 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:18.487188 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:18.487188 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:18.487188 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:18.487188 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:18.487992 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:18.487992 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:18.487992 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:18.487992 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:18.487992 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:08:18.487992 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:08:18.487992 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:08:18.487992 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:08:18.487992 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:08:18.487992 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:08:18.487992 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:08:18.487992 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:18.487992 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 215/442] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:08:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:18.493206 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a848dc-ca82-49c0-84e0-9ac0d9fade0f None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:18.601212 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a848dc-ca82-49c0-84e0-9ac0d9fade0f None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:18.605016 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65620a7-d1c7-4f82-8008-fea5b9b74d3e None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:18.605313 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65620a7-d1c7-4f82-8008-fea5b9b74d3e None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:18.605599 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65620a7-d1c7-4f82-8008-fea5b9b74d3e None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:18.607096 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 216/443] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:08:18.612749 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de025826-b63b-44bb-858d-57e01d95fc60 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:18.613049 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de025826-b63b-44bb-858d-57e01d95fc60 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:18.613334 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de025826-b63b-44bb-858d-57e01d95fc60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:18.628610 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:18.633802 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-de025826-b63b-44bb-858d-57e01d95fc60 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:18.635240 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-de025826-b63b-44bb-858d-57e01d95fc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:18.641159 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daada36d-3aaf-476f-ac64-1689876181ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:18.641847 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daada36d-3aaf-476f-ac64-1689876181ee None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:18.642229 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daada36d-3aaf-476f-ac64-1689876181ee None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:18.642467 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daada36d-3aaf-476f-ac64-1689876181ee None admin] PATH_INFO: `/v3/roles` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:18.643240 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daada36d-3aaf-476f-ac64-1689876181ee None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:18.643539 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daada36d-3aaf-476f-ac64-1689876181ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:18.644930 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daada36d-3aaf-476f-ac64-1689876181ee None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:18.655740 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 228/444] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:08:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:08:18.661364 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daada36d-3aaf-476f-ac64-1689876181ee None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:18.723361 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 217/445] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:08:18.747744 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de025826-b63b-44bb-858d-57e01d95fc60 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:18.783593 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daada36d-3aaf-476f-ac64-1689876181ee None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:18.821600 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03eb6a9-3b15-4590-8b05-9bd644055985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:18.822031 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03eb6a9-3b15-4590-8b05-9bd644055985 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:18.822474 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03eb6a9-3b15-4590-8b05-9bd644055985 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:18.822760 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03eb6a9-3b15-4590-8b05-9bd644055985 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:18.854061 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:18.857060 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de025826-b63b-44bb-858d-57e01d95fc60 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:18.877878 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:18.890306 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03eb6a9-3b15-4590-8b05-9bd644055985 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:18.890607 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838bb2b-8ba3-4a19-920f-c7ef11eaac4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:18.891408 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838bb2b-8ba3-4a19-920f-c7ef11eaac4a None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:18.891686 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838bb2b-8ba3-4a19-920f-c7ef11eaac4a None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:18.891776 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03eb6a9-3b15-4590-8b05-9bd644055985 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:18.891957 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838bb2b-8ba3-4a19-920f-c7ef11eaac4a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:18.902300 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0838bb2b-8ba3-4a19-920f-c7ef11eaac4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:08:18.910209 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-0838bb2b-8ba3-4a19-920f-c7ef11eaac4a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:08:18.910209 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:18.910209 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:18.910209 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:18.910209 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:18.910209 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:18.910209 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:18.910209 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:18.910209 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:18.910209 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:18.910209 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:18.910209 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:18.910209 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:08:18.910209 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:08:18.910209 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:08:18.910209 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:08:18.911195 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:08:18.911195 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:08:18.911195 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:08:18.911195 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:08:18.911195 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:18.911195 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:18.911195 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:18.911195 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:18.911195 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:18.911195 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:18.911195 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:18.911195 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:18.911195 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:18.911195 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:18.911195 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:18.911195 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:18.912144 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:18.912144 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:18.912144 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:18.912144 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:18.912144 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:08:18.912144 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:08:18.912144 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:08:18.912144 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:08:18.912144 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:08:18.912144 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:08:18.912144 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:08:18.912144 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:18.912144 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 218/446] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:08:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:08:18.918042 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838bb2b-8ba3-4a19-920f-c7ef11eaac4a None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:18.991799 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 229/447] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:08:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 21:08:18.997784 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03eb6a9-3b15-4590-8b05-9bd644055985 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:19.015339 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838bb2b-8ba3-4a19-920f-c7ef11eaac4a None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:19.048348 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01213495-6dc4-4ad9-bfe4-9e1dd33c48d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:19.049008 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01213495-6dc4-4ad9-bfe4-9e1dd33c48d7 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:19.049296 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01213495-6dc4-4ad9-bfe4-9e1dd33c48d7 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:19.049575 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01213495-6dc4-4ad9-bfe4-9e1dd33c48d7 None admin] PATH_INFO: `/v3/roles` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:19.050351 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01213495-6dc4-4ad9-bfe4-9e1dd33c48d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:19.050661 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01213495-6dc4-4ad9-bfe4-9e1dd33c48d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:19.052029 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01213495-6dc4-4ad9-bfe4-9e1dd33c48d7 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:19.060504 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 219/448] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:08:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:08:19.066169 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01213495-6dc4-4ad9-bfe4-9e1dd33c48d7 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:19.082924 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:19.089750 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:19.094834 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03eb6a9-3b15-4590-8b05-9bd644055985 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:19.128491 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a435a0-b1e3-4fac-b9dc-634834206c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:19.129360 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a435a0-b1e3-4fac-b9dc-634834206c79 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:19.129650 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a435a0-b1e3-4fac-b9dc-634834206c79 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:19.129928 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a435a0-b1e3-4fac-b9dc-634834206c79 None admin] PATH_INFO: `/v3/projects/9d370c4b5282475484b01c328ffd7864` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:19.131596 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a435a0-b1e3-4fac-b9dc-634834206c79 None admin] RBAC: Authorizing `identity:get_project(project_id=9d370c4b5282475484b01c328ffd7864)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:19.133047 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a435a0-b1e3-4fac-b9dc-634834206c79 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:19.135653 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 230/449] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:08:18 2022] GET /identity/v3/projects/9d370c4b5282475484b01c328ffd7864 => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:08:19.140658 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a435a0-b1e3-4fac-b9dc-634834206c79 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:19.165145 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01213495-6dc4-4ad9-bfe4-9e1dd33c48d7 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:19.198570 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312787f7-95fd-4456-9d9c-69be12b1ab65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:19.199215 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312787f7-95fd-4456-9d9c-69be12b1ab65 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:19.199500 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312787f7-95fd-4456-9d9c-69be12b1ab65 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:19.199777 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312787f7-95fd-4456-9d9c-69be12b1ab65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:19.238152 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a435a0-b1e3-4fac-b9dc-634834206c79 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:19.267602 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312787f7-95fd-4456-9d9c-69be12b1ab65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:19.268982 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312787f7-95fd-4456-9d9c-69be12b1ab65 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:19.272272 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8879a8-0310-49b0-b86f-928725f24cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:19.273127 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8879a8-0310-49b0-b86f-928725f24cb4 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:19.273417 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8879a8-0310-49b0-b86f-928725f24cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:19.273700 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8879a8-0310-49b0-b86f-928725f24cb4 None admin] PATH_INFO: `/v3/groups/e5dbbd5132dc4f24a2e910f1a46ce656` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:19.274909 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8879a8-0310-49b0-b86f-928725f24cb4 None admin] RBAC: Authorizing `identity:get_group(group_id=e5dbbd5132dc4f24a2e910f1a46ce656)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:19.276329 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8879a8-0310-49b0-b86f-928725f24cb4 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:19.277945 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 231/450] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Jul 5 21:08:19 2022] GET /identity/v3/groups/e5dbbd5132dc4f24a2e910f1a46ce656 => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:19.283614 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8879a8-0310-49b0-b86f-928725f24cb4 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:19.291499 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:19.311705 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:19.368064 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 220/451] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:08:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 21:08:19.374274 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312787f7-95fd-4456-9d9c-69be12b1ab65 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:19.386453 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8879a8-0310-49b0-b86f-928725f24cb4 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:19.420571 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681a869-b2bd-46ba-a81e-2a169c3e0108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:19.421236 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681a869-b2bd-46ba-a81e-2a169c3e0108 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:19.421538 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681a869-b2bd-46ba-a81e-2a169c3e0108 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:19.421828 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681a869-b2bd-46ba-a81e-2a169c3e0108 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:19.422712 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681a869-b2bd-46ba-a81e-2a169c3e0108 None admin] RBAC: Adding query filter params (group.id=e5dbbd5132dc4f24a2e910f1a46ce656, role.id=49943dd485174ef39fdd0368de241417, scope.project.id=9d370c4b5282475484b01c328ffd7864) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:19.423036 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681a869-b2bd-46ba-a81e-2a169c3e0108 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:19.424497 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681a869-b2bd-46ba-a81e-2a169c3e0108 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:19.430303 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 232/452] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Jul 5 21:08:19 2022] GET /identity/v3/role_assignments?group.id=e5dbbd5132dc4f24a2e910f1a46ce656&scope.project.id=9d370c4b5282475484b01c328ffd7864&role.id=49943dd485174ef39fdd0368de241417 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:08:19.477498 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312787f7-95fd-4456-9d9c-69be12b1ab65 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:19.502630 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:19.515184 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529048b-09b0-4cd6-bd3c-abb31770bb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:19.516067 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529048b-09b0-4cd6-bd3c-abb31770bb71 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:19.516350 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529048b-09b0-4cd6-bd3c-abb31770bb71 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:19.516626 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529048b-09b0-4cd6-bd3c-abb31770bb71 None admin] PATH_INFO: `/v3/projects/819d2c6b4ee2448890d6f7032696195a` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:19.517893 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f529048b-09b0-4cd6-bd3c-abb31770bb71 None admin] RBAC: Authorizing `identity:get_project(project_id=819d2c6b4ee2448890d6f7032696195a)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:19.519411 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f529048b-09b0-4cd6-bd3c-abb31770bb71 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:19.521129 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 221/453] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:08:19 2022] GET /identity/v3/projects/819d2c6b4ee2448890d6f7032696195a => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:08:19.527669 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681a869-b2bd-46ba-a81e-2a169c3e0108 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:19.618212 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:19.630406 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681a869-b2bd-46ba-a81e-2a169c3e0108 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:19.665143 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76200b15-584e-4ae9-8e74-35cf8f53bba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:19.666624 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76200b15-584e-4ae9-8e74-35cf8f53bba7 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:19.667222 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76200b15-584e-4ae9-8e74-35cf8f53bba7 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:19.667388 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76200b15-584e-4ae9-8e74-35cf8f53bba7 None admin] PATH_INFO: `/v3/groups/c6a53ac1c7c349f68b4e3ce4d399965e` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:19.668592 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76200b15-584e-4ae9-8e74-35cf8f53bba7 None admin] RBAC: Authorizing `identity:get_group(group_id=c6a53ac1c7c349f68b4e3ce4d399965e)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:19.670040 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76200b15-584e-4ae9-8e74-35cf8f53bba7 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:19.671692 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 233/454] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Jul 5 21:08:19 2022] GET /identity/v3/groups/c6a53ac1c7c349f68b4e3ce4d399965e => generated 229 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:19.677570 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529048b-09b0-4cd6-bd3c-abb31770bb71 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:19.778345 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529048b-09b0-4cd6-bd3c-abb31770bb71 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:19.811599 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c3f56-99c6-4ac9-bd3d-88e56ced0d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:19.812251 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c3f56-99c6-4ac9-bd3d-88e56ced0d76 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:19.812538 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c3f56-99c6-4ac9-bd3d-88e56ced0d76 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:19.812820 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c3f56-99c6-4ac9-bd3d-88e56ced0d76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:19.813898 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c3f56-99c6-4ac9-bd3d-88e56ced0d76 None admin] RBAC: Adding query filter params (group.id=c6a53ac1c7c349f68b4e3ce4d399965e, role.id=101b93f94624407f8c812ab86ebec32a, scope.project.id=819d2c6b4ee2448890d6f7032696195a) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:19.814245 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c3f56-99c6-4ac9-bd3d-88e56ced0d76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:19.815675 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c3f56-99c6-4ac9-bd3d-88e56ced0d76 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:19.821321 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 222/455] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Jul 5 21:08:19 2022] GET /identity/v3/role_assignments?group.id=c6a53ac1c7c349f68b4e3ce4d399965e&scope.project.id=819d2c6b4ee2448890d6f7032696195a&role.id=101b93f94624407f8c812ab86ebec32a => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:22.247042 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1888b-ab89-4991-8dc8-1b3e0dad95ac None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:22.247601 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1888b-ab89-4991-8dc8-1b3e0dad95ac None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:22.247601 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1888b-ab89-4991-8dc8-1b3e0dad95ac None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:22.249350 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 234/456] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:22.254105 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd3b65-0a7b-41aa-845e-be7d1829a6f7 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:22.254529 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd3b65-0a7b-41aa-845e-be7d1829a6f7 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:22.254696 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd3b65-0a7b-41aa-845e-be7d1829a6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:22.275071 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-73dd3b65-0a7b-41aa-845e-be7d1829a6f7 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:22.276295 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-73dd3b65-0a7b-41aa-845e-be7d1829a6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:22.340356 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:22.362519 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 223/457] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:08:22.399338 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1888b-ab89-4991-8dc8-1b3e0dad95ac None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:22.531071 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1888b-ab89-4991-8dc8-1b3e0dad95ac None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:22.578985 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de96029c-5924-4db4-8d5c-31cffdd38c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:22.580143 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96029c-5924-4db4-8d5c-31cffdd38c5a None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:22.580630 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96029c-5924-4db4-8d5c-31cffdd38c5a None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:22.581127 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96029c-5924-4db4-8d5c-31cffdd38c5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:22.594855 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de96029c-5924-4db4-8d5c-31cffdd38c5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:22.596633 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de96029c-5924-4db4-8d5c-31cffdd38c5a None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:22.597643 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d62c60-4fd9-4c55-bff0-e15ea4f058f2 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:22.598221 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d62c60-4fd9-4c55-bff0-e15ea4f058f2 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:22.598710 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d62c60-4fd9-4c55-bff0-e15ea4f058f2 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:22.601730 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 224/458] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:22.608604 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a24cc-0b33-45a4-a217-a9376ba5f87a None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:22.609235 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a24cc-0b33-45a4-a217-a9376ba5f87a None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:22.609720 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a24cc-0b33-45a4-a217-a9376ba5f87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:22.626637 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-de96029c-5924-4db4-8d5c-31cffdd38c5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:22.626637 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:22.626637 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:22.626637 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:22.626637 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:22.626637 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:22.626637 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:22.626637 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:22.626637 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:22.626637 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:22.626637 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:22.626637 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:22.626637 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:08:22.626637 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:08:22.626637 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:08:22.627598 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:08:22.627598 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:22.627598 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:22.627598 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:22.627598 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:22.627598 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:22.627598 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:22.627598 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:22.627598 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:22.627598 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:22.627598 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:22.627598 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:22.627598 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:22.627598 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:22.627598 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:22.627598 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:22.627598 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:22.628448 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:08:22.628448 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:08:22.628448 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:22.628448 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:22.628448 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 235/459] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:22.639167 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de96029c-5924-4db4-8d5c-31cffdd38c5a None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:22.644752 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-e89a24cc-0b33-45a4-a217-a9376ba5f87a None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:22.650608 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-e89a24cc-0b33-45a4-a217-a9376ba5f87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:22.661142 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:22.755477 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 225/460] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:08:22.784693 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae8b89-b2f3-4776-8900-7b2f33482447 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:22.784959 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae8b89-b2f3-4776-8900-7b2f33482447 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:22.785200 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae8b89-b2f3-4776-8900-7b2f33482447 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:22.786725 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 226/461] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:08:22.797058 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de96029c-5924-4db4-8d5c-31cffdd38c5a None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:22.798858 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c9cab-a9ae-4ad6-9530-231238bba737 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:22.799267 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c9cab-a9ae-4ad6-9530-231238bba737 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:22.799712 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c9cab-a9ae-4ad6-9530-231238bba737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:22.819194 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-4a6c9cab-a9ae-4ad6-9530-231238bba737 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:22.820737 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-4a6c9cab-a9ae-4ad6-9530-231238bba737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:22.838316 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be7e8b-0f01-4968-9ec7-144186b51acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:22.840369 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be7e8b-0f01-4968-9ec7-144186b51acd None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:22.840870 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be7e8b-0f01-4968-9ec7-144186b51acd None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:22.841371 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be7e8b-0f01-4968-9ec7-144186b51acd None admin] PATH_INFO: `/v3/domains` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:22.842520 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3be7e8b-0f01-4968-9ec7-144186b51acd None admin] RBAC: Adding query filter params (name=Default) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:22.843041 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3be7e8b-0f01-4968-9ec7-144186b51acd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:22.844924 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3be7e8b-0f01-4968-9ec7-144186b51acd None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:22.869014 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 236/462] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:08:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:22.871861 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be7e8b-0f01-4968-9ec7-144186b51acd None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:22.918238 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 227/463] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:08:22.919411 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c9cab-a9ae-4ad6-9530-231238bba737 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:22.958718 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:22.988589 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:23.000064 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be7e8b-0f01-4968-9ec7-144186b51acd None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:23.037958 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32b921-3a0d-4c9a-b7a0-ad9947f5a291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:23.039187 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32b921-3a0d-4c9a-b7a0-ad9947f5a291 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:23.039619 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32b921-3a0d-4c9a-b7a0-ad9947f5a291 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:23.040041 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32b921-3a0d-4c9a-b7a0-ad9947f5a291 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:23.045572 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c9cab-a9ae-4ad6-9530-231238bba737 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:23.052206 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b32b921-3a0d-4c9a-b7a0-ad9947f5a291 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:23.054007 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b32b921-3a0d-4c9a-b7a0-ad9947f5a291 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:23.073962 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-3b32b921-3a0d-4c9a-b7a0-ad9947f5a291 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:23.073962 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:23.073962 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:23.073962 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:23.073962 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:23.073962 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:23.073962 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:23.073962 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:23.073962 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:23.073962 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:23.073962 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:23.073962 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:23.073962 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:08:23.073962 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:08:23.073962 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:08:23.075065 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:08:23.075065 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:23.075065 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:23.075065 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:23.075065 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:23.075065 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:23.075065 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:23.075065 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:23.075065 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:23.075065 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:23.075065 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:23.075065 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:23.075065 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:23.075065 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:23.075065 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:23.075065 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:23.075065 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:23.076055 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:08:23.076055 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:08:23.076055 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:23.076055 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:23.078046 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 237/464] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:23.079084 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32b921-3a0d-4c9a-b7a0-ad9947f5a291 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:23.089232 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a6b03-f469-40e2-bb2c-2fed41586f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:23.090043 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a6b03-f469-40e2-bb2c-2fed41586f87 None admin] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:23.090386 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a6b03-f469-40e2-bb2c-2fed41586f87 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:23.090720 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a6b03-f469-40e2-bb2c-2fed41586f87 None admin] PATH_INFO: `/v3/users` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:23.091445 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a6b03-f469-40e2-bb2c-2fed41586f87 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:23.092915 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a6b03-f469-40e2-bb2c-2fed41586f87 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:23.194626 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 228/465] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:08:22 2022] POST /identity/v3/users => generated 246 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:08:23.195413 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a6b03-f469-40e2-bb2c-2fed41586f87 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:23.202150 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32b921-3a0d-4c9a-b7a0-ad9947f5a291 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:23.228313 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:23.247814 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b41dc-8393-4f40-9e76-4ebd3f17ea97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:23.248696 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b41dc-8393-4f40-9e76-4ebd3f17ea97 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:23.248980 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b41dc-8393-4f40-9e76-4ebd3f17ea97 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:23.249290 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b41dc-8393-4f40-9e76-4ebd3f17ea97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:23.261940 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4b41dc-8393-4f40-9e76-4ebd3f17ea97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:23.263870 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4b41dc-8393-4f40-9e76-4ebd3f17ea97 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:23.284993 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-ff4b41dc-8393-4f40-9e76-4ebd3f17ea97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:23.284993 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:23.284993 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:23.284993 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:23.284993 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:23.284993 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:23.284993 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:23.284993 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:23.284993 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:23.284993 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:23.284993 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:23.284993 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:23.284993 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:08:23.284993 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:08:23.284993 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:08:23.285967 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:08:23.285967 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:23.285967 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:23.285967 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:23.285967 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:23.285967 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:23.285967 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:23.285967 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:23.285967 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:23.285967 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:23.285967 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:23.285967 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:23.285967 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:23.285967 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:23.285967 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:23.285967 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:23.285967 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:23.287413 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:08:23.287413 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:08:23.287413 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:23.287413 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:23.292523 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 238/466] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:23.294030 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925f3f7-489c-4b09-a416-a46b807fc7fb None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:23.294361 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925f3f7-489c-4b09-a416-a46b807fc7fb None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:23.295011 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925f3f7-489c-4b09-a416-a46b807fc7fb None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:23.296334 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 239/467] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:23.297122 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925f3f7-489c-4b09-a416-a46b807fc7fb None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:23.352136 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:23.357753 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a6b03-f469-40e2-bb2c-2fed41586f87 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:23.407324 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b16774-b5cb-4015-9291-25e0bef10240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:23.407666 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b16774-b5cb-4015-9291-25e0bef10240 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:23.407973 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b16774-b5cb-4015-9291-25e0bef10240 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:23.408456 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b16774-b5cb-4015-9291-25e0bef10240 None admin] PATH_INFO: `/v3/domains` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:23.409113 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b16774-b5cb-4015-9291-25e0bef10240 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:23.409428 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b16774-b5cb-4015-9291-25e0bef10240 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:23.411030 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b16774-b5cb-4015-9291-25e0bef10240 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:23.426119 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 229/468] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:23.427960 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadf666-6ac2-4396-85ec-9f928774a4ce None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:23.428260 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadf666-6ac2-4396-85ec-9f928774a4ce None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:23.428550 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadf666-6ac2-4396-85ec-9f928774a4ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:23.445921 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925f3f7-489c-4b09-a416-a46b807fc7fb None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:23.447355 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-5aadf666-6ac2-4396-85ec-9f928774a4ce None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:23.448558 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-5aadf666-6ac2-4396-85ec-9f928774a4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:23.494302 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cdb1c-151e-4f19-b4b5-cd1d629cdda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:23.495869 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cdb1c-151e-4f19-b4b5-cd1d629cdda5 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:23.496169 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cdb1c-151e-4f19-b4b5-cd1d629cdda5 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:23.497384 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cdb1c-151e-4f19-b4b5-cd1d629cdda5 None admin] PATH_INFO: `/v3/domains` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:23.498153 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266cdb1c-151e-4f19-b4b5-cd1d629cdda5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:23.498503 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266cdb1c-151e-4f19-b4b5-cd1d629cdda5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:23.500015 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266cdb1c-151e-4f19-b4b5-cd1d629cdda5 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:23.517261 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 240/469] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:23.518111 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cdb1c-151e-4f19-b4b5-cd1d629cdda5 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:23.539897 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 230/470] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:08:23.540755 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aadf666-6ac2-4396-85ec-9f928774a4ce None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:23.562367 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:23.635302 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cdb1c-151e-4f19-b4b5-cd1d629cdda5 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:23.651581 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:23.661966 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aadf666-6ac2-4396-85ec-9f928774a4ce None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:23.669479 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b32978-adf9-4c18-b8d4-07cbbc4052c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:23.670340 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b32978-adf9-4c18-b8d4-07cbbc4052c8 None admin] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:23.670725 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b32978-adf9-4c18-b8d4-07cbbc4052c8 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:23.671014 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b32978-adf9-4c18-b8d4-07cbbc4052c8 None admin] PATH_INFO: `/v3/users` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:23.671733 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b32978-adf9-4c18-b8d4-07cbbc4052c8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:23.673273 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b32978-adf9-4c18-b8d4-07cbbc4052c8 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:23.700097 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7cb43-454a-46e5-8274-552d80286923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:23.700781 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7cb43-454a-46e5-8274-552d80286923 None admin] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:23.701075 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7cb43-454a-46e5-8274-552d80286923 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:23.701366 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7cb43-454a-46e5-8274-552d80286923 None admin] PATH_INFO: `/v3/users` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:23.702086 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f7cb43-454a-46e5-8274-552d80286923 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:23.703559 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f7cb43-454a-46e5-8274-552d80286923 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:23.777419 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 241/471] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:08:23 2022] POST /identity/v3/users => generated 248 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:08:23.778819 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300d59f-333b-4838-ad0a-ade58c93aedf None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:23.779110 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300d59f-333b-4838-ad0a-ade58c93aedf None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:23.779390 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300d59f-333b-4838-ad0a-ade58c93aedf None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:23.780886 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 242/472] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:23.785874 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300d59f-333b-4838-ad0a-ade58c93aedf None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:23.815668 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 231/473] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:08:23 2022] POST /identity/v3/users => generated 248 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:08:23.816982 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31896346-8c65-493d-852a-4fd6b13403f7 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:23.817282 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31896346-8c65-493d-852a-4fd6b13403f7 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:23.817584 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31896346-8c65-493d-852a-4fd6b13403f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:23.859437 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-31896346-8c65-493d-852a-4fd6b13403f7 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:23.860722 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-31896346-8c65-493d-852a-4fd6b13403f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:23.931380 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:23.964809 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300d59f-333b-4838-ad0a-ade58c93aedf None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:24.011662 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 232/474] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:08:24.023636 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e34cfd5-c723-46ad-b2ac-2d77753e57e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:24.024449 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34cfd5-c723-46ad-b2ac-2d77753e57e6 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:24.024736 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34cfd5-c723-46ad-b2ac-2d77753e57e6 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:24.025013 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34cfd5-c723-46ad-b2ac-2d77753e57e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:24.037022 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e34cfd5-c723-46ad-b2ac-2d77753e57e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:24.038612 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e34cfd5-c723-46ad-b2ac-2d77753e57e6 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:24.042447 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31896346-8c65-493d-852a-4fd6b13403f7 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:24.061407 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-6e34cfd5-c723-46ad-b2ac-2d77753e57e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:24.061407 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:24.061407 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:24.061407 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:24.061407 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:24.061407 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:24.061407 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:24.061407 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:24.061407 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:24.061407 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:24.061407 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:24.061407 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:24.061407 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:08:24.061407 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:08:24.061407 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:08:24.062376 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:08:24.062376 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:24.062376 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:24.062376 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:24.062376 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:24.062376 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:24.062376 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:24.062376 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:24.062376 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:24.062376 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:24.062376 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:24.062376 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:24.062376 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:24.062376 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:24.062376 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:24.062376 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:24.062376 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:24.063237 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:08:24.063237 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:08:24.063237 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:24.063237 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:24.065433 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 243/475] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:24.071413 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e34cfd5-c723-46ad-b2ac-2d77753e57e6 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:24.133955 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:24.166581 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31896346-8c65-493d-852a-4fd6b13403f7 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:24.205744 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e34cfd5-c723-46ad-b2ac-2d77753e57e6 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:24.211761 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082c1386-2273-424c-a50a-04bc20cf779e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:24.212642 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c1386-2273-424c-a50a-04bc20cf779e None admin] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:24.213099 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c1386-2273-424c-a50a-04bc20cf779e None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:24.214071 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c1386-2273-424c-a50a-04bc20cf779e None admin] PATH_INFO: `/v3/roles` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:24.215000 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082c1386-2273-424c-a50a-04bc20cf779e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:24.217407 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082c1386-2273-424c-a50a-04bc20cf779e None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:24.249045 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ece209-9d54-4b04-8b62-8ffd4b0fefa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:24.249758 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ece209-9d54-4b04-8b62-8ffd4b0fefa9 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:24.249992 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ece209-9d54-4b04-8b62-8ffd4b0fefa9 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:24.250308 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ece209-9d54-4b04-8b62-8ffd4b0fefa9 None admin] PATH_INFO: `/v3/domains` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:24.251051 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ece209-9d54-4b04-8b62-8ffd4b0fefa9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:24.251368 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ece209-9d54-4b04-8b62-8ffd4b0fefa9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:24.251581 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.sql.core [None req-082c1386-2273-424c-a50a-04bc20cf779e None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 05 21:08:24.251581 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 05 21:08:24.251581 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [parameters: {'id': '593b319f54c44ccea304264570482734', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 05 21:08:24.251581 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=108008) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 05 21:08:24.252759 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ece209-9d54-4b04-8b62-8ffd4b0fefa9 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:24.263375 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:24.267193 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 244/476] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:08:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:08:24.272570 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-082c1386-2273-424c-a50a-04bc20cf779e None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 05 21:08:24.272570 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:24.272570 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 21:08:24.272570 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 21:08:24.272570 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 21:08:24.272570 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 21:08:24.272570 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 21:08:24.272570 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 21:08:24.272570 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 21:08:24.272570 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application conn.query(q) Jul 05 21:08:24.272570 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 21:08:24.272570 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 21:08:24.272570 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 21:08:24.272570 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application result.read() Jul 05 21:08:24.272570 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 21:08:24.280585 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 21:08:24.280585 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 21:08:24.280585 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 21:08:24.280585 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 21:08:24.280585 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 21:08:24.280585 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 21:08:24.280585 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 21:08:24.280585 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 05 21:08:24.280585 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:24.280585 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 05 21:08:24.280585 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:24.280585 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:24.280585 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 05 21:08:24.280585 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 05 21:08:24.280585 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 05 21:08:24.280585 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return ref.to_dict() Jul 05 21:08:24.280585 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 21:08:24.280585 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application next(self.gen) Jul 05 21:08:24.281533 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 05 21:08:24.281533 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application yield resource Jul 05 21:08:24.281533 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 21:08:24.281533 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application next(self.gen) Jul 05 21:08:24.281533 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 05 21:08:24.281533 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application self.session.rollback() Jul 05 21:08:24.281533 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 05 21:08:24.281533 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application self.force_reraise() Jul 05 21:08:24.281533 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 05 21:08:24.281533 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise self.value Jul 05 21:08:24.281533 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 05 21:08:24.281533 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 05 21:08:24.281533 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 05 21:08:24.281533 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application session.commit() Jul 05 21:08:24.281533 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 05 21:08:24.281533 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 05 21:08:24.281533 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 05 21:08:24.282446 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application self._prepare_impl() Jul 05 21:08:24.282446 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 05 21:08:24.282446 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application self.session.flush() Jul 05 21:08:24.282446 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 05 21:08:24.282446 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application self._flush(objects) Jul 05 21:08:24.282446 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 05 21:08:24.282446 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 05 21:08:24.282446 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 05 21:08:24.282446 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application compat.raise_( Jul 05 21:08:24.282446 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 21:08:24.282446 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception Jul 05 21:08:24.282446 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 05 21:08:24.282446 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application flush_context.execute() Jul 05 21:08:24.282446 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 05 21:08:24.282446 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rec.execute(self) Jul 05 21:08:24.282446 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 05 21:08:24.282446 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 05 21:08:24.283407 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 05 21:08:24.283407 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 05 21:08:24.283407 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 05 21:08:24.283407 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 05 21:08:24.283407 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 05 21:08:24.283407 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 05 21:08:24.283407 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 05 21:08:24.283407 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 05 21:08:24.283407 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 05 21:08:24.283407 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 05 21:08:24.283407 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 05 21:08:24.283407 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 05 21:08:24.283407 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 05 21:08:24.283407 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 05 21:08:24.283407 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 21:08:24.283407 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception Jul 05 21:08:24.285993 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 21:08:24.285993 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 21:08:24.285993 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 21:08:24.285993 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 21:08:24.285993 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 21:08:24.285993 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 21:08:24.285993 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 21:08:24.285993 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application conn.query(q) Jul 05 21:08:24.285993 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 21:08:24.285993 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 21:08:24.285993 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 21:08:24.285993 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application result.read() Jul 05 21:08:24.285993 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 21:08:24.285993 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 21:08:24.285993 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 21:08:24.285993 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 21:08:24.288186 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 21:08:24.288186 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 21:08:24.288186 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 21:08:24.288186 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 21:08:24.288186 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 05 21:08:24.288186 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 05 21:08:24.288186 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [parameters: {'id': '593b319f54c44ccea304264570482734', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 05 21:08:24.288186 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 05 21:08:24.288186 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:24.288186 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:08:24.288186 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:24.288186 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:24.288186 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:24.288186 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:24.288186 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:24.288186 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:24.292510 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:24.292510 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:24.292510 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:24.292510 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:24.292510 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:24.292510 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:24.292510 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 05 21:08:24.292510 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 05 21:08:24.292510 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:24.292510 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:24.292510 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 05 21:08:24.292510 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 05 21:08:24.292510 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 05 21:08:24.292510 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 05 21:08:24.292510 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 05 21:08:24.292510 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:24.294633 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 233/477] 10.222.0.30 () {60 vars in 1131 bytes} [Tue Jul 5 21:08:24 2022] POST /identity/v3/roles => generated 144 bytes in 233 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:24.294769 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ece209-9d54-4b04-8b62-8ffd4b0fefa9 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:24.294913 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082c1386-2273-424c-a50a-04bc20cf779e None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:24.449981 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ece209-9d54-4b04-8b62-8ffd4b0fefa9 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:24.470599 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082c1386-2273-424c-a50a-04bc20cf779e None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:24.508597 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd243e-d1ca-4004-b697-66aa91e5aa48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:24.509997 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd243e-d1ca-4004-b697-66aa91e5aa48 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:24.510583 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd243e-d1ca-4004-b697-66aa91e5aa48 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:24.511057 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd243e-d1ca-4004-b697-66aa91e5aa48 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:24.521843 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:24.527823 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd243e-d1ca-4004-b697-66aa91e5aa48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:08:24.539161 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-02cd243e-d1ca-4004-b697-66aa91e5aa48 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:08:24.539161 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:24.539161 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:24.539161 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:24.539161 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:24.539161 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:24.539161 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:24.539161 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:24.539161 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:24.539161 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:24.539161 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:24.539161 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:24.539161 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:08:24.539161 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:08:24.539161 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:08:24.539161 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:08:24.545051 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:08:24.545051 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:08:24.545051 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:08:24.545051 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:08:24.545051 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:24.545051 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:24.545051 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:24.545051 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:24.545051 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:24.545051 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:24.545051 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:24.545051 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:24.545051 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:24.545051 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:24.545051 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:24.545051 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:24.545876 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:24.545876 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:24.545876 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:24.545876 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:24.545876 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:08:24.545876 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:08:24.545876 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:08:24.545876 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:08:24.545876 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:08:24.545876 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:08:24.545876 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:08:24.545876 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:24.546530 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc7f8a-609f-4d80-9024-3caf71ddf95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:24.546530 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc7f8a-609f-4d80-9024-3caf71ddf95f None admin] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:24.546530 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc7f8a-609f-4d80-9024-3caf71ddf95f None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:24.547580 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc7f8a-609f-4d80-9024-3caf71ddf95f None admin] PATH_INFO: `/v3/users` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:24.548528 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fc7f8a-609f-4d80-9024-3caf71ddf95f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:24.551324 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fc7f8a-609f-4d80-9024-3caf71ddf95f None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:24.551810 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 234/478] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:08:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:24.558076 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd243e-d1ca-4004-b697-66aa91e5aa48 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:24.654328 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 245/479] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:08:24 2022] POST /identity/v3/users => generated 249 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:08:24.686620 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd243e-d1ca-4004-b697-66aa91e5aa48 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:24.730336 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71981526-c43a-4efa-8dc0-8522bc73213e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:24.731374 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71981526-c43a-4efa-8dc0-8522bc73213e None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:24.731878 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71981526-c43a-4efa-8dc0-8522bc73213e None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:24.732352 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71981526-c43a-4efa-8dc0-8522bc73213e None admin] PATH_INFO: `/v3/roles` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:24.733303 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71981526-c43a-4efa-8dc0-8522bc73213e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:24.733807 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71981526-c43a-4efa-8dc0-8522bc73213e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:24.735482 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71981526-c43a-4efa-8dc0-8522bc73213e None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:24.750597 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 235/480] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:08:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:25.677569 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5a1c8-568b-4e24-8b61-a53621b17f51 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:25.678057 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5a1c8-568b-4e24-8b61-a53621b17f51 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:25.678057 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5a1c8-568b-4e24-8b61-a53621b17f51 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:25.679666 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 246/481] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:25.689208 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07193a-8c4d-4e3d-9644-738473b33b3c None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:25.690098 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07193a-8c4d-4e3d-9644-738473b33b3c None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:25.690619 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07193a-8c4d-4e3d-9644-738473b33b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:25.715125 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-0b07193a-8c4d-4e3d-9644-738473b33b3c None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:25.716684 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-0b07193a-8c4d-4e3d-9644-738473b33b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:25.787968 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:25.803805 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 236/482] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:08:25.839745 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d5a1c8-568b-4e24-8b61-a53621b17f51 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:25.926089 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:25.984419 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d5a1c8-568b-4e24-8b61-a53621b17f51 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:26.031279 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f6513f-46bc-4a43-9cb0-fffe78e7c764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:26.032340 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6513f-46bc-4a43-9cb0-fffe78e7c764 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:26.032776 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6513f-46bc-4a43-9cb0-fffe78e7c764 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:26.033201 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6513f-46bc-4a43-9cb0-fffe78e7c764 None admin] PATH_INFO: `/v3/roles/service` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:26.055008 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f6513f-46bc-4a43-9cb0-fffe78e7c764 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:08:26.064107 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-35f6513f-46bc-4a43-9cb0-fffe78e7c764 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:08:26.064107 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:26.064107 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:26.064107 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:26.064107 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:26.064107 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:26.064107 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:26.064107 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:26.064107 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:26.064107 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:26.064107 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:26.064107 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:26.064107 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:08:26.064107 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:08:26.064107 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:08:26.064107 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:08:26.065221 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:08:26.065221 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:08:26.065221 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:08:26.065221 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:08:26.065221 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:26.065221 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:26.065221 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:26.065221 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:26.065221 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:26.065221 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:26.065221 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:26.065221 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:26.065221 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:26.065221 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:26.065221 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:26.065221 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:26.066346 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:26.066346 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:26.066346 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:26.066346 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:26.066346 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:08:26.066346 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:08:26.066346 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:08:26.066346 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:08:26.066346 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:08:26.066346 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:08:26.066346 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:08:26.066346 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:26.068373 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 247/483] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:08:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:26.079359 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b07193a-8c4d-4e3d-9644-738473b33b3c None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:26.149892 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc1b2f-17ae-443a-9695-38f93baa1169 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:26.150222 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc1b2f-17ae-443a-9695-38f93baa1169 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:26.151149 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc1b2f-17ae-443a-9695-38f93baa1169 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:26.152980 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 248/484] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:26.158309 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efafced5-2f42-47cc-8aff-c7359e2fa49a None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:26.158608 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efafced5-2f42-47cc-8aff-c7359e2fa49a None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:26.159558 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efafced5-2f42-47cc-8aff-c7359e2fa49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:26.187626 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-efafced5-2f42-47cc-8aff-c7359e2fa49a None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:26.189333 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-efafced5-2f42-47cc-8aff-c7359e2fa49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:26.198141 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b07193a-8c4d-4e3d-9644-738473b33b3c None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:26.239437 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2125c-1883-4d43-8858-0390b7db429b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:26.240046 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2125c-1883-4d43-8858-0390b7db429b None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:26.240351 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2125c-1883-4d43-8858-0390b7db429b None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:26.240620 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2125c-1883-4d43-8858-0390b7db429b None admin] PATH_INFO: `/v3/roles` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:26.241381 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc2125c-1883-4d43-8858-0390b7db429b None admin] RBAC: Adding query filter params (name=service) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:26.241698 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc2125c-1883-4d43-8858-0390b7db429b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:26.243120 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc2125c-1883-4d43-8858-0390b7db429b None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:26.252088 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 237/485] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:08:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:26.257199 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2125c-1883-4d43-8858-0390b7db429b None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:26.330120 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:26.335125 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 249/486] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:08:26.359641 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efafced5-2f42-47cc-8aff-c7359e2fa49a None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:26.405285 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2125c-1883-4d43-8858-0390b7db429b None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:26.435760 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:26.473316 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a3c78-a1f5-44b7-8360-6dc25434dd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:26.474224 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a3c78-a1f5-44b7-8360-6dc25434dd0d None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:26.474521 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a3c78-a1f5-44b7-8360-6dc25434dd0d None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:26.474807 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a3c78-a1f5-44b7-8360-6dc25434dd0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:26.498533 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a3c78-a1f5-44b7-8360-6dc25434dd0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:26.499991 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a3c78-a1f5-44b7-8360-6dc25434dd0d None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:26.520623 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efafced5-2f42-47cc-8aff-c7359e2fa49a None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:26.524405 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-083a3c78-a1f5-44b7-8360-6dc25434dd0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:26.524405 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:26.524405 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:26.524405 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:26.524405 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:26.524405 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:26.524405 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:26.524405 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:26.524405 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:26.524405 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:26.524405 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:26.524405 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:26.524405 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:08:26.524405 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:08:26.524405 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:08:26.525247 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:08:26.525247 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:26.525247 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:26.525247 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:26.525247 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:26.525247 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:26.525247 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:26.525247 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:26.525247 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:26.525247 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:26.525247 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:26.525247 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:26.525247 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:26.525247 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:26.525247 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:26.525247 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:26.525247 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:26.526123 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:08:26.526123 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:08:26.526123 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:26.526123 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:26.527612 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 238/487] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:26.527612 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc552f-cbda-4b26-943a-8e036b35ee98 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:26.527939 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc552f-cbda-4b26-943a-8e036b35ee98 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:26.528090 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc552f-cbda-4b26-943a-8e036b35ee98 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:26.531689 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 239/488] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:26.536212 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc552f-cbda-4b26-943a-8e036b35ee98 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:26.563902 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403da5c-e5e8-4db5-87da-5fb65627c30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:26.564764 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403da5c-e5e8-4db5-87da-5fb65627c30d None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:26.565049 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403da5c-e5e8-4db5-87da-5fb65627c30d None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:26.565376 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403da5c-e5e8-4db5-87da-5fb65627c30d None admin] PATH_INFO: `/v3/roles/service` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:26.579368 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d403da5c-e5e8-4db5-87da-5fb65627c30d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:08:26.589763 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-d403da5c-e5e8-4db5-87da-5fb65627c30d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:08:26.589763 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:26.589763 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:26.589763 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:26.589763 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:26.589763 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:26.589763 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:26.589763 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:26.589763 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:26.589763 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:26.589763 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:26.589763 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:26.589763 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:08:26.589763 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:08:26.589763 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:08:26.589763 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:08:26.590683 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:08:26.590683 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:08:26.590683 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:08:26.590683 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:08:26.590683 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:26.590683 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:26.590683 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:26.590683 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:26.590683 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:26.590683 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:26.590683 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:26.590683 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:26.590683 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:26.590683 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:26.590683 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:26.590683 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:26.591973 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:26.591973 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:26.591973 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:26.591973 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:26.591973 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:08:26.591973 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:08:26.591973 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:08:26.591973 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:08:26.591973 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:08:26.591973 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:08:26.591973 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:08:26.591973 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:26.591973 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 250/489] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:08:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:08:26.595271 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831920a1-5cbf-4243-bd53-b51f1bee7e42 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:26.595564 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831920a1-5cbf-4243-bd53-b51f1bee7e42 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:26.595850 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831920a1-5cbf-4243-bd53-b51f1bee7e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:26.622710 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-831920a1-5cbf-4243-bd53-b51f1bee7e42 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:26.623931 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-831920a1-5cbf-4243-bd53-b51f1bee7e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:26.653691 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc552f-cbda-4b26-943a-8e036b35ee98 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:26.661197 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:26.690550 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a0f662-a8dc-483d-87d8-75f753b0c179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:26.691287 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0f662-a8dc-483d-87d8-75f753b0c179 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:26.691568 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0f662-a8dc-483d-87d8-75f753b0c179 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:26.691876 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0f662-a8dc-483d-87d8-75f753b0c179 None admin] PATH_INFO: `/v3/domains` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:26.692621 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a0f662-a8dc-483d-87d8-75f753b0c179 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:26.693041 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a0f662-a8dc-483d-87d8-75f753b0c179 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:26.694689 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a0f662-a8dc-483d-87d8-75f753b0c179 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:26.712283 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 240/490] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:08:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:26.713241 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a0f662-a8dc-483d-87d8-75f753b0c179 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:26.715494 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 251/491] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:08:26.717113 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831920a1-5cbf-4243-bd53-b51f1bee7e42 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:26.758657 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:26.848053 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a0f662-a8dc-483d-87d8-75f753b0c179 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:26.852774 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831920a1-5cbf-4243-bd53-b51f1bee7e42 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:26.885033 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be26d1c-8e1a-4179-ac03-4f87c696fe92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:26.885715 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be26d1c-8e1a-4179-ac03-4f87c696fe92 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:26.886170 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be26d1c-8e1a-4179-ac03-4f87c696fe92 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:26.886394 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be26d1c-8e1a-4179-ac03-4f87c696fe92 None admin] PATH_INFO: `/v3/roles` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:26.887121 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be26d1c-8e1a-4179-ac03-4f87c696fe92 None admin] RBAC: Adding query filter params (name=service) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:26.887490 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be26d1c-8e1a-4179-ac03-4f87c696fe92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:26.888899 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be26d1c-8e1a-4179-ac03-4f87c696fe92 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:26.904126 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 241/492] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:08:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:26.904126 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be26d1c-8e1a-4179-ac03-4f87c696fe92 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:26.907591 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e51c5b-dff8-4d11-bc38-e14d8afab57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:26.908583 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e51c5b-dff8-4d11-bc38-e14d8afab57a None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:26.909042 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e51c5b-dff8-4d11-bc38-e14d8afab57a None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:26.909471 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e51c5b-dff8-4d11-bc38-e14d8afab57a None admin] PATH_INFO: `/v3/users/nova` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:26.920393 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e51c5b-dff8-4d11-bc38-e14d8afab57a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:26.922377 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e51c5b-dff8-4d11-bc38-e14d8afab57a None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:26.937226 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:26.946412 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-27e51c5b-dff8-4d11-bc38-e14d8afab57a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:08:26.946412 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:26.946412 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:26.946412 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:26.946412 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:26.946412 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:26.946412 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:26.946412 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:26.946412 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:26.946412 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:26.946412 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:26.946412 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:26.946412 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:08:26.946412 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:08:26.946412 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:08:26.946412 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:08:26.955842 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:26.955842 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:26.955842 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:08:26.955842 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:08:26.955842 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:08:26.955842 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:08:26.955842 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:26.955842 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:26.955842 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:26.955842 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:26.955842 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:26.955842 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:26.955842 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:26.955842 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:26.955842 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:26.955842 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:26.955842 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:26.955842 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:26.957006 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:26.957006 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:26.957006 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:08:26.957006 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:08:26.957006 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:08:26.957006 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:08:26.957006 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:08:26.957006 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:08:26.957006 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:08:26.957006 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:26.957006 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 252/493] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Jul 5 21:08:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:26.957006 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e51c5b-dff8-4d11-bc38-e14d8afab57a None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:27.024711 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be26d1c-8e1a-4179-ac03-4f87c696fe92 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:27.062715 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b9375-e1b0-4287-af25-eaa94b4d5693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:27.063923 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b9375-e1b0-4287-af25-eaa94b4d5693 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:27.064516 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b9375-e1b0-4287-af25-eaa94b4d5693 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:27.064671 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b9375-e1b0-4287-af25-eaa94b4d5693 None admin] PATH_INFO: `/v3/roles/service` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:27.076107 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189b9375-e1b0-4287-af25-eaa94b4d5693 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:08:27.084489 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-189b9375-e1b0-4287-af25-eaa94b4d5693 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:08:27.084489 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:27.084489 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:27.084489 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:27.084489 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:27.084489 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:27.084489 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:27.084489 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:27.084489 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:27.084489 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:27.084489 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:27.084489 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:27.084489 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:08:27.084489 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:08:27.084489 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:08:27.084489 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:08:27.085595 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:08:27.085595 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:08:27.085595 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:08:27.085595 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:08:27.085595 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:27.085595 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:27.085595 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:27.085595 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:27.085595 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:27.085595 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:27.085595 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:27.085595 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:27.085595 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:27.085595 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:27.085595 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:27.085595 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:27.086615 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:27.086615 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:27.086615 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:27.086615 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:27.086615 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:08:27.086615 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:08:27.086615 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:08:27.086615 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:08:27.086615 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:08:27.086615 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:08:27.086615 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:08:27.086615 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:27.088949 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:27.093923 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 242/494] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:08:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:27.094947 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b9375-e1b0-4287-af25-eaa94b4d5693 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:27.096096 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e51c5b-dff8-4d11-bc38-e14d8afab57a None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:27.145798 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3cd1e-cae1-406e-9c86-340c6b940edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:27.146912 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3cd1e-cae1-406e-9c86-340c6b940edb None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:27.147452 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3cd1e-cae1-406e-9c86-340c6b940edb None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:27.148351 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3cd1e-cae1-406e-9c86-340c6b940edb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:27.163071 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e3cd1e-cae1-406e-9c86-340c6b940edb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:27.165702 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e3cd1e-cae1-406e-9c86-340c6b940edb None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:27.191826 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-11e3cd1e-cae1-406e-9c86-340c6b940edb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:27.191826 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:27.191826 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:27.191826 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:27.191826 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:27.191826 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:27.191826 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:27.191826 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:27.191826 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:27.191826 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:27.191826 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:27.191826 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:27.191826 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:08:27.191826 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:08:27.191826 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:08:27.192921 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:08:27.192921 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:27.192921 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:27.192921 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:27.192921 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:27.192921 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:27.192921 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:27.192921 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:27.192921 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:27.192921 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:27.192921 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:27.192921 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:27.192921 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:27.192921 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:27.192921 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:27.192921 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:27.192921 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:27.193961 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:08:27.193961 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:08:27.193961 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:27.193961 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:27.202332 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 253/495] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:27.202332 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3cd1e-cae1-406e-9c86-340c6b940edb None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:27.211082 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:27.226668 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b9375-e1b0-4287-af25-eaa94b4d5693 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:27.264605 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092fc0d-f679-4f0e-988a-e2006519bc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:27.265290 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092fc0d-f679-4f0e-988a-e2006519bc1d None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:27.265581 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092fc0d-f679-4f0e-988a-e2006519bc1d None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:27.265866 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092fc0d-f679-4f0e-988a-e2006519bc1d None admin] PATH_INFO: `/v3/users` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:27.266987 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5092fc0d-f679-4f0e-988a-e2006519bc1d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:27.267098 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5092fc0d-f679-4f0e-988a-e2006519bc1d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:27.268515 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5092fc0d-f679-4f0e-988a-e2006519bc1d None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:27.314955 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 243/496] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Jul 5 21:08:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:27.314955 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092fc0d-f679-4f0e-988a-e2006519bc1d None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:27.341779 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3cd1e-cae1-406e-9c86-340c6b940edb None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:27.383854 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c75fec7-1d63-4dfb-87b0-d7a0254bcaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:27.385422 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75fec7-1d63-4dfb-87b0-d7a0254bcaf2 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:27.385700 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75fec7-1d63-4dfb-87b0-d7a0254bcaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:27.386030 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75fec7-1d63-4dfb-87b0-d7a0254bcaf2 None admin] PATH_INFO: `/v3/roles` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:27.386752 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c75fec7-1d63-4dfb-87b0-d7a0254bcaf2 None admin] RBAC: Adding query filter params (name=service) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:27.387064 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c75fec7-1d63-4dfb-87b0-d7a0254bcaf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:27.388450 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c75fec7-1d63-4dfb-87b0-d7a0254bcaf2 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:27.396650 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 254/497] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:08:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:27.402085 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1178ae-e13a-4aff-afac-3fbd335a4a71 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:27.402406 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1178ae-e13a-4aff-afac-3fbd335a4a71 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:27.402698 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1178ae-e13a-4aff-afac-3fbd335a4a71 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:27.403970 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 255/498] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:27.404663 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1178ae-e13a-4aff-afac-3fbd335a4a71 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:27.415789 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092fc0d-f679-4f0e-988a-e2006519bc1d None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:27.418259 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:27.451149 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8503b854-249e-4e96-be50-a815eeb4b170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:27.451822 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503b854-249e-4e96-be50-a815eeb4b170 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:27.452114 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503b854-249e-4e96-be50-a815eeb4b170 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:27.452404 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503b854-249e-4e96-be50-a815eeb4b170 None admin] PATH_INFO: `/v3/domains` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:27.453135 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8503b854-249e-4e96-be50-a815eeb4b170 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:27.453454 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8503b854-249e-4e96-be50-a815eeb4b170 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:27.454888 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8503b854-249e-4e96-be50-a815eeb4b170 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:27.466303 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 244/499] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:08:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:27.467454 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c7310-3f6f-433d-af35-aa72978ea6b3 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:27.467754 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c7310-3f6f-433d-af35-aa72978ea6b3 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:27.468040 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c7310-3f6f-433d-af35-aa72978ea6b3 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:27.469275 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 245/500] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:27.469980 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70c7310-3f6f-433d-af35-aa72978ea6b3 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:27.481145 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:27.511996 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1178ae-e13a-4aff-afac-3fbd335a4a71 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:27.547803 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4385ee8-619d-4ad5-98b5-a59979cf4bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:27.548453 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4385ee8-619d-4ad5-98b5-a59979cf4bf7 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:27.548742 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4385ee8-619d-4ad5-98b5-a59979cf4bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:27.549024 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4385ee8-619d-4ad5-98b5-a59979cf4bf7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:27.573454 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70c7310-3f6f-433d-af35-aa72978ea6b3 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:27.606634 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c27fa-40f8-4ae8-b6a0-0e82b951db84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:27.607429 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c27fa-40f8-4ae8-b6a0-0e82b951db84 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:27.607718 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c27fa-40f8-4ae8-b6a0-0e82b951db84 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:27.608004 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c27fa-40f8-4ae8-b6a0-0e82b951db84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:27.617524 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4385ee8-619d-4ad5-98b5-a59979cf4bf7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:27.618269 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9c27fa-40f8-4ae8-b6a0-0e82b951db84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:27.619070 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4385ee8-619d-4ad5-98b5-a59979cf4bf7 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:27.619979 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9c27fa-40f8-4ae8-b6a0-0e82b951db84 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:27.629776 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:27.636796 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-af9c27fa-40f8-4ae8-b6a0-0e82b951db84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:27.636796 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:27.636796 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:27.636796 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:27.636796 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:27.636796 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:27.636796 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:27.636796 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:27.636796 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:27.636796 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:27.636796 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:27.636796 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:27.636796 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:08:27.636796 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:08:27.636796 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:08:27.640687 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:08:27.640687 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:27.640687 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:27.640687 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:27.640687 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:27.640687 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:27.640687 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:27.640687 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:27.640687 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:27.640687 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:27.640687 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:27.640687 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:27.640687 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:27.640687 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:27.640687 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:27.640687 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:27.640687 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:27.641543 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:08:27.641543 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:08:27.641543 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:27.641543 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:27.641543 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 246/501] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:27.641543 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bca252-c69e-465c-83d6-1de72e5b0444 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:27.641543 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bca252-c69e-465c-83d6-1de72e5b0444 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:27.641543 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bca252-c69e-465c-83d6-1de72e5b0444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:27.657659 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-23bca252-c69e-465c-83d6-1de72e5b0444 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:27.658891 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-23bca252-c69e-465c-83d6-1de72e5b0444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:27.714018 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:27.720876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 256/502] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:08:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:08:27.725572 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4385ee8-619d-4ad5-98b5-a59979cf4bf7 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:27.732324 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 247/503] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:08:27.733664 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4c618-7c74-422f-9641-7cd31eaf7f64 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:27.733973 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4c618-7c74-422f-9641-7cd31eaf7f64 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:27.734290 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4c618-7c74-422f-9641-7cd31eaf7f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:27.758221 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-a6c4c618-7c74-422f-9641-7cd31eaf7f64 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:27.759871 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-a6c4c618-7c74-422f-9641-7cd31eaf7f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:27.826361 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4385ee8-619d-4ad5-98b5-a59979cf4bf7 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:27.827156 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 248/504] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:08:27.827984 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4c618-7c74-422f-9641-7cd31eaf7f64 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:27.852235 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:27.876327 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276fe239-f3cc-42a4-9c6e-2391e722d309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:27.877127 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fe239-f3cc-42a4-9c6e-2391e722d309 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:27.877414 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fe239-f3cc-42a4-9c6e-2391e722d309 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:27.877693 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fe239-f3cc-42a4-9c6e-2391e722d309 None admin] PATH_INFO: `/v3/users/glance` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:27.885344 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276fe239-f3cc-42a4-9c6e-2391e722d309 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:27.886981 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276fe239-f3cc-42a4-9c6e-2391e722d309 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:27.901045 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-276fe239-f3cc-42a4-9c6e-2391e722d309 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 05 21:08:27.901045 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:27.901045 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:27.901045 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:27.901045 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:27.901045 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:27.901045 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:27.901045 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:27.901045 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:27.901045 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:27.901045 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:27.901045 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:27.901045 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:08:27.901045 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:08:27.901045 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:08:27.901045 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:08:27.902016 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:27.902016 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:27.902016 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:08:27.902016 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:08:27.902016 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:08:27.902016 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:08:27.902016 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:27.902016 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:27.902016 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:27.902016 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:27.902016 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:27.902016 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:27.902016 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:27.902016 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:27.902016 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:27.902016 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:27.902016 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:27.902016 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:27.902967 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:27.902967 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:27.902967 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:08:27.902967 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:08:27.902967 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:08:27.902967 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:08:27.902967 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:08:27.902967 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:08:27.902967 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 05 21:08:27.902967 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:27.902967 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 257/505] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:08:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:27.903539 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276fe239-f3cc-42a4-9c6e-2391e722d309 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:27.930238 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4c618-7c74-422f-9641-7cd31eaf7f64 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:27.948459 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:27.965792 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1b95a-4623-4638-bc70-4ae9f0cfeab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:27.966502 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1b95a-4623-4638-bc70-4ae9f0cfeab6 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:27.966796 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1b95a-4623-4638-bc70-4ae9f0cfeab6 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:27.967080 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1b95a-4623-4638-bc70-4ae9f0cfeab6 None admin] PATH_INFO: `/v3/domains` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:27.967807 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a1b95a-4623-4638-bc70-4ae9f0cfeab6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:27.968126 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a1b95a-4623-4638-bc70-4ae9f0cfeab6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:27.969526 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a1b95a-4623-4638-bc70-4ae9f0cfeab6 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:27.981508 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 249/506] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:08:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:27.982425 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1b95a-4623-4638-bc70-4ae9f0cfeab6 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:28.002533 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276fe239-f3cc-42a4-9c6e-2391e722d309 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:28.035923 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1108ecee-6b13-4796-8782-1bef965f4fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:28.036717 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108ecee-6b13-4796-8782-1bef965f4fd4 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:28.037011 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108ecee-6b13-4796-8782-1bef965f4fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:28.037292 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108ecee-6b13-4796-8782-1bef965f4fd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:28.047792 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1108ecee-6b13-4796-8782-1bef965f4fd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:28.049234 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1108ecee-6b13-4796-8782-1bef965f4fd4 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:28.066590 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-1108ecee-6b13-4796-8782-1bef965f4fd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:28.066590 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:28.066590 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:28.066590 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:28.066590 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:28.066590 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:28.066590 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:28.066590 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:28.066590 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:28.066590 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:28.066590 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:28.066590 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:28.066590 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:08:28.066590 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:08:28.066590 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:08:28.067478 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:08:28.067478 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:28.067478 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:28.067478 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:28.067478 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:28.067478 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:28.067478 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:28.067478 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:28.067478 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:28.067478 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:28.067478 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:28.067478 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:28.067478 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:28.067478 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:28.067478 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:28.067478 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:28.067478 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:28.068317 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:08:28.068317 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:08:28.068317 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:28.068317 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:28.068317 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 258/507] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:28.068609 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1108ecee-6b13-4796-8782-1bef965f4fd4 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:28.080942 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1b95a-4623-4638-bc70-4ae9f0cfeab6 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:28.096514 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:28.114885 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9f7dd-cc3c-4dfc-8697-4f3e9a5162bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:28.115684 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9f7dd-cc3c-4dfc-8697-4f3e9a5162bc None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:28.115972 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9f7dd-cc3c-4dfc-8697-4f3e9a5162bc None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:28.116255 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9f7dd-cc3c-4dfc-8697-4f3e9a5162bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:28.127171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c9f7dd-cc3c-4dfc-8697-4f3e9a5162bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:28.128642 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c9f7dd-cc3c-4dfc-8697-4f3e9a5162bc None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:28.145894 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-07c9f7dd-cc3c-4dfc-8697-4f3e9a5162bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:28.145894 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:28.145894 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:28.145894 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:28.145894 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:28.145894 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:28.145894 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:28.145894 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:28.145894 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:28.145894 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:28.145894 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:28.145894 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:28.145894 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:08:28.145894 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:08:28.145894 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:08:28.147034 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:08:28.147034 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:28.147034 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:28.147034 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:28.147034 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:28.147034 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:28.147034 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:28.147034 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:28.147034 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:28.147034 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:28.147034 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:28.147034 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:28.147034 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:28.147034 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:28.147034 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:28.147034 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:28.147034 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:28.147914 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:08:28.147914 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:08:28.147914 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:28.147914 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:28.147914 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 250/508] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:28.147914 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9f7dd-cc3c-4dfc-8697-4f3e9a5162bc None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:28.172568 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1108ecee-6b13-4796-8782-1bef965f4fd4 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:28.182186 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:28.207150 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3cb669-c814-4822-87ed-7ef0cb84f890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:28.207948 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3cb669-c814-4822-87ed-7ef0cb84f890 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:28.208233 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3cb669-c814-4822-87ed-7ef0cb84f890 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:28.208513 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3cb669-c814-4822-87ed-7ef0cb84f890 None admin] PATH_INFO: `/v3/roles/service` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:28.219033 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3cb669-c814-4822-87ed-7ef0cb84f890 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:08:28.226753 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-ae3cb669-c814-4822-87ed-7ef0cb84f890 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:08:28.226753 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:28.226753 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:28.226753 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:28.226753 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:28.226753 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:28.226753 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:28.226753 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:28.226753 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:28.226753 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:28.226753 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:28.226753 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:28.226753 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:08:28.226753 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:08:28.226753 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:08:28.226753 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:08:28.227693 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:08:28.227693 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:08:28.227693 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:08:28.227693 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:08:28.227693 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:28.227693 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:28.227693 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:28.227693 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:28.227693 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:28.227693 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:28.227693 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:28.227693 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:28.227693 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:28.227693 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:28.227693 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:28.227693 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:28.228589 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:28.228589 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:28.228589 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:28.228589 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:28.228589 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:08:28.228589 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:08:28.228589 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:08:28.228589 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:08:28.228589 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:08:28.228589 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:08:28.228589 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:08:28.228589 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:28.228589 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 259/509] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:08:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:28.229460 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3cb669-c814-4822-87ed-7ef0cb84f890 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:28.258731 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9f7dd-cc3c-4dfc-8697-4f3e9a5162bc None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:28.292665 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315105b-6122-440b-a6b1-b3b1948d2edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:28.293339 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315105b-6122-440b-a6b1-b3b1948d2edc None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:28.293627 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315105b-6122-440b-a6b1-b3b1948d2edc None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:28.293909 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315105b-6122-440b-a6b1-b3b1948d2edc None admin] PATH_INFO: `/v3/users` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:28.294789 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2315105b-6122-440b-a6b1-b3b1948d2edc None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:28.295105 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2315105b-6122-440b-a6b1-b3b1948d2edc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:28.296572 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2315105b-6122-440b-a6b1-b3b1948d2edc None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:28.315166 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 251/510] 10.222.0.30 () {56 vars in 1137 bytes} [Tue Jul 5 21:08:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:28.316069 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315105b-6122-440b-a6b1-b3b1948d2edc None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:28.316186 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:28.335497 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3cb669-c814-4822-87ed-7ef0cb84f890 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:28.369461 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d6a2e-fc8d-4ed4-beb2-9e6a344e8911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:28.370427 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d6a2e-fc8d-4ed4-beb2-9e6a344e8911 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:28.370711 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d6a2e-fc8d-4ed4-beb2-9e6a344e8911 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:28.370988 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d6a2e-fc8d-4ed4-beb2-9e6a344e8911 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:28.377957 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d6a2e-fc8d-4ed4-beb2-9e6a344e8911 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:28.379462 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d6a2e-fc8d-4ed4-beb2-9e6a344e8911 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:28.394540 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-c78d6a2e-fc8d-4ed4-beb2-9e6a344e8911 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 21:08:28.394540 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:28.394540 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:28.394540 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:28.394540 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:28.394540 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:28.394540 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:28.394540 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:28.394540 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:28.394540 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:28.394540 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:28.394540 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:28.394540 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:08:28.394540 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:08:28.394540 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:08:28.394540 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:08:28.395475 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:28.395475 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:28.395475 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:08:28.395475 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:08:28.395475 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:08:28.395475 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:08:28.395475 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:28.395475 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:28.395475 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:28.395475 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:28.395475 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:28.395475 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:28.395475 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:28.395475 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:28.395475 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:28.395475 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:28.395475 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:28.395475 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:28.396583 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:28.396583 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:28.396583 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:08:28.396583 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:08:28.396583 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:08:28.396583 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:08:28.396583 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:08:28.396583 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:08:28.396583 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 21:08:28.396583 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:28.396583 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 260/511] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:08:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:28.397707 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d6a2e-fc8d-4ed4-beb2-9e6a344e8911 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:28.403360 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:28.415193 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315105b-6122-440b-a6b1-b3b1948d2edc None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:28.450319 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c2b7c-7b11-48cc-9c70-89f472fd74ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:28.450990 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c2b7c-7b11-48cc-9c70-89f472fd74ce None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:28.451280 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c2b7c-7b11-48cc-9c70-89f472fd74ce None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:28.451562 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c2b7c-7b11-48cc-9c70-89f472fd74ce None admin] PATH_INFO: `/v3/domains` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:28.452276 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7c2b7c-7b11-48cc-9c70-89f472fd74ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:28.452588 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7c2b7c-7b11-48cc-9c70-89f472fd74ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:28.453958 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7c2b7c-7b11-48cc-9c70-89f472fd74ce None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:28.465821 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 252/512] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:08:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:28.466837 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c2b7c-7b11-48cc-9c70-89f472fd74ce None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:28.495200 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d6a2e-fc8d-4ed4-beb2-9e6a344e8911 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:28.528245 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52936b6-9c77-4b86-b9c0-0fe20d259033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:28.528907 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52936b6-9c77-4b86-b9c0-0fe20d259033 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:28.529197 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52936b6-9c77-4b86-b9c0-0fe20d259033 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:28.529478 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52936b6-9c77-4b86-b9c0-0fe20d259033 None admin] PATH_INFO: `/v3/domains` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:28.530232 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52936b6-9c77-4b86-b9c0-0fe20d259033 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:28.530552 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52936b6-9c77-4b86-b9c0-0fe20d259033 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:28.531946 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52936b6-9c77-4b86-b9c0-0fe20d259033 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:28.543410 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 261/513] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:08:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:28.544207 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52936b6-9c77-4b86-b9c0-0fe20d259033 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:28.546766 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:28.570028 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c2b7c-7b11-48cc-9c70-89f472fd74ce None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:28.603181 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801ed68-e81d-4882-82b9-8dcc34fb8899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:28.604332 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801ed68-e81d-4882-82b9-8dcc34fb8899 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:28.604616 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801ed68-e81d-4882-82b9-8dcc34fb8899 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:28.604896 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801ed68-e81d-4882-82b9-8dcc34fb8899 None admin] PATH_INFO: `/v3/roles` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:28.605640 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8801ed68-e81d-4882-82b9-8dcc34fb8899 None admin] RBAC: Adding query filter params (name=service) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:28.605957 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8801ed68-e81d-4882-82b9-8dcc34fb8899 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:28.607354 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8801ed68-e81d-4882-82b9-8dcc34fb8899 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:28.615357 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 253/514] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:08:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:28.616055 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801ed68-e81d-4882-82b9-8dcc34fb8899 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:28.627979 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:28.646012 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52936b6-9c77-4b86-b9c0-0fe20d259033 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:28.679622 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6ea5e-fdff-43b2-8f2c-e3b4936a5c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:28.680270 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6ea5e-fdff-43b2-8f2c-e3b4936a5c4e None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:28.680558 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6ea5e-fdff-43b2-8f2c-e3b4936a5c4e None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:28.680839 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6ea5e-fdff-43b2-8f2c-e3b4936a5c4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:28.714629 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801ed68-e81d-4882-82b9-8dcc34fb8899 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:28.748523 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc7b41-0872-4615-b2a2-f6df16ecace0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:28.748684 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6ea5e-fdff-43b2-8f2c-e3b4936a5c4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:28.749200 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc7b41-0872-4615-b2a2-f6df16ecace0 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:28.749492 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc7b41-0872-4615-b2a2-f6df16ecace0 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:28.749781 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc7b41-0872-4615-b2a2-f6df16ecace0 None admin] PATH_INFO: `/v3/users` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:28.749996 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6ea5e-fdff-43b2-8f2c-e3b4936a5c4e None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:28.750649 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc7b41-0872-4615-b2a2-f6df16ecace0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:28.750968 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc7b41-0872-4615-b2a2-f6df16ecace0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:28.751867 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:28.752404 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc7b41-0872-4615-b2a2-f6df16ecace0 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:28.769736 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 254/515] 10.222.0.30 () {56 vars in 1137 bytes} [Tue Jul 5 21:08:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:28.770676 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc7b41-0872-4615-b2a2-f6df16ecace0 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:28.837041 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:28.848952 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 262/516] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:08:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:08:28.851625 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6ea5e-fdff-43b2-8f2c-e3b4936a5c4e None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:28.871278 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc7b41-0872-4615-b2a2-f6df16ecace0 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:28.905537 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a6d3b-3199-4dab-a383-063d4ee6409a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:28.906372 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a6d3b-3199-4dab-a383-063d4ee6409a None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:28.906661 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a6d3b-3199-4dab-a383-063d4ee6409a None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:28.906941 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a6d3b-3199-4dab-a383-063d4ee6409a None admin] PATH_INFO: `/v3/projects/service` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:28.913592 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a6d3b-3199-4dab-a383-063d4ee6409a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:28.915082 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a6d3b-3199-4dab-a383-063d4ee6409a None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:28.929713 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-709a6d3b-3199-4dab-a383-063d4ee6409a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:08:28.929713 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:28.929713 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:28.929713 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:28.929713 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:28.929713 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:28.929713 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:28.929713 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:28.929713 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:28.929713 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:28.929713 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:28.929713 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:28.929713 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:08:28.929713 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:08:28.929713 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:08:28.930637 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:08:28.930637 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:28.930637 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:28.930637 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:28.930637 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:28.930637 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:28.930637 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:28.930637 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:28.930637 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:28.930637 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:28.930637 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:28.930637 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:28.930637 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:28.930637 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:28.930637 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:28.930637 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:28.930637 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:28.932794 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:08:28.932794 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:08:28.932794 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:08:28.932794 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:08:28.932794 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:08:28.932794 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:08:28.932794 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:08:28.932794 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:28.932794 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 255/517] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:08:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:28.932794 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a6d3b-3199-4dab-a383-063d4ee6409a None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:28.952317 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6ea5e-fdff-43b2-8f2c-e3b4936a5c4e None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:28.953842 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:28.986105 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130192d9-ab78-4bfe-8758-ef9cb0a94f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:28.986808 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130192d9-ab78-4bfe-8758-ef9cb0a94f07 None admin] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:28.987093 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130192d9-ab78-4bfe-8758-ef9cb0a94f07 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:28.987370 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130192d9-ab78-4bfe-8758-ef9cb0a94f07 None admin] PATH_INFO: `/v3/users` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:28.988069 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130192d9-ab78-4bfe-8758-ef9cb0a94f07 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:28.989489 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130192d9-ab78-4bfe-8758-ef9cb0a94f07 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:29.035733 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a6d3b-3199-4dab-a383-063d4ee6409a None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:29.061213 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:29.068877 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca42a8-6933-4011-a71b-90fdd80461df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:29.069670 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca42a8-6933-4011-a71b-90fdd80461df None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:29.069959 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca42a8-6933-4011-a71b-90fdd80461df None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:29.070272 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca42a8-6933-4011-a71b-90fdd80461df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:29.080385 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca42a8-6933-4011-a71b-90fdd80461df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:29.081846 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca42a8-6933-4011-a71b-90fdd80461df None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:29.084925 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 263/518] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:08:28 2022] POST /identity/v3/users => generated 247 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:08:29.085889 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130192d9-ab78-4bfe-8758-ef9cb0a94f07 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:29.099891 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-52ca42a8-6933-4011-a71b-90fdd80461df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:29.099891 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:29.099891 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:29.099891 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:29.099891 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:29.099891 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:29.099891 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:29.099891 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:29.099891 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:29.099891 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:29.099891 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:29.099891 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:29.099891 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:08:29.099891 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:08:29.099891 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:08:29.100977 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:08:29.100977 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:29.100977 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:29.100977 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:29.100977 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:29.100977 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:29.100977 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:29.100977 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:29.100977 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:29.100977 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:29.100977 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:29.100977 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:29.100977 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:29.100977 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:29.100977 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:29.100977 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:29.100977 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:29.107777 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:08:29.107777 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:08:29.107777 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:29.107777 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:29.107777 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 256/519] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:29.107777 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca42a8-6933-4011-a71b-90fdd80461df None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:29.217620 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca42a8-6933-4011-a71b-90fdd80461df None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:29.218275 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130192d9-ab78-4bfe-8758-ef9cb0a94f07 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:29.255242 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf80ee-d70d-41e8-b288-cb9f66f906fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:29.256116 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf80ee-d70d-41e8-b288-cb9f66f906fd None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:29.256328 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf80ee-d70d-41e8-b288-cb9f66f906fd None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:29.256661 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf80ee-d70d-41e8-b288-cb9f66f906fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:29.258175 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37870837-5a93-4c69-9cdb-270dce0db06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:29.258655 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37870837-5a93-4c69-9cdb-270dce0db06d None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:29.258950 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37870837-5a93-4c69-9cdb-270dce0db06d None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:29.259233 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37870837-5a93-4c69-9cdb-270dce0db06d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:29.268538 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbf80ee-d70d-41e8-b288-cb9f66f906fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:29.270447 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbf80ee-d70d-41e8-b288-cb9f66f906fd None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:29.289331 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-acbf80ee-d70d-41e8-b288-cb9f66f906fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:29.289331 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:29.289331 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:29.289331 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:29.289331 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:29.289331 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:29.289331 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:29.289331 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:29.289331 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:29.289331 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:29.289331 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:29.289331 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:29.289331 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:08:29.289331 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:08:29.289331 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:08:29.290459 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:08:29.290459 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:29.290459 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:29.290459 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:29.290459 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:29.290459 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:29.290459 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:29.290459 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:29.290459 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:29.290459 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:29.290459 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:29.290459 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:29.290459 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:29.290459 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:29.290459 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:29.290459 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:29.290459 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:29.291749 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:08:29.291749 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:08:29.291749 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:29.291749 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:29.292195 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:29.292281 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 257/520] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:29.292281 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf80ee-d70d-41e8-b288-cb9f66f906fd None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:29.326735 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:29.340880 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37870837-5a93-4c69-9cdb-270dce0db06d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:29.342503 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37870837-5a93-4c69-9cdb-270dce0db06d None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:29.398719 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf80ee-d70d-41e8-b288-cb9f66f906fd None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:29.435265 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe8cbd-d966-40b0-abc2-64fe0cefa365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:29.436285 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe8cbd-d966-40b0-abc2-64fe0cefa365 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:29.436826 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe8cbd-d966-40b0-abc2-64fe0cefa365 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:29.437275 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe8cbd-d966-40b0-abc2-64fe0cefa365 None admin] PATH_INFO: `/v3/projects` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:29.438227 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fe8cbd-d966-40b0-abc2-64fe0cefa365 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:29.439045 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fe8cbd-d966-40b0-abc2-64fe0cefa365 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:29.440744 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fe8cbd-d966-40b0-abc2-64fe0cefa365 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:29.443037 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 264/521] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:08:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:08:29.443885 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37870837-5a93-4c69-9cdb-270dce0db06d None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:29.463230 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 258/522] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:08:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:29.464437 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe8cbd-d966-40b0-abc2-64fe0cefa365 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:29.513025 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:29.555362 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37870837-5a93-4c69-9cdb-270dce0db06d None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:29.564314 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:29.572872 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe8cbd-d966-40b0-abc2-64fe0cefa365 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:29.595227 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502d2ad-5518-4f34-b525-c6c820c4d8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:29.596128 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502d2ad-5518-4f34-b525-c6c820c4d8b4 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:29.596572 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502d2ad-5518-4f34-b525-c6c820c4d8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:29.596858 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502d2ad-5518-4f34-b525-c6c820c4d8b4 None admin] PATH_INFO: `/v3/domains` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:29.597589 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9502d2ad-5518-4f34-b525-c6c820c4d8b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:29.597907 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9502d2ad-5518-4f34-b525-c6c820c4d8b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:29.599330 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9502d2ad-5518-4f34-b525-c6c820c4d8b4 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:29.611082 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6b7f9-4508-4279-aead-9cdbc2350a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:29.615985 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 265/523] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:08:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:29.616136 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6b7f9-4508-4279-aead-9cdbc2350a34 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:29.616136 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6b7f9-4508-4279-aead-9cdbc2350a34 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:29.616136 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6b7f9-4508-4279-aead-9cdbc2350a34 None admin] PATH_INFO: `/v3/domains` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:29.616359 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502d2ad-5518-4f34-b525-c6c820c4d8b4 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:29.616440 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a6b7f9-4508-4279-aead-9cdbc2350a34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:29.616440 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a6b7f9-4508-4279-aead-9cdbc2350a34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:29.616440 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a6b7f9-4508-4279-aead-9cdbc2350a34 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:29.631866 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 259/524] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:08:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:29.632782 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6b7f9-4508-4279-aead-9cdbc2350a34 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:29.725521 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502d2ad-5518-4f34-b525-c6c820c4d8b4 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:29.736965 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6b7f9-4508-4279-aead-9cdbc2350a34 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:29.745038 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:29.762019 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd515946-70eb-4d39-ad19-fe5a4d30128e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:29.762858 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd515946-70eb-4d39-ad19-fe5a4d30128e None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:29.763198 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd515946-70eb-4d39-ad19-fe5a4d30128e None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:29.763423 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd515946-70eb-4d39-ad19-fe5a4d30128e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:29.773598 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd005a-d32a-4f34-bbf1-78385a940d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:29.773870 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd515946-70eb-4d39-ad19-fe5a4d30128e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:29.774296 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd005a-d32a-4f34-bbf1-78385a940d6b None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:29.774588 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd005a-d32a-4f34-bbf1-78385a940d6b None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:29.774871 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd005a-d32a-4f34-bbf1-78385a940d6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:29.776100 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd515946-70eb-4d39-ad19-fe5a4d30128e None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:29.776278 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dd005a-d32a-4f34-bbf1-78385a940d6b None admin] RBAC: Adding query filter params (role.id=601a166d56f647bda8256e971450cfdf, scope.project.id=ccd95a48530c4c86a3774301b969d6a9, user.id=be0701b0a7ff479e8b3214afaf618acd) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:29.776590 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dd005a-d32a-4f34-bbf1-78385a940d6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:29.778110 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dd005a-d32a-4f34-bbf1-78385a940d6b None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:29.783851 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 260/525] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:08:29 2022] GET /identity/v3/role_assignments?user.id=be0701b0a7ff479e8b3214afaf618acd&scope.project.id=ccd95a48530c4c86a3774301b969d6a9&role.id=601a166d56f647bda8256e971450cfdf => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:29.784494 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd005a-d32a-4f34-bbf1-78385a940d6b None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:29.805463 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:29.808550 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-fd515946-70eb-4d39-ad19-fe5a4d30128e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:29.808550 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:29.808550 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:29.808550 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:29.808550 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:29.808550 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:29.808550 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:29.808550 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:29.808550 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:29.808550 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:29.808550 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:29.808550 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:29.808550 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:08:29.808550 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:08:29.808550 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:08:29.809499 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:08:29.809499 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:29.809499 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:29.809499 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:29.809499 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:29.809499 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:29.809499 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:29.809499 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:29.809499 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:29.809499 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:29.809499 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:29.809499 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:29.809499 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:29.809499 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:29.809499 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:29.809499 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:29.809499 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:29.810417 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:08:29.810417 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:08:29.810417 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:29.810417 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:29.814464 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 266/526] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:29.815680 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd515946-70eb-4d39-ad19-fe5a4d30128e None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:29.910370 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd005a-d32a-4f34-bbf1-78385a940d6b None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:29.959711 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835fabda-3301-488e-b42c-381d433cd215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:29.960580 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fabda-3301-488e-b42c-381d433cd215 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:29.960872 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fabda-3301-488e-b42c-381d433cd215 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:29.961165 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fabda-3301-488e-b42c-381d433cd215 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:29.961278 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd515946-70eb-4d39-ad19-fe5a4d30128e None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:29.971962 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835fabda-3301-488e-b42c-381d433cd215 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:29.974176 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835fabda-3301-488e-b42c-381d433cd215 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:29.996723 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-835fabda-3301-488e-b42c-381d433cd215 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 21:08:29.996723 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:29.996723 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:29.996723 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:29.996723 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:29.996723 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:29.996723 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:29.996723 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:29.996723 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:29.996723 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:29.996723 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:29.996723 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:29.996723 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:08:29.996723 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:08:29.996723 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:08:29.996723 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:08:29.997672 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:29.997672 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:29.997672 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:08:29.997672 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:08:29.997672 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:08:29.997672 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:08:29.997672 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:29.997672 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:29.997672 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:29.997672 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:29.997672 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:29.997672 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:29.997672 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:29.997672 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:29.997672 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:29.997672 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:29.997672 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:29.997672 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:29.998596 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:29.998596 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:29.998596 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:08:29.998596 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:08:29.998596 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:08:29.998596 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:08:29.998596 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:08:29.998596 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:08:29.998596 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 21:08:29.998596 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:29.999108 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76a8a8-3231-4767-9b02-0feea9b6ef3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:29.999108 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76a8a8-3231-4767-9b02-0feea9b6ef3a None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:29.999108 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76a8a8-3231-4767-9b02-0feea9b6ef3a None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:29.999299 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 261/527] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:08:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:29.999364 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76a8a8-3231-4767-9b02-0feea9b6ef3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:29.999437 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835fabda-3301-488e-b42c-381d433cd215 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:30.010559 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa76a8a8-3231-4767-9b02-0feea9b6ef3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:30.012156 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa76a8a8-3231-4767-9b02-0feea9b6ef3a None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:30.028223 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-aa76a8a8-3231-4767-9b02-0feea9b6ef3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:08:30.028223 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:30.028223 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:30.028223 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:30.028223 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:30.028223 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:30.028223 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:30.028223 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:30.028223 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:30.028223 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:30.028223 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:30.028223 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:30.028223 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:08:30.028223 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:08:30.028223 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:08:30.029090 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:08:30.029090 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:30.029090 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:30.029090 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:30.029090 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:30.029090 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:30.029090 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:30.029090 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:30.029090 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:30.029090 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:30.029090 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:30.029090 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:30.029090 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:30.029090 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:30.029090 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:30.029090 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:30.029090 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:30.030580 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:08:30.030580 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:08:30.030580 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:08:30.030580 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:08:30.030580 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:08:30.030580 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:08:30.030580 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:08:30.030580 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:30.030580 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 267/528] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:08:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:30.030580 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76a8a8-3231-4767-9b02-0feea9b6ef3a None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:30.062192 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:30.106944 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:30.140907 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835fabda-3301-488e-b42c-381d433cd215 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:30.145794 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76a8a8-3231-4767-9b02-0feea9b6ef3a None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:30.183648 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1beef3c-2974-481f-b049-06b2830111da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:30.184328 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1beef3c-2974-481f-b049-06b2830111da None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:30.184617 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1beef3c-2974-481f-b049-06b2830111da None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:30.184893 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1beef3c-2974-481f-b049-06b2830111da None admin] PATH_INFO: `/v3/users` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:30.185846 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1beef3c-2974-481f-b049-06b2830111da None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:30.186188 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1beef3c-2974-481f-b049-06b2830111da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:30.186782 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70baf56d-996a-4a01-b784-384727dbce57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:30.187639 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1beef3c-2974-481f-b049-06b2830111da None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:30.187890 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70baf56d-996a-4a01-b784-384727dbce57 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:30.188372 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70baf56d-996a-4a01-b784-384727dbce57 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:30.189125 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70baf56d-996a-4a01-b784-384727dbce57 None admin] PATH_INFO: `/v3/domains` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:30.190293 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70baf56d-996a-4a01-b784-384727dbce57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:30.190807 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70baf56d-996a-4a01-b784-384727dbce57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:30.192386 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70baf56d-996a-4a01-b784-384727dbce57 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:30.211717 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 262/529] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:08:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:30.213122 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70baf56d-996a-4a01-b784-384727dbce57 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:30.238227 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 268/530] 10.222.0.30 () {56 vars in 1139 bytes} [Tue Jul 5 21:08:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:30.239575 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1beef3c-2974-481f-b049-06b2830111da None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:30.337481 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70baf56d-996a-4a01-b784-384727dbce57 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:30.357044 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:30.374101 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1beef3c-2974-481f-b049-06b2830111da None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:30.381321 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d8fcc-5e59-4a6a-b052-09105664d60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:30.381321 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d8fcc-5e59-4a6a-b052-09105664d60e None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:30.381321 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d8fcc-5e59-4a6a-b052-09105664d60e None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:30.381321 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d8fcc-5e59-4a6a-b052-09105664d60e None admin] PATH_INFO: `/v3/projects` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:30.381638 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33d8fcc-5e59-4a6a-b052-09105664d60e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:30.381638 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33d8fcc-5e59-4a6a-b052-09105664d60e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:30.381638 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33d8fcc-5e59-4a6a-b052-09105664d60e None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:30.383876 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:30.394957 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 263/531] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:08:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:30.396195 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d8fcc-5e59-4a6a-b052-09105664d60e None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:30.416637 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca36d8-aea0-47a2-b6da-cb102dbb0cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:30.417450 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca36d8-aea0-47a2-b6da-cb102dbb0cc8 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:30.417742 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca36d8-aea0-47a2-b6da-cb102dbb0cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:30.418051 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca36d8-aea0-47a2-b6da-cb102dbb0cc8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:30.427358 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ca36d8-aea0-47a2-b6da-cb102dbb0cc8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:30.429280 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ca36d8-aea0-47a2-b6da-cb102dbb0cc8 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:30.445760 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-c8ca36d8-aea0-47a2-b6da-cb102dbb0cc8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:08:30.445760 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:30.445760 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:30.445760 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:30.445760 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:30.445760 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:30.445760 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:30.445760 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:30.445760 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:30.445760 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:30.445760 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:30.445760 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:30.445760 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:08:30.445760 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:08:30.445760 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:08:30.446690 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:08:30.446690 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:30.446690 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:30.446690 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:30.446690 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:30.446690 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:30.446690 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:30.446690 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:30.446690 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:30.446690 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:30.446690 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:30.446690 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:30.446690 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:30.446690 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:30.446690 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:30.446690 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:30.446690 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:30.448069 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:08:30.448069 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:08:30.448069 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:08:30.448069 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:08:30.448069 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:08:30.448069 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:08:30.448069 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:08:30.448069 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:30.454778 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 269/532] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:08:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:30.455853 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca36d8-aea0-47a2-b6da-cb102dbb0cc8 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:30.524396 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d8fcc-5e59-4a6a-b052-09105664d60e None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:30.562269 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca36d8-aea0-47a2-b6da-cb102dbb0cc8 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:30.573239 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c630c678-7a20-4741-ae06-b511c2b994e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:30.574187 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630c678-7a20-4741-ae06-b511c2b994e8 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:30.574680 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630c678-7a20-4741-ae06-b511c2b994e8 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:30.575178 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630c678-7a20-4741-ae06-b511c2b994e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:30.606734 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5896a85a-0a02-44bb-b08e-3811915146c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:30.607399 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896a85a-0a02-44bb-b08e-3811915146c6 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:30.607686 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896a85a-0a02-44bb-b08e-3811915146c6 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:30.607968 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896a85a-0a02-44bb-b08e-3811915146c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:30.609340 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5896a85a-0a02-44bb-b08e-3811915146c6 None admin] RBAC: Adding query filter params (role.id=601a166d56f647bda8256e971450cfdf, scope.project.id=ccd95a48530c4c86a3774301b969d6a9, user.id=598e27ffd54748f6aadb3d7cab5a4ce7) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:30.609797 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5896a85a-0a02-44bb-b08e-3811915146c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:30.611292 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5896a85a-0a02-44bb-b08e-3811915146c6 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:30.618923 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 270/533] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:08:30 2022] GET /identity/v3/role_assignments?user.id=598e27ffd54748f6aadb3d7cab5a4ce7&scope.project.id=ccd95a48530c4c86a3774301b969d6a9&role.id=601a166d56f647bda8256e971450cfdf => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:30.620253 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5896a85a-0a02-44bb-b08e-3811915146c6 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:30.642970 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:30.652506 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:30.662430 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c630c678-7a20-4741-ae06-b511c2b994e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:30.664384 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c630c678-7a20-4741-ae06-b511c2b994e8 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:30.800478 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 264/534] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:08:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:08:30.805564 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5896a85a-0a02-44bb-b08e-3811915146c6 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:30.807791 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c630c678-7a20-4741-ae06-b511c2b994e8 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:30.886783 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ff4b8-ab39-4ba6-be61-e24cbc09845f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:30.887541 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ff4b8-ab39-4ba6-be61-e24cbc09845f None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:30.887931 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ff4b8-ab39-4ba6-be61-e24cbc09845f None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:30.888312 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ff4b8-ab39-4ba6-be61-e24cbc09845f None admin] PATH_INFO: `/v3/projects` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:30.889310 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83ff4b8-ab39-4ba6-be61-e24cbc09845f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:30.890232 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83ff4b8-ab39-4ba6-be61-e24cbc09845f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:30.891476 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83ff4b8-ab39-4ba6-be61-e24cbc09845f None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:30.922329 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 271/535] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:08:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:30.923062 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:30.925965 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ff4b8-ab39-4ba6-be61-e24cbc09845f None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:30.929736 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c630c678-7a20-4741-ae06-b511c2b994e8 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:30.988331 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b4d42-fd19-4906-b5bf-1b08f91ba4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:30.989150 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b4d42-fd19-4906-b5bf-1b08f91ba4e9 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:30.989438 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b4d42-fd19-4906-b5bf-1b08f91ba4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:30.989718 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b4d42-fd19-4906-b5bf-1b08f91ba4e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:31.019255 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b4d42-fd19-4906-b5bf-1b08f91ba4e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:31.019888 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:31.020732 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b4d42-fd19-4906-b5bf-1b08f91ba4e9 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:31.054898 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ff4b8-ab39-4ba6-be61-e24cbc09845f None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:31.066874 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-b17b4d42-fd19-4906-b5bf-1b08f91ba4e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:31.066874 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:31.066874 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:31.066874 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:31.066874 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:31.066874 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:31.066874 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:31.066874 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:31.066874 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:31.066874 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:31.066874 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:31.066874 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:31.066874 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:08:31.066874 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:08:31.066874 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:08:31.067816 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:08:31.067816 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:31.067816 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:31.067816 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:31.067816 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:31.067816 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:31.067816 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:31.067816 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:31.067816 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:31.067816 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:31.067816 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:31.067816 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:31.067816 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:31.067816 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:31.067816 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:31.067816 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:31.067816 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:31.069079 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:08:31.069079 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:08:31.069079 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:31.069079 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:31.069079 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 265/536] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:31.087142 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b4d42-fd19-4906-b5bf-1b08f91ba4e9 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:31.110874 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1acc4f-ee90-4c79-ac65-30000290b3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:31.111560 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1acc4f-ee90-4c79-ac65-30000290b3c6 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:31.111851 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1acc4f-ee90-4c79-ac65-30000290b3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:31.112136 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1acc4f-ee90-4c79-ac65-30000290b3c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:31.112987 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1acc4f-ee90-4c79-ac65-30000290b3c6 None admin] RBAC: Adding query filter params (role.id=601a166d56f647bda8256e971450cfdf, scope.project.id=ccd95a48530c4c86a3774301b969d6a9, user.id=4b5719dcd7314f1487b5e168e07039f8) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:31.113306 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1acc4f-ee90-4c79-ac65-30000290b3c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:31.114796 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1acc4f-ee90-4c79-ac65-30000290b3c6 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:31.133114 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 272/537] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:08:30 2022] GET /identity/v3/role_assignments?user.id=4b5719dcd7314f1487b5e168e07039f8&scope.project.id=ccd95a48530c4c86a3774301b969d6a9&role.id=601a166d56f647bda8256e971450cfdf => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:31.205162 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b4d42-fd19-4906-b5bf-1b08f91ba4e9 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:31.211430 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1d67d-1b8e-4fc4-8bc2-edeb60ec38ce None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:31.211725 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1d67d-1b8e-4fc4-8bc2-edeb60ec38ce None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:31.212010 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1d67d-1b8e-4fc4-8bc2-edeb60ec38ce None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:31.213885 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 273/538] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:08:31.219146 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a36c59-3e02-4219-a7ad-b50240905a14 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:31.219439 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a36c59-3e02-4219-a7ad-b50240905a14 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:31.219725 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a36c59-3e02-4219-a7ad-b50240905a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:31.245417 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-f1a36c59-3e02-4219-a7ad-b50240905a14 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:31.246703 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-f1a36c59-3e02-4219-a7ad-b50240905a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:31.262977 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f629b065-3dc2-4787-aa8d-039199fe1341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:31.263669 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629b065-3dc2-4787-aa8d-039199fe1341 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:31.263960 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629b065-3dc2-4787-aa8d-039199fe1341 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:31.264239 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629b065-3dc2-4787-aa8d-039199fe1341 None admin] PATH_INFO: `/v3/domains` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:31.264977 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f629b065-3dc2-4787-aa8d-039199fe1341 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:31.265293 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f629b065-3dc2-4787-aa8d-039199fe1341 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:31.266745 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f629b065-3dc2-4787-aa8d-039199fe1341 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:31.287649 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 266/539] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:08:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:31.292667 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f629b065-3dc2-4787-aa8d-039199fe1341 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:31.311786 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:31.379695 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 274/540] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:08:31.419271 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a36c59-3e02-4219-a7ad-b50240905a14 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:31.431171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f629b065-3dc2-4787-aa8d-039199fe1341 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:31.470465 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca94167b-2007-4dde-ad65-53104593da1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:31.471321 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94167b-2007-4dde-ad65-53104593da1f None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:31.471615 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94167b-2007-4dde-ad65-53104593da1f None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:31.471955 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94167b-2007-4dde-ad65-53104593da1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:31.479634 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca94167b-2007-4dde-ad65-53104593da1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:31.481174 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca94167b-2007-4dde-ad65-53104593da1f None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:31.497424 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-ca94167b-2007-4dde-ad65-53104593da1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:08:31.497424 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:31.497424 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:31.497424 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:31.497424 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:31.497424 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:31.497424 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:31.497424 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:31.497424 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:31.497424 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:31.497424 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:31.497424 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:31.497424 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:08:31.497424 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:08:31.497424 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:08:31.498369 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:08:31.498369 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:31.498369 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:31.498369 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:31.498369 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:31.498369 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:31.498369 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:31.498369 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:31.498369 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:31.498369 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:31.498369 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:31.498369 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:31.498369 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:31.498369 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:31.498369 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:31.498369 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:31.498369 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:31.499674 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:08:31.499674 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:08:31.499674 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:08:31.499674 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:08:31.499674 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:08:31.499674 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:08:31.499674 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:08:31.499674 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:31.499674 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 267/541] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:08:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:31.504519 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca94167b-2007-4dde-ad65-53104593da1f None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:31.579973 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:31.585774 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:31.615323 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca94167b-2007-4dde-ad65-53104593da1f None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:31.655289 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe05e2-b3ec-4e20-aa87-7562d1fe4197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:31.655289 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe05e2-b3ec-4e20-aa87-7562d1fe4197 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:31.655289 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe05e2-b3ec-4e20-aa87-7562d1fe4197 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:31.655660 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe05e2-b3ec-4e20-aa87-7562d1fe4197 None admin] PATH_INFO: `/v3/projects` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:31.656496 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fe05e2-b3ec-4e20-aa87-7562d1fe4197 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:31.656878 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fe05e2-b3ec-4e20-aa87-7562d1fe4197 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:31.658687 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fe05e2-b3ec-4e20-aa87-7562d1fe4197 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:31.664237 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a36c59-3e02-4219-a7ad-b50240905a14 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:31.673598 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 268/542] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:08:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:08:31.679722 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe05e2-b3ec-4e20-aa87-7562d1fe4197 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:31.738976 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1795f-d29b-483f-9a49-5b0a2ca2d947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:31.739714 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1795f-d29b-483f-9a49-5b0a2ca2d947 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:31.740006 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1795f-d29b-483f-9a49-5b0a2ca2d947 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:31.740285 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1795f-d29b-483f-9a49-5b0a2ca2d947 None admin] PATH_INFO: `/v3/roles/service` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:31.771911 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f1795f-d29b-483f-9a49-5b0a2ca2d947 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:08:31.780917 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-38f1795f-d29b-483f-9a49-5b0a2ca2d947 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:08:31.780917 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:31.780917 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:31.780917 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:31.780917 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:31.780917 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:31.780917 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:31.780917 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:31.780917 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:31.780917 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:31.780917 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:31.780917 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:31.780917 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:08:31.780917 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:08:31.780917 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:08:31.780917 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:08:31.781818 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:08:31.781818 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:08:31.781818 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:08:31.781818 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:08:31.781818 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:31.781818 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:31.781818 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:31.781818 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:31.781818 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:31.781818 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:31.781818 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:31.781818 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:31.781818 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:31.781818 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:31.781818 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:31.781818 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:31.782658 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:31.782658 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:31.782658 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:31.782658 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:31.782658 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:08:31.782658 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:08:31.782658 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:08:31.782658 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:08:31.782658 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:08:31.782658 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:08:31.782658 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:08:31.782658 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:31.785452 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 275/543] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:08:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:08:31.793325 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe05e2-b3ec-4e20-aa87-7562d1fe4197 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:31.794538 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1795f-d29b-483f-9a49-5b0a2ca2d947 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:31.824694 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:31.833583 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d433a8-4b9f-4da3-ba05-7bf3b0a60607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:31.834725 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d433a8-4b9f-4da3-ba05-7bf3b0a60607 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:31.835018 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d433a8-4b9f-4da3-ba05-7bf3b0a60607 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:31.854329 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d433a8-4b9f-4da3-ba05-7bf3b0a60607 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:31.854329 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d433a8-4b9f-4da3-ba05-7bf3b0a60607 None admin] RBAC: Adding query filter params (role.id=601a166d56f647bda8256e971450cfdf, scope.project.id=ccd95a48530c4c86a3774301b969d6a9, user.id=a3947355cf8a4b75bd31c5e6125e75e4) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:31.854329 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d433a8-4b9f-4da3-ba05-7bf3b0a60607 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:31.854329 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d433a8-4b9f-4da3-ba05-7bf3b0a60607 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:31.854329 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 269/544] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:08:31 2022] GET /identity/v3/role_assignments?user.id=a3947355cf8a4b75bd31c5e6125e75e4&scope.project.id=ccd95a48530c4c86a3774301b969d6a9&role.id=601a166d56f647bda8256e971450cfdf => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:08:31.969550 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8a6b0-7d6e-49d4-ace8-9304c4c7388c None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:31.969837 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8a6b0-7d6e-49d4-ace8-9304c4c7388c None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:31.970117 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8a6b0-7d6e-49d4-ace8-9304c4c7388c None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:31.971530 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 270/545] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:08:31.976865 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271e7f8-56f6-43d1-a359-64cb5a5c7014 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:31.977160 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271e7f8-56f6-43d1-a359-64cb5a5c7014 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:31.977448 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271e7f8-56f6-43d1-a359-64cb5a5c7014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:31.987339 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1795f-d29b-483f-9a49-5b0a2ca2d947 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:32.007540 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-4271e7f8-56f6-43d1-a359-64cb5a5c7014 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:32.008681 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-4271e7f8-56f6-43d1-a359-64cb5a5c7014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:32.019067 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:32.025997 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14355517-ee8d-4523-8fc1-12ab9447bcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:32.026974 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14355517-ee8d-4523-8fc1-12ab9447bcf5 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:32.027476 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14355517-ee8d-4523-8fc1-12ab9447bcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:32.027948 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14355517-ee8d-4523-8fc1-12ab9447bcf5 None admin] PATH_INFO: `/v3/roles` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:32.028897 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14355517-ee8d-4523-8fc1-12ab9447bcf5 None admin] RBAC: Adding query filter params (name=service) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:32.029376 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14355517-ee8d-4523-8fc1-12ab9447bcf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:32.036981 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14355517-ee8d-4523-8fc1-12ab9447bcf5 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:32.041948 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 276/546] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:08:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:32.047067 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14355517-ee8d-4523-8fc1-12ab9447bcf5 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:32.125676 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 271/547] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:08:32.151834 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4271e7f8-56f6-43d1-a359-64cb5a5c7014 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:32.298497 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14355517-ee8d-4523-8fc1-12ab9447bcf5 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:32.360656 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4271e7f8-56f6-43d1-a359-64cb5a5c7014 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:32.378159 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe836ef1-3ae7-41cc-b0b6-a922d5b65cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:32.379000 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe836ef1-3ae7-41cc-b0b6-a922d5b65cbb None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:32.379289 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe836ef1-3ae7-41cc-b0b6-a922d5b65cbb None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:32.379569 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe836ef1-3ae7-41cc-b0b6-a922d5b65cbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:32.405608 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe836ef1-3ae7-41cc-b0b6-a922d5b65cbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:32.407147 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe836ef1-3ae7-41cc-b0b6-a922d5b65cbb None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:32.412873 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:32.440457 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe782a90-7f40-4d88-9ad4-d2f10044e874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:32.441639 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe782a90-7f40-4d88-9ad4-d2f10044e874 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:32.443980 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe782a90-7f40-4d88-9ad4-d2f10044e874 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:32.444460 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe782a90-7f40-4d88-9ad4-d2f10044e874 None admin] PATH_INFO: `/v3/roles/service` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:32.450642 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-fe836ef1-3ae7-41cc-b0b6-a922d5b65cbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:32.450642 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:32.450642 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:32.450642 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:32.450642 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:32.450642 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:32.450642 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:32.450642 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:32.450642 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:32.450642 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:32.450642 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:32.450642 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:32.450642 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:08:32.450642 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:08:32.450642 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:08:32.451486 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:08:32.451486 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:32.451486 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:32.451486 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:32.451486 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:32.451486 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:32.451486 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:32.451486 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:32.451486 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:32.451486 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:32.451486 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:32.451486 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:32.451486 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:32.451486 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:32.451486 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:32.451486 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:32.451486 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:32.452329 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:08:32.452329 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:08:32.452329 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:32.452329 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:32.458242 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 277/548] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 411 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:08:32.465646 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe836ef1-3ae7-41cc-b0b6-a922d5b65cbb None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:32.466603 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe782a90-7f40-4d88-9ad4-d2f10044e874 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:08:32.487057 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-fe782a90-7f40-4d88-9ad4-d2f10044e874 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:08:32.487057 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:32.487057 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:32.487057 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:32.487057 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:32.487057 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:32.487057 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:32.487057 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:32.487057 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:32.487057 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:32.487057 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:32.487057 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:32.487057 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:08:32.487057 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:08:32.487057 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:08:32.487057 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:08:32.488200 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:08:32.488200 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:08:32.488200 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:08:32.488200 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:08:32.488200 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:32.488200 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:32.488200 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:32.488200 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:32.488200 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:32.488200 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:32.488200 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:32.488200 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:32.488200 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:32.488200 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:32.488200 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:32.488200 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:32.489037 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:32.489037 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:32.489037 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:32.489037 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:32.489037 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:08:32.489037 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:08:32.489037 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:08:32.489037 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:08:32.489037 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:08:32.489037 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:08:32.489037 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:08:32.489037 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:32.491550 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 272/549] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:08:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:08:32.496067 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe782a90-7f40-4d88-9ad4-d2f10044e874 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:32.579842 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:32.650540 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe836ef1-3ae7-41cc-b0b6-a922d5b65cbb None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:32.685616 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe782a90-7f40-4d88-9ad4-d2f10044e874 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:32.716243 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e271a-7b39-48ce-9dcc-3a48ebe1c75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:32.717111 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e271a-7b39-48ce-9dcc-3a48ebe1c75e None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:32.717497 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e271a-7b39-48ce-9dcc-3a48ebe1c75e None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:32.717879 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e271a-7b39-48ce-9dcc-3a48ebe1c75e None admin] PATH_INFO: `/v3/domains` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:32.718752 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e271a-7b39-48ce-9dcc-3a48ebe1c75e None admin] RBAC: Adding query filter params (name=Default) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:32.719157 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e271a-7b39-48ce-9dcc-3a48ebe1c75e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:32.720637 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e271a-7b39-48ce-9dcc-3a48ebe1c75e None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:32.728117 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba4d1b-922a-4eee-bc0d-2d7c8d454e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:32.729684 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba4d1b-922a-4eee-bc0d-2d7c8d454e5b None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:32.732211 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba4d1b-922a-4eee-bc0d-2d7c8d454e5b None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:32.732653 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba4d1b-922a-4eee-bc0d-2d7c8d454e5b None admin] PATH_INFO: `/v3/roles` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:32.733561 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba4d1b-922a-4eee-bc0d-2d7c8d454e5b None admin] RBAC: Adding query filter params (name=service) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:32.737211 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba4d1b-922a-4eee-bc0d-2d7c8d454e5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:32.738829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba4d1b-922a-4eee-bc0d-2d7c8d454e5b None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:32.749562 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 278/550] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:08:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:32.756061 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e271a-7b39-48ce-9dcc-3a48ebe1c75e None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:32.760695 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 273/551] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:08:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:32.768695 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba4d1b-922a-4eee-bc0d-2d7c8d454e5b None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:32.849934 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:32.912974 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba4d1b-922a-4eee-bc0d-2d7c8d454e5b None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:32.952910 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460c8ec-a102-4b6d-b61f-e7175667dba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:32.955209 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460c8ec-a102-4b6d-b61f-e7175667dba2 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:32.956542 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460c8ec-a102-4b6d-b61f-e7175667dba2 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:32.957122 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460c8ec-a102-4b6d-b61f-e7175667dba2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:32.970355 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:32.973750 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e271a-7b39-48ce-9dcc-3a48ebe1c75e None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:32.986305 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3460c8ec-a102-4b6d-b61f-e7175667dba2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:32.988024 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3460c8ec-a102-4b6d-b61f-e7175667dba2 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:33.018287 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-3460c8ec-a102-4b6d-b61f-e7175667dba2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:33.018287 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:33.018287 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:33.018287 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:33.018287 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:33.018287 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:33.018287 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:33.018287 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:33.018287 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:33.018287 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:33.018287 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:33.018287 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:33.018287 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:08:33.018287 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:08:33.018287 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:08:33.019437 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:08:33.019437 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:33.019437 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:33.019437 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:33.019437 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:33.019437 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:33.019437 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:33.019437 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:33.019437 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:33.019437 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:33.019437 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:33.019437 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:33.019437 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:33.019437 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:33.019437 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:33.019437 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:33.019437 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:33.020531 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:08:33.020531 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:08:33.020531 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:33.020531 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:33.027532 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 274/552] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:33.033650 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460c8ec-a102-4b6d-b61f-e7175667dba2 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:33.049227 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5f446-9c91-422d-93b2-4ff805bb09fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:33.050698 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5f446-9c91-422d-93b2-4ff805bb09fc None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:33.051188 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5f446-9c91-422d-93b2-4ff805bb09fc None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:33.051613 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5f446-9c91-422d-93b2-4ff805bb09fc None admin] PATH_INFO: `/v3/users/swift` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:33.064922 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa5f446-9c91-422d-93b2-4ff805bb09fc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:33.068165 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa5f446-9c91-422d-93b2-4ff805bb09fc None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:33.095198 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-bfa5f446-9c91-422d-93b2-4ff805bb09fc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 21:08:33.095198 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:33.095198 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:33.095198 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:33.095198 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:33.095198 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:33.095198 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:33.095198 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:33.095198 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:33.095198 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:33.095198 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:33.095198 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:33.095198 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:08:33.095198 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:08:33.095198 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:08:33.095198 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:08:33.096281 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:33.096281 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:33.096281 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:08:33.096281 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:08:33.096281 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:08:33.096281 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:08:33.096281 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:33.096281 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:33.096281 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:33.096281 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:33.096281 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:33.096281 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:33.096281 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:33.096281 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:33.096281 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:33.096281 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:33.096281 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:33.096281 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:33.097217 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:33.097217 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:33.097217 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:08:33.097217 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:08:33.097217 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:08:33.097217 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:08:33.097217 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:08:33.097217 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:08:33.097217 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 21:08:33.097217 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:33.102368 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 279/553] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:08:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:33.108989 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5f446-9c91-422d-93b2-4ff805bb09fc None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:33.172058 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:33.178408 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460c8ec-a102-4b6d-b61f-e7175667dba2 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:33.215155 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2aa0a5-d584-4fb5-824e-ad375560c3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:33.215834 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2aa0a5-d584-4fb5-824e-ad375560c3ea None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:33.216124 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2aa0a5-d584-4fb5-824e-ad375560c3ea None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:33.216418 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2aa0a5-d584-4fb5-824e-ad375560c3ea None admin] PATH_INFO: `/v3/domains` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:33.217136 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2aa0a5-d584-4fb5-824e-ad375560c3ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:33.217450 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2aa0a5-d584-4fb5-824e-ad375560c3ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:33.218872 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2aa0a5-d584-4fb5-824e-ad375560c3ea None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:33.232358 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 275/554] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:08:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:33.233776 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df23df8-ccc4-4994-ba84-bd5fe30d5682 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:33.234073 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df23df8-ccc4-4994-ba84-bd5fe30d5682 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:33.234407 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df23df8-ccc4-4994-ba84-bd5fe30d5682 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:33.240109 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 276/555] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:33.240938 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df23df8-ccc4-4994-ba84-bd5fe30d5682 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:33.272227 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5f446-9c91-422d-93b2-4ff805bb09fc None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:33.318691 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0e9f6-193b-41bf-ae76-21165c86f57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:33.320024 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0e9f6-193b-41bf-ae76-21165c86f57e None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:33.320705 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0e9f6-193b-41bf-ae76-21165c86f57e None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:33.321135 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0e9f6-193b-41bf-ae76-21165c86f57e None admin] PATH_INFO: `/v3/users` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:33.322752 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0e9f6-193b-41bf-ae76-21165c86f57e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:33.323228 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0e9f6-193b-41bf-ae76-21165c86f57e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:33.325678 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0e9f6-193b-41bf-ae76-21165c86f57e None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:33.354244 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 280/556] 10.222.0.30 () {56 vars in 1135 bytes} [Tue Jul 5 21:08:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:08:33.355464 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ec861-6579-418c-a201-2cbbfb7153e4 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:33.355994 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ec861-6579-418c-a201-2cbbfb7153e4 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:33.356279 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ec861-6579-418c-a201-2cbbfb7153e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:33.370229 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df23df8-ccc4-4994-ba84-bd5fe30d5682 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:33.378728 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-6b0ec861-6579-418c-a201-2cbbfb7153e4 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:33.380197 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-6b0ec861-6579-418c-a201-2cbbfb7153e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:33.399681 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:33.410073 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f306bf2-0694-407d-8eea-721ad3ea314d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:33.410844 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f306bf2-0694-407d-8eea-721ad3ea314d None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:33.412046 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f306bf2-0694-407d-8eea-721ad3ea314d None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:33.412046 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f306bf2-0694-407d-8eea-721ad3ea314d None admin] PATH_INFO: `/v3/users/nova` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:33.420462 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f306bf2-0694-407d-8eea-721ad3ea314d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:33.422291 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f306bf2-0694-407d-8eea-721ad3ea314d None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:33.439223 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-3f306bf2-0694-407d-8eea-721ad3ea314d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:08:33.439223 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:33.439223 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:33.439223 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:33.439223 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:33.439223 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:33.439223 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:33.439223 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:33.439223 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:33.439223 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:33.439223 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:33.439223 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:33.439223 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:08:33.439223 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:08:33.439223 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:08:33.439223 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:08:33.440852 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:33.440852 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:33.440852 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:08:33.440852 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:08:33.440852 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:08:33.440852 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:08:33.440852 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:33.440852 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:33.440852 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:33.440852 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:33.440852 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:33.440852 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:33.440852 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:33.440852 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:33.440852 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:33.440852 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:33.440852 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:33.440852 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:33.442039 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:33.442039 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:33.442039 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:08:33.442039 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:08:33.442039 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:08:33.442039 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:08:33.442039 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:08:33.442039 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:08:33.442039 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:08:33.442039 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:33.444742 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 277/557] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Jul 5 21:08:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:33.445914 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f306bf2-0694-407d-8eea-721ad3ea314d None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:33.466875 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:33.474159 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 281/558] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:08:33.474159 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ec861-6579-418c-a201-2cbbfb7153e4 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:33.582173 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f306bf2-0694-407d-8eea-721ad3ea314d None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:33.602625 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ec861-6579-418c-a201-2cbbfb7153e4 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:33.618748 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6aee84-bce6-4602-9b0a-5e8c66e9c178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:33.619855 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6aee84-bce6-4602-9b0a-5e8c66e9c178 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:33.620149 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6aee84-bce6-4602-9b0a-5e8c66e9c178 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:33.620435 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6aee84-bce6-4602-9b0a-5e8c66e9c178 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:33.640229 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ef4fd-391f-4dee-be53-9b04c479d443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:33.640912 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ef4fd-391f-4dee-be53-9b04c479d443 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:33.641202 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ef4fd-391f-4dee-be53-9b04c479d443 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:33.641479 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ef4fd-391f-4dee-be53-9b04c479d443 None admin] PATH_INFO: `/v3/users` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:33.642355 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ef4fd-391f-4dee-be53-9b04c479d443 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:33.642671 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ef4fd-391f-4dee-be53-9b04c479d443 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:33.644113 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ef4fd-391f-4dee-be53-9b04c479d443 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:33.668135 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 282/559] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Jul 5 21:08:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:33.668135 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ef4fd-391f-4dee-be53-9b04c479d443 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:33.678290 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:33.691426 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6aee84-bce6-4602-9b0a-5e8c66e9c178 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:33.692891 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6aee84-bce6-4602-9b0a-5e8c66e9c178 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:33.711253 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:33.775691 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ef4fd-391f-4dee-be53-9b04c479d443 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:33.802741 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 278/560] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:08:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:08:33.802741 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcf3f0-3ad1-411c-b9e5-3b343c57bf0c None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:33.802741 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcf3f0-3ad1-411c-b9e5-3b343c57bf0c None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:33.802741 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcf3f0-3ad1-411c-b9e5-3b343c57bf0c None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:33.802741 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 279/561] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:33.802741 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dcf3f0-3ad1-411c-b9e5-3b343c57bf0c None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:33.820149 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693d43a-ca8f-4418-bd2d-cd3bafec5c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:33.820957 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693d43a-ca8f-4418-bd2d-cd3bafec5c8c None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:33.821285 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693d43a-ca8f-4418-bd2d-cd3bafec5c8c None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:33.821557 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693d43a-ca8f-4418-bd2d-cd3bafec5c8c None admin] PATH_INFO: `/v3/roles/service` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:33.832539 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c693d43a-ca8f-4418-bd2d-cd3bafec5c8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:08:33.842119 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-c693d43a-ca8f-4418-bd2d-cd3bafec5c8c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:08:33.842119 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:33.842119 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:33.842119 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:33.842119 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:33.842119 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:33.842119 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:33.842119 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:33.842119 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:33.842119 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:33.842119 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:33.842119 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:33.842119 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:08:33.842119 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:08:33.842119 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:08:33.842119 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:08:33.846544 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:08:33.846544 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:08:33.846544 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:08:33.846544 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:08:33.846544 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:33.846544 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:33.846544 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:33.846544 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:33.846544 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:33.846544 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:33.846544 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:33.846544 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:33.846544 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:33.846544 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:33.846544 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:33.846544 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:33.847454 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:33.847454 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:33.847454 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:33.847454 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:33.847454 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:08:33.847454 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:08:33.847454 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:08:33.847454 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:08:33.847454 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:08:33.847454 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:08:33.847454 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:08:33.847454 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:33.848635 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 283/562] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:08:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:33.849529 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693d43a-ca8f-4418-bd2d-cd3bafec5c8c None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:33.913194 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dcf3f0-3ad1-411c-b9e5-3b343c57bf0c None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:33.927038 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:33.932646 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:33.950283 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9937568d-e733-4d60-bf2e-56edfaab9184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:33.951094 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937568d-e733-4d60-bf2e-56edfaab9184 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:33.951384 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937568d-e733-4d60-bf2e-56edfaab9184 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:33.951662 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937568d-e733-4d60-bf2e-56edfaab9184 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:33.961997 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9937568d-e733-4d60-bf2e-56edfaab9184 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:33.963756 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9937568d-e733-4d60-bf2e-56edfaab9184 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:33.965345 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693d43a-ca8f-4418-bd2d-cd3bafec5c8c None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:33.984219 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-9937568d-e733-4d60-bf2e-56edfaab9184 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:33.984219 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:33.984219 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:33.984219 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:33.984219 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:33.984219 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:33.984219 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:33.984219 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:33.984219 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:33.984219 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:33.984219 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:33.984219 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:33.984219 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:08:33.984219 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:08:33.984219 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:08:33.985171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:08:33.985171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:33.985171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:33.985171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:33.985171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:33.985171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:33.985171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:33.985171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:33.985171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:33.985171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:33.985171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:33.985171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:33.985171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:33.985171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:33.985171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:33.985171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:33.985171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:33.986060 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:08:33.986060 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:08:33.986060 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:33.986060 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:33.990740 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 280/563] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:33.992059 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf5a13-6f9c-4792-80f8-b552e3045900 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:33.992349 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf5a13-6f9c-4792-80f8-b552e3045900 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:33.992630 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf5a13-6f9c-4792-80f8-b552e3045900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:34.002017 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe479b-66a9-48b8-b8e0-b9a18e9781a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:34.002917 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe479b-66a9-48b8-b8e0-b9a18e9781a1 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:34.003200 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe479b-66a9-48b8-b8e0-b9a18e9781a1 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:34.003475 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe479b-66a9-48b8-b8e0-b9a18e9781a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:34.009191 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-aedf5a13-6f9c-4792-80f8-b552e3045900 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:34.010438 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-aedf5a13-6f9c-4792-80f8-b552e3045900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:34.015369 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe479b-66a9-48b8-b8e0-b9a18e9781a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:34.016826 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe479b-66a9-48b8-b8e0-b9a18e9781a1 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:34.035026 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-4bfe479b-66a9-48b8-b8e0-b9a18e9781a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:34.035026 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:34.035026 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:34.035026 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:34.035026 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:34.035026 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:34.035026 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:34.035026 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:34.035026 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:34.035026 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:34.035026 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:34.035026 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:34.035026 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:08:34.035026 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:08:34.035026 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:08:34.035983 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:08:34.035983 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:34.035983 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:34.035983 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:34.035983 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:34.035983 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:34.035983 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:34.035983 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:34.035983 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:34.035983 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:34.035983 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:34.035983 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:34.035983 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:34.035983 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:34.035983 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:34.035983 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:34.035983 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:34.036867 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:08:34.036867 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:08:34.036867 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:34.036867 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:34.036867 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 284/564] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:34.036867 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe479b-66a9-48b8-b8e0-b9a18e9781a1 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:34.088743 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 281/565] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:08:34.089605 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf5a13-6f9c-4792-80f8-b552e3045900 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:34.143546 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe479b-66a9-48b8-b8e0-b9a18e9781a1 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:34.160842 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:34.177124 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5a495-e708-4e2a-8df4-869dc9925a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:34.177728 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5a495-e708-4e2a-8df4-869dc9925a49 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:34.178016 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5a495-e708-4e2a-8df4-869dc9925a49 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:34.178324 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5a495-e708-4e2a-8df4-869dc9925a49 None admin] PATH_INFO: `/v3/roles` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:34.179071 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5a495-e708-4e2a-8df4-869dc9925a49 None admin] RBAC: Adding query filter params (name=service) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:34.179382 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5a495-e708-4e2a-8df4-869dc9925a49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:34.180833 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5a495-e708-4e2a-8df4-869dc9925a49 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:34.189419 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 285/566] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:08:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:34.190225 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5a495-e708-4e2a-8df4-869dc9925a49 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:34.194386 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:34.196565 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf5a13-6f9c-4792-80f8-b552e3045900 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:34.231234 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530630a-00aa-4609-9182-41ca7afc521c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:34.231909 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530630a-00aa-4609-9182-41ca7afc521c None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:34.232198 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530630a-00aa-4609-9182-41ca7afc521c None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:34.232480 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530630a-00aa-4609-9182-41ca7afc521c None admin] PATH_INFO: `/v3/domains` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:34.233201 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4530630a-00aa-4609-9182-41ca7afc521c None admin] RBAC: Adding query filter params (name=Default) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:34.233518 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4530630a-00aa-4609-9182-41ca7afc521c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:34.234922 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4530630a-00aa-4609-9182-41ca7afc521c None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:34.246289 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 282/567] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:08:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:34.247549 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f7362-03bb-4108-bf9f-a64172d71518 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:34.247842 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f7362-03bb-4108-bf9f-a64172d71518 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:34.248128 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f7362-03bb-4108-bf9f-a64172d71518 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:34.249508 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 283/568] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:34.250029 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f7362-03bb-4108-bf9f-a64172d71518 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:34.296320 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5a495-e708-4e2a-8df4-869dc9925a49 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:34.332184 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c748c-d0ba-4308-a3fb-be0380664b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:34.332849 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c748c-d0ba-4308-a3fb-be0380664b5d None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:34.333136 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c748c-d0ba-4308-a3fb-be0380664b5d None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:34.333411 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c748c-d0ba-4308-a3fb-be0380664b5d None admin] PATH_INFO: `/v3/domains` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:34.334141 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c748c-d0ba-4308-a3fb-be0380664b5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:34.334459 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c748c-d0ba-4308-a3fb-be0380664b5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:34.335857 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c748c-d0ba-4308-a3fb-be0380664b5d None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:34.347830 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 286/569] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:08:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:34.348615 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c748c-d0ba-4308-a3fb-be0380664b5d None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:34.353125 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f7362-03bb-4108-bf9f-a64172d71518 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:34.387978 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8195e-ce88-49b0-a0c6-ce16c6d07a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:34.388777 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8195e-ce88-49b0-a0c6-ce16c6d07a75 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:34.389064 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8195e-ce88-49b0-a0c6-ce16c6d07a75 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:34.389341 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8195e-ce88-49b0-a0c6-ce16c6d07a75 None admin] PATH_INFO: `/v3/roles/service` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:34.390222 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:34.399914 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c8195e-ce88-49b0-a0c6-ce16c6d07a75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:08:34.408185 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-84c8195e-ce88-49b0-a0c6-ce16c6d07a75 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:08:34.408185 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:34.408185 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:34.408185 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:34.408185 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:34.408185 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:34.408185 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:34.408185 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:34.408185 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:34.408185 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:34.408185 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:34.408185 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:34.408185 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:08:34.408185 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:08:34.408185 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:08:34.408185 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:08:34.415168 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:08:34.415168 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:08:34.415168 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:08:34.415168 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:08:34.415168 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:34.415168 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:34.415168 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:34.415168 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:34.415168 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:34.415168 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:34.415168 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:34.415168 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:34.415168 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:34.415168 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:34.415168 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:34.415168 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:34.417167 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:34.417167 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:34.417167 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:34.417167 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:34.417167 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:08:34.417167 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:08:34.417167 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:08:34.417167 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:08:34.417167 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:08:34.417167 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:08:34.417167 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:08:34.417167 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:34.417167 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 284/570] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:08:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:34.417167 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8195e-ce88-49b0-a0c6-ce16c6d07a75 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:34.434335 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:34.448043 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c748c-d0ba-4308-a3fb-be0380664b5d None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:34.481442 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81bc9e9-bd01-4ecc-b467-7ca757995ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:34.482269 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bc9e9-bd01-4ecc-b467-7ca757995ac4 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:34.482557 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bc9e9-bd01-4ecc-b467-7ca757995ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:34.482838 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bc9e9-bd01-4ecc-b467-7ca757995ac4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:34.493128 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81bc9e9-bd01-4ecc-b467-7ca757995ac4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:34.495165 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81bc9e9-bd01-4ecc-b467-7ca757995ac4 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:34.512426 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-e81bc9e9-bd01-4ecc-b467-7ca757995ac4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:34.512426 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:34.512426 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:34.512426 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:34.512426 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:34.512426 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:34.512426 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:34.512426 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:34.512426 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:34.512426 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:34.512426 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:34.512426 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:34.512426 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:08:34.512426 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:08:34.512426 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:08:34.513448 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:08:34.513448 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:34.513448 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:34.513448 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:34.513448 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:34.513448 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:34.513448 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:34.513448 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:34.513448 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:34.513448 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:34.513448 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:34.513448 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:34.513448 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:34.513448 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:34.513448 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:34.513448 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:34.513448 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:34.519126 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:08:34.519126 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:08:34.519126 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:34.519126 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:34.519126 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 287/571] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:34.519126 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d57d7-9557-416d-a517-1680cb7b87cc None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:34.519126 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d57d7-9557-416d-a517-1680cb7b87cc None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:34.519126 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d57d7-9557-416d-a517-1680cb7b87cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:34.519694 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8195e-ce88-49b0-a0c6-ce16c6d07a75 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:34.534759 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-392d57d7-9557-416d-a517-1680cb7b87cc None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:34.535942 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-392d57d7-9557-416d-a517-1680cb7b87cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:34.551795 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00ef43f-826b-4c78-b2a4-b48bf7cbb484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:34.552592 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ef43f-826b-4c78-b2a4-b48bf7cbb484 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:34.552878 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ef43f-826b-4c78-b2a4-b48bf7cbb484 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:34.553159 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ef43f-826b-4c78-b2a4-b48bf7cbb484 None admin] PATH_INFO: `/v3/projects/service` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:34.560280 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00ef43f-826b-4c78-b2a4-b48bf7cbb484 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:34.561714 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00ef43f-826b-4c78-b2a4-b48bf7cbb484 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:34.576529 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-d00ef43f-826b-4c78-b2a4-b48bf7cbb484 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:08:34.576529 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:34.576529 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:34.576529 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:34.576529 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:34.576529 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:34.576529 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:34.576529 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:34.576529 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:34.576529 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:34.576529 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:34.576529 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:34.576529 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:08:34.576529 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:08:34.576529 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:08:34.577592 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:08:34.577592 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:34.577592 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:34.577592 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:34.577592 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:34.577592 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:34.577592 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:34.577592 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:34.577592 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:34.577592 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:34.577592 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:34.577592 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:34.577592 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:34.577592 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:34.577592 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:34.577592 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:34.577592 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:34.578739 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:08:34.578739 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:08:34.578739 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:08:34.578739 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:08:34.578739 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:08:34.578739 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:08:34.578739 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:08:34.578739 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:34.578739 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 285/572] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:08:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:34.578739 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00ef43f-826b-4c78-b2a4-b48bf7cbb484 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:34.604808 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 288/573] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:08:34.605655 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d57d7-9557-416d-a517-1680cb7b87cc None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:34.638219 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:34.657134 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:34.678765 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00ef43f-826b-4c78-b2a4-b48bf7cbb484 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:34.712689 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d57d7-9557-416d-a517-1680cb7b87cc None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:34.713305 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632aa42c-c530-4fe3-8ef8-29cc2b235876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:34.714099 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632aa42c-c530-4fe3-8ef8-29cc2b235876 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:34.714414 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632aa42c-c530-4fe3-8ef8-29cc2b235876 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:34.714692 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632aa42c-c530-4fe3-8ef8-29cc2b235876 None admin] PATH_INFO: `/v3/projects/service` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:34.721277 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632aa42c-c530-4fe3-8ef8-29cc2b235876 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:34.722752 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632aa42c-c530-4fe3-8ef8-29cc2b235876 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:34.737341 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-632aa42c-c530-4fe3-8ef8-29cc2b235876 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:08:34.737341 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:34.737341 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:34.737341 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:34.737341 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:34.737341 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:34.737341 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:34.737341 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:34.737341 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:34.737341 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:34.737341 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:34.737341 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:34.737341 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:08:34.737341 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:08:34.737341 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:08:34.738484 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:08:34.738484 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:34.738484 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:34.738484 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:34.738484 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:34.738484 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:34.738484 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:34.738484 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:34.738484 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:34.738484 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:34.738484 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:34.738484 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:34.738484 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:34.738484 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:34.738484 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:34.738484 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:34.738484 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:34.739579 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:08:34.739579 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:08:34.739579 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:08:34.739579 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:08:34.739579 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:08:34.739579 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:08:34.739579 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:08:34.739579 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:34.739579 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 286/574] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:08:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:34.739579 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632aa42c-c530-4fe3-8ef8-29cc2b235876 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:34.749564 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b05e0-5a0a-4d51-bc5d-60f7540861a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:34.750333 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b05e0-5a0a-4d51-bc5d-60f7540861a1 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:34.750633 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b05e0-5a0a-4d51-bc5d-60f7540861a1 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:34.750897 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b05e0-5a0a-4d51-bc5d-60f7540861a1 None admin] PATH_INFO: `/v3/roles` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:34.751646 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b05e0-5a0a-4d51-bc5d-60f7540861a1 None admin] RBAC: Adding query filter params (name=service) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:34.751954 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b05e0-5a0a-4d51-bc5d-60f7540861a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:34.753327 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b05e0-5a0a-4d51-bc5d-60f7540861a1 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:34.761835 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 289/575] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:08:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:34.763188 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b05e0-5a0a-4d51-bc5d-60f7540861a1 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:34.839658 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632aa42c-c530-4fe3-8ef8-29cc2b235876 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:34.848214 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:34.865727 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b05e0-5a0a-4d51-bc5d-60f7540861a1 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:34.876387 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce044a4-1d7a-4f68-b551-cec13634b633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:34.877061 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce044a4-1d7a-4f68-b551-cec13634b633 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:34.877362 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce044a4-1d7a-4f68-b551-cec13634b633 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:34.877641 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce044a4-1d7a-4f68-b551-cec13634b633 None admin] PATH_INFO: `/v3/domains` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:34.878394 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce044a4-1d7a-4f68-b551-cec13634b633 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:34.878708 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce044a4-1d7a-4f68-b551-cec13634b633 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:34.880080 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce044a4-1d7a-4f68-b551-cec13634b633 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:34.887115 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:34.892213 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 287/576] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:08:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:34.893076 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce044a4-1d7a-4f68-b551-cec13634b633 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:34.906061 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c37bfa-f337-45b8-a55c-411ebf581a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:34.906755 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c37bfa-f337-45b8-a55c-411ebf581a9a None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:34.907041 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c37bfa-f337-45b8-a55c-411ebf581a9a None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:34.908239 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c37bfa-f337-45b8-a55c-411ebf581a9a None admin] PATH_INFO: `/v3/projects` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:34.908239 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c37bfa-f337-45b8-a55c-411ebf581a9a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:34.908406 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c37bfa-f337-45b8-a55c-411ebf581a9a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:34.909795 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c37bfa-f337-45b8-a55c-411ebf581a9a None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:34.922044 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 290/577] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:08:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:34.922790 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c37bfa-f337-45b8-a55c-411ebf581a9a None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:34.995981 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce044a4-1d7a-4f68-b551-cec13634b633 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:35.023963 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c37bfa-f337-45b8-a55c-411ebf581a9a None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:35.029648 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62233f5-3b22-4671-8ff2-6db7a708fc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:35.030482 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62233f5-3b22-4671-8ff2-6db7a708fc2b None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:35.030769 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62233f5-3b22-4671-8ff2-6db7a708fc2b None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:35.031048 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62233f5-3b22-4671-8ff2-6db7a708fc2b None admin] PATH_INFO: `/v3/roles/service` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:35.041524 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62233f5-3b22-4671-8ff2-6db7a708fc2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:08:35.049381 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-b62233f5-3b22-4671-8ff2-6db7a708fc2b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:08:35.049381 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:35.049381 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:35.049381 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:35.049381 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:35.049381 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:35.049381 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:35.049381 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:35.049381 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:35.049381 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:35.049381 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:35.049381 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:35.049381 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:08:35.049381 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:08:35.049381 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:08:35.049381 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:08:35.050406 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:08:35.050406 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:08:35.050406 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:08:35.050406 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:08:35.050406 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:35.050406 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:35.050406 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:35.050406 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:35.050406 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:35.050406 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:35.050406 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:35.050406 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:35.050406 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:35.050406 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:35.050406 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:35.050406 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:35.056426 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:35.056426 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:35.056426 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:35.056426 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:35.056426 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:08:35.056426 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:08:35.056426 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:08:35.056426 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:08:35.056426 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:08:35.056426 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:08:35.056426 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:08:35.056426 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:35.056426 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 288/578] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:08:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:35.056426 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62233f5-3b22-4671-8ff2-6db7a708fc2b None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:35.065755 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c3d4b-9fc3-4c07-a2ae-ca0f8b34138a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:35.066461 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c3d4b-9fc3-4c07-a2ae-ca0f8b34138a None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:35.066751 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c3d4b-9fc3-4c07-a2ae-ca0f8b34138a None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:35.067028 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c3d4b-9fc3-4c07-a2ae-ca0f8b34138a None admin] PATH_INFO: `/v3/projects` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:35.067817 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3c3d4b-9fc3-4c07-a2ae-ca0f8b34138a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:35.068131 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3c3d4b-9fc3-4c07-a2ae-ca0f8b34138a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:35.069560 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3c3d4b-9fc3-4c07-a2ae-ca0f8b34138a None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:35.081512 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 291/579] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:08:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:35.082547 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c3d4b-9fc3-4c07-a2ae-ca0f8b34138a None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:35.086040 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:35.115018 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:35.157678 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62233f5-3b22-4671-8ff2-6db7a708fc2b None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:35.183920 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c3d4b-9fc3-4c07-a2ae-ca0f8b34138a None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:35.191008 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae901d-4ccb-4beb-a07b-37f496ab7b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:35.191806 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae901d-4ccb-4beb-a07b-37f496ab7b70 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:35.192093 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae901d-4ccb-4beb-a07b-37f496ab7b70 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:35.192371 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae901d-4ccb-4beb-a07b-37f496ab7b70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:35.203971 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dae901d-4ccb-4beb-a07b-37f496ab7b70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:35.205427 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dae901d-4ccb-4beb-a07b-37f496ab7b70 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:35.217603 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78435b53-92fa-439d-a6e2-fd4a2381f4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:35.218499 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78435b53-92fa-439d-a6e2-fd4a2381f4a7 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:35.218789 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78435b53-92fa-439d-a6e2-fd4a2381f4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:35.219069 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78435b53-92fa-439d-a6e2-fd4a2381f4a7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:35.222645 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-3dae901d-4ccb-4beb-a07b-37f496ab7b70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:35.222645 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:35.222645 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:35.222645 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:35.222645 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:35.222645 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:35.222645 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:35.222645 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:35.222645 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:35.222645 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:35.222645 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:35.222645 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:35.222645 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:08:35.222645 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:08:35.222645 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:08:35.223695 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:08:35.223695 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:35.223695 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:35.223695 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:35.223695 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:35.223695 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:35.223695 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:35.223695 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:35.223695 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:35.223695 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:35.223695 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:35.223695 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:35.223695 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:35.223695 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:35.223695 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:35.223695 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:35.223695 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:35.225008 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:08:35.225008 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:08:35.225008 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:35.225008 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:35.225008 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 289/580] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:35.225008 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae901d-4ccb-4beb-a07b-37f496ab7b70 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:35.226359 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78435b53-92fa-439d-a6e2-fd4a2381f4a7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:35.227789 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78435b53-92fa-439d-a6e2-fd4a2381f4a7 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:35.243295 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-78435b53-92fa-439d-a6e2-fd4a2381f4a7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 05 21:08:35.243295 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:35.243295 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:35.243295 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:35.243295 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:35.243295 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:35.243295 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:35.243295 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:35.243295 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:35.243295 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:35.243295 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:35.243295 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:35.243295 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:08:35.243295 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:08:35.243295 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:08:35.243295 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:08:35.245041 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:35.245041 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:35.245041 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:08:35.245041 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:08:35.245041 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:08:35.245041 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:08:35.245041 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:35.245041 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:35.245041 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:35.245041 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:35.245041 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:35.245041 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:35.245041 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:35.245041 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:35.245041 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:35.245041 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:35.245041 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:35.245041 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:35.246546 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:35.246546 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:35.246546 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:08:35.246546 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:08:35.246546 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:08:35.246546 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:08:35.246546 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:08:35.246546 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:08:35.246546 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 05 21:08:35.246546 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:35.246546 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 292/581] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:08:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:35.246546 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78435b53-92fa-439d-a6e2-fd4a2381f4a7 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:35.313028 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:35.330373 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae901d-4ccb-4beb-a07b-37f496ab7b70 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:35.340390 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:35.352080 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78435b53-92fa-439d-a6e2-fd4a2381f4a7 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:35.363081 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b57580-d21e-4120-8431-7d7ac082d510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:35.363970 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b57580-d21e-4120-8431-7d7ac082d510 None admin] REQUEST_METHOD: `PUT` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:35.364264 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b57580-d21e-4120-8431-7d7ac082d510 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:35.364541 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b57580-d21e-4120-8431-7d7ac082d510 None admin] PATH_INFO: `/v3/projects/ccd95a48530c4c86a3774301b969d6a9/users/be0701b0a7ff479e8b3214afaf618acd/roles/601a166d56f647bda8256e971450cfdf` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:35.379762 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b57580-d21e-4120-8431-7d7ac082d510 None admin] RBAC: Authorizing `identity:create_grant(project_id=ccd95a48530c4c86a3774301b969d6a9, user_id=be0701b0a7ff479e8b3214afaf618acd, role_id=601a166d56f647bda8256e971450cfdf)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:35.381225 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b57580-d21e-4120-8431-7d7ac082d510 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:35.385457 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25624473-517e-41bd-a234-bb94243fb86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:35.386141 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25624473-517e-41bd-a234-bb94243fb86e None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:35.386442 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25624473-517e-41bd-a234-bb94243fb86e None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:35.386720 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25624473-517e-41bd-a234-bb94243fb86e None admin] PATH_INFO: `/v3/roles` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:35.387462 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25624473-517e-41bd-a234-bb94243fb86e None admin] RBAC: Adding query filter params (name=service) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:35.387773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25624473-517e-41bd-a234-bb94243fb86e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:35.389122 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25624473-517e-41bd-a234-bb94243fb86e None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:35.396859 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 293/582] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:08:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:35.397628 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25624473-517e-41bd-a234-bb94243fb86e None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:35.445216 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 290/583] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:08:35 2022] PUT /identity/v3/projects/ccd95a48530c4c86a3774301b969d6a9/users/be0701b0a7ff479e8b3214afaf618acd/roles/601a166d56f647bda8256e971450cfdf => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:08:35.458600 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b57580-d21e-4120-8431-7d7ac082d510 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:35.510901 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25624473-517e-41bd-a234-bb94243fb86e None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:35.542116 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:35.552517 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef21d6f-2e93-4196-aeea-e8070491826d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:35.553519 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef21d6f-2e93-4196-aeea-e8070491826d None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:35.553519 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef21d6f-2e93-4196-aeea-e8070491826d None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:35.553763 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef21d6f-2e93-4196-aeea-e8070491826d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:35.554663 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef21d6f-2e93-4196-aeea-e8070491826d None admin] RBAC: Adding query filter params (role.id=601a166d56f647bda8256e971450cfdf, scope.project.id=ccd95a48530c4c86a3774301b969d6a9, user.id=e6761d76cc1d48579c7fda6125900648) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:35.554989 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef21d6f-2e93-4196-aeea-e8070491826d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:35.557241 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef21d6f-2e93-4196-aeea-e8070491826d None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:35.563547 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 294/584] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:08:35 2022] GET /identity/v3/role_assignments?user.id=e6761d76cc1d48579c7fda6125900648&scope.project.id=ccd95a48530c4c86a3774301b969d6a9&role.id=601a166d56f647bda8256e971450cfdf => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:35.575238 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef21d6f-2e93-4196-aeea-e8070491826d None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:35.587585 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b57580-d21e-4120-8431-7d7ac082d510 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:35.641714 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e58c3-389a-4c7f-80d9-a9774e7c3866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:35.642488 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e58c3-389a-4c7f-80d9-a9774e7c3866 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:35.642778 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e58c3-389a-4c7f-80d9-a9774e7c3866 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:35.643051 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e58c3-389a-4c7f-80d9-a9774e7c3866 None admin] PATH_INFO: `/v3/domains` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:35.643941 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e58c3-389a-4c7f-80d9-a9774e7c3866 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:35.644230 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e58c3-389a-4c7f-80d9-a9774e7c3866 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:35.645780 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e58c3-389a-4c7f-80d9-a9774e7c3866 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:35.660460 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 291/585] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:08:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:35.661339 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e58c3-389a-4c7f-80d9-a9774e7c3866 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:35.698313 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:35.714864 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef21d6f-2e93-4196-aeea-e8070491826d None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:35.761908 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798674cc-669e-48e1-8c5a-0a67bd8b933c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:35.763326 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798674cc-669e-48e1-8c5a-0a67bd8b933c None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:35.763623 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798674cc-669e-48e1-8c5a-0a67bd8b933c None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:35.763910 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798674cc-669e-48e1-8c5a-0a67bd8b933c None admin] PATH_INFO: `/v3/users` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:35.764769 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798674cc-669e-48e1-8c5a-0a67bd8b933c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:35.765090 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798674cc-669e-48e1-8c5a-0a67bd8b933c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:35.766576 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798674cc-669e-48e1-8c5a-0a67bd8b933c None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:35.790727 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 295/586] 10.222.0.30 () {56 vars in 1137 bytes} [Tue Jul 5 21:08:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:35.792450 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798674cc-669e-48e1-8c5a-0a67bd8b933c None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:35.798276 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e58c3-389a-4c7f-80d9-a9774e7c3866 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:35.841371 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4056c7f5-44ec-472d-8032-53133258d81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:35.842240 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056c7f5-44ec-472d-8032-53133258d81e None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:35.842531 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056c7f5-44ec-472d-8032-53133258d81e None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:35.843354 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056c7f5-44ec-472d-8032-53133258d81e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:35.853896 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:35.858054 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4056c7f5-44ec-472d-8032-53133258d81e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:35.860441 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4056c7f5-44ec-472d-8032-53133258d81e None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:35.879752 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-4056c7f5-44ec-472d-8032-53133258d81e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:35.879752 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:35.879752 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:35.879752 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:35.879752 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:35.879752 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:35.879752 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:35.879752 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:35.879752 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:35.879752 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:35.879752 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:35.879752 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:35.879752 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:08:35.879752 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:08:35.879752 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:08:35.880890 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:08:35.880890 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:35.880890 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:35.880890 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:35.880890 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:35.880890 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:35.880890 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:35.880890 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:35.880890 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:35.880890 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:35.880890 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:35.880890 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:35.880890 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:35.880890 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:35.880890 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:35.880890 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:35.880890 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:35.882098 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:08:35.882098 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:08:35.882098 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:35.882098 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:35.885673 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 292/587] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:35.886667 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4056c7f5-44ec-472d-8032-53133258d81e None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:35.923496 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798674cc-669e-48e1-8c5a-0a67bd8b933c None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:35.970721 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40386b19-08d5-4352-ab13-a2a39d09e3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:35.971967 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40386b19-08d5-4352-ab13-a2a39d09e3cd None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:35.972559 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40386b19-08d5-4352-ab13-a2a39d09e3cd None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:35.973011 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40386b19-08d5-4352-ab13-a2a39d09e3cd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:35.974493 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:35.983923 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40386b19-08d5-4352-ab13-a2a39d09e3cd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:35.986339 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40386b19-08d5-4352-ab13-a2a39d09e3cd None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:35.993485 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4056c7f5-44ec-472d-8032-53133258d81e None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:36.005686 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-40386b19-08d5-4352-ab13-a2a39d09e3cd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 21:08:36.005686 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:36.005686 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:36.005686 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:36.005686 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:36.005686 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:36.005686 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:36.005686 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:36.005686 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:36.005686 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:36.005686 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:36.005686 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:36.005686 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:08:36.005686 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:08:36.005686 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:08:36.005686 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:08:36.006729 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:36.006729 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:36.006729 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:08:36.006729 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:08:36.006729 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:08:36.006729 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:08:36.006729 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:36.006729 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:36.006729 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:36.006729 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:36.006729 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:36.006729 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:36.006729 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:36.006729 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:36.006729 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:36.006729 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:36.006729 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:36.006729 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:36.007720 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:36.007720 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:36.007720 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:08:36.007720 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:08:36.007720 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:08:36.007720 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:08:36.007720 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:08:36.007720 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:08:36.007720 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 21:08:36.007720 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:36.010285 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 296/588] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:08:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:36.011341 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40386b19-08d5-4352-ab13-a2a39d09e3cd None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:36.033995 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e4302-7425-4f24-b5eb-c77396393e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:36.035453 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e4302-7425-4f24-b5eb-c77396393e14 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:36.035932 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e4302-7425-4f24-b5eb-c77396393e14 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:36.036393 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e4302-7425-4f24-b5eb-c77396393e14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:36.048475 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e4302-7425-4f24-b5eb-c77396393e14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:36.050274 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e4302-7425-4f24-b5eb-c77396393e14 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:36.068845 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-f55e4302-7425-4f24-b5eb-c77396393e14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:36.068845 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:36.068845 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:36.068845 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:36.068845 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:36.068845 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:36.068845 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:36.068845 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:36.068845 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:36.068845 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:36.068845 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:36.068845 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:36.068845 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:08:36.068845 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:08:36.068845 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:08:36.069780 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:08:36.069780 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:36.069780 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:36.069780 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:36.069780 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:36.069780 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:36.069780 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:36.069780 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:36.069780 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:36.069780 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:36.069780 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:36.069780 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:36.069780 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:36.069780 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:36.069780 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:36.069780 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:36.069780 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:36.070819 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:08:36.070819 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:08:36.070819 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:36.070819 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:36.073142 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 293/589] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:36.074155 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e4302-7425-4f24-b5eb-c77396393e14 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:36.142177 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40386b19-08d5-4352-ab13-a2a39d09e3cd None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:36.153704 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:36.183251 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b80d5a9-9adf-48dd-9c8b-0de93aac1573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:36.184256 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80d5a9-9adf-48dd-9c8b-0de93aac1573 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:36.185178 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80d5a9-9adf-48dd-9c8b-0de93aac1573 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:36.185661 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80d5a9-9adf-48dd-9c8b-0de93aac1573 None admin] PATH_INFO: `/v3/domains` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:36.186653 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b80d5a9-9adf-48dd-9c8b-0de93aac1573 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:36.187206 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b80d5a9-9adf-48dd-9c8b-0de93aac1573 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:36.189123 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e4302-7425-4f24-b5eb-c77396393e14 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:36.189691 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b80d5a9-9adf-48dd-9c8b-0de93aac1573 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:36.208676 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 297/590] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:08:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:36.208676 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b80d5a9-9adf-48dd-9c8b-0de93aac1573 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:36.223629 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:36.236545 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1759bc89-d481-4ccd-b8a1-6aa6f0c01aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:36.237556 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759bc89-d481-4ccd-b8a1-6aa6f0c01aaa None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:36.238060 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759bc89-d481-4ccd-b8a1-6aa6f0c01aaa None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:36.239290 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759bc89-d481-4ccd-b8a1-6aa6f0c01aaa None admin] PATH_INFO: `/v3/users` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:36.239753 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1759bc89-d481-4ccd-b8a1-6aa6f0c01aaa None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:36.240284 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1759bc89-d481-4ccd-b8a1-6aa6f0c01aaa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:36.241990 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1759bc89-d481-4ccd-b8a1-6aa6f0c01aaa None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:36.262679 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 294/591] 10.222.0.30 () {56 vars in 1137 bytes} [Tue Jul 5 21:08:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:36.263882 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1759bc89-d481-4ccd-b8a1-6aa6f0c01aaa None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:36.319850 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b80d5a9-9adf-48dd-9c8b-0de93aac1573 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:36.355329 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4091cde0-d136-4cf2-9e61-df02e0e1570d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:36.356065 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4091cde0-d136-4cf2-9e61-df02e0e1570d None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:36.356274 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4091cde0-d136-4cf2-9e61-df02e0e1570d None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:36.356544 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4091cde0-d136-4cf2-9e61-df02e0e1570d None admin] PATH_INFO: `/v3/domains` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:36.357266 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4091cde0-d136-4cf2-9e61-df02e0e1570d None admin] RBAC: Adding query filter params (name=Default) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:36.357577 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4091cde0-d136-4cf2-9e61-df02e0e1570d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:36.359000 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4091cde0-d136-4cf2-9e61-df02e0e1570d None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:36.371617 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 298/592] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:08:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:36.372499 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4091cde0-d136-4cf2-9e61-df02e0e1570d None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:36.382411 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1759bc89-d481-4ccd-b8a1-6aa6f0c01aaa None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:36.402281 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:36.419963 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d4b88-9168-4954-bcbb-99f4f1c8711a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:36.421156 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d4b88-9168-4954-bcbb-99f4f1c8711a None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:36.421645 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d4b88-9168-4954-bcbb-99f4f1c8711a None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:36.422123 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d4b88-9168-4954-bcbb-99f4f1c8711a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:36.429894 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5d4b88-9168-4954-bcbb-99f4f1c8711a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:36.431700 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5d4b88-9168-4954-bcbb-99f4f1c8711a None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:36.448829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-0d5d4b88-9168-4954-bcbb-99f4f1c8711a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 21:08:36.448829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:36.448829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:36.448829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:36.448829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:36.448829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:36.448829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:36.448829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:36.448829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:36.448829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:36.448829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:36.448829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:36.448829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:08:36.448829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:08:36.448829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:08:36.448829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:08:36.449788 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:36.449788 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:36.449788 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:08:36.449788 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:08:36.449788 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:08:36.449788 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:08:36.449788 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:36.449788 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:36.449788 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:36.449788 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:36.449788 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:36.449788 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:36.449788 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:36.449788 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:36.449788 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:36.449788 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:36.449788 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:36.449788 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:36.450785 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:36.450785 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:36.450785 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:08:36.450785 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:08:36.450785 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:08:36.450785 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:08:36.450785 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:08:36.450785 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:08:36.450785 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 21:08:36.450785 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:36.457655 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 295/593] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:08:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:36.458755 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d4b88-9168-4954-bcbb-99f4f1c8711a None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:36.477143 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4091cde0-d136-4cf2-9e61-df02e0e1570d None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:36.504799 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:36.512469 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb128c-7a33-4f93-8b5e-2e8b96a08748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:36.513271 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb128c-7a33-4f93-8b5e-2e8b96a08748 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:36.513553 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb128c-7a33-4f93-8b5e-2e8b96a08748 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:36.513950 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb128c-7a33-4f93-8b5e-2e8b96a08748 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:36.524496 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb128c-7a33-4f93-8b5e-2e8b96a08748 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:36.526487 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb128c-7a33-4f93-8b5e-2e8b96a08748 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:36.547258 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-85cb128c-7a33-4f93-8b5e-2e8b96a08748 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:36.547258 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:36.547258 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:36.547258 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:36.547258 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:36.547258 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:36.547258 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:36.547258 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:36.547258 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:36.547258 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:36.547258 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:36.547258 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:36.547258 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:08:36.547258 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:08:36.547258 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:08:36.548250 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:08:36.548250 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:36.548250 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:36.548250 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:36.548250 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:36.548250 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:36.548250 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:36.548250 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:36.548250 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:36.548250 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:36.548250 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:36.548250 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:36.548250 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:36.548250 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:36.548250 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:36.548250 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:36.548250 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:36.549208 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:08:36.549208 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:08:36.549208 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:36.549208 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:36.552967 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 299/594] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:36.554233 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb128c-7a33-4f93-8b5e-2e8b96a08748 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:36.570975 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d4b88-9168-4954-bcbb-99f4f1c8711a None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:36.608782 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29c7ab-eacf-4333-beb0-f373ab4cdfef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:36.610413 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29c7ab-eacf-4333-beb0-f373ab4cdfef None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:36.610656 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29c7ab-eacf-4333-beb0-f373ab4cdfef None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:36.610936 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29c7ab-eacf-4333-beb0-f373ab4cdfef None admin] PATH_INFO: `/v3/projects/service` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:36.623739 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d29c7ab-eacf-4333-beb0-f373ab4cdfef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:36.626279 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d29c7ab-eacf-4333-beb0-f373ab4cdfef None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:36.646154 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:36.648721 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-6d29c7ab-eacf-4333-beb0-f373ab4cdfef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:08:36.648721 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:36.648721 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:36.648721 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:36.648721 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:36.648721 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:36.648721 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:36.648721 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:36.648721 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:36.648721 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:36.648721 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:36.648721 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:36.648721 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:08:36.648721 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:08:36.648721 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:08:36.649601 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:08:36.649601 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:36.649601 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:36.649601 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:36.649601 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:36.649601 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:36.649601 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:36.649601 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:36.649601 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:36.649601 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:36.649601 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:36.649601 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:36.649601 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:36.649601 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:36.649601 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:36.649601 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:36.649601 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:36.656889 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:08:36.656889 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:08:36.656889 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:08:36.656889 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:08:36.656889 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:08:36.656889 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:08:36.656889 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:08:36.656889 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:36.656889 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 296/595] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:08:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:36.656889 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29c7ab-eacf-4333-beb0-f373ab4cdfef None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:36.670295 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb128c-7a33-4f93-8b5e-2e8b96a08748 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:36.716147 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894749ef-247f-405f-8872-0e80a4d9b1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:36.717664 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894749ef-247f-405f-8872-0e80a4d9b1aa None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:36.718241 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894749ef-247f-405f-8872-0e80a4d9b1aa None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:36.718696 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894749ef-247f-405f-8872-0e80a4d9b1aa None admin] PATH_INFO: `/v3/users` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:36.719961 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894749ef-247f-405f-8872-0e80a4d9b1aa None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:36.720885 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894749ef-247f-405f-8872-0e80a4d9b1aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:36.722780 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894749ef-247f-405f-8872-0e80a4d9b1aa None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:36.753321 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 300/596] 10.222.0.30 () {56 vars in 1139 bytes} [Tue Jul 5 21:08:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:36.753321 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894749ef-247f-405f-8872-0e80a4d9b1aa None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:36.788804 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29c7ab-eacf-4333-beb0-f373ab4cdfef None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:36.790915 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:36.828624 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5de27c-d778-4796-964f-dce00568929a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:36.828624 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5de27c-d778-4796-964f-dce00568929a None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:36.828624 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5de27c-d778-4796-964f-dce00568929a None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:36.828624 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5de27c-d778-4796-964f-dce00568929a None admin] PATH_INFO: `/v3/domains` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:36.829068 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5de27c-d778-4796-964f-dce00568929a None admin] RBAC: Adding query filter params (name=Default) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:36.829068 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5de27c-d778-4796-964f-dce00568929a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:36.829477 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5de27c-d778-4796-964f-dce00568929a None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:36.846299 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 297/597] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:08:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:36.847804 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5de27c-d778-4796-964f-dce00568929a None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:36.886501 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894749ef-247f-405f-8872-0e80a4d9b1aa None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:36.928321 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4760025a-a74c-427f-9b69-6d61d33b0bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:36.928537 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4760025a-a74c-427f-9b69-6d61d33b0bf3 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:36.929284 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4760025a-a74c-427f-9b69-6d61d33b0bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:36.929284 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4760025a-a74c-427f-9b69-6d61d33b0bf3 None admin] PATH_INFO: `/v3/projects` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:36.930152 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4760025a-a74c-427f-9b69-6d61d33b0bf3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:36.930561 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4760025a-a74c-427f-9b69-6d61d33b0bf3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:36.932863 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4760025a-a74c-427f-9b69-6d61d33b0bf3 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:36.942200 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:36.947357 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 301/598] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:08:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:36.948605 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4760025a-a74c-427f-9b69-6d61d33b0bf3 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:36.980919 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5de27c-d778-4796-964f-dce00568929a None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:37.020517 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ac908-1126-4915-af33-ece13bfd5ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:37.021326 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ac908-1126-4915-af33-ece13bfd5ba7 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:37.021616 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ac908-1126-4915-af33-ece13bfd5ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:37.021898 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ac908-1126-4915-af33-ece13bfd5ba7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:37.032640 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ac908-1126-4915-af33-ece13bfd5ba7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:37.034175 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ac908-1126-4915-af33-ece13bfd5ba7 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:37.053235 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-3f6ac908-1126-4915-af33-ece13bfd5ba7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:37.053235 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:37.053235 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:37.053235 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:37.053235 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:37.053235 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:37.053235 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:37.053235 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:37.053235 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:37.053235 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:37.053235 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:37.053235 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:37.053235 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:08:37.053235 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:08:37.053235 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:08:37.054230 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:08:37.054230 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:37.054230 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:37.054230 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:37.054230 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:37.054230 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:37.054230 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:37.054230 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:37.054230 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:37.054230 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:37.054230 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:37.054230 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:37.054230 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:37.054230 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:37.054230 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:37.054230 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:37.054230 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:37.055162 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:08:37.055162 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:08:37.055162 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:37.055162 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:37.055162 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 298/599] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:37.055861 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ac908-1126-4915-af33-ece13bfd5ba7 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:37.072776 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4760025a-a74c-427f-9b69-6d61d33b0bf3 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:37.073513 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:37.119358 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3996a4-f50c-411e-8f49-88fa8130fd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:37.121085 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3996a4-f50c-411e-8f49-88fa8130fd6a None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:37.121521 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3996a4-f50c-411e-8f49-88fa8130fd6a None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:37.121990 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3996a4-f50c-411e-8f49-88fa8130fd6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:37.130724 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3996a4-f50c-411e-8f49-88fa8130fd6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:37.132431 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3996a4-f50c-411e-8f49-88fa8130fd6a None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:37.148815 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-ed3996a4-f50c-411e-8f49-88fa8130fd6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:08:37.148815 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:37.148815 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:37.148815 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:37.148815 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:37.148815 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:37.148815 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:37.148815 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:37.148815 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:37.148815 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:37.148815 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:37.148815 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:37.148815 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:08:37.148815 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:08:37.148815 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:08:37.156178 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:08:37.156178 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:37.156178 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:37.156178 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:37.156178 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:37.156178 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:37.156178 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:37.156178 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:37.156178 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:37.156178 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:37.156178 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:37.156178 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:37.156178 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:37.156178 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:37.156178 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:37.156178 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:37.156178 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:37.157168 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:08:37.157168 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:08:37.157168 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:08:37.157168 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:08:37.157168 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:08:37.157168 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:08:37.157168 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:08:37.157168 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:37.157694 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 302/600] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:08:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:37.159081 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3996a4-f50c-411e-8f49-88fa8130fd6a None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:37.168129 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ac908-1126-4915-af33-ece13bfd5ba7 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:37.207778 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38701b8-ede5-4865-9854-62b361d7f6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:37.208695 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38701b8-ede5-4865-9854-62b361d7f6a8 None admin] REQUEST_METHOD: `PUT` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:37.208979 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38701b8-ede5-4865-9854-62b361d7f6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:37.209260 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38701b8-ede5-4865-9854-62b361d7f6a8 None admin] PATH_INFO: `/v3/projects/ccd95a48530c4c86a3774301b969d6a9/users/598e27ffd54748f6aadb3d7cab5a4ce7/roles/601a166d56f647bda8256e971450cfdf` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:37.227073 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38701b8-ede5-4865-9854-62b361d7f6a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=ccd95a48530c4c86a3774301b969d6a9, user_id=598e27ffd54748f6aadb3d7cab5a4ce7, role_id=601a166d56f647bda8256e971450cfdf)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:37.228098 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:37.228601 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38701b8-ede5-4865-9854-62b361d7f6a8 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:37.273414 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3996a4-f50c-411e-8f49-88fa8130fd6a None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:37.296795 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 299/601] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:08:37 2022] PUT /identity/v3/projects/ccd95a48530c4c86a3774301b969d6a9/users/598e27ffd54748f6aadb3d7cab5a4ce7/roles/601a166d56f647bda8256e971450cfdf => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:08:37.298020 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38701b8-ede5-4865-9854-62b361d7f6a8 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:37.316494 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9947c8-e1bd-4966-a6de-c2a51575b2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:37.317596 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9947c8-e1bd-4966-a6de-c2a51575b2ec None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:37.318097 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9947c8-e1bd-4966-a6de-c2a51575b2ec None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:37.318594 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9947c8-e1bd-4966-a6de-c2a51575b2ec None admin] PATH_INFO: `/v3/domains` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:37.319693 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9947c8-e1bd-4966-a6de-c2a51575b2ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:37.320246 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9947c8-e1bd-4966-a6de-c2a51575b2ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:37.321979 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9947c8-e1bd-4966-a6de-c2a51575b2ec None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:37.337626 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 303/602] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:08:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:37.344235 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9947c8-e1bd-4966-a6de-c2a51575b2ec None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:37.447342 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:37.525871 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38701b8-ede5-4865-9854-62b361d7f6a8 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:37.538076 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9947c8-e1bd-4966-a6de-c2a51575b2ec None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:37.561586 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:37.575932 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453b4fc-efb0-4101-90cb-c77715275eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:37.576872 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453b4fc-efb0-4101-90cb-c77715275eb6 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:37.577339 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453b4fc-efb0-4101-90cb-c77715275eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:37.577878 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453b4fc-efb0-4101-90cb-c77715275eb6 None admin] PATH_INFO: `/v3/projects` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:37.579108 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9453b4fc-efb0-4101-90cb-c77715275eb6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:37.579674 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9453b4fc-efb0-4101-90cb-c77715275eb6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:37.581024 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af4d86-4fda-447a-a23f-cf9cc219e936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:37.581669 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9453b4fc-efb0-4101-90cb-c77715275eb6 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:37.581826 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af4d86-4fda-447a-a23f-cf9cc219e936 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:37.582117 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af4d86-4fda-447a-a23f-cf9cc219e936 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:37.582426 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af4d86-4fda-447a-a23f-cf9cc219e936 None admin] PATH_INFO: `/v3/projects/service` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:37.589682 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24af4d86-4fda-447a-a23f-cf9cc219e936 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:37.591903 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24af4d86-4fda-447a-a23f-cf9cc219e936 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:37.597921 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 300/603] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:08:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:37.604062 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453b4fc-efb0-4101-90cb-c77715275eb6 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:37.606425 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-24af4d86-4fda-447a-a23f-cf9cc219e936 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:08:37.606425 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:37.606425 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:37.606425 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:37.606425 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:37.606425 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:37.606425 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:37.606425 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:37.606425 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:37.606425 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:37.606425 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:37.606425 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:37.606425 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:08:37.606425 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:08:37.606425 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:08:37.607332 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:08:37.607332 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:37.607332 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:37.607332 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:37.607332 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:37.607332 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:37.607332 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:37.607332 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:37.607332 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:37.607332 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:37.607332 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:37.607332 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:37.607332 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:37.607332 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:37.607332 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:37.607332 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:37.607332 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:37.608227 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:08:37.608227 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:08:37.608227 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:08:37.608227 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:08:37.608227 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:08:37.608227 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:08:37.608227 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:08:37.608227 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:37.614477 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 304/604] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:08:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:37.615373 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af4d86-4fda-447a-a23f-cf9cc219e936 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:37.722169 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453b4fc-efb0-4101-90cb-c77715275eb6 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:37.736558 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af4d86-4fda-447a-a23f-cf9cc219e936 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:37.746713 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:37.758043 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad1928-33ac-4ead-8b95-30ae369f55f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:37.759250 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad1928-33ac-4ead-8b95-30ae369f55f4 None admin] REQUEST_METHOD: `PUT` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:37.760031 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad1928-33ac-4ead-8b95-30ae369f55f4 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:37.761301 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad1928-33ac-4ead-8b95-30ae369f55f4 None admin] PATH_INFO: `/v3/projects/ccd95a48530c4c86a3774301b969d6a9/users/4b5719dcd7314f1487b5e168e07039f8/roles/601a166d56f647bda8256e971450cfdf` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:37.775536 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2164a7b6-f5e3-4edc-8a7a-2ba0f36f769b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:37.775750 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ad1928-33ac-4ead-8b95-30ae369f55f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=ccd95a48530c4c86a3774301b969d6a9, user_id=4b5719dcd7314f1487b5e168e07039f8, role_id=601a166d56f647bda8256e971450cfdf)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:37.776546 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164a7b6-f5e3-4edc-8a7a-2ba0f36f769b None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:37.776991 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164a7b6-f5e3-4edc-8a7a-2ba0f36f769b None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:37.777134 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ad1928-33ac-4ead-8b95-30ae369f55f4 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:37.777548 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164a7b6-f5e3-4edc-8a7a-2ba0f36f769b None admin] PATH_INFO: `/v3/projects` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:37.778535 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2164a7b6-f5e3-4edc-8a7a-2ba0f36f769b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:37.778989 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2164a7b6-f5e3-4edc-8a7a-2ba0f36f769b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:37.781271 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2164a7b6-f5e3-4edc-8a7a-2ba0f36f769b None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:37.794469 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 305/605] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:08:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:37.795870 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4490c-8fab-40e2-9e0d-7ad98dc27216 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:37.796167 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4490c-8fab-40e2-9e0d-7ad98dc27216 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:37.796440 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4490c-8fab-40e2-9e0d-7ad98dc27216 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:37.797940 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 306/606] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:37.802181 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ade7e-6c23-4a13-9db8-e43682d51b66 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:37.802181 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ade7e-6c23-4a13-9db8-e43682d51b66 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:37.802181 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ade7e-6c23-4a13-9db8-e43682d51b66 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:37.804756 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 307/607] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:37.805535 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ade7e-6c23-4a13-9db8-e43682d51b66 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:37.847013 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:37.867362 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 301/608] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:08:37 2022] PUT /identity/v3/projects/ccd95a48530c4c86a3774301b969d6a9/users/4b5719dcd7314f1487b5e168e07039f8/roles/601a166d56f647bda8256e971450cfdf => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:08:37.867362 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3e068-9554-44a3-bbfc-fccadb5fd3a9 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:37.867362 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3e068-9554-44a3-bbfc-fccadb5fd3a9 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:37.867362 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3e068-9554-44a3-bbfc-fccadb5fd3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:37.887346 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-d4b3e068-9554-44a3-bbfc-fccadb5fd3a9 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:37.889508 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-d4b3e068-9554-44a3-bbfc-fccadb5fd3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:37.939297 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ade7e-6c23-4a13-9db8-e43682d51b66 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:37.976682 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 302/609] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:08:37.978807 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ecdf5f-c03c-4e28-bc78-b34ab855f51a None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:37.979519 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ecdf5f-c03c-4e28-bc78-b34ab855f51a None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:37.980156 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ecdf5f-c03c-4e28-bc78-b34ab855f51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:38.001319 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-13ecdf5f-c03c-4e28-bc78-b34ab855f51a None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:38.003013 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-13ecdf5f-c03c-4e28-bc78-b34ab855f51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:38.012344 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973147d3-6065-4ae5-bd12-f46a60ad23ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:38.013341 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973147d3-6065-4ae5-bd12-f46a60ad23ea None admin] REQUEST_METHOD: `PUT` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:38.013635 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973147d3-6065-4ae5-bd12-f46a60ad23ea None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:38.013916 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973147d3-6065-4ae5-bd12-f46a60ad23ea None admin] PATH_INFO: `/v3/projects/ccd95a48530c4c86a3774301b969d6a9/users/a3947355cf8a4b75bd31c5e6125e75e4/roles/601a166d56f647bda8256e971450cfdf` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:38.041852 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973147d3-6065-4ae5-bd12-f46a60ad23ea None admin] RBAC: Authorizing `identity:create_grant(project_id=ccd95a48530c4c86a3774301b969d6a9, user_id=a3947355cf8a4b75bd31c5e6125e75e4, role_id=601a166d56f647bda8256e971450cfdf)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:38.043377 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973147d3-6065-4ae5-bd12-f46a60ad23ea None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:38.087125 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 303/610] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:08:38.088331 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ecdf5f-c03c-4e28-bc78-b34ab855f51a None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:38.123267 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:38.138706 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 308/611] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:08:37 2022] PUT /identity/v3/projects/ccd95a48530c4c86a3774301b969d6a9/users/a3947355cf8a4b75bd31c5e6125e75e4/roles/601a166d56f647bda8256e971450cfdf => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:08:38.146882 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973147d3-6065-4ae5-bd12-f46a60ad23ea None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:38.226912 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ecdf5f-c03c-4e28-bc78-b34ab855f51a None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:38.305303 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:38.321014 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973147d3-6065-4ae5-bd12-f46a60ad23ea None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:38.322890 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a722f3-d037-4368-8f1f-ce1c70c54187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:38.323936 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a722f3-d037-4368-8f1f-ce1c70c54187 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:38.324227 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a722f3-d037-4368-8f1f-ce1c70c54187 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:38.324505 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a722f3-d037-4368-8f1f-ce1c70c54187 None admin] PATH_INFO: `/v3/roles/service` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:38.357587 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a722f3-d037-4368-8f1f-ce1c70c54187 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:08:38.365785 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-17a722f3-d037-4368-8f1f-ce1c70c54187 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:08:38.365785 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:38.365785 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:38.365785 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:38.365785 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:38.365785 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:38.365785 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:38.365785 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:38.365785 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:38.365785 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:38.365785 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:38.365785 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:38.365785 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:08:38.365785 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:08:38.365785 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:08:38.365785 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:08:38.366887 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:08:38.366887 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:08:38.366887 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:08:38.366887 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:08:38.366887 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:38.366887 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:38.366887 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:38.366887 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:38.366887 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:38.366887 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:38.366887 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:38.366887 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:38.366887 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:38.366887 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:38.366887 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:38.366887 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:38.367733 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:38.367733 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:38.367733 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:38.367733 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:38.367733 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:08:38.367733 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:08:38.367733 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:08:38.367733 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:08:38.367733 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:08:38.367733 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:08:38.367733 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:08:38.367733 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:38.368385 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93370e-abf0-48f3-bcff-7c08acf50874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:38.368385 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93370e-abf0-48f3-bcff-7c08acf50874 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:38.368385 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93370e-abf0-48f3-bcff-7c08acf50874 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:38.368385 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93370e-abf0-48f3-bcff-7c08acf50874 None admin] PATH_INFO: `/v3/roles/service` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:38.371341 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 304/612] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:08:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:38.379115 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a722f3-d037-4368-8f1f-ce1c70c54187 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:38.388714 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b93370e-abf0-48f3-bcff-7c08acf50874 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:08:38.399130 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-0b93370e-abf0-48f3-bcff-7c08acf50874 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:08:38.399130 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:38.399130 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:38.399130 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:38.399130 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:38.399130 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:38.399130 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:38.399130 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:38.399130 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:38.399130 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:38.399130 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:38.399130 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:38.399130 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:08:38.399130 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:08:38.399130 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:08:38.399130 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:08:38.400356 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:08:38.400356 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:08:38.400356 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:08:38.400356 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:08:38.400356 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:38.400356 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:38.400356 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:38.400356 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:38.400356 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:38.400356 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:38.400356 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:38.400356 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:38.400356 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:38.400356 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:38.400356 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:38.400356 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:38.401629 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:38.401629 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:38.401629 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:38.401629 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:38.401629 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:08:38.401629 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:08:38.401629 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:08:38.401629 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:08:38.401629 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:08:38.401629 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:08:38.401629 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:08:38.401629 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:38.402719 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 309/613] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:08:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:38.409623 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93370e-abf0-48f3-bcff-7c08acf50874 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:38.570170 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:38.580403 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a722f3-d037-4368-8f1f-ce1c70c54187 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:38.608320 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93370e-abf0-48f3-bcff-7c08acf50874 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:38.649531 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5b43c-15d9-40ba-a484-6951901436c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:38.650329 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5b43c-15d9-40ba-a484-6951901436c2 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:38.650623 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5b43c-15d9-40ba-a484-6951901436c2 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:38.650899 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5b43c-15d9-40ba-a484-6951901436c2 None admin] PATH_INFO: `/v3/roles` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:38.651661 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b5b43c-15d9-40ba-a484-6951901436c2 None admin] RBAC: Adding query filter params (name=service) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:38.651976 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b5b43c-15d9-40ba-a484-6951901436c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:38.653366 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b5b43c-15d9-40ba-a484-6951901436c2 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:38.667946 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 305/614] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:08:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:38.670917 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a96b93-a798-4073-ad52-0e4bd7df4694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:38.671594 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a96b93-a798-4073-ad52-0e4bd7df4694 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:38.671965 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a96b93-a798-4073-ad52-0e4bd7df4694 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:38.672250 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a96b93-a798-4073-ad52-0e4bd7df4694 None admin] PATH_INFO: `/v3/roles` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:38.673003 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a96b93-a798-4073-ad52-0e4bd7df4694 None admin] RBAC: Adding query filter params (name=service) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:38.673315 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a96b93-a798-4073-ad52-0e4bd7df4694 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:38.674720 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a96b93-a798-4073-ad52-0e4bd7df4694 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:38.676907 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5b43c-15d9-40ba-a484-6951901436c2 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:38.688549 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 310/615] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:08:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:08:38.694972 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a96b93-a798-4073-ad52-0e4bd7df4694 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:38.715291 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:38.823464 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5b43c-15d9-40ba-a484-6951901436c2 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:38.877906 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a96b93-a798-4073-ad52-0e4bd7df4694 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:38.893956 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf855868-fee2-46fe-9517-da4b74856bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:38.895102 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf855868-fee2-46fe-9517-da4b74856bfb None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:38.895600 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf855868-fee2-46fe-9517-da4b74856bfb None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:38.896105 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf855868-fee2-46fe-9517-da4b74856bfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:38.917272 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf855868-fee2-46fe-9517-da4b74856bfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:38.919081 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf855868-fee2-46fe-9517-da4b74856bfb None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:38.940972 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-cf855868-fee2-46fe-9517-da4b74856bfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:38.940972 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:38.940972 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:38.940972 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:38.940972 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:38.940972 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:38.940972 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:38.940972 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:38.940972 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:38.940972 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:38.940972 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:38.940972 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:38.940972 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:08:38.940972 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:08:38.940972 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:08:38.941871 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:08:38.941871 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:38.941871 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:38.941871 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:38.941871 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:38.941871 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:38.941871 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:38.941871 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:38.941871 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:38.941871 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:38.941871 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:38.941871 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:38.941871 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:38.941871 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:38.941871 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:38.941871 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:38.941871 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:38.942829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:08:38.942829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:08:38.942829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:38.942829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:38.945017 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 306/616] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:38.951282 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf855868-fee2-46fe-9517-da4b74856bfb None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:38.959656 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521660b-c90d-4678-bc0d-8f91891ce59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:38.966056 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521660b-c90d-4678-bc0d-8f91891ce59b None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:38.966622 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521660b-c90d-4678-bc0d-8f91891ce59b None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:38.967133 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521660b-c90d-4678-bc0d-8f91891ce59b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:38.972633 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:38.987036 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b521660b-c90d-4678-bc0d-8f91891ce59b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:38.989960 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b521660b-c90d-4678-bc0d-8f91891ce59b None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:39.021479 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-b521660b-c90d-4678-bc0d-8f91891ce59b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:39.021479 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:39.021479 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:39.021479 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:39.021479 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:39.021479 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:39.021479 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:39.021479 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:39.021479 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:39.021479 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:39.021479 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:39.021479 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:39.021479 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:08:39.021479 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:08:39.021479 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:08:39.022485 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:08:39.022485 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:39.022485 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:39.022485 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:39.022485 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:39.022485 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:39.022485 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:39.022485 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:39.022485 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:39.022485 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:39.022485 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:39.022485 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:39.022485 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:39.022485 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:39.022485 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:39.022485 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:39.022485 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:39.023407 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:08:39.023407 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:08:39.023407 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:39.023407 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:39.036003 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 311/617] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:08:39.042342 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521660b-c90d-4678-bc0d-8f91891ce59b None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:39.117845 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:39.131109 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf855868-fee2-46fe-9517-da4b74856bfb None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:39.157408 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521660b-c90d-4678-bc0d-8f91891ce59b None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:39.169718 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b35f95-7277-4893-a566-9b83d5874379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:39.170791 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b35f95-7277-4893-a566-9b83d5874379 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:39.171292 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b35f95-7277-4893-a566-9b83d5874379 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:39.171877 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b35f95-7277-4893-a566-9b83d5874379 None admin] PATH_INFO: `/v3/domains` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:39.172916 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b35f95-7277-4893-a566-9b83d5874379 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:39.173469 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b35f95-7277-4893-a566-9b83d5874379 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:39.175297 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b35f95-7277-4893-a566-9b83d5874379 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:39.190304 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 307/618] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:08:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:39.194470 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de999e-b139-4579-8608-1863ec5ac3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:39.194943 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de999e-b139-4579-8608-1863ec5ac3f0 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:39.202672 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de999e-b139-4579-8608-1863ec5ac3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:39.202672 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de999e-b139-4579-8608-1863ec5ac3f0 None admin] PATH_INFO: `/v3/domains` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:39.202876 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b35f95-7277-4893-a566-9b83d5874379 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:39.202955 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0de999e-b139-4579-8608-1863ec5ac3f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:39.202955 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0de999e-b139-4579-8608-1863ec5ac3f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:39.202955 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0de999e-b139-4579-8608-1863ec5ac3f0 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:39.212208 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 312/619] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:08:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:39.219313 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de999e-b139-4579-8608-1863ec5ac3f0 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:39.308625 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b35f95-7277-4893-a566-9b83d5874379 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:39.326508 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:39.326707 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de999e-b139-4579-8608-1863ec5ac3f0 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:39.359959 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:39.367016 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd19bd6-143e-4378-aad8-0c489d7d5e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:39.367823 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd19bd6-143e-4378-aad8-0c489d7d5e15 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:39.368157 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd19bd6-143e-4378-aad8-0c489d7d5e15 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:39.368381 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd19bd6-143e-4378-aad8-0c489d7d5e15 None admin] PATH_INFO: `/v3/users/swift` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:39.377294 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd19bd6-143e-4378-aad8-0c489d7d5e15 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:39.378796 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd19bd6-143e-4378-aad8-0c489d7d5e15 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:39.395503 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-2cd19bd6-143e-4378-aad8-0c489d7d5e15 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 21:08:39.395503 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:39.395503 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:39.395503 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:39.395503 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:39.395503 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:39.395503 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:39.395503 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:39.395503 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:39.395503 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:39.395503 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:39.395503 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:39.395503 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:08:39.395503 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:08:39.395503 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:08:39.395503 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:08:39.396503 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:39.396503 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:39.396503 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:08:39.396503 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:08:39.396503 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:08:39.396503 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:08:39.396503 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:39.396503 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:39.396503 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:39.396503 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:39.396503 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:39.396503 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:39.396503 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:39.396503 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:39.396503 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:39.396503 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:39.396503 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:39.396503 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:39.397493 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:39.397493 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:39.397493 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:08:39.397493 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:08:39.397493 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:08:39.397493 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:08:39.397493 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:08:39.397493 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:08:39.397493 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 21:08:39.397493 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:39.397493 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 313/620] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:08:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:39.403064 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd19bd6-143e-4378-aad8-0c489d7d5e15 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:39.435237 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e758f-fead-4dd4-a236-c5e37ad0b089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:39.436549 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e758f-fead-4dd4-a236-c5e37ad0b089 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:39.437663 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e758f-fead-4dd4-a236-c5e37ad0b089 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:39.438365 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e758f-fead-4dd4-a236-c5e37ad0b089 None admin] PATH_INFO: `/v3/users/nova` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:39.457220 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e758f-fead-4dd4-a236-c5e37ad0b089 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:39.459013 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e758f-fead-4dd4-a236-c5e37ad0b089 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:39.486845 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-4f0e758f-fead-4dd4-a236-c5e37ad0b089 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:08:39.486845 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:39.486845 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:39.486845 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:39.486845 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:39.486845 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:39.486845 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:39.486845 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:39.486845 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:39.486845 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:39.486845 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:39.486845 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:39.486845 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:08:39.486845 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:08:39.486845 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:08:39.486845 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:08:39.487862 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:39.487862 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:39.487862 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:08:39.487862 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:08:39.487862 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:08:39.487862 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:08:39.487862 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:39.487862 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:39.487862 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:39.487862 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:39.487862 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:39.487862 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:39.487862 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:39.487862 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:39.487862 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:39.487862 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:39.487862 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:39.487862 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:39.488831 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:39.488831 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:39.488831 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:08:39.488831 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:08:39.488831 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:08:39.488831 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:08:39.488831 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:08:39.488831 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:08:39.488831 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:08:39.488831 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:39.488831 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 308/621] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Jul 5 21:08:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:39.493471 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e758f-fead-4dd4-a236-c5e37ad0b089 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:39.562975 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd19bd6-143e-4378-aad8-0c489d7d5e15 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:39.639280 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc76ef0-28ac-46f0-9814-57baffed778c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:39.640431 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc76ef0-28ac-46f0-9814-57baffed778c None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:39.640944 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc76ef0-28ac-46f0-9814-57baffed778c None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:39.641449 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc76ef0-28ac-46f0-9814-57baffed778c None admin] PATH_INFO: `/v3/users` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:39.642547 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc76ef0-28ac-46f0-9814-57baffed778c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:39.643068 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc76ef0-28ac-46f0-9814-57baffed778c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:39.644800 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc76ef0-28ac-46f0-9814-57baffed778c None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:39.655902 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e758f-fead-4dd4-a236-c5e37ad0b089 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:39.664897 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 314/622] 10.222.0.30 () {56 vars in 1135 bytes} [Tue Jul 5 21:08:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:39.671228 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc76ef0-28ac-46f0-9814-57baffed778c None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:39.683932 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:39.701535 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980eb75-e2d2-49ee-82db-5e915562a021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:39.702249 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980eb75-e2d2-49ee-82db-5e915562a021 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:39.702542 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980eb75-e2d2-49ee-82db-5e915562a021 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:39.702827 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980eb75-e2d2-49ee-82db-5e915562a021 None admin] PATH_INFO: `/v3/users` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:39.703671 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9980eb75-e2d2-49ee-82db-5e915562a021 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:39.703983 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9980eb75-e2d2-49ee-82db-5e915562a021 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:39.705432 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9980eb75-e2d2-49ee-82db-5e915562a021 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:39.725621 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:39.733746 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 309/623] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Jul 5 21:08:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:39.739276 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8250c-2b39-456e-864c-724fb7e8486a None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:39.739583 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8250c-2b39-456e-864c-724fb7e8486a None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:39.739902 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8250c-2b39-456e-864c-724fb7e8486a None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:39.741618 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 310/624] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:39.742808 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8250c-2b39-456e-864c-724fb7e8486a None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:39.797259 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc76ef0-28ac-46f0-9814-57baffed778c None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:39.841854 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a985d-128f-4e04-b39a-892972ac8f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:39.842684 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a985d-128f-4e04-b39a-892972ac8f62 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:39.842967 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a985d-128f-4e04-b39a-892972ac8f62 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:39.843242 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a985d-128f-4e04-b39a-892972ac8f62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:39.854194 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8a985d-128f-4e04-b39a-892972ac8f62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:39.855731 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8a985d-128f-4e04-b39a-892972ac8f62 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:39.872108 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8250c-2b39-456e-864c-724fb7e8486a None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:39.873358 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-1c8a985d-128f-4e04-b39a-892972ac8f62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:39.873358 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:39.873358 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:39.873358 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:39.873358 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:39.873358 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:39.873358 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:39.873358 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:39.873358 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:39.873358 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:39.873358 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:39.873358 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:39.873358 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:08:39.873358 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:08:39.873358 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:08:39.874271 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:08:39.874271 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:39.874271 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:39.874271 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:39.874271 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:39.874271 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:39.874271 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:39.874271 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:39.874271 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:39.874271 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:39.874271 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:39.874271 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:39.874271 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:39.874271 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:39.874271 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:39.874271 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:39.874271 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:39.875215 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:08:39.875215 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:08:39.875215 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:39.875215 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:39.875215 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 315/625] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:39.876157 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2cb1a5-d05e-4578-9c5d-c02117e3eccb None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:39.876442 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2cb1a5-d05e-4578-9c5d-c02117e3eccb None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:39.876722 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2cb1a5-d05e-4578-9c5d-c02117e3eccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:39.894308 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-bf2cb1a5-d05e-4578-9c5d-c02117e3eccb None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:39.895399 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-bf2cb1a5-d05e-4578-9c5d-c02117e3eccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:39.916780 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbe28b-f90c-46ea-9836-abc6450aa04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:39.917905 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbe28b-f90c-46ea-9836-abc6450aa04f None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:39.918475 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbe28b-f90c-46ea-9836-abc6450aa04f None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:39.918982 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbe28b-f90c-46ea-9836-abc6450aa04f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:39.970377 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 316/626] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:08:39.971281 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2cb1a5-d05e-4578-9c5d-c02117e3eccb None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:39.983024 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:39.998754 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfbe28b-f90c-46ea-9836-abc6450aa04f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:40.000551 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfbe28b-f90c-46ea-9836-abc6450aa04f None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:40.008329 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:40.093951 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2cb1a5-d05e-4578-9c5d-c02117e3eccb None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:40.116490 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 311/627] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:08:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:08:40.117706 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbe28b-f90c-46ea-9836-abc6450aa04f None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:40.132501 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f6332-f943-4896-8900-e51486074487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:40.133173 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f6332-f943-4896-8900-e51486074487 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:40.133458 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f6332-f943-4896-8900-e51486074487 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:40.133734 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f6332-f943-4896-8900-e51486074487 None admin] PATH_INFO: `/v3/domains` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:40.135031 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3f6332-f943-4896-8900-e51486074487 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:40.135516 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3f6332-f943-4896-8900-e51486074487 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:40.137156 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3f6332-f943-4896-8900-e51486074487 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:40.155968 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 317/628] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:08:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:40.155968 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f6332-f943-4896-8900-e51486074487 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:40.217721 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:40.235194 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbe28b-f90c-46ea-9836-abc6450aa04f None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:40.238079 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:40.256498 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f6332-f943-4896-8900-e51486074487 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:40.271259 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801e609-fa5b-474e-8eb3-253295e3d7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:40.272151 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801e609-fa5b-474e-8eb3-253295e3d7e9 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:40.272440 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801e609-fa5b-474e-8eb3-253295e3d7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:40.272718 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801e609-fa5b-474e-8eb3-253295e3d7e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:40.284765 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801e609-fa5b-474e-8eb3-253295e3d7e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:08:40.292701 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-3801e609-fa5b-474e-8eb3-253295e3d7e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:08:40.292701 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:40.292701 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:40.292701 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:40.292701 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:40.292701 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:40.292701 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:40.292701 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:40.292701 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:40.292701 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:40.292701 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:40.292701 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:40.292701 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:08:40.292701 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:08:40.292701 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:08:40.292701 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:08:40.293738 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:08:40.293738 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:08:40.293738 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:08:40.293738 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:08:40.293738 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:40.293738 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:40.293738 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:40.293738 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:40.293738 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:40.293738 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:40.293738 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:40.293738 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:40.293738 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:40.293738 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:40.293738 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:40.293738 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:40.294680 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:40.294680 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:40.294680 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:40.294680 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:40.294680 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:08:40.294680 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:08:40.294680 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:08:40.294680 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:08:40.294680 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:08:40.294680 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:08:40.294680 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:08:40.294680 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:40.294680 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 312/629] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:08:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:40.294680 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801e609-fa5b-474e-8eb3-253295e3d7e9 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:40.299437 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5cfd2-28a1-4f73-8198-8417e0648047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:40.300244 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5cfd2-28a1-4f73-8198-8417e0648047 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:40.300532 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5cfd2-28a1-4f73-8198-8417e0648047 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:40.300812 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5cfd2-28a1-4f73-8198-8417e0648047 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:40.312318 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c5cfd2-28a1-4f73-8198-8417e0648047 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:40.313795 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c5cfd2-28a1-4f73-8198-8417e0648047 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:40.331773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-40c5cfd2-28a1-4f73-8198-8417e0648047 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:40.331773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:40.331773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:40.331773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:40.331773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:40.331773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:40.331773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:40.331773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:40.331773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:40.331773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:40.331773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:40.331773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:40.331773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:08:40.331773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:08:40.331773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:08:40.333276 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:08:40.333276 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:40.333276 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:40.333276 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:40.333276 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:40.333276 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:40.333276 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:40.333276 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:40.333276 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:40.333276 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:40.333276 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:40.333276 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:40.333276 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:40.333276 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:40.333276 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:40.333276 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:40.333276 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:40.334545 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:08:40.334545 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:08:40.334545 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:40.334545 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:40.337416 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 318/630] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:40.339139 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc7386-929e-4131-bf38-c3f414863cb3 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:40.339432 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc7386-929e-4131-bf38-c3f414863cb3 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:40.339719 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc7386-929e-4131-bf38-c3f414863cb3 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:40.341249 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 319/631] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:40.341960 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc7386-929e-4131-bf38-c3f414863cb3 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:40.415307 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801e609-fa5b-474e-8eb3-253295e3d7e9 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:40.450058 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55abf7-b23f-471e-bf18-80d20fb21959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:40.450894 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55abf7-b23f-471e-bf18-80d20fb21959 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:40.451183 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55abf7-b23f-471e-bf18-80d20fb21959 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:40.451467 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55abf7-b23f-471e-bf18-80d20fb21959 None admin] PATH_INFO: `/v3/projects/service` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:40.455123 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc7386-929e-4131-bf38-c3f414863cb3 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:40.458481 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a55abf7-b23f-471e-bf18-80d20fb21959 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:40.459925 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a55abf7-b23f-471e-bf18-80d20fb21959 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:40.474645 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-2a55abf7-b23f-471e-bf18-80d20fb21959 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:08:40.474645 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:40.474645 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:40.474645 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:40.474645 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:40.474645 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:40.474645 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:40.474645 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:40.474645 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:40.474645 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:40.474645 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:40.474645 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:40.474645 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:08:40.474645 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:08:40.474645 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:08:40.475591 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:08:40.475591 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:40.475591 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:40.475591 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:40.475591 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:40.475591 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:40.475591 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:40.475591 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:40.475591 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:40.475591 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:40.475591 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:40.475591 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:40.475591 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:40.475591 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:40.475591 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:40.475591 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:40.475591 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:40.476504 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:08:40.476504 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:08:40.476504 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:08:40.476504 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:08:40.476504 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:08:40.476504 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:08:40.476504 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:08:40.476504 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:40.476504 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 313/632] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:08:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:40.477049 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55abf7-b23f-471e-bf18-80d20fb21959 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:40.486763 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:40.498708 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef8304-b0fc-4589-b118-735f45da0ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:40.499381 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef8304-b0fc-4589-b118-735f45da0ad3 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:40.500136 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef8304-b0fc-4589-b118-735f45da0ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:40.500421 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef8304-b0fc-4589-b118-735f45da0ad3 None admin] PATH_INFO: `/v3/roles` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:40.501505 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ef8304-b0fc-4589-b118-735f45da0ad3 None admin] RBAC: Adding query filter params (name=service) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:40.501805 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ef8304-b0fc-4589-b118-735f45da0ad3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:40.503999 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ef8304-b0fc-4589-b118-735f45da0ad3 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:40.505806 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:40.517461 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 320/633] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:08:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:40.519481 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98afab-9a94-4fe0-92df-3bcdcaaf1fd9 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:40.519936 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98afab-9a94-4fe0-92df-3bcdcaaf1fd9 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:40.520223 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98afab-9a94-4fe0-92df-3bcdcaaf1fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:40.537000 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-7a98afab-9a94-4fe0-92df-3bcdcaaf1fd9 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:40.538237 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-7a98afab-9a94-4fe0-92df-3bcdcaaf1fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:40.583883 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55abf7-b23f-471e-bf18-80d20fb21959 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:40.608810 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 321/634] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:08:40.609666 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a98afab-9a94-4fe0-92df-3bcdcaaf1fd9 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:40.618176 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e598b1-7400-48da-a900-35735fb5cc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:40.619348 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e598b1-7400-48da-a900-35735fb5cc67 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:40.619696 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e598b1-7400-48da-a900-35735fb5cc67 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:40.619983 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e598b1-7400-48da-a900-35735fb5cc67 None admin] PATH_INFO: `/v3/domains` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:40.620701 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e598b1-7400-48da-a900-35735fb5cc67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:40.621011 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e598b1-7400-48da-a900-35735fb5cc67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:40.622407 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e598b1-7400-48da-a900-35735fb5cc67 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:40.633840 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 314/635] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:08:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:40.635383 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e598b1-7400-48da-a900-35735fb5cc67 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:40.701053 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:40.711416 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a98afab-9a94-4fe0-92df-3bcdcaaf1fd9 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:40.734071 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e598b1-7400-48da-a900-35735fb5cc67 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:40.737014 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:40.746029 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043ecc4-75d8-4b20-82c8-bde83e1717ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:40.746741 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043ecc4-75d8-4b20-82c8-bde83e1717ab None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:40.747072 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043ecc4-75d8-4b20-82c8-bde83e1717ab None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:40.747354 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043ecc4-75d8-4b20-82c8-bde83e1717ab None admin] PATH_INFO: `/v3/projects` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:40.748151 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4043ecc4-75d8-4b20-82c8-bde83e1717ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:40.748475 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4043ecc4-75d8-4b20-82c8-bde83e1717ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:40.749914 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4043ecc4-75d8-4b20-82c8-bde83e1717ab None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:40.761340 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 322/636] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:08:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:40.762681 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6ac8c-df6a-4810-bb4d-f814ba05c643 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:40.762980 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6ac8c-df6a-4810-bb4d-f814ba05c643 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:40.763268 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6ac8c-df6a-4810-bb4d-f814ba05c643 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:40.764541 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 323/637] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:40.765242 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6ac8c-df6a-4810-bb4d-f814ba05c643 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:40.769497 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d977e-7f3f-47c7-b1a2-b5da71e57477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:40.770337 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d977e-7f3f-47c7-b1a2-b5da71e57477 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:40.770627 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d977e-7f3f-47c7-b1a2-b5da71e57477 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:40.770905 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d977e-7f3f-47c7-b1a2-b5da71e57477 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:40.781711 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3d977e-7f3f-47c7-b1a2-b5da71e57477 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:40.783181 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3d977e-7f3f-47c7-b1a2-b5da71e57477 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:40.800264 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-5a3d977e-7f3f-47c7-b1a2-b5da71e57477 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:40.800264 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:40.800264 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:40.800264 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:40.800264 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:40.800264 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:40.800264 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:40.800264 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:40.800264 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:40.800264 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:40.800264 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:40.800264 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:40.800264 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:08:40.800264 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:08:40.800264 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:08:40.801348 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:08:40.801348 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:40.801348 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:40.801348 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:40.801348 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:40.801348 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:40.801348 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:40.801348 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:40.801348 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:40.801348 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:40.801348 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:40.801348 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:40.801348 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:40.801348 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:40.801348 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:40.801348 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:40.801348 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:40.802481 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:08:40.802481 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:08:40.802481 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:40.802481 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:40.802481 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 315/638] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:40.802481 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d977e-7f3f-47c7-b1a2-b5da71e57477 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:40.868343 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6ac8c-df6a-4810-bb4d-f814ba05c643 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:40.901423 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d977e-7f3f-47c7-b1a2-b5da71e57477 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:40.901772 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136eba0d-4eb1-4d63-90ba-a3bf263b44f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:40.902605 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136eba0d-4eb1-4d63-90ba-a3bf263b44f5 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:40.902899 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136eba0d-4eb1-4d63-90ba-a3bf263b44f5 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:40.903177 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136eba0d-4eb1-4d63-90ba-a3bf263b44f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:40.913167 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136eba0d-4eb1-4d63-90ba-a3bf263b44f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:08:40.918269 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:40.921672 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-136eba0d-4eb1-4d63-90ba-a3bf263b44f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:08:40.921672 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:40.921672 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:40.921672 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:40.921672 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:40.921672 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:40.921672 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:40.921672 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:40.921672 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:40.921672 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:40.921672 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:40.921672 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:40.921672 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:08:40.921672 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:08:40.921672 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:08:40.921672 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:08:40.922846 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:08:40.922846 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:08:40.922846 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:08:40.922846 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:08:40.922846 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:40.922846 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:40.922846 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:40.922846 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:40.922846 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:40.922846 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:40.922846 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:40.922846 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:40.922846 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:40.922846 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:40.922846 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:40.922846 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:40.923700 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:40.923700 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:40.923700 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:40.923700 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:40.923700 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:08:40.923700 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:08:40.923700 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:08:40.923700 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:08:40.923700 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:08:40.923700 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:08:40.923700 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:08:40.923700 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:40.923700 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 324/639] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:08:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:40.923700 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136eba0d-4eb1-4d63-90ba-a3bf263b44f5 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:40.937226 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69148d-ad13-4a9b-87c8-bff06bd893b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:40.938021 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69148d-ad13-4a9b-87c8-bff06bd893b3 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:40.938344 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69148d-ad13-4a9b-87c8-bff06bd893b3 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:40.938625 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69148d-ad13-4a9b-87c8-bff06bd893b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:40.949142 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69148d-ad13-4a9b-87c8-bff06bd893b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:40.950962 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69148d-ad13-4a9b-87c8-bff06bd893b3 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:40.965705 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-8c69148d-ad13-4a9b-87c8-bff06bd893b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:08:40.965705 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:40.965705 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:40.965705 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:40.965705 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:40.965705 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:40.965705 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:40.965705 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:40.965705 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:40.965705 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:40.965705 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:40.965705 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:40.965705 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:08:40.965705 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:08:40.965705 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:08:40.966724 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:08:40.966724 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:40.966724 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:40.966724 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:40.966724 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:40.966724 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:40.966724 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:40.966724 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:40.966724 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:40.966724 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:40.966724 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:40.966724 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:40.966724 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:40.966724 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:40.966724 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:40.966724 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:40.966724 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:40.967658 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:08:40.967658 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:08:40.967658 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:08:40.967658 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:08:40.967658 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:08:40.967658 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:08:40.967658 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:08:40.967658 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:40.967658 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 316/640] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:08:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:40.968171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871921e-ff47-4237-b028-fee2082076f4 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:40.968298 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871921e-ff47-4237-b028-fee2082076f4 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:40.968675 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871921e-ff47-4237-b028-fee2082076f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:40.978566 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:40.984399 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-4871921e-ff47-4237-b028-fee2082076f4 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:40.985585 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-4871921e-ff47-4237-b028-fee2082076f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:41.033717 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136eba0d-4eb1-4d63-90ba-a3bf263b44f5 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:41.051147 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 317/641] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:08:41.051986 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871921e-ff47-4237-b028-fee2082076f4 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:41.069383 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9897a75-389c-4124-821d-bf6bd0bec8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:41.070300 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9897a75-389c-4124-821d-bf6bd0bec8a1 None admin] REQUEST_METHOD: `PUT` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:41.070579 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9897a75-389c-4124-821d-bf6bd0bec8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:41.070854 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9897a75-389c-4124-821d-bf6bd0bec8a1 None admin] PATH_INFO: `/v3/projects/ccd95a48530c4c86a3774301b969d6a9/users/e6761d76cc1d48579c7fda6125900648/roles/601a166d56f647bda8256e971450cfdf` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:41.086100 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9897a75-389c-4124-821d-bf6bd0bec8a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=ccd95a48530c4c86a3774301b969d6a9, user_id=e6761d76cc1d48579c7fda6125900648, role_id=601a166d56f647bda8256e971450cfdf)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:41.088103 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9897a75-389c-4124-821d-bf6bd0bec8a1 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:41.155053 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871921e-ff47-4237-b028-fee2082076f4 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:41.159205 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 325/642] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:08:40 2022] PUT /identity/v3/projects/ccd95a48530c4c86a3774301b969d6a9/users/e6761d76cc1d48579c7fda6125900648/roles/601a166d56f647bda8256e971450cfdf => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:08:41.160017 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9897a75-389c-4124-821d-bf6bd0bec8a1 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:41.171446 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:41.195700 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb9fa64-e82a-4bac-86a5-d6f34a46db25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:41.196405 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9fa64-e82a-4bac-86a5-d6f34a46db25 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:41.196692 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9fa64-e82a-4bac-86a5-d6f34a46db25 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:41.196988 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9fa64-e82a-4bac-86a5-d6f34a46db25 None admin] PATH_INFO: `/v3/domains` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:41.198757 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb9fa64-e82a-4bac-86a5-d6f34a46db25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:41.199136 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb9fa64-e82a-4bac-86a5-d6f34a46db25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:41.200862 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb9fa64-e82a-4bac-86a5-d6f34a46db25 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:41.219477 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 318/643] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:08:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:41.219477 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb9fa64-e82a-4bac-86a5-d6f34a46db25 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:41.275989 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:41.282431 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9897a75-389c-4124-821d-bf6bd0bec8a1 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:41.326083 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63230634-8041-4c94-ae81-76a0650a2881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:41.326790 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63230634-8041-4c94-ae81-76a0650a2881 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:41.327087 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63230634-8041-4c94-ae81-76a0650a2881 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:41.327354 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63230634-8041-4c94-ae81-76a0650a2881 None admin] PATH_INFO: `/v3/roles` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:41.328113 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63230634-8041-4c94-ae81-76a0650a2881 None admin] RBAC: Adding query filter params (name=service) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:41.328426 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63230634-8041-4c94-ae81-76a0650a2881 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:41.329798 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63230634-8041-4c94-ae81-76a0650a2881 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:41.339173 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 326/644] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:08:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:41.339820 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63230634-8041-4c94-ae81-76a0650a2881 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:41.346053 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb9fa64-e82a-4bac-86a5-d6f34a46db25 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:41.381530 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408aa07c-8fe8-4fa8-a99f-525a7050c8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:41.382337 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408aa07c-8fe8-4fa8-a99f-525a7050c8fc None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:41.382623 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408aa07c-8fe8-4fa8-a99f-525a7050c8fc None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:41.382900 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408aa07c-8fe8-4fa8-a99f-525a7050c8fc None admin] PATH_INFO: `/v3/projects` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:41.383807 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408aa07c-8fe8-4fa8-a99f-525a7050c8fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:41.384120 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408aa07c-8fe8-4fa8-a99f-525a7050c8fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:41.385901 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408aa07c-8fe8-4fa8-a99f-525a7050c8fc None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:41.405225 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 319/645] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:08:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:41.405225 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408aa07c-8fe8-4fa8-a99f-525a7050c8fc None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:41.433635 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:41.451556 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63230634-8041-4c94-ae81-76a0650a2881 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:41.488521 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67799de0-9574-4dd0-9d1d-240b5b0e244c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:41.489601 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67799de0-9574-4dd0-9d1d-240b5b0e244c None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:41.490065 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67799de0-9574-4dd0-9d1d-240b5b0e244c None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:41.490570 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67799de0-9574-4dd0-9d1d-240b5b0e244c None admin] PATH_INFO: `/v3/roles/service` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:41.503627 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67799de0-9574-4dd0-9d1d-240b5b0e244c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:08:41.510993 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408aa07c-8fe8-4fa8-a99f-525a7050c8fc None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:41.515239 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-67799de0-9574-4dd0-9d1d-240b5b0e244c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:08:41.515239 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:41.515239 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:41.515239 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:41.515239 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:41.515239 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:41.515239 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:41.515239 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:41.515239 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:41.515239 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:41.515239 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:41.515239 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:41.515239 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:08:41.515239 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:08:41.515239 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:08:41.515239 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:08:41.516198 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:08:41.516198 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:08:41.516198 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:08:41.516198 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:08:41.516198 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:41.516198 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:41.516198 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:41.516198 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:41.516198 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:41.516198 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:41.516198 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:41.516198 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:41.516198 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:41.516198 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:41.516198 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:41.516198 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:41.517184 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:41.517184 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:41.517184 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:41.517184 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:41.517184 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:08:41.517184 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:08:41.517184 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:08:41.517184 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:08:41.517184 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:08:41.517184 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:08:41.517184 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:08:41.517184 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:41.518528 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 327/646] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:08:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:41.519108 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67799de0-9574-4dd0-9d1d-240b5b0e244c None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:41.542864 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:41.549358 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b956dd76-2791-4d52-a468-c7f7ab44e57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:41.550211 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956dd76-2791-4d52-a468-c7f7ab44e57d None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:41.550518 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956dd76-2791-4d52-a468-c7f7ab44e57d None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:41.550769 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956dd76-2791-4d52-a468-c7f7ab44e57d None admin] PATH_INFO: `/v3/users/glance` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:41.558472 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b956dd76-2791-4d52-a468-c7f7ab44e57d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:41.559934 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b956dd76-2791-4d52-a468-c7f7ab44e57d None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:41.575910 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-b956dd76-2791-4d52-a468-c7f7ab44e57d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 05 21:08:41.575910 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:41.575910 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:41.575910 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:41.575910 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:41.575910 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:41.575910 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:41.575910 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:41.575910 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:41.575910 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:41.575910 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:41.575910 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:41.575910 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:08:41.575910 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:08:41.575910 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:08:41.575910 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:08:41.576902 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:41.576902 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:41.576902 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:08:41.576902 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:08:41.576902 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:08:41.576902 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:08:41.576902 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:41.576902 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:41.576902 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:41.576902 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:41.576902 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:41.576902 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:41.576902 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:41.576902 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:41.576902 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:41.576902 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:41.576902 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:41.576902 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:41.577891 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:41.577891 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:41.577891 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:08:41.577891 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:08:41.577891 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:08:41.577891 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:08:41.577891 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:08:41.577891 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:08:41.577891 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 05 21:08:41.577891 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:41.577891 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 320/647] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:08:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:41.577891 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b956dd76-2791-4d52-a468-c7f7ab44e57d None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:41.632065 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67799de0-9574-4dd0-9d1d-240b5b0e244c None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:41.668651 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab8880-a29a-4905-91dd-d0ed48474a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:41.669456 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab8880-a29a-4905-91dd-d0ed48474a99 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:41.669747 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab8880-a29a-4905-91dd-d0ed48474a99 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:41.670028 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab8880-a29a-4905-91dd-d0ed48474a99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:41.675846 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:41.681900 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab8880-a29a-4905-91dd-d0ed48474a99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:41.683410 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab8880-a29a-4905-91dd-d0ed48474a99 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:41.689323 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b956dd76-2791-4d52-a468-c7f7ab44e57d None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:41.702347 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-1bab8880-a29a-4905-91dd-d0ed48474a99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:41.702347 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:41.702347 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:41.702347 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:41.702347 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:41.702347 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:41.702347 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:41.702347 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:41.702347 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:41.702347 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:41.702347 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:41.702347 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:41.702347 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:08:41.702347 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:08:41.702347 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:08:41.703452 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:08:41.703452 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:41.703452 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:41.703452 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:41.703452 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:41.703452 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:41.703452 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:41.703452 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:41.703452 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:41.703452 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:41.703452 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:41.703452 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:41.703452 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:41.703452 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:41.703452 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:41.703452 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:41.703452 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:41.704374 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:08:41.704374 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:08:41.704374 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:41.704374 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:41.704374 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 328/648] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:41.704374 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab8880-a29a-4905-91dd-d0ed48474a99 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:41.735256 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b4825-2beb-41f3-9a4b-8214acb8eb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:41.735962 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b4825-2beb-41f3-9a4b-8214acb8eb7b None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:41.736257 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b4825-2beb-41f3-9a4b-8214acb8eb7b None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:41.736556 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b4825-2beb-41f3-9a4b-8214acb8eb7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:41.737482 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b4825-2beb-41f3-9a4b-8214acb8eb7b None admin] RBAC: Adding query filter params (role.id=601a166d56f647bda8256e971450cfdf, scope.project.id=ccd95a48530c4c86a3774301b969d6a9, user.id=be0701b0a7ff479e8b3214afaf618acd) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:41.737833 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b4825-2beb-41f3-9a4b-8214acb8eb7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:41.739494 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b4825-2beb-41f3-9a4b-8214acb8eb7b None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:41.754165 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 321/649] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:08:41 2022] GET /identity/v3/role_assignments?user.id=be0701b0a7ff479e8b3214afaf618acd&scope.project.id=ccd95a48530c4c86a3774301b969d6a9&role.id=601a166d56f647bda8256e971450cfdf => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:41.754165 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b4825-2beb-41f3-9a4b-8214acb8eb7b None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:41.802724 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:41.841138 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab8880-a29a-4905-91dd-d0ed48474a99 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:41.877891 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b4825-2beb-41f3-9a4b-8214acb8eb7b None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:41.880138 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578cfdf-1db5-453f-b4cf-073dcda95c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:41.881106 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578cfdf-1db5-453f-b4cf-073dcda95c8a None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:41.881612 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578cfdf-1db5-453f-b4cf-073dcda95c8a None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:41.882359 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578cfdf-1db5-453f-b4cf-073dcda95c8a None admin] PATH_INFO: `/v3/roles` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:41.883412 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f578cfdf-1db5-453f-b4cf-073dcda95c8a None admin] RBAC: Adding query filter params (name=service) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:41.883935 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f578cfdf-1db5-453f-b4cf-073dcda95c8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:41.886612 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f578cfdf-1db5-453f-b4cf-073dcda95c8a None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:41.896778 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 329/650] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:08:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:41.898227 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578cfdf-1db5-453f-b4cf-073dcda95c8a None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:41.917981 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd6dfdf-eecb-49ba-806a-b5c54f7cfc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:41.918790 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6dfdf-eecb-49ba-806a-b5c54f7cfc7c None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:41.919082 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6dfdf-eecb-49ba-806a-b5c54f7cfc7c None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:41.919357 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6dfdf-eecb-49ba-806a-b5c54f7cfc7c None admin] PATH_INFO: `/v3/users` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:41.920234 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd6dfdf-eecb-49ba-806a-b5c54f7cfc7c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:41.920521 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd6dfdf-eecb-49ba-806a-b5c54f7cfc7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:41.921973 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd6dfdf-eecb-49ba-806a-b5c54f7cfc7c None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:41.941236 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 322/651] 10.222.0.30 () {56 vars in 1137 bytes} [Tue Jul 5 21:08:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:41.942093 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd6dfdf-eecb-49ba-806a-b5c54f7cfc7c None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:41.954773 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:42.016861 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578cfdf-1db5-453f-b4cf-073dcda95c8a None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:42.051937 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd6dfdf-eecb-49ba-806a-b5c54f7cfc7c None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:42.054375 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f9ef0-3d1a-4cec-9caa-8ab22e4a9564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:42.055049 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f9ef0-3d1a-4cec-9caa-8ab22e4a9564 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:42.055338 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f9ef0-3d1a-4cec-9caa-8ab22e4a9564 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:42.055616 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f9ef0-3d1a-4cec-9caa-8ab22e4a9564 None admin] PATH_INFO: `/v3/domains` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:42.056944 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f9ef0-3d1a-4cec-9caa-8ab22e4a9564 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:42.057297 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f9ef0-3d1a-4cec-9caa-8ab22e4a9564 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:42.058816 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f9ef0-3d1a-4cec-9caa-8ab22e4a9564 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:42.073744 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 330/652] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:08:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:42.074644 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f9ef0-3d1a-4cec-9caa-8ab22e4a9564 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:42.090002 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2509cb90-d9c0-4243-8da3-6fcffdd420ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:42.090861 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509cb90-d9c0-4243-8da3-6fcffdd420ad None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:42.091204 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509cb90-d9c0-4243-8da3-6fcffdd420ad None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:42.091489 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509cb90-d9c0-4243-8da3-6fcffdd420ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:42.102413 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2509cb90-d9c0-4243-8da3-6fcffdd420ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:42.107805 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2509cb90-d9c0-4243-8da3-6fcffdd420ad None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:42.115357 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:42.123214 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-2509cb90-d9c0-4243-8da3-6fcffdd420ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:42.123214 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:42.123214 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:42.123214 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:42.123214 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:42.123214 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:42.123214 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:42.123214 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:42.123214 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:42.123214 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:42.123214 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:42.123214 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:42.123214 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:08:42.123214 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:08:42.123214 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:08:42.124207 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:08:42.124207 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:42.124207 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:42.124207 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:42.124207 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:42.124207 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:42.124207 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:42.124207 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:42.124207 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:42.124207 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:42.124207 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:42.124207 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:42.124207 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:42.124207 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:42.124207 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:42.124207 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:42.124207 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:42.125638 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:08:42.125638 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:08:42.125638 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:42.125638 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:42.125638 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 323/653] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:42.125638 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2509cb90-d9c0-4243-8da3-6fcffdd420ad None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:42.201068 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f9ef0-3d1a-4cec-9caa-8ab22e4a9564 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:42.210833 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:42.246044 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685faf70-6352-4334-af3e-163f1ebf5aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:42.247055 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685faf70-6352-4334-af3e-163f1ebf5aff None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:42.247347 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685faf70-6352-4334-af3e-163f1ebf5aff None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:42.247631 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685faf70-6352-4334-af3e-163f1ebf5aff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:42.252810 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2509cb90-d9c0-4243-8da3-6fcffdd420ad None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:42.290590 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f2e6e1-f8ae-45ca-97ea-8b4e581a9eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:42.291839 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2e6e1-f8ae-45ca-97ea-8b4e581a9eb1 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:42.292128 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2e6e1-f8ae-45ca-97ea-8b4e581a9eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:42.292406 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2e6e1-f8ae-45ca-97ea-8b4e581a9eb1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:42.300006 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f2e6e1-f8ae-45ca-97ea-8b4e581a9eb1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:42.301497 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f2e6e1-f8ae-45ca-97ea-8b4e581a9eb1 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:42.318939 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:42.324777 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-45f2e6e1-f8ae-45ca-97ea-8b4e581a9eb1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 21:08:42.324777 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:42.324777 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:42.324777 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:42.324777 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:42.324777 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:42.324777 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:42.324777 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:42.324777 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:42.324777 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:42.324777 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:42.324777 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:42.324777 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:08:42.324777 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:08:42.324777 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:08:42.324777 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:08:42.325942 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:42.325942 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:42.325942 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:08:42.325942 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:08:42.325942 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:08:42.325942 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:08:42.325942 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:42.325942 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:42.325942 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:42.325942 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:42.325942 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:42.325942 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:42.325942 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:42.325942 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:42.325942 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:42.325942 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:42.325942 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:42.325942 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:42.338371 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:42.338371 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:42.338371 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:08:42.338371 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:08:42.338371 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:08:42.338371 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:08:42.338371 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:08:42.338371 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:08:42.338371 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 21:08:42.338371 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:42.338960 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685faf70-6352-4334-af3e-163f1ebf5aff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:42.338960 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685faf70-6352-4334-af3e-163f1ebf5aff None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:42.339102 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 324/654] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:08:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:42.339102 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f2e6e1-f8ae-45ca-97ea-8b4e581a9eb1 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:42.443610 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f2e6e1-f8ae-45ca-97ea-8b4e581a9eb1 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:42.457503 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 331/655] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:08:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:08:42.459216 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685faf70-6352-4334-af3e-163f1ebf5aff None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:42.467747 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:42.479802 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b167fba-7235-49b0-8ca1-50983ecf02a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:42.480784 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b167fba-7235-49b0-8ca1-50983ecf02a9 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:42.481117 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b167fba-7235-49b0-8ca1-50983ecf02a9 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:42.481398 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b167fba-7235-49b0-8ca1-50983ecf02a9 None admin] PATH_INFO: `/v3/domains` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:42.482225 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b167fba-7235-49b0-8ca1-50983ecf02a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:42.482535 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b167fba-7235-49b0-8ca1-50983ecf02a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:42.484019 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b167fba-7235-49b0-8ca1-50983ecf02a9 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:42.497450 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 325/656] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:08:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:42.498360 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b167fba-7235-49b0-8ca1-50983ecf02a9 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:42.561039 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:42.571063 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685faf70-6352-4334-af3e-163f1ebf5aff None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:42.606858 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b167fba-7235-49b0-8ca1-50983ecf02a9 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:42.608272 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83683864-1abe-45af-a32f-793efc4bcf10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:42.609053 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83683864-1abe-45af-a32f-793efc4bcf10 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:42.609347 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83683864-1abe-45af-a32f-793efc4bcf10 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:42.609629 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83683864-1abe-45af-a32f-793efc4bcf10 None admin] PATH_INFO: `/v3/users` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:42.610890 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83683864-1abe-45af-a32f-793efc4bcf10 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:42.610890 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83683864-1abe-45af-a32f-793efc4bcf10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:42.612348 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83683864-1abe-45af-a32f-793efc4bcf10 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:42.636330 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 332/657] 10.222.0.30 () {56 vars in 1137 bytes} [Tue Jul 5 21:08:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:42.637421 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83683864-1abe-45af-a32f-793efc4bcf10 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:42.645498 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c3fc98-1d8d-494f-9717-4265c4fb9bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:42.646711 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c3fc98-1d8d-494f-9717-4265c4fb9bc4 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:42.647298 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c3fc98-1d8d-494f-9717-4265c4fb9bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:42.647762 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c3fc98-1d8d-494f-9717-4265c4fb9bc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:42.660448 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c3fc98-1d8d-494f-9717-4265c4fb9bc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:42.662156 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c3fc98-1d8d-494f-9717-4265c4fb9bc4 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:42.681146 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-d8c3fc98-1d8d-494f-9717-4265c4fb9bc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:42.681146 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:42.681146 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:42.681146 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:42.681146 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:42.681146 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:42.681146 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:42.681146 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:42.681146 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:42.681146 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:42.681146 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:42.681146 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:42.681146 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:08:42.681146 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:08:42.681146 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:08:42.682695 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:08:42.682695 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:42.682695 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:42.682695 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:42.682695 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:42.682695 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:42.682695 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:42.682695 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:42.682695 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:42.682695 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:42.682695 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:42.682695 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:42.682695 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:42.682695 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:42.682695 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:42.682695 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:42.682695 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:42.683585 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:08:42.683585 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:08:42.683585 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:42.683585 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:42.685676 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 326/658] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:42.686788 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c3fc98-1d8d-494f-9717-4265c4fb9bc4 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:42.724293 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:42.749398 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83683864-1abe-45af-a32f-793efc4bcf10 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:42.787960 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1198e56-f138-4125-be2c-148ea5db4b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:42.788776 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1198e56-f138-4125-be2c-148ea5db4b7b None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:42.789063 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1198e56-f138-4125-be2c-148ea5db4b7b None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:42.789377 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1198e56-f138-4125-be2c-148ea5db4b7b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:42.797332 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1198e56-f138-4125-be2c-148ea5db4b7b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:42.797860 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c3fc98-1d8d-494f-9717-4265c4fb9bc4 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:42.798845 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1198e56-f138-4125-be2c-148ea5db4b7b None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:42.815521 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-e1198e56-f138-4125-be2c-148ea5db4b7b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 21:08:42.815521 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:42.815521 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:42.815521 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:42.815521 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:42.815521 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:42.815521 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:42.815521 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:42.815521 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:42.815521 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:42.815521 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:42.815521 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:42.815521 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:08:42.815521 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:08:42.815521 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:08:42.815521 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:08:42.816724 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:42.816724 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:42.816724 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:08:42.816724 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:08:42.816724 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:08:42.816724 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:08:42.816724 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:42.816724 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:42.816724 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:42.816724 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:42.816724 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:42.816724 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:42.816724 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:42.816724 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:42.816724 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:42.816724 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:42.816724 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:42.816724 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:42.817831 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:42.817831 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:42.817831 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:08:42.817831 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:08:42.817831 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:08:42.817831 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:08:42.817831 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:08:42.817831 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:08:42.817831 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 21:08:42.817831 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:42.817831 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 333/659] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:08:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:42.817831 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1198e56-f138-4125-be2c-148ea5db4b7b None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:42.831117 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:42.839723 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabce04f-e101-4497-80f5-2b9a4775d90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:42.845961 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabce04f-e101-4497-80f5-2b9a4775d90a None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:42.845961 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabce04f-e101-4497-80f5-2b9a4775d90a None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:42.845961 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabce04f-e101-4497-80f5-2b9a4775d90a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:42.928862 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1198e56-f138-4125-be2c-148ea5db4b7b None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:42.932395 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabce04f-e101-4497-80f5-2b9a4775d90a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:42.933877 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabce04f-e101-4497-80f5-2b9a4775d90a None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:42.971226 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:42.975895 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe77fe-81b1-4dfd-8137-1135e91927d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:42.976628 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe77fe-81b1-4dfd-8137-1135e91927d0 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:42.976914 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe77fe-81b1-4dfd-8137-1135e91927d0 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:42.977604 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe77fe-81b1-4dfd-8137-1135e91927d0 None admin] PATH_INFO: `/v3/domains` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:42.978891 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fe77fe-81b1-4dfd-8137-1135e91927d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:42.983075 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fe77fe-81b1-4dfd-8137-1135e91927d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:42.983075 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fe77fe-81b1-4dfd-8137-1135e91927d0 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:42.997363 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 334/660] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:08:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:42.998245 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe77fe-81b1-4dfd-8137-1135e91927d0 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:43.053983 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 327/661] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:08:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:08:43.055013 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabce04f-e101-4497-80f5-2b9a4775d90a None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:43.089397 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:43.134224 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe77fe-81b1-4dfd-8137-1135e91927d0 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:43.168864 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabce04f-e101-4497-80f5-2b9a4775d90a None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:43.185923 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc38b0-1663-4a07-8e31-f3f701e5d2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:43.187379 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc38b0-1663-4a07-8e31-f3f701e5d2e0 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:43.188234 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc38b0-1663-4a07-8e31-f3f701e5d2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:43.188769 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc38b0-1663-4a07-8e31-f3f701e5d2e0 None admin] PATH_INFO: `/v3/users` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:43.190207 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dc38b0-1663-4a07-8e31-f3f701e5d2e0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:43.190739 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dc38b0-1663-4a07-8e31-f3f701e5d2e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:43.193157 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dc38b0-1663-4a07-8e31-f3f701e5d2e0 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:43.212781 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3bf05c-c88d-4c3e-9af5-c9c27f7bdfb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:43.214061 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bf05c-c88d-4c3e-9af5-c9c27f7bdfb1 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:43.214590 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bf05c-c88d-4c3e-9af5-c9c27f7bdfb1 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:43.215190 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bf05c-c88d-4c3e-9af5-c9c27f7bdfb1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:43.215430 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 335/662] 10.222.0.30 () {56 vars in 1139 bytes} [Tue Jul 5 21:08:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:43.216367 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc38b0-1663-4a07-8e31-f3f701e5d2e0 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:43.217832 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:43.226045 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3bf05c-c88d-4c3e-9af5-c9c27f7bdfb1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:43.228769 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3bf05c-c88d-4c3e-9af5-c9c27f7bdfb1 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:43.250485 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-dc3bf05c-c88d-4c3e-9af5-c9c27f7bdfb1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:08:43.250485 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:43.250485 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:43.250485 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:43.250485 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:43.250485 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:43.250485 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:43.250485 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:43.250485 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:43.250485 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:43.250485 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:43.250485 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:43.250485 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:08:43.250485 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:08:43.250485 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:08:43.251633 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:08:43.251633 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:43.251633 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:43.251633 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:43.251633 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:43.251633 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:43.251633 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:43.251633 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:43.251633 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:43.251633 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:43.251633 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:43.251633 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:43.251633 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:43.251633 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:43.251633 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:43.251633 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:43.251633 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:43.252792 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:08:43.252792 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:08:43.252792 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:08:43.252792 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:08:43.252792 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:08:43.252792 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:08:43.252792 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:08:43.252792 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:43.259471 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 328/663] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:08:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:43.259471 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3bf05c-c88d-4c3e-9af5-c9c27f7bdfb1 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:43.335685 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc38b0-1663-4a07-8e31-f3f701e5d2e0 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:43.367547 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:43.369695 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3bf05c-c88d-4c3e-9af5-c9c27f7bdfb1 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:43.375543 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61880aa9-1c02-45fc-af86-d9adf64004d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:43.376451 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61880aa9-1c02-45fc-af86-d9adf64004d5 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:43.376945 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61880aa9-1c02-45fc-af86-d9adf64004d5 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:43.377319 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61880aa9-1c02-45fc-af86-d9adf64004d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:43.388052 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61880aa9-1c02-45fc-af86-d9adf64004d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:43.389699 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61880aa9-1c02-45fc-af86-d9adf64004d5 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:43.404425 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e065c23-0536-48d1-b240-8e4c4b090990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:43.405085 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e065c23-0536-48d1-b240-8e4c4b090990 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:43.405372 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e065c23-0536-48d1-b240-8e4c4b090990 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:43.405655 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e065c23-0536-48d1-b240-8e4c4b090990 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:43.412095 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-61880aa9-1c02-45fc-af86-d9adf64004d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:43.412095 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:43.412095 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:43.412095 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:43.412095 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:43.412095 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:43.412095 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:43.412095 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:43.412095 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:43.412095 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:43.412095 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:43.412095 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:43.412095 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:08:43.412095 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:08:43.412095 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:08:43.412978 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:08:43.412978 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:43.412978 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:43.412978 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:43.412978 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:43.412978 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:43.412978 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:43.412978 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:43.412978 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:43.412978 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:43.412978 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:43.412978 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:43.412978 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:43.412978 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:43.412978 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:43.412978 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:43.412978 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:43.413900 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:08:43.413900 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:08:43.413900 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:43.413900 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:43.413900 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 336/664] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:43.414634 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61880aa9-1c02-45fc-af86-d9adf64004d5 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:43.474768 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:43.483662 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e065c23-0536-48d1-b240-8e4c4b090990 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:43.485139 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e065c23-0536-48d1-b240-8e4c4b090990 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:43.524241 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61880aa9-1c02-45fc-af86-d9adf64004d5 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:43.560642 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64694f7-8e19-468b-bd25-3d833b075317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:43.561444 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64694f7-8e19-468b-bd25-3d833b075317 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:43.561829 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64694f7-8e19-468b-bd25-3d833b075317 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:43.562241 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64694f7-8e19-468b-bd25-3d833b075317 None admin] PATH_INFO: `/v3/projects` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:43.563127 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64694f7-8e19-468b-bd25-3d833b075317 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:43.563535 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64694f7-8e19-468b-bd25-3d833b075317 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:43.565444 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64694f7-8e19-468b-bd25-3d833b075317 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:43.584489 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 337/665] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:08:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:43.584489 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc272845-d55d-44ed-8cc7-59084beefc8e None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:43.584489 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc272845-d55d-44ed-8cc7-59084beefc8e None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:43.584489 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc272845-d55d-44ed-8cc7-59084beefc8e None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:43.584489 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 338/666] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:43.584489 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc272845-d55d-44ed-8cc7-59084beefc8e None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:43.599802 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 329/667] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:08:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:08:43.600791 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e065c23-0536-48d1-b240-8e4c4b090990 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:43.638053 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:43.701161 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:43.704247 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc272845-d55d-44ed-8cc7-59084beefc8e None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:43.707667 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e065c23-0536-48d1-b240-8e4c4b090990 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:43.740347 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84313786-ca3e-40d6-9675-a77f1ad34c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:43.741213 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84313786-ca3e-40d6-9675-a77f1ad34c3e None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:43.741500 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84313786-ca3e-40d6-9675-a77f1ad34c3e None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:43.741776 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84313786-ca3e-40d6-9675-a77f1ad34c3e None admin] PATH_INFO: `/v3/domains` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:43.742065 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf4338c-cdb9-464e-8968-d3ea89f4025e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:43.742624 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84313786-ca3e-40d6-9675-a77f1ad34c3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:43.742789 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4338c-cdb9-464e-8968-d3ea89f4025e None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:43.742948 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84313786-ca3e-40d6-9675-a77f1ad34c3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:43.743049 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4338c-cdb9-464e-8968-d3ea89f4025e None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:43.743308 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4338c-cdb9-464e-8968-d3ea89f4025e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:43.744350 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf4338c-cdb9-464e-8968-d3ea89f4025e None admin] RBAC: Adding query filter params (role.id=601a166d56f647bda8256e971450cfdf, scope.project.id=ccd95a48530c4c86a3774301b969d6a9, user.id=598e27ffd54748f6aadb3d7cab5a4ce7) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:43.744454 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84313786-ca3e-40d6-9675-a77f1ad34c3e None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:43.744658 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf4338c-cdb9-464e-8968-d3ea89f4025e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:43.746085 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf4338c-cdb9-464e-8968-d3ea89f4025e None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:43.762393 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 330/668] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:08:43 2022] GET /identity/v3/role_assignments?user.id=598e27ffd54748f6aadb3d7cab5a4ce7&scope.project.id=ccd95a48530c4c86a3774301b969d6a9&role.id=601a166d56f647bda8256e971450cfdf => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:43.762393 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703dd6dd-df3c-4da9-9e05-338b5a3916c2 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:43.762393 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703dd6dd-df3c-4da9-9e05-338b5a3916c2 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:43.762393 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703dd6dd-df3c-4da9-9e05-338b5a3916c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:43.767676 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 339/669] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:08:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:43.768651 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84313786-ca3e-40d6-9675-a77f1ad34c3e None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:43.784285 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-703dd6dd-df3c-4da9-9e05-338b5a3916c2 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:43.785645 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-703dd6dd-df3c-4da9-9e05-338b5a3916c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:43.882633 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:43.883415 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 331/670] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:08:43.884747 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703dd6dd-df3c-4da9-9e05-338b5a3916c2 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:43.886541 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84313786-ca3e-40d6-9675-a77f1ad34c3e None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:43.926015 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb036b5-cae7-46d8-a05a-e2597d035717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:43.927217 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb036b5-cae7-46d8-a05a-e2597d035717 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:43.927704 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb036b5-cae7-46d8-a05a-e2597d035717 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:43.928137 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb036b5-cae7-46d8-a05a-e2597d035717 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:43.940988 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb036b5-cae7-46d8-a05a-e2597d035717 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:43.942746 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb036b5-cae7-46d8-a05a-e2597d035717 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:43.963025 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-edb036b5-cae7-46d8-a05a-e2597d035717 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:43.963025 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:43.963025 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:43.963025 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:43.963025 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:43.963025 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:43.963025 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:43.963025 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:43.963025 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:43.963025 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:43.963025 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:43.963025 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:43.963025 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:08:43.963025 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:08:43.963025 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:08:43.964202 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:08:43.964202 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:43.964202 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:43.964202 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:43.964202 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:43.964202 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:43.964202 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:43.964202 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:43.964202 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:43.964202 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:43.964202 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:43.964202 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:43.964202 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:43.964202 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:43.964202 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:43.964202 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:43.964202 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:43.965320 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:08:43.965320 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:08:43.965320 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:43.965320 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:43.967181 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 340/671] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:43.968177 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb036b5-cae7-46d8-a05a-e2597d035717 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:44.007867 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:44.021757 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703dd6dd-df3c-4da9-9e05-338b5a3916c2 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:44.066052 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc150b6-f647-4a53-97f7-280bc2f4f30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:44.066911 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc150b6-f647-4a53-97f7-280bc2f4f30e None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:44.067206 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc150b6-f647-4a53-97f7-280bc2f4f30e None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:44.067494 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc150b6-f647-4a53-97f7-280bc2f4f30e None admin] PATH_INFO: `/v3/projects/service` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:44.074738 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc150b6-f647-4a53-97f7-280bc2f4f30e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:44.076193 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc150b6-f647-4a53-97f7-280bc2f4f30e None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:44.086201 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb036b5-cae7-46d8-a05a-e2597d035717 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:44.090663 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-7fc150b6-f647-4a53-97f7-280bc2f4f30e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:08:44.090663 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:44.090663 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:44.090663 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:44.090663 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:44.090663 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:44.090663 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:44.090663 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:44.090663 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:44.090663 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:44.090663 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:44.090663 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:44.090663 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:08:44.090663 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:08:44.090663 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:08:44.091581 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:08:44.091581 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:44.091581 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:44.091581 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:44.091581 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:44.091581 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:44.091581 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:44.091581 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:44.091581 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:44.091581 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:44.091581 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:44.091581 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:44.091581 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:44.091581 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:44.091581 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:44.091581 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:44.091581 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:44.095136 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:08:44.095136 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:08:44.095136 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:08:44.095136 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:08:44.095136 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:08:44.095136 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:08:44.095136 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:08:44.095136 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:44.095136 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 332/672] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:08:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:44.095136 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc150b6-f647-4a53-97f7-280bc2f4f30e None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:44.127549 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586935e1-f657-4d73-a7ef-6e8ba947acb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:44.128532 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586935e1-f657-4d73-a7ef-6e8ba947acb0 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:44.129153 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586935e1-f657-4d73-a7ef-6e8ba947acb0 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:44.129438 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586935e1-f657-4d73-a7ef-6e8ba947acb0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:44.141122 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586935e1-f657-4d73-a7ef-6e8ba947acb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:08:44.149227 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-586935e1-f657-4d73-a7ef-6e8ba947acb0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:08:44.149227 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:44.149227 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:44.149227 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:44.149227 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:44.149227 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:44.149227 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:44.149227 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:44.149227 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:44.149227 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:44.149227 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:44.149227 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:44.149227 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:08:44.149227 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:08:44.149227 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:08:44.149227 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:08:44.151711 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:08:44.151711 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:08:44.151711 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:08:44.151711 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:08:44.151711 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:44.151711 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:44.151711 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:44.151711 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:44.151711 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:44.151711 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:44.151711 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:44.151711 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:44.151711 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:44.151711 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:44.151711 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:44.151711 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:44.152563 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:44.152563 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:44.152563 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:44.152563 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:44.152563 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:08:44.152563 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:08:44.152563 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:08:44.152563 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:08:44.152563 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:08:44.152563 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:08:44.152563 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:08:44.152563 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:44.152563 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 341/673] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:08:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:44.153321 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e08517-b6d1-4e35-8c56-809db71c62b4 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:44.153321 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e08517-b6d1-4e35-8c56-809db71c62b4 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:44.153567 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e08517-b6d1-4e35-8c56-809db71c62b4 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:44.154923 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 342/674] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:44.159234 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e08517-b6d1-4e35-8c56-809db71c62b4 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:44.174704 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:44.213915 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc150b6-f647-4a53-97f7-280bc2f4f30e None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:44.249858 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea2db7c-3590-49c5-8876-9a6bd3ce7ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:44.250598 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2db7c-3590-49c5-8876-9a6bd3ce7ef6 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:44.250886 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2db7c-3590-49c5-8876-9a6bd3ce7ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:44.251167 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2db7c-3590-49c5-8876-9a6bd3ce7ef6 None admin] PATH_INFO: `/v3/domains` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:44.251999 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea2db7c-3590-49c5-8876-9a6bd3ce7ef6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:44.252317 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea2db7c-3590-49c5-8876-9a6bd3ce7ef6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:44.253834 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea2db7c-3590-49c5-8876-9a6bd3ce7ef6 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:44.267965 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 333/675] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:08:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:44.268829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea2db7c-3590-49c5-8876-9a6bd3ce7ef6 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:44.269448 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e08517-b6d1-4e35-8c56-809db71c62b4 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:44.283833 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:44.309559 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b6fe01-58a4-45bf-8308-fffcaa29d27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:44.310285 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6fe01-58a4-45bf-8308-fffcaa29d27e None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:44.310578 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6fe01-58a4-45bf-8308-fffcaa29d27e None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:44.310861 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6fe01-58a4-45bf-8308-fffcaa29d27e None admin] PATH_INFO: `/v3/projects` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:44.311861 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b6fe01-58a4-45bf-8308-fffcaa29d27e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:44.312182 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b6fe01-58a4-45bf-8308-fffcaa29d27e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:44.314804 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b6fe01-58a4-45bf-8308-fffcaa29d27e None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:44.331742 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 343/676] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:08:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:44.331742 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d8d1f-99d5-47e3-8acf-6d1322f6aeb4 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:44.331742 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d8d1f-99d5-47e3-8acf-6d1322f6aeb4 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:44.331742 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d8d1f-99d5-47e3-8acf-6d1322f6aeb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:44.347607 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-cd7d8d1f-99d5-47e3-8acf-6d1322f6aeb4 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:44.348812 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-cd7d8d1f-99d5-47e3-8acf-6d1322f6aeb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:44.389035 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea2db7c-3590-49c5-8876-9a6bd3ce7ef6 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:44.426163 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 344/677] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:08:44.426163 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d8d1f-99d5-47e3-8acf-6d1322f6aeb4 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:44.426163 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:44.433811 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296bd3ad-8c1f-4371-95fd-b181917070f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:44.434533 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296bd3ad-8c1f-4371-95fd-b181917070f4 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:44.434823 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296bd3ad-8c1f-4371-95fd-b181917070f4 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:44.435109 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296bd3ad-8c1f-4371-95fd-b181917070f4 None admin] PATH_INFO: `/v3/roles` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:44.435862 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296bd3ad-8c1f-4371-95fd-b181917070f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:44.436181 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296bd3ad-8c1f-4371-95fd-b181917070f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:44.437560 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296bd3ad-8c1f-4371-95fd-b181917070f4 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:44.450983 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 334/678] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:08:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:44.450983 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296bd3ad-8c1f-4371-95fd-b181917070f4 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:44.522539 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:44.536776 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d8d1f-99d5-47e3-8acf-6d1322f6aeb4 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:44.554702 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296bd3ad-8c1f-4371-95fd-b181917070f4 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:44.574734 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b7b56-c424-404d-9bc2-246f6e911495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:44.575549 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b7b56-c424-404d-9bc2-246f6e911495 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:44.575836 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b7b56-c424-404d-9bc2-246f6e911495 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:44.576116 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b7b56-c424-404d-9bc2-246f6e911495 None admin] PATH_INFO: `/v3/projects/service` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:44.583241 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b7b56-c424-404d-9bc2-246f6e911495 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:44.584700 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b7b56-c424-404d-9bc2-246f6e911495 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:44.590810 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288dc9eb-1572-4033-93c7-e0cbee1f7f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:44.591499 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288dc9eb-1572-4033-93c7-e0cbee1f7f6c None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:44.591789 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288dc9eb-1572-4033-93c7-e0cbee1f7f6c None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:44.592067 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288dc9eb-1572-4033-93c7-e0cbee1f7f6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:44.592923 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288dc9eb-1572-4033-93c7-e0cbee1f7f6c None admin] RBAC: Adding query filter params (role.id=601a166d56f647bda8256e971450cfdf, scope.project.id=ccd95a48530c4c86a3774301b969d6a9, user.id=4b5719dcd7314f1487b5e168e07039f8) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:44.593257 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288dc9eb-1572-4033-93c7-e0cbee1f7f6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:44.594746 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288dc9eb-1572-4033-93c7-e0cbee1f7f6c None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:44.599178 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-121b7b56-c424-404d-9bc2-246f6e911495 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:08:44.599178 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:44.599178 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:44.599178 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:44.599178 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:44.599178 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:44.599178 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:44.599178 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:44.599178 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:44.599178 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:44.599178 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:44.599178 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:44.599178 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:08:44.599178 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:08:44.599178 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:08:44.600077 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:08:44.600077 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:44.600077 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:44.600077 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:44.600077 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:44.600077 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:44.600077 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:44.600077 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:44.600077 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:44.600077 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:44.600077 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:44.600077 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:44.600077 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:44.600077 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:44.600077 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:44.600077 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:44.600077 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:44.600981 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:08:44.600981 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:08:44.600981 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:08:44.600981 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:08:44.600981 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:08:44.600981 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:08:44.600981 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:08:44.600981 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:44.605532 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 345/679] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:08:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:44.606519 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b7b56-c424-404d-9bc2-246f6e911495 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:44.614554 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 335/680] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:08:44 2022] GET /identity/v3/role_assignments?user.id=4b5719dcd7314f1487b5e168e07039f8&scope.project.id=ccd95a48530c4c86a3774301b969d6a9&role.id=601a166d56f647bda8256e971450cfdf => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:44.622351 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288dc9eb-1572-4033-93c7-e0cbee1f7f6c None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:44.683801 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:44.739361 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b7b56-c424-404d-9bc2-246f6e911495 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:44.755693 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288dc9eb-1572-4033-93c7-e0cbee1f7f6c None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:44.785657 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ea2a67-6606-463e-8196-da059963c52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:44.786420 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea2a67-6606-463e-8196-da059963c52d None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:44.786703 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea2a67-6606-463e-8196-da059963c52d None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:44.786982 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea2a67-6606-463e-8196-da059963c52d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:44.797049 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eaf74e-f1ef-4c51-9cc5-22d8e30b7eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:44.798193 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eaf74e-f1ef-4c51-9cc5-22d8e30b7eea None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:44.798825 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eaf74e-f1ef-4c51-9cc5-22d8e30b7eea None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:44.799273 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ea2a67-6606-463e-8196-da059963c52d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:08:44.799542 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eaf74e-f1ef-4c51-9cc5-22d8e30b7eea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:44.801832 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:44.807629 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-16ea2a67-6606-463e-8196-da059963c52d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:08:44.807629 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:44.807629 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:44.807629 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:44.807629 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:44.807629 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:44.807629 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:44.807629 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:44.807629 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:44.807629 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:44.807629 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:44.807629 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:44.807629 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:08:44.807629 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:08:44.807629 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:08:44.807629 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:08:44.808818 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:08:44.808818 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:08:44.808818 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:08:44.808818 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:08:44.808818 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:44.808818 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:44.808818 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:44.808818 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:44.808818 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:44.808818 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:44.808818 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:44.808818 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:44.808818 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:44.808818 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:44.808818 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:44.808818 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:44.809987 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:44.809987 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:44.809987 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:44.809987 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:44.809987 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:08:44.809987 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:08:44.809987 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:08:44.809987 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:08:44.809987 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:08:44.809987 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:08:44.809987 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:08:44.809987 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:44.809987 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 346/681] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:08:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:44.809987 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ea2a67-6606-463e-8196-da059963c52d None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:44.819592 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eaf74e-f1ef-4c51-9cc5-22d8e30b7eea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:44.835487 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eaf74e-f1ef-4c51-9cc5-22d8e30b7eea None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:44.843013 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-91eaf74e-f1ef-4c51-9cc5-22d8e30b7eea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:44.843013 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:44.843013 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:44.843013 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:44.843013 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:44.843013 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:44.843013 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:44.843013 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:44.843013 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:44.843013 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:44.843013 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:44.843013 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:44.843013 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:08:44.843013 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:08:44.843013 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:08:44.843981 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:08:44.843981 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:44.843981 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:44.843981 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:44.843981 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:44.843981 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:44.843981 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:44.843981 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:44.843981 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:44.843981 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:44.843981 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:44.843981 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:44.843981 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:44.843981 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:44.843981 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:44.843981 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:44.843981 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:44.845309 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:08:44.845309 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:08:44.845309 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:44.845309 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:44.845309 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 336/682] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:44.845617 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eaf74e-f1ef-4c51-9cc5-22d8e30b7eea None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:44.937516 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ea2a67-6606-463e-8196-da059963c52d None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:44.961485 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:44.973951 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d92c57-60d3-455a-965c-c455bab85ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:44.978373 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d92c57-60d3-455a-965c-c455bab85ba7 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:44.978373 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d92c57-60d3-455a-965c-c455bab85ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:44.978373 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d92c57-60d3-455a-965c-c455bab85ba7 None admin] PATH_INFO: `/v3/projects` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:44.978373 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d92c57-60d3-455a-965c-c455bab85ba7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:44.978373 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d92c57-60d3-455a-965c-c455bab85ba7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:44.978373 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d92c57-60d3-455a-965c-c455bab85ba7 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:44.978852 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eaf74e-f1ef-4c51-9cc5-22d8e30b7eea None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:44.991557 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 347/683] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:08:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:44.992413 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d92c57-60d3-455a-965c-c455bab85ba7 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:45.026399 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20514d95-e445-4f54-b2ab-0ec5882bd7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:45.027088 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20514d95-e445-4f54-b2ab-0ec5882bd7f7 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:45.027371 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20514d95-e445-4f54-b2ab-0ec5882bd7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:45.027697 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20514d95-e445-4f54-b2ab-0ec5882bd7f7 None admin] PATH_INFO: `/v3/roles` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:45.028493 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20514d95-e445-4f54-b2ab-0ec5882bd7f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:45.028809 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20514d95-e445-4f54-b2ab-0ec5882bd7f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:45.030213 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20514d95-e445-4f54-b2ab-0ec5882bd7f7 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:45.039468 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 337/684] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:08:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:45.040246 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20514d95-e445-4f54-b2ab-0ec5882bd7f7 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:45.095046 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:45.124724 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d92c57-60d3-455a-965c-c455bab85ba7 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:45.163521 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20514d95-e445-4f54-b2ab-0ec5882bd7f7 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:45.164325 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d37e20-dd29-441b-9c2b-31a07302b0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:45.165435 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d37e20-dd29-441b-9c2b-31a07302b0cb None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:45.166549 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d37e20-dd29-441b-9c2b-31a07302b0cb None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:45.171805 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d37e20-dd29-441b-9c2b-31a07302b0cb None admin] PATH_INFO: `/v3/domains` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:45.171805 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d37e20-dd29-441b-9c2b-31a07302b0cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:45.171805 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d37e20-dd29-441b-9c2b-31a07302b0cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:45.171805 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d37e20-dd29-441b-9c2b-31a07302b0cb None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:45.182997 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 348/685] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:08:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:45.184315 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d37e20-dd29-441b-9c2b-31a07302b0cb None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:45.206057 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833866c8-6450-483f-8456-2e0a64e752e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:45.207159 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833866c8-6450-483f-8456-2e0a64e752e5 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:45.207452 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833866c8-6450-483f-8456-2e0a64e752e5 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:45.207740 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833866c8-6450-483f-8456-2e0a64e752e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:45.208581 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833866c8-6450-483f-8456-2e0a64e752e5 None admin] RBAC: Adding query filter params (role.id=601a166d56f647bda8256e971450cfdf, scope.project.id=ccd95a48530c4c86a3774301b969d6a9, user.id=a3947355cf8a4b75bd31c5e6125e75e4) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:45.208901 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833866c8-6450-483f-8456-2e0a64e752e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:45.211285 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833866c8-6450-483f-8456-2e0a64e752e5 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:45.222286 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 338/686] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:08:45 2022] GET /identity/v3/role_assignments?user.id=a3947355cf8a4b75bd31c5e6125e75e4&scope.project.id=ccd95a48530c4c86a3774301b969d6a9&role.id=601a166d56f647bda8256e971450cfdf => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:45.223199 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833866c8-6450-483f-8456-2e0a64e752e5 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:45.246429 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:45.338550 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d37e20-dd29-441b-9c2b-31a07302b0cb None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:45.389529 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0b07c-15e9-4080-9b82-669e09d6af50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:45.390776 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0b07c-15e9-4080-9b82-669e09d6af50 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:45.391280 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0b07c-15e9-4080-9b82-669e09d6af50 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:45.391791 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0b07c-15e9-4080-9b82-669e09d6af50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:45.423314 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c0b07c-15e9-4080-9b82-669e09d6af50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:45.424787 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c0b07c-15e9-4080-9b82-669e09d6af50 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:45.427270 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833866c8-6450-483f-8456-2e0a64e752e5 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:45.443108 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:45.447413 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-a0c0b07c-15e9-4080-9b82-669e09d6af50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:45.447413 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:45.447413 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:45.447413 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:45.447413 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:45.447413 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:45.447413 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:45.447413 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:45.447413 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:45.447413 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:45.447413 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:45.447413 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:45.447413 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:08:45.447413 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:08:45.447413 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:08:45.448656 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:08:45.448656 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:45.448656 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:45.448656 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:45.448656 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:45.448656 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:45.448656 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:45.448656 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:45.448656 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:45.448656 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:45.448656 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:45.448656 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:45.448656 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:45.448656 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:45.448656 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:45.448656 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:45.448656 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:45.449791 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:08:45.449791 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:08:45.449791 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:45.449791 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:45.451379 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 349/687] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:45.457029 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0b07c-15e9-4080-9b82-669e09d6af50 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:45.470337 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff379d55-54bf-408f-ad51-1283b1c31eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:45.471155 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff379d55-54bf-408f-ad51-1283b1c31eef None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:45.471447 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff379d55-54bf-408f-ad51-1283b1c31eef None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:45.471729 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff379d55-54bf-408f-ad51-1283b1c31eef None admin] PATH_INFO: `/v3/users/swift` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:45.482384 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff379d55-54bf-408f-ad51-1283b1c31eef None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:45.483905 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff379d55-54bf-408f-ad51-1283b1c31eef None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:45.500928 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-ff379d55-54bf-408f-ad51-1283b1c31eef None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 21:08:45.500928 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:45.500928 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:45.500928 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:45.500928 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:45.500928 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:45.500928 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:45.500928 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:45.500928 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:45.500928 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:45.500928 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:45.500928 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:45.500928 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:08:45.500928 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:08:45.500928 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:08:45.500928 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:08:45.501933 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:45.501933 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:45.501933 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:08:45.501933 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:08:45.501933 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:08:45.501933 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:08:45.501933 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:45.501933 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:45.501933 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:45.501933 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:45.501933 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:45.501933 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:45.501933 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:45.501933 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:45.501933 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:45.501933 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:45.501933 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:45.501933 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:45.503260 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:45.503260 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:45.503260 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:08:45.503260 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:08:45.503260 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:08:45.503260 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:08:45.503260 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:08:45.503260 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:08:45.503260 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 21:08:45.503260 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:45.503260 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 339/688] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:08:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:45.507997 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff379d55-54bf-408f-ad51-1283b1c31eef None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:45.582094 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:45.592200 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0b07c-15e9-4080-9b82-669e09d6af50 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:45.636799 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff379d55-54bf-408f-ad51-1283b1c31eef None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:45.638968 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5c0ca-6f6a-4c2a-a13e-410269ac8df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:45.640897 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5c0ca-6f6a-4c2a-a13e-410269ac8df4 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:45.641376 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5c0ca-6f6a-4c2a-a13e-410269ac8df4 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:45.641858 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5c0ca-6f6a-4c2a-a13e-410269ac8df4 None admin] PATH_INFO: `/v3/domains` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:45.642820 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde5c0ca-6f6a-4c2a-a13e-410269ac8df4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:45.643313 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde5c0ca-6f6a-4c2a-a13e-410269ac8df4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:45.645418 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde5c0ca-6f6a-4c2a-a13e-410269ac8df4 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:45.661498 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 350/689] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:08:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:45.667049 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5c0ca-6f6a-4c2a-a13e-410269ac8df4 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:45.673934 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a9f543-a81c-4dcf-9951-32770fcfae24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:45.674739 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9f543-a81c-4dcf-9951-32770fcfae24 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:45.675103 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9f543-a81c-4dcf-9951-32770fcfae24 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:45.675461 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9f543-a81c-4dcf-9951-32770fcfae24 None admin] PATH_INFO: `/v3/users` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:45.676374 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a9f543-a81c-4dcf-9951-32770fcfae24 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:45.676782 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a9f543-a81c-4dcf-9951-32770fcfae24 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:45.678344 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a9f543-a81c-4dcf-9951-32770fcfae24 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:45.721276 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 340/690] 10.222.0.30 () {56 vars in 1135 bytes} [Tue Jul 5 21:08:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:45.726202 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a9f543-a81c-4dcf-9951-32770fcfae24 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:45.782773 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:45.795674 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5c0ca-6f6a-4c2a-a13e-410269ac8df4 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:45.839615 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1124e76-b6c8-4c5d-b5d7-4392d3e45510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:45.840347 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1124e76-b6c8-4c5d-b5d7-4392d3e45510 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:45.840637 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1124e76-b6c8-4c5d-b5d7-4392d3e45510 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:45.840920 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1124e76-b6c8-4c5d-b5d7-4392d3e45510 None admin] PATH_INFO: `/v3/users/nova` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:45.854806 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1124e76-b6c8-4c5d-b5d7-4392d3e45510 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:45.856276 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1124e76-b6c8-4c5d-b5d7-4392d3e45510 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:45.881625 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-e1124e76-b6c8-4c5d-b5d7-4392d3e45510 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:08:45.881625 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:45.881625 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:45.881625 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:45.881625 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:45.881625 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:45.881625 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:45.881625 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:45.881625 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:45.881625 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:45.881625 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:45.881625 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:45.881625 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:08:45.881625 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:08:45.881625 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:08:45.881625 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:08:45.882684 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:45.882684 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:45.882684 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:08:45.882684 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:08:45.882684 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:08:45.882684 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:08:45.882684 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:45.882684 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:45.882684 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:45.882684 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:45.882684 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:45.882684 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:45.882684 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:45.882684 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:45.882684 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:45.882684 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:45.882684 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:45.882684 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:45.883775 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:45.883775 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:45.883775 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:08:45.883775 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:08:45.883775 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:08:45.883775 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:08:45.883775 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:08:45.883775 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:08:45.883775 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:08:45.883775 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:45.891746 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 351/691] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Jul 5 21:08:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:08:45.895096 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1124e76-b6c8-4c5d-b5d7-4392d3e45510 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:45.911265 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a9f543-a81c-4dcf-9951-32770fcfae24 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:45.927945 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:45.977501 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789bb06a-079a-4b36-99cc-552e4af43d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:45.978774 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bb06a-079a-4b36-99cc-552e4af43d41 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:45.979233 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bb06a-079a-4b36-99cc-552e4af43d41 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:45.979597 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bb06a-079a-4b36-99cc-552e4af43d41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:46.076345 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1124e76-b6c8-4c5d-b5d7-4392d3e45510 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:46.124211 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac03dd-e6a7-4da8-9135-fba37897aa6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:46.124211 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac03dd-e6a7-4da8-9135-fba37897aa6f None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:46.124211 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac03dd-e6a7-4da8-9135-fba37897aa6f None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:46.124211 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac03dd-e6a7-4da8-9135-fba37897aa6f None admin] PATH_INFO: `/v3/users` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:46.124643 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ac03dd-e6a7-4da8-9135-fba37897aa6f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:46.124643 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ac03dd-e6a7-4da8-9135-fba37897aa6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:46.124643 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ac03dd-e6a7-4da8-9135-fba37897aa6f None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:46.125632 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789bb06a-079a-4b36-99cc-552e4af43d41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:46.127124 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789bb06a-079a-4b36-99cc-552e4af43d41 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:46.147448 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 352/692] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Jul 5 21:08:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:46.148812 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b296f70-46cb-4c58-b34a-8d2d8b600562 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:46.149103 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b296f70-46cb-4c58-b34a-8d2d8b600562 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:46.149386 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b296f70-46cb-4c58-b34a-8d2d8b600562 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:46.151505 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 353/693] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:46.157483 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b296f70-46cb-4c58-b34a-8d2d8b600562 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:46.163537 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:46.248578 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:46.252974 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 341/694] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:08:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 21:08:46.254969 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2632772-26cc-4c6e-a18c-79e44f203676 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:46.255883 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2632772-26cc-4c6e-a18c-79e44f203676 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:46.256361 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2632772-26cc-4c6e-a18c-79e44f203676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:46.277936 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-d2632772-26cc-4c6e-a18c-79e44f203676 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:46.279987 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-d2632772-26cc-4c6e-a18c-79e44f203676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:46.282295 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b296f70-46cb-4c58-b34a-8d2d8b600562 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:46.333048 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5af06-69e3-4187-8843-73dcfbef55cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:46.334146 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5af06-69e3-4187-8843-73dcfbef55cb None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:46.334638 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5af06-69e3-4187-8843-73dcfbef55cb None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:46.335162 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5af06-69e3-4187-8843-73dcfbef55cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:46.370401 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 342/695] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:08:46.371292 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2632772-26cc-4c6e-a18c-79e44f203676 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:46.423671 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e5af06-69e3-4187-8843-73dcfbef55cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:46.424913 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e5af06-69e3-4187-8843-73dcfbef55cb None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:46.459206 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:46.499406 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:46.512205 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2632772-26cc-4c6e-a18c-79e44f203676 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:46.534731 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 354/696] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:08:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:08:46.535727 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5af06-69e3-4187-8843-73dcfbef55cb None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:46.555264 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43532f-4aef-4d81-8348-b051421d87a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:46.557257 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43532f-4aef-4d81-8348-b051421d87a0 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:46.557893 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43532f-4aef-4d81-8348-b051421d87a0 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:46.558346 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43532f-4aef-4d81-8348-b051421d87a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:46.572489 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43532f-4aef-4d81-8348-b051421d87a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:46.574830 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43532f-4aef-4d81-8348-b051421d87a0 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:46.600991 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-4f43532f-4aef-4d81-8348-b051421d87a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:46.600991 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:46.600991 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:46.600991 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:46.600991 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:46.600991 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:46.600991 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:46.600991 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:46.600991 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:46.600991 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:46.600991 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:46.600991 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:46.600991 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:08:46.600991 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:08:46.600991 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:08:46.601946 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:08:46.601946 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:46.601946 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:46.601946 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:46.601946 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:46.601946 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:46.601946 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:46.601946 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:46.601946 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:46.601946 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:46.601946 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:46.601946 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:46.601946 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:46.601946 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:46.601946 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:46.601946 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:46.601946 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:46.602880 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:08:46.602880 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:08:46.602880 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:46.602880 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:46.606210 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 343/697] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:46.607251 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43532f-4aef-4d81-8348-b051421d87a0 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:46.650742 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5af06-69e3-4187-8843-73dcfbef55cb None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:46.691508 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12471ad-91fc-45df-bbf8-dc92aa60345f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:46.693409 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12471ad-91fc-45df-bbf8-dc92aa60345f None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:46.693886 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12471ad-91fc-45df-bbf8-dc92aa60345f None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:46.694387 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12471ad-91fc-45df-bbf8-dc92aa60345f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:46.709097 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12471ad-91fc-45df-bbf8-dc92aa60345f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:46.711393 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12471ad-91fc-45df-bbf8-dc92aa60345f None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:46.723797 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43532f-4aef-4d81-8348-b051421d87a0 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:46.737041 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-b12471ad-91fc-45df-bbf8-dc92aa60345f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:46.737041 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:46.737041 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:46.737041 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:46.737041 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:46.737041 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:46.737041 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:46.737041 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:46.737041 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:46.737041 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:46.737041 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:46.737041 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:46.737041 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:08:46.737041 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:08:46.737041 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:08:46.737953 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:08:46.737953 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:46.737953 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:46.737953 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:46.737953 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:46.737953 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:46.737953 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:46.737953 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:46.737953 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:46.737953 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:46.737953 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:46.737953 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:46.737953 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:46.737953 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:46.737953 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:46.737953 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:46.737953 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:46.738905 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:08:46.738905 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:08:46.738905 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:46.738905 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:46.739667 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 355/698] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:46.740108 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12471ad-91fc-45df-bbf8-dc92aa60345f None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:46.741983 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:46.767903 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:46.773117 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f033ce5-52f6-4b35-a3c7-abba474d3dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:46.774346 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f033ce5-52f6-4b35-a3c7-abba474d3dee None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:46.775752 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f033ce5-52f6-4b35-a3c7-abba474d3dee None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:46.776493 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f033ce5-52f6-4b35-a3c7-abba474d3dee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:46.789535 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f033ce5-52f6-4b35-a3c7-abba474d3dee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:46.791561 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f033ce5-52f6-4b35-a3c7-abba474d3dee None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:46.816363 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-9f033ce5-52f6-4b35-a3c7-abba474d3dee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:46.816363 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:46.816363 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:46.816363 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:46.816363 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:46.816363 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:46.816363 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:46.816363 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:46.816363 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:46.816363 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:46.816363 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:46.816363 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:46.816363 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:08:46.816363 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:08:46.816363 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:08:46.817322 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:08:46.817322 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:46.817322 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:46.817322 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:46.817322 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:46.817322 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:46.817322 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:46.817322 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:46.817322 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:46.817322 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:46.817322 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:46.817322 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:46.817322 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:46.817322 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:46.817322 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:46.817322 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:46.817322 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:46.818243 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:08:46.818243 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:08:46.818243 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:46.818243 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:46.825291 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 344/699] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:46.825291 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f033ce5-52f6-4b35-a3c7-abba474d3dee None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:46.863235 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12471ad-91fc-45df-bbf8-dc92aa60345f None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:46.905591 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78a2ba-674d-4894-8988-76a19dab2fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:46.906294 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78a2ba-674d-4894-8988-76a19dab2fce None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:46.906587 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78a2ba-674d-4894-8988-76a19dab2fce None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:46.906872 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78a2ba-674d-4894-8988-76a19dab2fce None admin] PATH_INFO: `/v3/domains` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:46.907607 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de78a2ba-674d-4894-8988-76a19dab2fce None admin] RBAC: Adding query filter params (name=Default) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:46.907923 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de78a2ba-674d-4894-8988-76a19dab2fce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:46.909536 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de78a2ba-674d-4894-8988-76a19dab2fce None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:46.927987 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 356/700] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:08:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:46.928929 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78a2ba-674d-4894-8988-76a19dab2fce None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:46.938255 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f033ce5-52f6-4b35-a3c7-abba474d3dee None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:46.977065 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c74aa-cf12-41fb-8aae-51077dc63132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:46.977728 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c74aa-cf12-41fb-8aae-51077dc63132 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:46.978014 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c74aa-cf12-41fb-8aae-51077dc63132 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:46.978830 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c74aa-cf12-41fb-8aae-51077dc63132 None admin] PATH_INFO: `/v3/domains` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:46.979548 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c74aa-cf12-41fb-8aae-51077dc63132 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:46.979956 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c74aa-cf12-41fb-8aae-51077dc63132 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:46.981265 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c74aa-cf12-41fb-8aae-51077dc63132 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:46.997949 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 345/701] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:08:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:46.997949 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c74aa-cf12-41fb-8aae-51077dc63132 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:47.026002 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:47.029054 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:47.045811 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78a2ba-674d-4894-8988-76a19dab2fce None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:47.079761 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9566183f-c609-4560-8bb2-a3c57e0a5458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:47.080840 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566183f-c609-4560-8bb2-a3c57e0a5458 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:47.080840 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566183f-c609-4560-8bb2-a3c57e0a5458 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:47.081128 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566183f-c609-4560-8bb2-a3c57e0a5458 None admin] PATH_INFO: `/v3/domains` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:47.081808 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9566183f-c609-4560-8bb2-a3c57e0a5458 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:47.082123 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9566183f-c609-4560-8bb2-a3c57e0a5458 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:47.083664 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9566183f-c609-4560-8bb2-a3c57e0a5458 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:47.102681 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 357/702] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:08:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:47.102681 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78639c45-5126-46a3-b2c2-48d993c25df0 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:47.102681 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78639c45-5126-46a3-b2c2-48d993c25df0 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:47.102681 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78639c45-5126-46a3-b2c2-48d993c25df0 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:47.102681 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 358/703] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:47.102681 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78639c45-5126-46a3-b2c2-48d993c25df0 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:47.115290 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c74aa-cf12-41fb-8aae-51077dc63132 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:47.151761 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6a214-e7c3-4c08-8765-7cbe33226d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:47.152573 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6a214-e7c3-4c08-8765-7cbe33226d7c None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:47.152868 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6a214-e7c3-4c08-8765-7cbe33226d7c None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:47.153154 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6a214-e7c3-4c08-8765-7cbe33226d7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:47.163202 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d6a214-e7c3-4c08-8765-7cbe33226d7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:47.164660 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d6a214-e7c3-4c08-8765-7cbe33226d7c None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:47.180083 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-98d6a214-e7c3-4c08-8765-7cbe33226d7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:08:47.180083 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:47.180083 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:47.180083 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:47.180083 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:47.180083 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:47.180083 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:47.180083 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:47.180083 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:47.180083 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:47.180083 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:47.180083 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:47.180083 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:08:47.180083 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:08:47.180083 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:08:47.181240 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:08:47.181240 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:47.181240 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:47.181240 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:47.181240 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:47.181240 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:47.181240 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:47.181240 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:47.181240 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:47.181240 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:47.181240 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:47.181240 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:47.181240 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:47.181240 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:47.181240 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:47.181240 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:47.181240 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:47.182788 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:08:47.182788 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:08:47.182788 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:08:47.182788 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:08:47.182788 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:08:47.182788 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:08:47.182788 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:08:47.182788 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:47.184614 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 346/704] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:08:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:47.185628 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6a214-e7c3-4c08-8765-7cbe33226d7c None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:47.224002 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78639c45-5126-46a3-b2c2-48d993c25df0 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:47.260822 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3eef70-b921-450c-8474-9a9960101f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:47.261301 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3eef70-b921-450c-8474-9a9960101f25 None admin] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:47.261587 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3eef70-b921-450c-8474-9a9960101f25 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:47.261863 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3eef70-b921-450c-8474-9a9960101f25 None admin] PATH_INFO: `/v3/users` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:47.262601 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3eef70-b921-450c-8474-9a9960101f25 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:47.264034 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3eef70-b921-450c-8474-9a9960101f25 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:47.278893 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:47.295176 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6a214-e7c3-4c08-8765-7cbe33226d7c None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:47.329776 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c350065-8340-48c2-84c9-888164b157e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:47.330613 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c350065-8340-48c2-84c9-888164b157e8 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:47.330902 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c350065-8340-48c2-84c9-888164b157e8 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:47.331182 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c350065-8340-48c2-84c9-888164b157e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:47.337780 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c350065-8340-48c2-84c9-888164b157e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:47.339251 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c350065-8340-48c2-84c9-888164b157e8 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:47.352802 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-1c350065-8340-48c2-84c9-888164b157e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:08:47.352802 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:47.352802 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:47.352802 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:47.352802 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:47.352802 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:47.352802 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:47.352802 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:47.352802 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:47.352802 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:47.352802 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:47.352802 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:47.352802 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:08:47.352802 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:08:47.352802 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:08:47.353983 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:08:47.353983 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:47.353983 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:47.353983 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:47.353983 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:47.353983 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:47.353983 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:47.353983 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:47.353983 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:47.353983 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:47.353983 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:47.353983 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:47.353983 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:47.353983 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:47.353983 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:47.353983 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:47.353983 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:47.354986 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:08:47.354986 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:08:47.354986 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:08:47.354986 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:08:47.354986 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:08:47.354986 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:08:47.354986 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:08:47.354986 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:47.354986 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 347/705] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:08:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:47.357045 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6a2ec-a30c-4044-9bec-1102c530f450 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:47.357532 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6a2ec-a30c-4044-9bec-1102c530f450 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:47.357823 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6a2ec-a30c-4044-9bec-1102c530f450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:47.362006 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:47.378158 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 359/706] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:08:47 2022] POST /identity/v3/users => generated 254 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:08:47.378158 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3eef70-b921-450c-8474-9a9960101f25 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:47.386503 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-84d6a2ec-a30c-4044-9bec-1102c530f450 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:47.387758 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-84d6a2ec-a30c-4044-9bec-1102c530f450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:47.482601 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 348/707] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:08:47.483993 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6a2ec-a30c-4044-9bec-1102c530f450 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:47.493930 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3eef70-b921-450c-8474-9a9960101f25 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:47.551261 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0e4e9-f52c-48b2-be49-b2de28920b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:47.552181 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0e4e9-f52c-48b2-be49-b2de28920b74 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:47.552889 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0e4e9-f52c-48b2-be49-b2de28920b74 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:47.553367 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0e4e9-f52c-48b2-be49-b2de28920b74 None admin] PATH_INFO: `/v3/projects` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:47.555003 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b0e4e9-f52c-48b2-be49-b2de28920b74 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:47.555599 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b0e4e9-f52c-48b2-be49-b2de28920b74 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:47.558310 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b0e4e9-f52c-48b2-be49-b2de28920b74 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:47.573772 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 360/708] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:08:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:47.575577 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0e4e9-f52c-48b2-be49-b2de28920b74 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:47.591236 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:47.621315 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6a2ec-a30c-4044-9bec-1102c530f450 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:47.643931 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:47.661516 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167a2fe-9552-4b3d-918b-85ae63d1c8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:47.662220 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167a2fe-9552-4b3d-918b-85ae63d1c8cd None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:47.662515 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167a2fe-9552-4b3d-918b-85ae63d1c8cd None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:47.662799 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167a2fe-9552-4b3d-918b-85ae63d1c8cd None admin] PATH_INFO: `/v3/projects` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:47.663595 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5167a2fe-9552-4b3d-918b-85ae63d1c8cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:47.663910 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5167a2fe-9552-4b3d-918b-85ae63d1c8cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:47.665349 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5167a2fe-9552-4b3d-918b-85ae63d1c8cd None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:47.677910 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 349/709] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:08:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:47.679540 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59184fc-2992-4c05-b47d-0d918fbd954f None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:47.679837 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59184fc-2992-4c05-b47d-0d918fbd954f None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:47.680122 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59184fc-2992-4c05-b47d-0d918fbd954f None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:47.682222 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 350/710] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:47.686665 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59184fc-2992-4c05-b47d-0d918fbd954f None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:47.694683 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0e4e9-f52c-48b2-be49-b2de28920b74 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:47.732569 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5a33d-b3fd-4158-9f2d-a633de2d2bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:47.733843 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5a33d-b3fd-4158-9f2d-a633de2d2bec None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:47.733843 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5a33d-b3fd-4158-9f2d-a633de2d2bec None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:47.734191 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5a33d-b3fd-4158-9f2d-a633de2d2bec None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:47.734862 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b5a33d-b3fd-4158-9f2d-a633de2d2bec None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:47.736240 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b5a33d-b3fd-4158-9f2d-a633de2d2bec None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:47.751085 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-89b5a33d-b3fd-4158-9f2d-a633de2d2bec None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 21:08:47.751085 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:47.751085 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:08:47.751085 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:08:47.751085 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:08:47.751085 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:08:47.751085 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:08:47.751085 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:08:47.751085 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 21:08:47.751085 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:47.751085 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:08:47.751085 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:47.751085 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:47.751085 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:47.751085 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:47.751085 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:47.752111 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:47.752111 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:47.752111 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:47.752111 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:47.752111 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:47.752111 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:47.752111 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:47.752111 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:08:47.752111 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:08:47.752111 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:08:47.752111 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:08:47.752111 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:47.752111 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:47.752111 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:47.752111 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:47.752111 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:47.752990 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:47.752990 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:47.752990 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:47.752990 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:47.752990 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:47.752990 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:47.752990 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:47.752990 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:47.752990 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:47.752990 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:47.752990 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:47.752990 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:08:47.752990 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:08:47.752990 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 21:08:47.752990 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:47.752990 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 361/711] 10.222.0.30 () {56 vars in 1129 bytes} [Tue Jul 5 21:08:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:47.754308 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5a33d-b3fd-4158-9f2d-a633de2d2bec None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:47.807834 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59184fc-2992-4c05-b47d-0d918fbd954f None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:47.844568 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6995d-d12b-4603-a710-662cd4076ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:47.845263 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6995d-d12b-4603-a710-662cd4076ed1 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:47.845647 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6995d-d12b-4603-a710-662cd4076ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:47.845911 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6995d-d12b-4603-a710-662cd4076ed1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:47.846892 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6995d-d12b-4603-a710-662cd4076ed1 None admin] RBAC: Adding query filter params (role.id=601a166d56f647bda8256e971450cfdf, scope.project.id=ccd95a48530c4c86a3774301b969d6a9, user.id=e6761d76cc1d48579c7fda6125900648) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:47.847218 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6995d-d12b-4603-a710-662cd4076ed1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:47.848748 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6995d-d12b-4603-a710-662cd4076ed1 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:47.851072 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:47.855148 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5a33d-b3fd-4158-9f2d-a633de2d2bec None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:47.866261 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 351/712] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:08:47 2022] GET /identity/v3/role_assignments?user.id=e6761d76cc1d48579c7fda6125900648&scope.project.id=ccd95a48530c4c86a3774301b969d6a9&role.id=601a166d56f647bda8256e971450cfdf => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:47.866261 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caef2bd-5819-4910-97f6-a16c0538890b None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:47.866261 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caef2bd-5819-4910-97f6-a16c0538890b None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:47.866261 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caef2bd-5819-4910-97f6-a16c0538890b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:47.893533 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:47.894420 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-1caef2bd-5819-4910-97f6-a16c0538890b None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:47.897177 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-1caef2bd-5819-4910-97f6-a16c0538890b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:47.910185 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceaebae-30db-4bc3-b018-f2391b75c366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:47.911052 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceaebae-30db-4bc3-b018-f2391b75c366 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:47.911829 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceaebae-30db-4bc3-b018-f2391b75c366 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:47.911829 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceaebae-30db-4bc3-b018-f2391b75c366 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:47.912829 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceaebae-30db-4bc3-b018-f2391b75c366 None admin] RBAC: Adding query filter params (role.id=101b93f94624407f8c812ab86ebec32a, scope.project.id=ccd95a48530c4c86a3774301b969d6a9, user.id=be0701b0a7ff479e8b3214afaf618acd) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:47.913680 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceaebae-30db-4bc3-b018-f2391b75c366 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:47.916406 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceaebae-30db-4bc3-b018-f2391b75c366 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:47.930665 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 362/713] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:08:47 2022] GET /identity/v3/role_assignments?user.id=be0701b0a7ff479e8b3214afaf618acd&scope.project.id=ccd95a48530c4c86a3774301b969d6a9&role.id=101b93f94624407f8c812ab86ebec32a => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:47.932646 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceaebae-30db-4bc3-b018-f2391b75c366 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:47.998227 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 352/714] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:08:48.020952 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caef2bd-5819-4910-97f6-a16c0538890b None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:48.104997 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceaebae-30db-4bc3-b018-f2391b75c366 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:48.143724 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98d787-f36c-45d3-bfe4-859bb9efdb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:48.144501 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98d787-f36c-45d3-bfe4-859bb9efdb14 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:48.144860 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98d787-f36c-45d3-bfe4-859bb9efdb14 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:48.145211 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98d787-f36c-45d3-bfe4-859bb9efdb14 None admin] PATH_INFO: `/v3/services` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:48.146119 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f98d787-f36c-45d3-bfe4-859bb9efdb14 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:48.146520 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f98d787-f36c-45d3-bfe4-859bb9efdb14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:48.152681 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f98d787-f36c-45d3-bfe4-859bb9efdb14 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:48.152819 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caef2bd-5819-4910-97f6-a16c0538890b None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:48.154195 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 363/715] 10.222.0.30 () {56 vars in 1124 bytes} [Tue Jul 5 21:08:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:48.159693 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98d787-f36c-45d3-bfe4-859bb9efdb14 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:48.182649 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:48.191553 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d34854-931e-474d-a45e-51c5c9f44541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:48.192460 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d34854-931e-474d-a45e-51c5c9f44541 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:48.192460 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d34854-931e-474d-a45e-51c5c9f44541 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:48.192620 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d34854-931e-474d-a45e-51c5c9f44541 None admin] PATH_INFO: `/v3/services/network` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:48.193235 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d34854-931e-474d-a45e-51c5c9f44541 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:48.194678 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d34854-931e-474d-a45e-51c5c9f44541 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:48.210631 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-44d34854-931e-474d-a45e-51c5c9f44541 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 21:08:48.210631 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:48.210631 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:08:48.210631 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:08:48.210631 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:08:48.210631 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:08:48.210631 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:08:48.210631 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:08:48.210631 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 21:08:48.210631 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:48.210631 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:08:48.210631 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:48.210631 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:48.210631 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:48.210631 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:48.210631 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:48.210631 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:48.211719 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:48.211719 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:48.211719 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:48.211719 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:48.211719 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:48.211719 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:48.211719 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:08:48.211719 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:08:48.211719 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:08:48.211719 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:08:48.211719 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:48.211719 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:48.211719 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:48.211719 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:48.211719 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:48.211719 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:48.212681 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:48.212681 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:48.212681 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:48.212681 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:48.212681 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:48.212681 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:48.212681 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:48.212681 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:48.212681 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:48.212681 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:48.212681 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:08:48.212681 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:08:48.212681 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 21:08:48.212681 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:48.213459 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 353/716] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:08:48 2022] GET /identity/v3/services/network => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:08:48.221012 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d34854-931e-474d-a45e-51c5c9f44541 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:48.227306 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:48.282753 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98d787-f36c-45d3-bfe4-859bb9efdb14 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:48.328084 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484b2d6-eb3c-4d89-91f9-c66dd74f2c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:48.328788 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484b2d6-eb3c-4d89-91f9-c66dd74f2c9f None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:48.329152 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484b2d6-eb3c-4d89-91f9-c66dd74f2c9f None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:48.329479 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484b2d6-eb3c-4d89-91f9-c66dd74f2c9f None admin] PATH_INFO: `/v3/services` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:48.330187 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6484b2d6-eb3c-4d89-91f9-c66dd74f2c9f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:48.330507 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6484b2d6-eb3c-4d89-91f9-c66dd74f2c9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:48.332061 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6484b2d6-eb3c-4d89-91f9-c66dd74f2c9f None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:48.339830 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 364/717] 10.222.0.30 () {56 vars in 1124 bytes} [Tue Jul 5 21:08:48 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:48.354723 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d34854-931e-474d-a45e-51c5c9f44541 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:48.394913 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6433a1-aa3a-41d0-bece-e36a8539f58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:48.395607 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6433a1-aa3a-41d0-bece-e36a8539f58a None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:48.396048 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6433a1-aa3a-41d0-bece-e36a8539f58a None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:48.396377 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6433a1-aa3a-41d0-bece-e36a8539f58a None admin] PATH_INFO: `/v3/services` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:48.397184 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6433a1-aa3a-41d0-bece-e36a8539f58a None admin] RBAC: Adding query filter params (name=network) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:48.397500 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6433a1-aa3a-41d0-bece-e36a8539f58a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:48.398991 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6433a1-aa3a-41d0-bece-e36a8539f58a None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:48.404975 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 354/718] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Jul 5 21:08:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:08:48.411011 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484b2d6-eb3c-4d89-91f9-c66dd74f2c9f None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:48.526896 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484b2d6-eb3c-4d89-91f9-c66dd74f2c9f None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:48.543960 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:48.562856 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6872aec-4768-4959-ad00-96cd1339a379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:48.563535 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6872aec-4768-4959-ad00-96cd1339a379 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:48.563824 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6872aec-4768-4959-ad00-96cd1339a379 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:48.564357 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6872aec-4768-4959-ad00-96cd1339a379 None admin] PATH_INFO: `/v3/services` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:48.565072 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6872aec-4768-4959-ad00-96cd1339a379 None admin] RBAC: Adding query filter params (type=network) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:48.565385 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6872aec-4768-4959-ad00-96cd1339a379 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:48.566804 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6872aec-4768-4959-ad00-96cd1339a379 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:48.572952 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 365/719] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Jul 5 21:08:48 2022] GET /identity/v3/services?type=network => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:08:49.896082 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027eb9da-9720-4213-8cb5-8b94b05b98a7 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:49.896610 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027eb9da-9720-4213-8cb5-8b94b05b98a7 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:49.896688 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027eb9da-9720-4213-8cb5-8b94b05b98a7 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:49.898253 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 355/720] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:49.904191 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d920e-7267-4efd-99b4-ad32cae6a695 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:49.904597 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d920e-7267-4efd-99b4-ad32cae6a695 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:49.904766 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d920e-7267-4efd-99b4-ad32cae6a695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:49.931105 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-995d920e-7267-4efd-99b4-ad32cae6a695 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:49.932417 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-995d920e-7267-4efd-99b4-ad32cae6a695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:50.028373 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 366/721] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:08:50.064578 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027eb9da-9720-4213-8cb5-8b94b05b98a7 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:50.140589 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:50.310870 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027eb9da-9720-4213-8cb5-8b94b05b98a7 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:50.353132 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c1567-2a58-4a74-8407-91583c1f1940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:50.354613 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c1567-2a58-4a74-8407-91583c1f1940 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:50.354912 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c1567-2a58-4a74-8407-91583c1f1940 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:50.355203 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c1567-2a58-4a74-8407-91583c1f1940 None admin] PATH_INFO: `/v3/roles/service` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:50.371982 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c1567-2a58-4a74-8407-91583c1f1940 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:08:50.372337 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093faab8-3817-4bd7-850d-297be5d17dd3 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:50.372633 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093faab8-3817-4bd7-850d-297be5d17dd3 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:50.372920 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093faab8-3817-4bd7-850d-297be5d17dd3 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:50.374531 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 367/722] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:50.379572 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703e3d8-e280-4a80-aa6a-d01aac110dde None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:50.379869 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703e3d8-e280-4a80-aa6a-d01aac110dde None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:50.380215 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703e3d8-e280-4a80-aa6a-d01aac110dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:50.381233 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-7c3c1567-2a58-4a74-8407-91583c1f1940 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:08:50.381233 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:50.381233 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:50.381233 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:50.381233 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:50.381233 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:50.381233 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:50.381233 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:50.381233 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:50.381233 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:50.381233 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:50.381233 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:50.381233 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:08:50.381233 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:08:50.381233 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:08:50.381233 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:08:50.382209 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:08:50.382209 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:08:50.382209 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:08:50.382209 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:08:50.382209 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:50.382209 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:50.382209 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:50.382209 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:50.382209 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:50.382209 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:50.382209 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:50.382209 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:50.382209 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:50.382209 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:50.382209 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:50.382209 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:50.383070 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:50.383070 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:50.383070 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:50.383070 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:50.383070 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:08:50.383070 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:08:50.383070 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:08:50.383070 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:08:50.383070 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:08:50.383070 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:08:50.383070 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:08:50.383070 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:50.383070 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 356/723] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:08:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:50.389038 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c1567-2a58-4a74-8407-91583c1f1940 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:50.401376 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-a703e3d8-e280-4a80-aa6a-d01aac110dde None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:50.402622 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-a703e3d8-e280-4a80-aa6a-d01aac110dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:50.495084 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 368/724] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:08:50.526775 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c1567-2a58-4a74-8407-91583c1f1940 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:50.530929 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703e3d8-e280-4a80-aa6a-d01aac110dde None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:50.572874 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:50.588797 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea5021e-fcda-4142-8421-2c39bab0bee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:50.589614 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5021e-fcda-4142-8421-2c39bab0bee4 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:50.589921 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5021e-fcda-4142-8421-2c39bab0bee4 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:50.590241 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5021e-fcda-4142-8421-2c39bab0bee4 None admin] PATH_INFO: `/v3/roles` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:50.591009 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea5021e-fcda-4142-8421-2c39bab0bee4 None admin] RBAC: Adding query filter params (name=service) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:50.591395 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea5021e-fcda-4142-8421-2c39bab0bee4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:50.593548 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea5021e-fcda-4142-8421-2c39bab0bee4 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:50.605625 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 357/725] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:08:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:08:50.614210 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea5021e-fcda-4142-8421-2c39bab0bee4 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:50.616994 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:50.731780 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703e3d8-e280-4a80-aa6a-d01aac110dde None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:50.735492 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea5021e-fcda-4142-8421-2c39bab0bee4 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:50.773777 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f629d3f-98f9-4e6a-982c-0ec6660d55e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:50.774616 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f629d3f-98f9-4e6a-982c-0ec6660d55e0 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:50.774956 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f629d3f-98f9-4e6a-982c-0ec6660d55e0 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:50.775751 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f629d3f-98f9-4e6a-982c-0ec6660d55e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:50.777250 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff4f8e-d113-43c8-ab06-e14539f4f0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:50.778324 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff4f8e-d113-43c8-ab06-e14539f4f0c1 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:50.778916 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff4f8e-d113-43c8-ab06-e14539f4f0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:50.779203 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff4f8e-d113-43c8-ab06-e14539f4f0c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:50.787166 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f629d3f-98f9-4e6a-982c-0ec6660d55e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:08:50.791327 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ff4f8e-d113-43c8-ab06-e14539f4f0c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:50.793004 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ff4f8e-d113-43c8-ab06-e14539f4f0c1 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:50.796726 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-4f629d3f-98f9-4e6a-982c-0ec6660d55e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:08:50.796726 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:50.796726 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:50.796726 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:50.796726 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:50.796726 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:50.796726 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:50.796726 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:50.796726 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:50.796726 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:50.796726 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:50.796726 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:50.796726 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:08:50.796726 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:08:50.796726 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:08:50.796726 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:08:50.797682 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:08:50.797682 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:08:50.797682 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:08:50.797682 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:08:50.797682 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:50.797682 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:50.797682 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:50.797682 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:50.797682 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:50.797682 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:50.797682 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:50.797682 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:50.797682 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:50.797682 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:50.797682 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:50.797682 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:50.798581 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:50.798581 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:50.798581 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:50.798581 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:50.798581 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:08:50.798581 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:08:50.798581 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:08:50.798581 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:08:50.798581 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:08:50.798581 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:08:50.798581 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:08:50.798581 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:50.802287 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 369/726] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:08:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:50.805628 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89a5e2-2b2b-4f23-92a8-edd26af886bf None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:50.805922 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89a5e2-2b2b-4f23-92a8-edd26af886bf None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:50.806835 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89a5e2-2b2b-4f23-92a8-edd26af886bf None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:50.808966 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 370/727] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:50.809716 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89a5e2-2b2b-4f23-92a8-edd26af886bf None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:50.821119 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-f5ff4f8e-d113-43c8-ab06-e14539f4f0c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:50.821119 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:50.821119 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:50.821119 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:50.821119 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:50.821119 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:50.821119 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:50.821119 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:50.821119 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:50.821119 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:50.821119 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:50.821119 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:50.821119 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:08:50.821119 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:08:50.821119 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:08:50.822201 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:08:50.822201 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:50.822201 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:50.822201 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:50.822201 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:50.822201 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:50.822201 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:50.822201 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:50.822201 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:50.822201 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:50.822201 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:50.822201 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:50.822201 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:50.822201 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:50.822201 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:50.822201 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:50.822201 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:50.823149 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:08:50.823149 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:08:50.823149 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:50.823149 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:50.829703 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 358/728] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:50.831478 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52edb3-0bf1-45c3-9dce-92edcaedbc02 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:50.831972 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52edb3-0bf1-45c3-9dce-92edcaedbc02 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:50.832450 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52edb3-0bf1-45c3-9dce-92edcaedbc02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:50.850663 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-2e52edb3-0bf1-45c3-9dce-92edcaedbc02 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:50.852180 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-2e52edb3-0bf1-45c3-9dce-92edcaedbc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:50.878678 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:50.918811 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:50.923719 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89a5e2-2b2b-4f23-92a8-edd26af886bf None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:50.934452 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 359/729] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:08:50.936025 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52edb3-0bf1-45c3-9dce-92edcaedbc02 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:50.965467 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb2ffb-0e6a-40e8-8f26-04307c490c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:50.966176 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb2ffb-0e6a-40e8-8f26-04307c490c53 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:50.966487 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb2ffb-0e6a-40e8-8f26-04307c490c53 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:50.966756 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb2ffb-0e6a-40e8-8f26-04307c490c53 None admin] PATH_INFO: `/v3/roles` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:50.967510 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fb2ffb-0e6a-40e8-8f26-04307c490c53 None admin] RBAC: Adding query filter params (name=admin) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:50.967820 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fb2ffb-0e6a-40e8-8f26-04307c490c53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:50.969198 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fb2ffb-0e6a-40e8-8f26-04307c490c53 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:50.981965 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 371/730] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:08:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:50.981965 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd4304-3c91-4dac-b1f5-98105f51947d None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:50.981965 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd4304-3c91-4dac-b1f5-98105f51947d None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:50.981965 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd4304-3c91-4dac-b1f5-98105f51947d None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:50.981965 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 372/731] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:50.981965 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd4304-3c91-4dac-b1f5-98105f51947d None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:51.051222 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52edb3-0bf1-45c3-9dce-92edcaedbc02 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:51.088970 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab0504-2ae1-4928-87a2-be8d5a12abbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:51.089661 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab0504-2ae1-4928-87a2-be8d5a12abbc None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:51.089955 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab0504-2ae1-4928-87a2-be8d5a12abbc None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:51.090266 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab0504-2ae1-4928-87a2-be8d5a12abbc None admin] PATH_INFO: `/v3/domains` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:51.090991 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab0504-2ae1-4928-87a2-be8d5a12abbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:51.091328 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab0504-2ae1-4928-87a2-be8d5a12abbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:51.092697 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab0504-2ae1-4928-87a2-be8d5a12abbc None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:51.093177 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd4304-3c91-4dac-b1f5-98105f51947d None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:51.106673 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 360/732] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:08:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:51.111164 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab0504-2ae1-4928-87a2-be8d5a12abbc None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:51.135317 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c99c2-8fd2-4c60-8bda-fe33350b1eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:51.136134 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c99c2-8fd2-4c60-8bda-fe33350b1eba None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:51.136664 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c99c2-8fd2-4c60-8bda-fe33350b1eba None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:51.136779 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:51.136867 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c99c2-8fd2-4c60-8bda-fe33350b1eba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:51.146839 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8c99c2-8fd2-4c60-8bda-fe33350b1eba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:08:51.154766 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-fe8c99c2-8fd2-4c60-8bda-fe33350b1eba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:08:51.154766 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:51.154766 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:51.154766 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:51.154766 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:51.154766 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:51.154766 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:51.154766 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:51.154766 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:51.154766 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:51.154766 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:51.154766 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:51.154766 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:08:51.154766 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:08:51.154766 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:08:51.154766 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:08:51.155804 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:08:51.155804 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:08:51.155804 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:08:51.155804 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:08:51.155804 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:51.155804 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:51.155804 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:51.155804 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:51.155804 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:51.155804 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:51.155804 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:51.155804 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:51.155804 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:51.155804 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:51.155804 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:51.155804 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:51.156663 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:51.156663 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:51.156663 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:51.156663 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:51.156663 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:08:51.156663 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:08:51.156663 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:08:51.156663 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:08:51.156663 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:08:51.156663 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:08:51.156663 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:08:51.156663 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:51.156663 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 373/733] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:08:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:51.157360 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0717e-42a0-4649-8eab-5dc4f0dfb13b None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:51.157428 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0717e-42a0-4649-8eab-5dc4f0dfb13b None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:51.157687 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0717e-42a0-4649-8eab-5dc4f0dfb13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:51.175606 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-2ee0717e-42a0-4649-8eab-5dc4f0dfb13b None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:51.176811 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-2ee0717e-42a0-4649-8eab-5dc4f0dfb13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:51.196378 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:51.218596 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab0504-2ae1-4928-87a2-be8d5a12abbc None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:51.247923 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 374/734] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:08:51.249005 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0717e-42a0-4649-8eab-5dc4f0dfb13b None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:51.267091 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced843bd-188c-44ae-b44f-cfdfe4e41d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:51.267914 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced843bd-188c-44ae-b44f-cfdfe4e41d31 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:51.268197 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced843bd-188c-44ae-b44f-cfdfe4e41d31 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:51.268482 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced843bd-188c-44ae-b44f-cfdfe4e41d31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:51.279633 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced843bd-188c-44ae-b44f-cfdfe4e41d31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:51.281084 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced843bd-188c-44ae-b44f-cfdfe4e41d31 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:51.298928 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-ced843bd-188c-44ae-b44f-cfdfe4e41d31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:51.298928 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:51.298928 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:51.298928 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:51.298928 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:51.298928 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:51.298928 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:51.298928 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:51.298928 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:51.298928 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:51.298928 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:51.298928 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:51.298928 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:08:51.298928 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:08:51.298928 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:08:51.299966 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:08:51.299966 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:51.299966 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:51.299966 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:51.299966 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:51.299966 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:51.299966 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:51.299966 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:51.299966 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:51.299966 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:51.299966 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:51.299966 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:51.299966 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:51.299966 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:51.299966 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:51.299966 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:51.299966 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:51.300878 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:08:51.300878 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:08:51.300878 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:51.300878 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:51.300878 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 361/735] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:51.301348 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e70f2-5533-4878-805d-d11c543023b5 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:51.301596 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e70f2-5533-4878-805d-d11c543023b5 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:51.301882 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e70f2-5533-4878-805d-d11c543023b5 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:51.304868 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 362/736] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:51.304868 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e70f2-5533-4878-805d-d11c543023b5 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:51.353637 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0717e-42a0-4649-8eab-5dc4f0dfb13b None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:51.380305 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:51.388146 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ba843-29db-41b1-a3d3-3888f8333e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:51.393600 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ba843-29db-41b1-a3d3-3888f8333e47 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:51.393600 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ba843-29db-41b1-a3d3-3888f8333e47 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:51.393600 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ba843-29db-41b1-a3d3-3888f8333e47 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:51.396468 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ba843-29db-41b1-a3d3-3888f8333e47 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:51.397909 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ba843-29db-41b1-a3d3-3888f8333e47 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:51.411028 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e70f2-5533-4878-805d-d11c543023b5 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:51.412711 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-6b4ba843-29db-41b1-a3d3-3888f8333e47 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 21:08:51.412711 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:51.412711 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:51.412711 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:51.412711 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:51.412711 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:51.412711 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:51.412711 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:51.412711 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:51.412711 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:51.412711 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:51.412711 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:51.412711 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:08:51.412711 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:08:51.412711 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:08:51.412711 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:08:51.413642 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:51.413642 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:51.413642 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:08:51.413642 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:08:51.413642 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:08:51.413642 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:08:51.413642 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:51.413642 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:51.413642 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:51.413642 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:51.413642 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:51.413642 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:51.413642 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:51.413642 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:51.413642 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:51.413642 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:51.413642 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:51.413642 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:51.414656 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:51.414656 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:51.414656 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:08:51.414656 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:08:51.414656 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:08:51.414656 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:08:51.414656 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:08:51.414656 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:08:51.414656 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 21:08:51.414656 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:51.414656 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 375/737] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Jul 5 21:08:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:51.414656 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ba843-29db-41b1-a3d3-3888f8333e47 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:51.434406 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:51.448169 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7e380-ca79-400c-94e6-2009b9e36673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:51.448845 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7e380-ca79-400c-94e6-2009b9e36673 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:51.449136 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7e380-ca79-400c-94e6-2009b9e36673 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:51.449418 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7e380-ca79-400c-94e6-2009b9e36673 None admin] PATH_INFO: `/v3/roles` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:51.450191 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda7e380-ca79-400c-94e6-2009b9e36673 None admin] RBAC: Adding query filter params (name=admin) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:51.450506 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda7e380-ca79-400c-94e6-2009b9e36673 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:51.451897 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda7e380-ca79-400c-94e6-2009b9e36673 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:51.459857 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 363/738] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:08:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:51.460644 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7e380-ca79-400c-94e6-2009b9e36673 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:51.521402 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ba843-29db-41b1-a3d3-3888f8333e47 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:51.555958 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5fbc44-c4d7-4f9f-829a-48468ad96611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:51.556678 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fbc44-c4d7-4f9f-829a-48468ad96611 None admin] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:51.556959 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fbc44-c4d7-4f9f-829a-48468ad96611 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:51.557232 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fbc44-c4d7-4f9f-829a-48468ad96611 None admin] PATH_INFO: `/v3/services` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:51.557952 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5fbc44-c4d7-4f9f-829a-48468ad96611 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:51.559404 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5fbc44-c4d7-4f9f-829a-48468ad96611 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:51.560152 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7e380-ca79-400c-94e6-2009b9e36673 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:51.593241 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252845fd-731f-44d7-bdae-3db27127d24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:51.593902 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252845fd-731f-44d7-bdae-3db27127d24a None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:51.594227 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252845fd-731f-44d7-bdae-3db27127d24a None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:51.594508 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252845fd-731f-44d7-bdae-3db27127d24a None admin] PATH_INFO: `/v3/domains` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:51.595224 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252845fd-731f-44d7-bdae-3db27127d24a None admin] RBAC: Adding query filter params (name=Default) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:51.595538 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252845fd-731f-44d7-bdae-3db27127d24a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:51.596893 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252845fd-731f-44d7-bdae-3db27127d24a None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:51.598350 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:51.609472 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 364/739] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:08:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:51.610799 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8b448-0da3-469a-b117-f28022625121 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:51.611038 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8b448-0da3-469a-b117-f28022625121 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:51.611259 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8b448-0da3-469a-b117-f28022625121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:51.626503 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-b1e8b448-0da3-469a-b117-f28022625121 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:51.627698 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-b1e8b448-0da3-469a-b117-f28022625121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:51.644903 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 376/740] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Jul 5 21:08:51 2022] POST /identity/v3/services => generated 251 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:08:51.645888 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5fbc44-c4d7-4f9f-829a-48468ad96611 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:51.716355 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 365/741] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:51 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:08:51.717219 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8b448-0da3-469a-b117-f28022625121 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:51.760613 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:51.796193 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5fbc44-c4d7-4f9f-829a-48468ad96611 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:51.833097 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8b448-0da3-469a-b117-f28022625121 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:51.836412 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4cc11-e03f-4b47-ac42-e9d204da8dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:51.837094 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4cc11-e03f-4b47-ac42-e9d204da8dce None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:51.837379 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4cc11-e03f-4b47-ac42-e9d204da8dce None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:51.838215 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4cc11-e03f-4b47-ac42-e9d204da8dce None admin] PATH_INFO: `/v3/users` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:51.839083 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4cc11-e03f-4b47-ac42-e9d204da8dce None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:51.839382 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4cc11-e03f-4b47-ac42-e9d204da8dce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:51.840831 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4cc11-e03f-4b47-ac42-e9d204da8dce None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:51.859067 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:51.863301 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 377/742] 10.222.0.30 () {56 vars in 1149 bytes} [Tue Jul 5 21:08:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:51.868378 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4cc11-e03f-4b47-ac42-e9d204da8dce None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:51.874345 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47231de-f94f-46c5-81f6-12a6d3cb0108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:51.875245 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47231de-f94f-46c5-81f6-12a6d3cb0108 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:51.875609 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47231de-f94f-46c5-81f6-12a6d3cb0108 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:51.875959 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47231de-f94f-46c5-81f6-12a6d3cb0108 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:51.887498 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47231de-f94f-46c5-81f6-12a6d3cb0108 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:51.889060 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47231de-f94f-46c5-81f6-12a6d3cb0108 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:51.908261 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-c47231de-f94f-46c5-81f6-12a6d3cb0108 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:51.908261 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:51.908261 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:51.908261 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:51.908261 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:51.908261 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:51.908261 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:51.908261 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:51.908261 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:51.908261 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:51.908261 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:51.908261 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:51.908261 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:08:51.908261 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:08:51.908261 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:08:51.909224 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:08:51.909224 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:51.909224 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:51.909224 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:51.909224 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:51.909224 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:51.909224 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:51.909224 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:51.909224 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:51.909224 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:51.909224 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:51.909224 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:51.909224 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:51.909224 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:51.909224 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:51.909224 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:51.909224 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:51.910178 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:08:51.910178 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:08:51.910178 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:51.910178 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:51.910178 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 366/743] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:51.910716 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47231de-f94f-46c5-81f6-12a6d3cb0108 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:51.980320 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4cc11-e03f-4b47-ac42-e9d204da8dce None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:52.010848 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:52.017301 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d8e87-3c28-4ad0-991c-88eac650de98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:52.019992 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d8e87-3c28-4ad0-991c-88eac650de98 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:52.019992 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d8e87-3c28-4ad0-991c-88eac650de98 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:52.019992 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d8e87-3c28-4ad0-991c-88eac650de98 None admin] PATH_INFO: `/v3/users/nova` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:52.024056 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47231de-f94f-46c5-81f6-12a6d3cb0108 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:52.026806 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2d8e87-3c28-4ad0-991c-88eac650de98 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:52.028358 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2d8e87-3c28-4ad0-991c-88eac650de98 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:52.043344 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-cc2d8e87-3c28-4ad0-991c-88eac650de98 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:08:52.043344 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:52.043344 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:52.043344 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:52.043344 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:52.043344 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:52.043344 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:52.043344 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:52.043344 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:52.043344 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:52.043344 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:52.043344 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:52.043344 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:08:52.043344 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:08:52.043344 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:08:52.043344 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:08:52.044515 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:52.044515 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:52.044515 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:08:52.044515 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:08:52.044515 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:08:52.044515 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:08:52.044515 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:52.044515 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:52.044515 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:52.044515 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:52.044515 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:52.044515 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:52.044515 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:52.044515 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:52.044515 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:52.044515 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:52.044515 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:52.044515 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:52.045678 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:52.045678 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:52.045678 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:08:52.045678 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:08:52.045678 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:08:52.045678 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:08:52.045678 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:08:52.045678 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:08:52.045678 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:08:52.045678 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:52.051130 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 378/744] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Jul 5 21:08:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:52.052025 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d8e87-3c28-4ad0-991c-88eac650de98 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:52.066217 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09643c-a60b-4069-835b-15da4e98de0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:52.066898 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09643c-a60b-4069-835b-15da4e98de0b None admin] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:52.067189 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09643c-a60b-4069-835b-15da4e98de0b None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:52.067472 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09643c-a60b-4069-835b-15da4e98de0b None admin] PATH_INFO: `/v3/services` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:52.068194 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b09643c-a60b-4069-835b-15da4e98de0b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:52.069577 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b09643c-a60b-4069-835b-15da4e98de0b None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:52.138206 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 367/745] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Jul 5 21:08:51 2022] POST /identity/v3/services => generated 240 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:08:52.138849 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09643c-a60b-4069-835b-15da4e98de0b None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:52.177894 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d8e87-3c28-4ad0-991c-88eac650de98 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:52.185774 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:52.233054 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488fde0-d0ab-4cf6-9f30-69fcce578530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:52.234063 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488fde0-d0ab-4cf6-9f30-69fcce578530 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:52.234560 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488fde0-d0ab-4cf6-9f30-69fcce578530 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:52.234992 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488fde0-d0ab-4cf6-9f30-69fcce578530 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:52.268156 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09643c-a60b-4069-835b-15da4e98de0b None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:52.320308 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:52.325476 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b60dc-d1e4-4ae8-86c3-2f34b32d49e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:52.329015 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b60dc-d1e4-4ae8-86c3-2f34b32d49e9 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:52.329308 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b60dc-d1e4-4ae8-86c3-2f34b32d49e9 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:52.330572 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b60dc-d1e4-4ae8-86c3-2f34b32d49e9 None admin] PATH_INFO: `/v3/domains` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:52.330572 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b60dc-d1e4-4ae8-86c3-2f34b32d49e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:52.330758 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b60dc-d1e4-4ae8-86c3-2f34b32d49e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:52.332519 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b60dc-d1e4-4ae8-86c3-2f34b32d49e9 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:52.341748 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5488fde0-d0ab-4cf6-9f30-69fcce578530 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:52.344060 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5488fde0-d0ab-4cf6-9f30-69fcce578530 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:52.346861 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 368/746] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:08:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:52.347675 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b60dc-d1e4-4ae8-86c3-2f34b32d49e9 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:52.462863 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:52.465202 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 379/747] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:08:52 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:08:52.466241 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488fde0-d0ab-4cf6-9f30-69fcce578530 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:52.472474 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b60dc-d1e4-4ae8-86c3-2f34b32d49e9 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:52.518460 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cdd4a8-2747-45f9-871e-4292c474fc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:52.519431 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cdd4a8-2747-45f9-871e-4292c474fc1b None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:52.519726 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cdd4a8-2747-45f9-871e-4292c474fc1b None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:52.520007 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cdd4a8-2747-45f9-871e-4292c474fc1b None admin] PATH_INFO: `/v3/users` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:52.521099 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cdd4a8-2747-45f9-871e-4292c474fc1b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:52.521418 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cdd4a8-2747-45f9-871e-4292c474fc1b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:52.523615 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cdd4a8-2747-45f9-871e-4292c474fc1b None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:52.544901 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 369/748] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Jul 5 21:08:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:52.545926 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cdd4a8-2747-45f9-871e-4292c474fc1b None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:52.569884 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:52.584827 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488fde0-d0ab-4cf6-9f30-69fcce578530 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:52.668587 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cdd4a8-2747-45f9-871e-4292c474fc1b None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:52.708093 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f743a6-fe2e-4532-97ea-4cca38f88263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:52.708907 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f743a6-fe2e-4532-97ea-4cca38f88263 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:52.709194 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f743a6-fe2e-4532-97ea-4cca38f88263 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:52.709470 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f743a6-fe2e-4532-97ea-4cca38f88263 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:52.723371 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f743a6-fe2e-4532-97ea-4cca38f88263 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:52.725035 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f743a6-fe2e-4532-97ea-4cca38f88263 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:52.742214 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b3ca29-490e-4b5e-abab-b26a97d7efcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:52.743022 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3ca29-490e-4b5e-abab-b26a97d7efcd None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:52.743309 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3ca29-490e-4b5e-abab-b26a97d7efcd None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:52.743585 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3ca29-490e-4b5e-abab-b26a97d7efcd None admin] PATH_INFO: `/v3/users/swift` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:52.748817 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-19f743a6-fe2e-4532-97ea-4cca38f88263 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:52.748817 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:52.748817 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:52.748817 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:52.748817 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:52.748817 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:52.748817 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:52.748817 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:52.748817 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:52.748817 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:52.748817 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:52.748817 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:52.748817 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:08:52.748817 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:08:52.748817 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:08:52.749750 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:08:52.749750 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:52.749750 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:52.749750 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:52.749750 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:52.749750 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:52.749750 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:52.749750 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:52.749750 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:52.749750 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:52.749750 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:52.749750 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:52.749750 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:52.749750 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:52.749750 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:52.749750 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:52.749750 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:52.750697 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:08:52.750697 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:08:52.750697 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:52.750697 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:52.752101 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b3ca29-490e-4b5e-abab-b26a97d7efcd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:52.753550 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b3ca29-490e-4b5e-abab-b26a97d7efcd None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:52.754270 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 370/749] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:52.755105 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f743a6-fe2e-4532-97ea-4cca38f88263 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:52.758110 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:52.771796 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-95b3ca29-490e-4b5e-abab-b26a97d7efcd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 21:08:52.771796 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:52.771796 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:52.771796 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:52.771796 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:52.771796 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:52.771796 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:52.771796 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:52.771796 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:52.771796 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:52.771796 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:52.771796 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:52.771796 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:08:52.771796 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:08:52.771796 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:08:52.771796 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:08:52.772966 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:52.772966 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:52.772966 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:08:52.772966 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:08:52.772966 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:08:52.772966 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:08:52.772966 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:52.772966 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:52.772966 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:52.772966 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:52.772966 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:52.772966 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:52.772966 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:52.772966 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:52.772966 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:52.772966 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:52.772966 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:52.772966 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:52.774151 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:52.774151 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:52.774151 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:08:52.774151 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:08:52.774151 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:08:52.774151 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:08:52.774151 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:08:52.774151 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:08:52.774151 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 21:08:52.774151 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:52.781231 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 380/750] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:08:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:52.782361 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b3ca29-490e-4b5e-abab-b26a97d7efcd None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:52.872785 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f743a6-fe2e-4532-97ea-4cca38f88263 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:52.892314 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b3ca29-490e-4b5e-abab-b26a97d7efcd None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:52.910163 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786f78b-6db4-461f-9d94-07d632898a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:52.911088 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786f78b-6db4-461f-9d94-07d632898a9a None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:52.911385 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786f78b-6db4-461f-9d94-07d632898a9a None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:52.911666 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786f78b-6db4-461f-9d94-07d632898a9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:52.925190 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4786f78b-6db4-461f-9d94-07d632898a9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:52.926674 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4786f78b-6db4-461f-9d94-07d632898a9a None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:52.929336 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7424499-bb9e-44f6-aabf-044bd48a370b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:52.930189 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7424499-bb9e-44f6-aabf-044bd48a370b None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:52.930641 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7424499-bb9e-44f6-aabf-044bd48a370b None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:52.931063 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7424499-bb9e-44f6-aabf-044bd48a370b None admin] PATH_INFO: `/v3/domains` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:52.932507 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7424499-bb9e-44f6-aabf-044bd48a370b None admin] RBAC: Adding query filter params (name=Default) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:52.932960 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7424499-bb9e-44f6-aabf-044bd48a370b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:52.934654 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7424499-bb9e-44f6-aabf-044bd48a370b None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:52.945885 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-4786f78b-6db4-461f-9d94-07d632898a9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:52.945885 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:52.945885 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:52.945885 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:52.945885 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:52.945885 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:52.945885 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:52.945885 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:52.945885 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:52.945885 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:52.945885 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:52.945885 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:52.945885 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:08:52.945885 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:08:52.945885 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:08:52.947238 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:08:52.947238 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:52.947238 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:52.947238 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:52.947238 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:52.947238 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:52.947238 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:52.947238 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:52.947238 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:52.947238 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:52.947238 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:52.947238 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:52.947238 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:52.947238 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:52.947238 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:52.947238 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:52.947238 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:52.948343 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:08:52.948343 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:08:52.948343 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:52.948343 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:52.950276 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 381/752] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:08:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:52.951300 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7424499-bb9e-44f6-aabf-044bd48a370b None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:52.951953 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 371/752] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:52.952851 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786f78b-6db4-461f-9d94-07d632898a9a None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:52.961533 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:53.018026 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:53.059524 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7424499-bb9e-44f6-aabf-044bd48a370b None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:53.066757 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786f78b-6db4-461f-9d94-07d632898a9a None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:53.097147 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2783bbd-26be-4fcd-a2a4-f88861b30037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:53.098168 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2783bbd-26be-4fcd-a2a4-f88861b30037 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:53.098605 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2783bbd-26be-4fcd-a2a4-f88861b30037 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:53.099021 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2783bbd-26be-4fcd-a2a4-f88861b30037 None admin] PATH_INFO: `/v3/users` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:53.100010 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2783bbd-26be-4fcd-a2a4-f88861b30037 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:53.100475 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2783bbd-26be-4fcd-a2a4-f88861b30037 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:53.102056 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2783bbd-26be-4fcd-a2a4-f88861b30037 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:53.102671 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f22d4-8f6b-455a-ae1a-e5e48b1f6e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:53.103483 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f22d4-8f6b-455a-ae1a-e5e48b1f6e66 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:53.103949 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f22d4-8f6b-455a-ae1a-e5e48b1f6e66 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:53.104245 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f22d4-8f6b-455a-ae1a-e5e48b1f6e66 None admin] PATH_INFO: `/v3/domains` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:53.105079 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850f22d4-8f6b-455a-ae1a-e5e48b1f6e66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:53.105398 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850f22d4-8f6b-455a-ae1a-e5e48b1f6e66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:53.107020 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850f22d4-8f6b-455a-ae1a-e5e48b1f6e66 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:53.126648 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 372/754] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:08:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:53.126648 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f22d4-8f6b-455a-ae1a-e5e48b1f6e66 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:53.127013 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 382/754] 10.222.0.30 () {56 vars in 1135 bytes} [Tue Jul 5 21:08:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:53.128021 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2783bbd-26be-4fcd-a2a4-f88861b30037 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:53.195201 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:53.236193 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2783bbd-26be-4fcd-a2a4-f88861b30037 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:53.240973 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f22d4-8f6b-455a-ae1a-e5e48b1f6e66 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:53.256409 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:53.273939 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ee2b8-56f4-4234-b292-ce22b24877ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:53.275499 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ee2b8-56f4-4234-b292-ce22b24877ac None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:53.275924 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ee2b8-56f4-4234-b292-ce22b24877ac None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:53.276439 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ee2b8-56f4-4234-b292-ce22b24877ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:53.280668 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a239c134-a3e4-47e6-a58f-c62f9d639265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:53.283105 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239c134-a3e4-47e6-a58f-c62f9d639265 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:53.283398 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239c134-a3e4-47e6-a58f-c62f9d639265 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:53.283680 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239c134-a3e4-47e6-a58f-c62f9d639265 None admin] PATH_INFO: `/v3/projects/service` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:53.285553 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ee2b8-56f4-4234-b292-ce22b24877ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:53.287856 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ee2b8-56f4-4234-b292-ce22b24877ac None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:53.292816 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a239c134-a3e4-47e6-a58f-c62f9d639265 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:53.294308 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a239c134-a3e4-47e6-a58f-c62f9d639265 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:53.304533 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-236ee2b8-56f4-4234-b292-ce22b24877ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:08:53.304533 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:53.304533 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:53.304533 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:53.304533 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:53.304533 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:53.304533 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:53.304533 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:53.304533 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:53.304533 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:53.304533 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:53.304533 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:53.304533 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:08:53.304533 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:08:53.304533 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:08:53.305650 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:08:53.305650 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:53.305650 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:53.305650 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:53.305650 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:53.305650 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:53.305650 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:53.305650 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:53.305650 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:53.305650 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:53.305650 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:53.305650 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:53.305650 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:53.305650 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:53.305650 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:53.305650 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:53.305650 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:53.307213 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:08:53.307213 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:08:53.307213 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:08:53.307213 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:08:53.307213 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:08:53.307213 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:08:53.307213 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:08:53.307213 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:53.309220 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 383/755] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:08:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:53.310158 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ee2b8-56f4-4234-b292-ce22b24877ac None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:53.316532 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-a239c134-a3e4-47e6-a58f-c62f9d639265 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:08:53.316532 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:53.316532 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:53.316532 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:53.316532 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:53.316532 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:53.316532 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:53.316532 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:53.316532 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:53.316532 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:53.316532 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:53.316532 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:53.316532 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:08:53.316532 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:08:53.316532 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:08:53.317472 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:08:53.317472 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:53.317472 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:53.317472 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:53.317472 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:53.317472 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:53.317472 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:53.317472 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:53.317472 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:53.317472 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:53.317472 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:53.317472 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:53.317472 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:53.317472 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:53.317472 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:53.317472 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:53.317472 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:53.318427 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:08:53.318427 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:08:53.318427 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:08:53.318427 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:08:53.318427 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:08:53.318427 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:08:53.318427 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:08:53.318427 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:53.323033 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 373/756] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:08:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:53.324065 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a239c134-a3e4-47e6-a58f-c62f9d639265 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:53.425757 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ee2b8-56f4-4234-b292-ce22b24877ac None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:53.437616 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a239c134-a3e4-47e6-a58f-c62f9d639265 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:53.456245 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:53.467368 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb3f79-d230-4f82-b805-4122ba1ae5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:53.468257 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb3f79-d230-4f82-b805-4122ba1ae5c4 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:53.468687 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb3f79-d230-4f82-b805-4122ba1ae5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:53.469110 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb3f79-d230-4f82-b805-4122ba1ae5c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:53.475554 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbccc0c-a296-4c35-bd87-2ea6efce5fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:53.478945 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbccc0c-a296-4c35-bd87-2ea6efce5fe3 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:53.478945 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbccc0c-a296-4c35-bd87-2ea6efce5fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:53.478945 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbccc0c-a296-4c35-bd87-2ea6efce5fe3 None admin] PATH_INFO: `/v3/projects` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:53.478945 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbccc0c-a296-4c35-bd87-2ea6efce5fe3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:53.478945 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbccc0c-a296-4c35-bd87-2ea6efce5fe3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:53.479960 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbccc0c-a296-4c35-bd87-2ea6efce5fe3 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:53.498080 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 374/757] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:08:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:53.499362 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbccc0c-a296-4c35-bd87-2ea6efce5fe3 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:53.538898 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:53.547465 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb3f79-d230-4f82-b805-4122ba1ae5c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:53.548979 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb3f79-d230-4f82-b805-4122ba1ae5c4 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:53.612919 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbccc0c-a296-4c35-bd87-2ea6efce5fe3 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:53.651793 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8eed5-cc82-4560-ae1d-eaec2c9061ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:53.652700 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8eed5-cc82-4560-ae1d-eaec2c9061ef None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:53.653140 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8eed5-cc82-4560-ae1d-eaec2c9061ef None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:53.653517 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8eed5-cc82-4560-ae1d-eaec2c9061ef None admin] PATH_INFO: `/v3/projects` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:53.654450 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8eed5-cc82-4560-ae1d-eaec2c9061ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:53.654868 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8eed5-cc82-4560-ae1d-eaec2c9061ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:53.656576 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8eed5-cc82-4560-ae1d-eaec2c9061ef None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:53.659928 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 384/758] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:08:53 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:08:53.660806 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb3f79-d230-4f82-b805-4122ba1ae5c4 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:53.674289 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 375/759] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:08:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:53.675394 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8eed5-cc82-4560-ae1d-eaec2c9061ef None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:53.686415 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:53.767504 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb3f79-d230-4f82-b805-4122ba1ae5c4 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:53.778576 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:53.786332 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8eed5-cc82-4560-ae1d-eaec2c9061ef None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:53.804842 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5982f-9a09-4edb-83f7-9f8f96f2175c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:53.805672 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5982f-9a09-4edb-83f7-9f8f96f2175c None admin] REQUEST_METHOD: `PUT` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:53.805961 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5982f-9a09-4edb-83f7-9f8f96f2175c None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:53.806809 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5982f-9a09-4edb-83f7-9f8f96f2175c None admin] PATH_INFO: `/v3/projects/ccd95a48530c4c86a3774301b969d6a9/users/be0701b0a7ff479e8b3214afaf618acd/roles/101b93f94624407f8c812ab86ebec32a` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:53.809093 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff5982f-9a09-4edb-83f7-9f8f96f2175c None admin] RBAC: Authorizing `identity:create_grant(project_id=ccd95a48530c4c86a3774301b969d6a9, user_id=be0701b0a7ff479e8b3214afaf618acd, role_id=101b93f94624407f8c812ab86ebec32a)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:53.810580 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff5982f-9a09-4edb-83f7-9f8f96f2175c None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:53.825049 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c7263-6a5b-458f-a5c0-42e58a875b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:53.827895 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c7263-6a5b-458f-a5c0-42e58a875b17 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:53.827895 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c7263-6a5b-458f-a5c0-42e58a875b17 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:53.827895 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c7263-6a5b-458f-a5c0-42e58a875b17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:53.837350 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26c7263-6a5b-458f-a5c0-42e58a875b17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:53.838958 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26c7263-6a5b-458f-a5c0-42e58a875b17 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:53.856808 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-f26c7263-6a5b-458f-a5c0-42e58a875b17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:53.856808 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:53.856808 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:53.856808 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:53.856808 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:53.856808 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:53.856808 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:53.856808 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:53.856808 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:53.856808 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:53.856808 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:53.856808 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:53.856808 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:08:53.856808 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:08:53.856808 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:08:53.857890 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:08:53.857890 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:53.857890 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:53.857890 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:53.857890 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:53.857890 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:53.857890 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:53.857890 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:53.857890 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:53.857890 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:53.857890 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:53.857890 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:53.857890 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:53.857890 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:53.857890 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:53.857890 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:53.857890 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:53.858853 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:08:53.858853 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:08:53.858853 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:53.858853 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:53.858853 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 376/760] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:53.859143 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c7263-6a5b-458f-a5c0-42e58a875b17 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:53.879419 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 385/761] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:08:53 2022] PUT /identity/v3/projects/ccd95a48530c4c86a3774301b969d6a9/users/be0701b0a7ff479e8b3214afaf618acd/roles/101b93f94624407f8c812ab86ebec32a => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:08:53.880807 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4504b3-b9cd-4c6a-8060-a5655bf32023 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:53.881108 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4504b3-b9cd-4c6a-8060-a5655bf32023 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:53.881441 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4504b3-b9cd-4c6a-8060-a5655bf32023 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:53.886206 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 386/762] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:53.886206 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4504b3-b9cd-4c6a-8060-a5655bf32023 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:54.004125 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c7263-6a5b-458f-a5c0-42e58a875b17 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:54.015276 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:54.039876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4504b3-b9cd-4c6a-8060-a5655bf32023 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:54.049466 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b569ee2-f5c3-46ad-beb7-504d823f7a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:54.049744 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b569ee2-f5c3-46ad-beb7-504d823f7a35 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:54.050963 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b569ee2-f5c3-46ad-beb7-504d823f7a35 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:54.050963 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b569ee2-f5c3-46ad-beb7-504d823f7a35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:54.051230 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b569ee2-f5c3-46ad-beb7-504d823f7a35 None admin] RBAC: Adding query filter params (role.id=601a166d56f647bda8256e971450cfdf, scope.project.id=ccd95a48530c4c86a3774301b969d6a9, user.id=e6cf35a185bc4707a4f2f7b56662354d) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:54.051552 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b569ee2-f5c3-46ad-beb7-504d823f7a35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:54.053322 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b569ee2-f5c3-46ad-beb7-504d823f7a35 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:54.063675 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 377/763] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:08:53 2022] GET /identity/v3/role_assignments?user.id=e6cf35a185bc4707a4f2f7b56662354d&scope.project.id=ccd95a48530c4c86a3774301b969d6a9&role.id=601a166d56f647bda8256e971450cfdf => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:54.063675 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539acf5-b6f5-497b-8239-f82a21439fbe None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:54.063675 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539acf5-b6f5-497b-8239-f82a21439fbe None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:54.063675 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539acf5-b6f5-497b-8239-f82a21439fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:54.086418 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-d539acf5-b6f5-497b-8239-f82a21439fbe None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:54.088591 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-d539acf5-b6f5-497b-8239-f82a21439fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:54.090489 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180fd55-0a52-40d7-82ed-9a15fb4c2c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:54.091773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180fd55-0a52-40d7-82ed-9a15fb4c2c5a None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:54.092211 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180fd55-0a52-40d7-82ed-9a15fb4c2c5a None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:54.092544 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:54.092832 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180fd55-0a52-40d7-82ed-9a15fb4c2c5a None admin] PATH_INFO: `/v3/domains` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:54.093792 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7180fd55-0a52-40d7-82ed-9a15fb4c2c5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:54.094244 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7180fd55-0a52-40d7-82ed-9a15fb4c2c5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:54.095608 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7180fd55-0a52-40d7-82ed-9a15fb4c2c5a None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:54.111099 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 387/764] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:08:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:54.116279 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180fd55-0a52-40d7-82ed-9a15fb4c2c5a None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:54.251791 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180fd55-0a52-40d7-82ed-9a15fb4c2c5a None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:54.257752 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 378/765] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:08:54.295223 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539acf5-b6f5-497b-8239-f82a21439fbe None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:54.322652 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eda84f-9752-4cd2-b66e-e8c9d6d33d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:54.323580 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eda84f-9752-4cd2-b66e-e8c9d6d33d3b None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:54.323865 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eda84f-9752-4cd2-b66e-e8c9d6d33d3b None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:54.324145 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eda84f-9752-4cd2-b66e-e8c9d6d33d3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:54.336058 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eda84f-9752-4cd2-b66e-e8c9d6d33d3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:54.337564 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eda84f-9752-4cd2-b66e-e8c9d6d33d3b None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:54.366577 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-99eda84f-9752-4cd2-b66e-e8c9d6d33d3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:08:54.366577 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:54.366577 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:54.366577 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:54.366577 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:54.366577 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:54.366577 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:54.366577 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:54.366577 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:54.366577 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:54.366577 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:54.366577 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:54.366577 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:08:54.366577 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:08:54.366577 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:08:54.367584 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:08:54.367584 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:54.367584 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:54.367584 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:54.367584 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:54.367584 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:54.367584 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:54.367584 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:54.367584 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:54.367584 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:54.367584 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:54.367584 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:54.367584 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:54.367584 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:54.367584 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:54.367584 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:54.367584 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:54.368497 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:08:54.368497 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:08:54.368497 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:08:54.368497 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:08:54.368497 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:08:54.368497 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:08:54.368497 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:08:54.368497 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:54.377012 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 388/766] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:08:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:08:54.389577 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eda84f-9752-4cd2-b66e-e8c9d6d33d3b None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:54.393585 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:54.497749 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539acf5-b6f5-497b-8239-f82a21439fbe None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:54.515753 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eda84f-9752-4cd2-b66e-e8c9d6d33d3b None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:54.547097 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8682ed-c873-40c2-b814-c06672c3b47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:54.548382 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8682ed-c873-40c2-b814-c06672c3b47b None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:54.548673 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8682ed-c873-40c2-b814-c06672c3b47b None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:54.549227 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8682ed-c873-40c2-b814-c06672c3b47b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:54.549905 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8682ed-c873-40c2-b814-c06672c3b47b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:54.551745 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8682ed-c873-40c2-b814-c06672c3b47b None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:54.558472 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e2ccc-926b-4689-af35-c89cc07d3882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:54.559258 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e2ccc-926b-4689-af35-c89cc07d3882 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:54.559609 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e2ccc-926b-4689-af35-c89cc07d3882 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:54.559954 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e2ccc-926b-4689-af35-c89cc07d3882 None admin] PATH_INFO: `/v3/projects` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:54.560932 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1e2ccc-926b-4689-af35-c89cc07d3882 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:54.561313 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1e2ccc-926b-4689-af35-c89cc07d3882 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:54.562867 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1e2ccc-926b-4689-af35-c89cc07d3882 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:54.567849 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-cd8682ed-c873-40c2-b814-c06672c3b47b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 21:08:54.567849 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:54.567849 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:08:54.567849 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:08:54.567849 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:08:54.567849 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:08:54.567849 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:08:54.567849 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:08:54.567849 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 21:08:54.567849 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:54.567849 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:08:54.567849 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:54.567849 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:54.567849 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:54.567849 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:54.567849 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:54.569143 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:54.569143 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:54.569143 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:54.569143 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:54.569143 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:54.569143 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:54.569143 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:54.569143 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:08:54.569143 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:08:54.569143 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:08:54.569143 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:08:54.569143 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:54.569143 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:54.569143 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:54.569143 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:54.569143 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:54.571527 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:54.571527 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:54.571527 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:54.571527 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:54.571527 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:54.571527 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:54.571527 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:54.571527 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:54.571527 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:54.571527 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:54.571527 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:54.571527 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:08:54.571527 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:08:54.571527 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 21:08:54.571527 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:54.574400 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 379/767] 10.222.0.30 () {56 vars in 1129 bytes} [Tue Jul 5 21:08:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:54.575755 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bdfc22-a246-48fd-9fb0-e28970096057 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:54.576050 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bdfc22-a246-48fd-9fb0-e28970096057 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:54.576596 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bdfc22-a246-48fd-9fb0-e28970096057 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:54.577824 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 380/768] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:54.581127 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bdfc22-a246-48fd-9fb0-e28970096057 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:54.588592 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 389/769] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:08:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:54.589833 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263c49d-2bc7-41d4-bcd5-7faaaf79a8f9 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:54.590055 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263c49d-2bc7-41d4-bcd5-7faaaf79a8f9 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:54.590359 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263c49d-2bc7-41d4-bcd5-7faaaf79a8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:54.594053 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:54.616313 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-9263c49d-2bc7-41d4-bcd5-7faaaf79a8f9 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:54.617890 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-9263c49d-2bc7-41d4-bcd5-7faaaf79a8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:54.705426 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:54.722153 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 390/770] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:08:54.722153 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263c49d-2bc7-41d4-bcd5-7faaaf79a8f9 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:54.741303 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bdfc22-a246-48fd-9fb0-e28970096057 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:54.801785 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b8b59b-5559-4b7a-96a1-c09308565e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:54.803284 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8b59b-5559-4b7a-96a1-c09308565e32 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:54.804045 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8b59b-5559-4b7a-96a1-c09308565e32 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:54.804536 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8b59b-5559-4b7a-96a1-c09308565e32 None admin] PATH_INFO: `/v3/services` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:54.805502 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b8b59b-5559-4b7a-96a1-c09308565e32 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:54.806034 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b8b59b-5559-4b7a-96a1-c09308565e32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:54.808464 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b8b59b-5559-4b7a-96a1-c09308565e32 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:54.820724 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 381/771] 10.222.0.30 () {56 vars in 1124 bytes} [Tue Jul 5 21:08:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:54.822021 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b8b59b-5559-4b7a-96a1-c09308565e32 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:54.860320 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263c49d-2bc7-41d4-bcd5-7faaaf79a8f9 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:54.899877 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d679c997-b5fb-47f8-942d-7685a44c0449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:54.902165 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679c997-b5fb-47f8-942d-7685a44c0449 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:54.902692 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679c997-b5fb-47f8-942d-7685a44c0449 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:54.903176 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679c997-b5fb-47f8-942d-7685a44c0449 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:54.904409 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d679c997-b5fb-47f8-942d-7685a44c0449 None admin] RBAC: Adding query filter params (role.id=101b93f94624407f8c812ab86ebec32a, scope.project.id=ccd95a48530c4c86a3774301b969d6a9, user.id=e6761d76cc1d48579c7fda6125900648) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:54.904940 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d679c997-b5fb-47f8-942d-7685a44c0449 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:54.905416 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:54.907586 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d679c997-b5fb-47f8-942d-7685a44c0449 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:54.922598 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 391/772] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:08:54 2022] GET /identity/v3/role_assignments?user.id=e6761d76cc1d48579c7fda6125900648&scope.project.id=ccd95a48530c4c86a3774301b969d6a9&role.id=101b93f94624407f8c812ab86ebec32a => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:54.923959 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d679c997-b5fb-47f8-942d-7685a44c0449 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:54.950478 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b8b59b-5559-4b7a-96a1-c09308565e32 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:55.030078 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1d53d-1371-4d84-9ddb-90255041a254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:55.030935 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1d53d-1371-4d84-9ddb-90255041a254 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:55.031221 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1d53d-1371-4d84-9ddb-90255041a254 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:55.031496 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1d53d-1371-4d84-9ddb-90255041a254 None admin] PATH_INFO: `/v3/services/network` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:55.032171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1d53d-1371-4d84-9ddb-90255041a254 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:55.033599 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1d53d-1371-4d84-9ddb-90255041a254 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:55.058364 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-56d1d53d-1371-4d84-9ddb-90255041a254 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 21:08:55.058364 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:55.058364 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:08:55.058364 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:08:55.058364 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:08:55.058364 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:08:55.058364 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:08:55.058364 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:08:55.058364 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 21:08:55.058364 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:55.058364 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:08:55.058364 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:55.058364 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:55.058364 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:55.058364 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:55.058364 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:55.058364 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:55.059448 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:55.059448 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:55.059448 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:55.059448 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:55.059448 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:55.059448 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:55.059448 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:08:55.059448 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:08:55.059448 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:08:55.059448 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:08:55.059448 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:55.059448 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:55.059448 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:55.059448 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:55.059448 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:55.059448 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:55.060298 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:55.060298 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:55.060298 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:55.060298 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:55.060298 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:55.060298 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:55.060298 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:55.060298 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:55.060298 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:55.060298 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:55.060298 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:08:55.060298 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:08:55.060298 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 21:08:55.060298 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:55.060298 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 382/773] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:08:54 2022] GET /identity/v3/services/network => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:55.071952 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:55.073847 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1d53d-1371-4d84-9ddb-90255041a254 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:55.125136 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d679c997-b5fb-47f8-942d-7685a44c0449 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:55.163616 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce0118d-2df7-4fea-8f20-f3af0dc2be7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:55.164695 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0118d-2df7-4fea-8f20-f3af0dc2be7a None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:55.165199 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0118d-2df7-4fea-8f20-f3af0dc2be7a None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:55.166256 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0118d-2df7-4fea-8f20-f3af0dc2be7a None admin] PATH_INFO: `/v3/services` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:55.167196 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce0118d-2df7-4fea-8f20-f3af0dc2be7a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:55.167751 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce0118d-2df7-4fea-8f20-f3af0dc2be7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:55.169356 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce0118d-2df7-4fea-8f20-f3af0dc2be7a None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:55.175748 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 392/774] 10.222.0.30 () {56 vars in 1124 bytes} [Tue Jul 5 21:08:54 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:55.181986 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce0118d-2df7-4fea-8f20-f3af0dc2be7a None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:55.258442 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1d53d-1371-4d84-9ddb-90255041a254 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:55.289400 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:55.295565 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889d9bc-a351-4f73-ad37-b8c7ca0540da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:55.296106 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889d9bc-a351-4f73-ad37-b8c7ca0540da None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:55.296391 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889d9bc-a351-4f73-ad37-b8c7ca0540da None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:55.296673 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889d9bc-a351-4f73-ad37-b8c7ca0540da None admin] PATH_INFO: `/v3/services` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:55.297381 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7889d9bc-a351-4f73-ad37-b8c7ca0540da None admin] RBAC: Adding query filter params (name=network) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:55.297790 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7889d9bc-a351-4f73-ad37-b8c7ca0540da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:55.299210 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7889d9bc-a351-4f73-ad37-b8c7ca0540da None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:55.304290 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 383/775] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Jul 5 21:08:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:55.315427 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889d9bc-a351-4f73-ad37-b8c7ca0540da None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:55.320914 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce0118d-2df7-4fea-8f20-f3af0dc2be7a None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:55.386638 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:55.397611 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d90c82-280a-45fa-8505-62a91213a0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:55.398410 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d90c82-280a-45fa-8505-62a91213a0f1 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:55.398706 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d90c82-280a-45fa-8505-62a91213a0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:55.400620 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d90c82-280a-45fa-8505-62a91213a0f1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:55.400620 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d90c82-280a-45fa-8505-62a91213a0f1 None admin] RBAC: Adding query filter params (interface=public, service_id=dcc442003e4b4a3fba9b3d20ee642690, region_id=RegionOne) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:55.400620 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d90c82-280a-45fa-8505-62a91213a0f1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:55.402233 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d90c82-280a-45fa-8505-62a91213a0f1 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:55.418659 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 393/776] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Jul 5 21:08:55 2022] GET /identity/v3/endpoints?service_id=dcc442003e4b4a3fba9b3d20ee642690&interface=public®ion_id=RegionOne => generated 194 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:55.423641 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d90c82-280a-45fa-8505-62a91213a0f1 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:55.425356 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889d9bc-a351-4f73-ad37-b8c7ca0540da None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:55.529463 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d90c82-280a-45fa-8505-62a91213a0f1 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:55.564444 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db05f9-6150-44bd-9655-0a35c6c29a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:55.565176 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db05f9-6150-44bd-9655-0a35c6c29a16 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:55.565469 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db05f9-6150-44bd-9655-0a35c6c29a16 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:55.565748 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db05f9-6150-44bd-9655-0a35c6c29a16 None admin] PATH_INFO: `/v3/services` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:55.566559 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db05f9-6150-44bd-9655-0a35c6c29a16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:55.567933 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db05f9-6150-44bd-9655-0a35c6c29a16 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:55.570829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b1e0b1-0aee-4444-88fe-04650354a40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:55.571511 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b1e0b1-0aee-4444-88fe-04650354a40d None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:55.571826 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b1e0b1-0aee-4444-88fe-04650354a40d None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:55.572128 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b1e0b1-0aee-4444-88fe-04650354a40d None admin] PATH_INFO: `/v3/services` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:55.572851 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b1e0b1-0aee-4444-88fe-04650354a40d None admin] RBAC: Adding query filter params (type=network) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:55.573167 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b1e0b1-0aee-4444-88fe-04650354a40d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:55.573881 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 394/777] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Jul 5 21:08:55 2022] GET /identity/v3/services => generated 772 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:08:55.574571 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b1e0b1-0aee-4444-88fe-04650354a40d None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:55.592467 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 384/778] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Jul 5 21:08:55 2022] GET /identity/v3/services?type=network => generated 350 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:55.598475 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db05f9-6150-44bd-9655-0a35c6c29a16 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:55.682626 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:55.752489 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db05f9-6150-44bd-9655-0a35c6c29a16 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:55.795440 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c1e64-6e6b-4f7d-bd62-a14199be34b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:55.796119 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c1e64-6e6b-4f7d-bd62-a14199be34b0 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:55.796408 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c1e64-6e6b-4f7d-bd62-a14199be34b0 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:55.796682 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c1e64-6e6b-4f7d-bd62-a14199be34b0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:55.797478 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c1e64-6e6b-4f7d-bd62-a14199be34b0 None admin] RBAC: Adding query filter params (interface=public, service_id=9877c7ae9a8141ff808ebc8f8c7d77ba, region_id=RegionOne) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:55.797794 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c1e64-6e6b-4f7d-bd62-a14199be34b0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:55.799198 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c1e64-6e6b-4f7d-bd62-a14199be34b0 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:55.805077 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 395/779] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Jul 5 21:08:55 2022] GET /identity/v3/endpoints?service_id=9877c7ae9a8141ff808ebc8f8c7d77ba&interface=public®ion_id=RegionOne => generated 194 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:55.810369 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b1e0b1-0aee-4444-88fe-04650354a40d None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:55.880781 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:55.943269 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b1e0b1-0aee-4444-88fe-04650354a40d None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:55.987365 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a98225-733b-4843-a1df-779ac5faedd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:55.988048 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a98225-733b-4843-a1df-779ac5faedd4 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:55.988339 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a98225-733b-4843-a1df-779ac5faedd4 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:55.988618 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a98225-733b-4843-a1df-779ac5faedd4 None admin] PATH_INFO: `/v3/services` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:55.989306 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a98225-733b-4843-a1df-779ac5faedd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:55.990771 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a98225-733b-4843-a1df-779ac5faedd4 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:55.999149 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 385/780] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Jul 5 21:08:55 2022] GET /identity/v3/services => generated 772 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:56.382489 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945b96c-722e-4a14-b3bb-7dccc5a9377d None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:56.383020 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945b96c-722e-4a14-b3bb-7dccc5a9377d None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:56.383020 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945b96c-722e-4a14-b3bb-7dccc5a9377d None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:56.384743 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 396/781] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:56.390270 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb20868-a158-412a-9136-cf8ded1029db None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:56.391107 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb20868-a158-412a-9136-cf8ded1029db None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:56.391615 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb20868-a158-412a-9136-cf8ded1029db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:56.398500 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0962d0-264e-4f29-8497-260f7a01aa98 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:56.398797 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0962d0-264e-4f29-8497-260f7a01aa98 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:56.399081 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0962d0-264e-4f29-8497-260f7a01aa98 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:56.400724 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 397/782] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:56.407054 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96a3a4-8065-4217-a84c-ce008b9987c5 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:56.407773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96a3a4-8065-4217-a84c-ce008b9987c5 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:56.409345 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96a3a4-8065-4217-a84c-ce008b9987c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:56.417177 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-bfb20868-a158-412a-9136-cf8ded1029db None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:56.420064 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-bfb20868-a158-412a-9136-cf8ded1029db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:56.440134 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-ea96a3a4-8065-4217-a84c-ce008b9987c5 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:56.443684 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-ea96a3a4-8065-4217-a84c-ce008b9987c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:56.543412 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 386/783] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:08:56.566230 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb20868-a158-412a-9136-cf8ded1029db None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:56.575021 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 398/784] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:08:56.597446 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96a3a4-8065-4217-a84c-ce008b9987c5 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:56.653580 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:56.668961 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:56.718085 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96a3a4-8065-4217-a84c-ce008b9987c5 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:56.765169 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb20868-a158-412a-9136-cf8ded1029db None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:56.792009 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8842953-3455-4692-8e68-7d2321e89a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:56.792825 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8842953-3455-4692-8e68-7d2321e89a17 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:56.793114 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8842953-3455-4692-8e68-7d2321e89a17 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:56.793394 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8842953-3455-4692-8e68-7d2321e89a17 None admin] PATH_INFO: `/v3/roles/service` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:56.809862 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c9311-2774-486f-92c7-dbe06389f2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:56.811112 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c9311-2774-486f-92c7-dbe06389f2a0 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:56.811726 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c9311-2774-486f-92c7-dbe06389f2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:56.812214 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c9311-2774-486f-92c7-dbe06389f2a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:56.823189 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8842953-3455-4692-8e68-7d2321e89a17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:08:56.824522 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4c9311-2774-486f-92c7-dbe06389f2a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:08:56.832460 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-da4c9311-2774-486f-92c7-dbe06389f2a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:08:56.832460 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:56.832460 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:56.832460 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:56.832460 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:56.832460 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:56.832460 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:56.832460 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:56.832460 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:56.832460 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:56.832460 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:56.832460 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:56.832460 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:08:56.832460 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:08:56.832460 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:08:56.832460 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:08:56.833394 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:08:56.833394 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:08:56.833394 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:08:56.833394 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:08:56.833394 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:56.833394 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:56.833394 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:56.833394 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:56.833394 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:56.833394 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:56.833394 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:56.833394 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:56.833394 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:56.833394 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:56.833394 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:56.833394 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:56.834296 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:56.834296 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:56.834296 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:56.834296 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:56.834296 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:08:56.834296 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:08:56.834296 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:08:56.834296 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:08:56.834296 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:08:56.834296 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:08:56.834296 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:08:56.834296 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:56.837176 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 387/785] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:08:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:08:56.839036 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-f8842953-3455-4692-8e68-7d2321e89a17 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:08:56.839036 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:56.839036 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:56.839036 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:56.839036 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:56.839036 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:56.839036 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:56.839036 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:56.839036 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:56.839036 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:56.839036 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:56.839036 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:56.839036 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:08:56.839036 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:08:56.839036 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:08:56.839036 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:08:56.839979 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:08:56.839979 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:08:56.839979 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:08:56.839979 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:08:56.839979 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:56.839979 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:56.839979 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:56.839979 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:56.839979 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:56.839979 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:56.839979 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:56.839979 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:56.839979 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:56.839979 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:56.839979 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:56.839979 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:56.840869 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:56.840869 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:56.840869 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:56.840869 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:56.840869 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:08:56.840869 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:08:56.840869 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:08:56.840869 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:08:56.840869 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:08:56.840869 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:08:56.840869 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:08:56.840869 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:56.844035 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c9311-2774-486f-92c7-dbe06389f2a0 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:56.845542 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 399/786] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:08:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:08:56.851330 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8842953-3455-4692-8e68-7d2321e89a17 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:57.010820 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c9311-2774-486f-92c7-dbe06389f2a0 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:57.026896 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:57.052091 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a81347-239d-47b6-8485-a464cadf10cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:57.053188 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a81347-239d-47b6-8485-a464cadf10cf None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:57.053696 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a81347-239d-47b6-8485-a464cadf10cf None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:57.054297 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a81347-239d-47b6-8485-a464cadf10cf None admin] PATH_INFO: `/v3/roles` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:57.055404 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a81347-239d-47b6-8485-a464cadf10cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:57.055936 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a81347-239d-47b6-8485-a464cadf10cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:57.058404 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a81347-239d-47b6-8485-a464cadf10cf None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:57.068104 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8842953-3455-4692-8e68-7d2321e89a17 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:57.069772 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 388/787] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:08:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:57.073613 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:57.076553 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a81347-239d-47b6-8485-a464cadf10cf None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:57.131569 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f5fb81-f201-447a-a8e5-afca215a250d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:57.132251 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f5fb81-f201-447a-a8e5-afca215a250d None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:57.132611 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f5fb81-f201-447a-a8e5-afca215a250d None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:57.132895 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f5fb81-f201-447a-a8e5-afca215a250d None admin] PATH_INFO: `/v3/roles` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:57.133651 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f5fb81-f201-447a-a8e5-afca215a250d None admin] RBAC: Adding query filter params (name=service) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:57.133964 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f5fb81-f201-447a-a8e5-afca215a250d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:57.135715 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f5fb81-f201-447a-a8e5-afca215a250d None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:57.155551 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 400/788] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:08:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:57.160459 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f5fb81-f201-447a-a8e5-afca215a250d None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:57.259209 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a81347-239d-47b6-8485-a464cadf10cf None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:57.333913 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e4e92-b50d-42d8-89ba-72717a5f53b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:57.334679 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e4e92-b50d-42d8-89ba-72717a5f53b5 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:57.334965 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e4e92-b50d-42d8-89ba-72717a5f53b5 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:57.335246 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e4e92-b50d-42d8-89ba-72717a5f53b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:57.348924 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f5fb81-f201-447a-a8e5-afca215a250d None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:57.360160 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9e4e92-b50d-42d8-89ba-72717a5f53b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:57.361623 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9e4e92-b50d-42d8-89ba-72717a5f53b5 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:57.388262 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-fd9e4e92-b50d-42d8-89ba-72717a5f53b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:57.388262 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:57.388262 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:57.388262 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:57.388262 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:57.388262 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:57.388262 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:57.388262 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:57.388262 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:57.388262 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:57.388262 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:57.388262 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:57.388262 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:08:57.388262 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:08:57.388262 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:08:57.389227 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:08:57.389227 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:57.389227 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:57.389227 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:57.389227 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:57.389227 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:57.389227 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:57.389227 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:57.389227 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:57.389227 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:57.389227 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:57.389227 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:57.389227 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:57.389227 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:57.389227 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:57.389227 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:57.389227 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:57.390120 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:08:57.390120 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:08:57.390120 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:57.390120 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:57.400315 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 389/789] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:57.401242 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e4e92-b50d-42d8-89ba-72717a5f53b5 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:57.417732 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c937b-d827-4e09-bdb9-6df79b838491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:57.418717 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c937b-d827-4e09-bdb9-6df79b838491 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:57.419002 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c937b-d827-4e09-bdb9-6df79b838491 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:57.419281 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c937b-d827-4e09-bdb9-6df79b838491 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:57.437253 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6c937b-d827-4e09-bdb9-6df79b838491 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:57.438756 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6c937b-d827-4e09-bdb9-6df79b838491 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:57.464342 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:57.465338 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-5e6c937b-d827-4e09-bdb9-6df79b838491 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:57.465338 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:57.465338 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:57.465338 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:57.465338 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:57.465338 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:57.465338 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:57.465338 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:57.465338 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:57.465338 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:57.465338 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:57.465338 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:57.465338 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:08:57.465338 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:08:57.465338 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:08:57.466325 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:08:57.466325 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:57.466325 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:57.466325 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:57.466325 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:57.466325 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:57.466325 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:57.466325 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:57.466325 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:57.466325 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:57.466325 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:57.466325 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:57.466325 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:57.466325 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:57.466325 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:57.466325 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:57.466325 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:57.467223 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:08:57.467223 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:08:57.467223 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:57.467223 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:57.469529 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 401/790] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:08:57.477755 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c937b-d827-4e09-bdb9-6df79b838491 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:57.509716 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:57.568594 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e4e92-b50d-42d8-89ba-72717a5f53b5 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:57.599918 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c937b-d827-4e09-bdb9-6df79b838491 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:57.609146 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe5116-b7d7-4167-b3b1-ab5a3448c446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:57.609832 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe5116-b7d7-4167-b3b1-ab5a3448c446 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:57.610122 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe5116-b7d7-4167-b3b1-ab5a3448c446 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:57.610432 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe5116-b7d7-4167-b3b1-ab5a3448c446 None admin] PATH_INFO: `/v3/domains` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:57.611537 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe5116-b7d7-4167-b3b1-ab5a3448c446 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:57.611853 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe5116-b7d7-4167-b3b1-ab5a3448c446 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:57.613869 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe5116-b7d7-4167-b3b1-ab5a3448c446 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:57.629819 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 390/791] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:08:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:57.631466 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262fd85-8f70-4ac0-9319-9c0a31162055 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:57.631763 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262fd85-8f70-4ac0-9319-9c0a31162055 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:57.632045 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262fd85-8f70-4ac0-9319-9c0a31162055 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:57.638661 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 391/792] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:57.638661 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262fd85-8f70-4ac0-9319-9c0a31162055 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:57.649103 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c8825-bd93-4788-a294-bdf3cf0e71f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:57.651375 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c8825-bd93-4788-a294-bdf3cf0e71f7 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:57.652153 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c8825-bd93-4788-a294-bdf3cf0e71f7 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:57.652634 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c8825-bd93-4788-a294-bdf3cf0e71f7 None admin] PATH_INFO: `/v3/domains` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:57.653721 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c8825-bd93-4788-a294-bdf3cf0e71f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:57.654257 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c8825-bd93-4788-a294-bdf3cf0e71f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:57.656570 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c8825-bd93-4788-a294-bdf3cf0e71f7 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:57.672284 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 402/793] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:08:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:57.673826 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7d26b-78a8-4238-8d6d-ab6c06c6ea28 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:57.674371 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7d26b-78a8-4238-8d6d-ab6c06c6ea28 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:57.674852 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7d26b-78a8-4238-8d6d-ab6c06c6ea28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:57.695657 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-4fd7d26b-78a8-4238-8d6d-ab6c06c6ea28 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:57.698374 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-4fd7d26b-78a8-4238-8d6d-ab6c06c6ea28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:57.750818 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:57.766990 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262fd85-8f70-4ac0-9319-9c0a31162055 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:57.792769 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 403/794] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:08:57.792769 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd7d26b-78a8-4238-8d6d-ab6c06c6ea28 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:57.812654 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:57.823525 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd6047-4c36-48a6-8e98-6dcd2e316cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:57.824220 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd6047-4c36-48a6-8e98-6dcd2e316cdf None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:57.825830 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd6047-4c36-48a6-8e98-6dcd2e316cdf None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:57.825830 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd6047-4c36-48a6-8e98-6dcd2e316cdf None admin] PATH_INFO: `/v3/users/nova` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:57.832852 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fd6047-4c36-48a6-8e98-6dcd2e316cdf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:57.834307 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fd6047-4c36-48a6-8e98-6dcd2e316cdf None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:57.850523 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-34fd6047-4c36-48a6-8e98-6dcd2e316cdf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:08:57.850523 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:57.850523 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:57.850523 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:57.850523 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:57.850523 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:57.850523 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:57.850523 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:57.850523 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:57.850523 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:57.850523 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:57.850523 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:57.850523 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:08:57.850523 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:08:57.850523 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:08:57.850523 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:08:57.851487 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:57.851487 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:57.851487 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:08:57.851487 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:08:57.851487 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:08:57.851487 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:08:57.851487 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:57.851487 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:57.851487 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:57.851487 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:57.851487 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:57.851487 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:57.851487 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:57.851487 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:57.851487 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:57.851487 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:57.851487 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:57.851487 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:57.852431 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:57.852431 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:57.852431 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:08:57.852431 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:08:57.852431 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:08:57.852431 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:08:57.852431 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:08:57.852431 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:08:57.852431 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:08:57.852431 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:57.852431 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 392/795] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Jul 5 21:08:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:57.853090 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd6047-4c36-48a6-8e98-6dcd2e316cdf None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:57.922774 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd7d26b-78a8-4238-8d6d-ab6c06c6ea28 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:57.961055 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0f6a1-bd23-42d4-b2b7-2e201dc86c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:57.962001 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0f6a1-bd23-42d4-b2b7-2e201dc86c58 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:57.962316 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0f6a1-bd23-42d4-b2b7-2e201dc86c58 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:57.962663 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0f6a1-bd23-42d4-b2b7-2e201dc86c58 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:57.970915 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a0f6a1-bd23-42d4-b2b7-2e201dc86c58 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:57.972169 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a0f6a1-bd23-42d4-b2b7-2e201dc86c58 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:57.984568 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd6047-4c36-48a6-8e98-6dcd2e316cdf None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:57.989254 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-67a0f6a1-bd23-42d4-b2b7-2e201dc86c58 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 21:08:57.989254 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:57.989254 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:57.989254 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:57.989254 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:57.989254 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:57.989254 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:57.989254 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:57.989254 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:57.989254 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:57.989254 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:57.989254 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:57.989254 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:08:57.989254 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:08:57.989254 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:08:57.989254 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:08:57.990225 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:57.990225 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:57.990225 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:08:57.990225 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:08:57.990225 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:08:57.990225 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:08:57.990225 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:57.990225 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:57.990225 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:57.990225 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:57.990225 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:57.990225 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:57.990225 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:57.990225 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:57.990225 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:57.990225 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:57.990225 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:57.990225 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:57.991181 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:57.991181 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:57.991181 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:08:57.991181 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:08:57.991181 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:08:57.991181 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:08:57.991181 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:08:57.991181 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:08:57.991181 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 21:08:57.991181 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:57.991181 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 404/796] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Jul 5 21:08:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:57.991765 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0f6a1-bd23-42d4-b2b7-2e201dc86c58 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:58.029703 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d903d4e4-b2ab-4e90-b296-001babd2c3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:58.031093 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903d4e4-b2ab-4e90-b296-001babd2c3f4 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:58.031585 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903d4e4-b2ab-4e90-b296-001babd2c3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:58.032816 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903d4e4-b2ab-4e90-b296-001babd2c3f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:58.046220 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d903d4e4-b2ab-4e90-b296-001babd2c3f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:08:58.056640 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-d903d4e4-b2ab-4e90-b296-001babd2c3f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:08:58.056640 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:58.056640 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:58.056640 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:58.056640 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:58.056640 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:58.056640 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:58.056640 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:58.056640 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:58.056640 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:58.056640 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:58.056640 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:58.056640 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:08:58.056640 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:08:58.056640 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:08:58.056640 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:08:58.057647 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:08:58.057647 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:08:58.057647 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:08:58.057647 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:08:58.057647 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:58.057647 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:58.057647 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:58.057647 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:58.057647 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:58.057647 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:58.057647 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:58.057647 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:58.057647 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:58.057647 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:58.057647 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:58.057647 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:58.058517 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:58.058517 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:58.058517 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:58.058517 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:58.058517 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:08:58.058517 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:08:58.058517 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:08:58.058517 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:08:58.058517 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:08:58.058517 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:08:58.058517 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:08:58.058517 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:58.064829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 393/797] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:08:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:58.064829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d903d4e4-b2ab-4e90-b296-001babd2c3f4 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:58.075171 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:58.078022 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:58.119452 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0f6a1-bd23-42d4-b2b7-2e201dc86c58 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:58.156209 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009f621-ae1c-4f02-b6ca-419f2ef7ec37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:58.156887 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009f621-ae1c-4f02-b6ca-419f2ef7ec37 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:58.157229 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009f621-ae1c-4f02-b6ca-419f2ef7ec37 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:58.157512 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009f621-ae1c-4f02-b6ca-419f2ef7ec37 None admin] PATH_INFO: `/v3/users` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:58.158373 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1009f621-ae1c-4f02-b6ca-419f2ef7ec37 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:58.158679 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1009f621-ae1c-4f02-b6ca-419f2ef7ec37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:58.160116 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1009f621-ae1c-4f02-b6ca-419f2ef7ec37 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:58.182669 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 405/798] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Jul 5 21:08:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:58.182669 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009f621-ae1c-4f02-b6ca-419f2ef7ec37 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:58.182940 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d903d4e4-b2ab-4e90-b296-001babd2c3f4 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:58.220555 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc60a22-26a1-43a5-be5d-4233396204a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:58.221237 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc60a22-26a1-43a5-be5d-4233396204a8 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:58.221531 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc60a22-26a1-43a5-be5d-4233396204a8 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:58.221814 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc60a22-26a1-43a5-be5d-4233396204a8 None admin] PATH_INFO: `/v3/users` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:58.222820 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc60a22-26a1-43a5-be5d-4233396204a8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:58.223075 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc60a22-26a1-43a5-be5d-4233396204a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:58.224659 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc60a22-26a1-43a5-be5d-4233396204a8 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:58.243205 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 394/799] 10.222.0.30 () {56 vars in 1149 bytes} [Tue Jul 5 21:08:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:58.244678 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e671f-3fd1-4124-a71b-59826106c098 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:58.244977 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e671f-3fd1-4124-a71b-59826106c098 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:58.245262 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e671f-3fd1-4124-a71b-59826106c098 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:58.246664 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 395/800] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:58.251163 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e671f-3fd1-4124-a71b-59826106c098 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:58.289548 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009f621-ae1c-4f02-b6ca-419f2ef7ec37 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:58.324290 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:58.327129 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:58.333911 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d2ac9-dac0-476e-9084-b7f15d2cb277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:58.334668 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d2ac9-dac0-476e-9084-b7f15d2cb277 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:58.334969 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d2ac9-dac0-476e-9084-b7f15d2cb277 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:58.335233 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d2ac9-dac0-476e-9084-b7f15d2cb277 None admin] PATH_INFO: `/v3/roles` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:58.335977 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d2ac9-dac0-476e-9084-b7f15d2cb277 None admin] RBAC: Adding query filter params (name=admin) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:58.336288 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d2ac9-dac0-476e-9084-b7f15d2cb277 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:58.337771 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d2ac9-dac0-476e-9084-b7f15d2cb277 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:58.350458 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 406/801] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:08:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:58.351131 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d2ac9-dac0-476e-9084-b7f15d2cb277 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:58.366319 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e671f-3fd1-4124-a71b-59826106c098 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:58.404615 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1124227e-0e8b-4869-b179-ec451c72960e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:58.405230 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124227e-0e8b-4869-b179-ec451c72960e None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:58.405468 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124227e-0e8b-4869-b179-ec451c72960e None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:58.405746 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124227e-0e8b-4869-b179-ec451c72960e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:58.456226 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d2ac9-dac0-476e-9084-b7f15d2cb277 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:58.473095 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1124227e-0e8b-4869-b179-ec451c72960e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:58.474593 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1124227e-0e8b-4869-b179-ec451c72960e None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:58.489374 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4b110-0c6c-4508-a75f-13feb2968ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:58.490200 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4b110-0c6c-4508-a75f-13feb2968ea8 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:58.490488 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4b110-0c6c-4508-a75f-13feb2968ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:58.490762 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4b110-0c6c-4508-a75f-13feb2968ea8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:58.501928 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db4b110-0c6c-4508-a75f-13feb2968ea8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:58.503404 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db4b110-0c6c-4508-a75f-13feb2968ea8 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:58.521232 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-4db4b110-0c6c-4508-a75f-13feb2968ea8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:58.521232 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:58.521232 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:58.521232 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:58.521232 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:58.521232 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:58.521232 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:58.521232 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:58.521232 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:58.521232 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:58.521232 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:58.521232 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:58.521232 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:08:58.521232 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:08:58.521232 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:08:58.522211 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:08:58.522211 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:58.522211 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:58.522211 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:58.522211 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:58.522211 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:58.522211 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:58.522211 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:58.522211 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:58.522211 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:58.522211 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:58.522211 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:58.522211 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:58.522211 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:58.522211 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:58.522211 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:58.522211 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:58.523159 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:08:58.523159 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:08:58.523159 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:58.523159 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:58.523159 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 407/802] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:58.523893 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1a3b3-ecd8-425c-acc8-34aed7c0c228 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:58.523893 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1a3b3-ecd8-425c-acc8-34aed7c0c228 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:58.524137 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1a3b3-ecd8-425c-acc8-34aed7c0c228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:58.539957 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-4cf1a3b3-ecd8-425c-acc8-34aed7c0c228 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:58.541198 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-4cf1a3b3-ecd8-425c-acc8-34aed7c0c228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:58.544319 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:58.576667 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:58.580363 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 396/803] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:08:58 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:08:58.581192 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1124227e-0e8b-4869-b179-ec451c72960e None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:58.610544 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 408/804] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:08:58.611681 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376dd098-961c-41cf-adde-bed412d04ed2 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:58.611974 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376dd098-961c-41cf-adde-bed412d04ed2 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:58.612253 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376dd098-961c-41cf-adde-bed412d04ed2 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:58.613492 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 409/805] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:08:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:08:58.614316 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376dd098-961c-41cf-adde-bed412d04ed2 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:58.696674 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1124227e-0e8b-4869-b179-ec451c72960e None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:58.719425 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376dd098-961c-41cf-adde-bed412d04ed2 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:58.729937 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a01d9-64ba-4ab7-99b6-33ac6b8580cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:58.730770 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a01d9-64ba-4ab7-99b6-33ac6b8580cc None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:58.731057 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a01d9-64ba-4ab7-99b6-33ac6b8580cc None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:58.731336 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a01d9-64ba-4ab7-99b6-33ac6b8580cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:58.741217 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a01d9-64ba-4ab7-99b6-33ac6b8580cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:58.742719 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a01d9-64ba-4ab7-99b6-33ac6b8580cc None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:58.753498 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c877be-b4d4-4825-9f5c-a0cbe98770d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:58.754176 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c877be-b4d4-4825-9f5c-a0cbe98770d0 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:58.754468 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c877be-b4d4-4825-9f5c-a0cbe98770d0 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:58.754747 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c877be-b4d4-4825-9f5c-a0cbe98770d0 None admin] PATH_INFO: `/v3/domains` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:58.755470 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c877be-b4d4-4825-9f5c-a0cbe98770d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:58.755782 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c877be-b4d4-4825-9f5c-a0cbe98770d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:58.757133 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c877be-b4d4-4825-9f5c-a0cbe98770d0 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:58.760707 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-c14a01d9-64ba-4ab7-99b6-33ac6b8580cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:58.760707 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:58.760707 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:58.760707 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:58.760707 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:58.760707 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:58.760707 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:58.760707 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:58.760707 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:58.760707 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:58.760707 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:58.760707 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:58.760707 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:08:58.760707 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:08:58.760707 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:08:58.761746 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:08:58.761746 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:58.761746 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:58.761746 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:58.761746 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:58.761746 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:58.761746 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:58.761746 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:58.761746 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:58.761746 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:58.761746 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:58.761746 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:58.761746 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:58.761746 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:58.761746 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:58.761746 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:58.761746 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:58.763109 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:08:58.763109 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:08:58.763109 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:58.763109 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:58.763109 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 397/806] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:58.763109 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a01d9-64ba-4ab7-99b6-33ac6b8580cc None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:58.775160 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 410/807] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:58.775160 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157207c9-1979-4783-a86f-d330583423c8 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:58.775160 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157207c9-1979-4783-a86f-d330583423c8 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:58.775160 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157207c9-1979-4783-a86f-d330583423c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:58.783063 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:58.792137 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-157207c9-1979-4783-a86f-d330583423c8 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:58.793336 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-157207c9-1979-4783-a86f-d330583423c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:58.817057 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:58.859024 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 411/808] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:08:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:08:58.859935 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157207c9-1979-4783-a86f-d330583423c8 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:58.864286 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a01d9-64ba-4ab7-99b6-33ac6b8580cc None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:58.898371 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76554e2f-a1b0-48bb-b3a4-becba04fc4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:58.899184 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76554e2f-a1b0-48bb-b3a4-becba04fc4df None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:58.899472 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76554e2f-a1b0-48bb-b3a4-becba04fc4df None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:58.899751 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76554e2f-a1b0-48bb-b3a4-becba04fc4df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:58.910004 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76554e2f-a1b0-48bb-b3a4-becba04fc4df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:58.911512 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76554e2f-a1b0-48bb-b3a4-becba04fc4df None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:58.929419 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-76554e2f-a1b0-48bb-b3a4-becba04fc4df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:58.929419 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:58.929419 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:58.929419 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:58.929419 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:58.929419 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:58.929419 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:58.929419 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:58.929419 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:58.929419 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:58.929419 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:58.929419 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:58.929419 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:08:58.929419 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:08:58.929419 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:08:58.930387 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:08:58.930387 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:58.930387 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:58.930387 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:58.930387 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:58.930387 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:58.930387 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:58.930387 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:58.930387 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:58.930387 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:58.930387 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:58.930387 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:58.930387 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:58.930387 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:58.930387 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:58.930387 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:58.930387 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:58.932404 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:08:58.932404 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:08:58.932404 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:08:58.932404 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:58.932404 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 398/809] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:08:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:58.932404 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76554e2f-a1b0-48bb-b3a4-becba04fc4df None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:58.975590 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157207c9-1979-4783-a86f-d330583423c8 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:59.001644 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:59.009874 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11f270-a4b2-46ce-b9fd-5fa4a430b0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:59.010722 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11f270-a4b2-46ce-b9fd-5fa4a430b0b3 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:59.011011 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11f270-a4b2-46ce-b9fd-5fa4a430b0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:59.011293 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11f270-a4b2-46ce-b9fd-5fa4a430b0b3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:59.011948 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e11f270-a4b2-46ce-b9fd-5fa4a430b0b3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:59.013321 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e11f270-a4b2-46ce-b9fd-5fa4a430b0b3 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:59.026174 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-6e11f270-a4b2-46ce-b9fd-5fa4a430b0b3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 21:08:59.026174 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:59.026174 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:08:59.026174 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:08:59.026174 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:08:59.026174 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:08:59.026174 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:08:59.026174 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:08:59.026174 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 21:08:59.026174 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:59.026174 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:08:59.026174 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:59.026174 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:59.026174 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:59.026174 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:59.026174 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:59.027130 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:59.027130 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:59.027130 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:59.027130 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:59.027130 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:59.027130 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:59.027130 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:59.027130 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:08:59.027130 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:08:59.027130 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:08:59.027130 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:08:59.027130 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:59.027130 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:59.027130 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:59.027130 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:59.027130 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:59.033108 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:59.033108 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:59.033108 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:59.033108 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:59.033108 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:59.033108 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:59.033108 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:59.033108 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:59.033108 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:59.033108 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:59.033108 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:59.033108 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:08:59.033108 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:08:59.033108 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 21:08:59.033108 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:59.033108 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 412/810] 10.222.0.30 () {56 vars in 1129 bytes} [Tue Jul 5 21:08:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:59.033961 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11f270-a4b2-46ce-b9fd-5fa4a430b0b3 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:59.034031 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76554e2f-a1b0-48bb-b3a4-becba04fc4df None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:59.055933 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:59.068440 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9233484-f5e8-4214-8660-1a430eb31084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:59.069112 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9233484-f5e8-4214-8660-1a430eb31084 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:59.069403 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9233484-f5e8-4214-8660-1a430eb31084 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:59.069687 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9233484-f5e8-4214-8660-1a430eb31084 None admin] PATH_INFO: `/v3/domains` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:59.070441 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9233484-f5e8-4214-8660-1a430eb31084 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:59.070759 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9233484-f5e8-4214-8660-1a430eb31084 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:59.072270 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9233484-f5e8-4214-8660-1a430eb31084 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:59.083490 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 399/811] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:59.084331 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9233484-f5e8-4214-8660-1a430eb31084 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:59.133160 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11f270-a4b2-46ce-b9fd-5fa4a430b0b3 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:59.168166 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9c92b-1910-4d3d-b844-ba6ed330e093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:59.169043 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9c92b-1910-4d3d-b844-ba6ed330e093 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:59.169333 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9c92b-1910-4d3d-b844-ba6ed330e093 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:59.169609 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9c92b-1910-4d3d-b844-ba6ed330e093 None admin] PATH_INFO: `/v3/projects/service` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:59.176258 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb9c92b-1910-4d3d-b844-ba6ed330e093 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:59.177695 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb9c92b-1910-4d3d-b844-ba6ed330e093 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:59.183865 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9233484-f5e8-4214-8660-1a430eb31084 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:59.191661 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-2bb9c92b-1910-4d3d-b844-ba6ed330e093 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:08:59.191661 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:59.191661 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:59.191661 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:59.191661 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:59.191661 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:59.191661 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:59.191661 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:59.191661 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:59.191661 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:59.191661 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:59.191661 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:59.191661 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:08:59.191661 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:08:59.191661 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:08:59.192735 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:08:59.192735 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:59.192735 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:59.192735 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:59.192735 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:59.192735 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:59.192735 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:59.192735 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:59.192735 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:59.192735 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:59.192735 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:59.192735 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:59.192735 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:59.192735 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:59.192735 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:59.192735 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:59.192735 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:59.193655 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:08:59.193655 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:08:59.193655 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:08:59.193655 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:08:59.193655 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:08:59.193655 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:08:59.193655 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:08:59.193655 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:59.193655 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 413/812] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:08:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:59.194173 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9c92b-1910-4d3d-b844-ba6ed330e093 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:59.214993 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:59.220818 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1131ff8-3240-4462-98f9-869e8a736e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:59.221855 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1131ff8-3240-4462-98f9-869e8a736e1c None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:59.222176 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1131ff8-3240-4462-98f9-869e8a736e1c None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:59.222452 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1131ff8-3240-4462-98f9-869e8a736e1c None admin] PATH_INFO: `/v3/services/network` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:59.223101 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1131ff8-3240-4462-98f9-869e8a736e1c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:59.224475 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1131ff8-3240-4462-98f9-869e8a736e1c None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:59.236853 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-a1131ff8-3240-4462-98f9-869e8a736e1c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 21:08:59.236853 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:59.236853 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:08:59.236853 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:08:59.236853 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:08:59.236853 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:08:59.236853 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:08:59.236853 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:08:59.236853 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 21:08:59.236853 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:59.236853 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:08:59.236853 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:59.236853 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:59.236853 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:59.236853 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:59.236853 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:59.236853 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:59.238052 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:59.238052 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:59.238052 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:59.238052 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:59.238052 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:59.238052 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:59.238052 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:08:59.238052 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:08:59.238052 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:08:59.238052 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:08:59.238052 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:59.238052 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:59.238052 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:59.238052 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:59.238052 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:59.238052 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:59.238992 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:59.238992 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:59.238992 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:59.238992 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:59.238992 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:59.238992 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:59.238992 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:59.238992 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:59.238992 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:59.238992 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:59.238992 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:08:59.238992 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:08:59.238992 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 21:08:59.238992 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:59.238992 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 400/813] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:08:59 2022] GET /identity/v3/services/network => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:59.239952 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1131ff8-3240-4462-98f9-869e8a736e1c None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:59.282301 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:59.298202 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9c92b-1910-4d3d-b844-ba6ed330e093 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:59.334392 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c42244-4f39-49eb-8bbc-3cdaf104774a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:59.335060 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c42244-4f39-49eb-8bbc-3cdaf104774a None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:59.335352 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c42244-4f39-49eb-8bbc-3cdaf104774a None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:59.335639 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c42244-4f39-49eb-8bbc-3cdaf104774a None admin] PATH_INFO: `/v3/domains` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:59.336362 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c42244-4f39-49eb-8bbc-3cdaf104774a None admin] RBAC: Adding query filter params (name=Default) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:59.336672 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c42244-4f39-49eb-8bbc-3cdaf104774a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:59.338606 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c42244-4f39-49eb-8bbc-3cdaf104774a None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:59.343017 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1131ff8-3240-4462-98f9-869e8a736e1c None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:59.349703 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 414/814] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:08:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:59.350367 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c42244-4f39-49eb-8bbc-3cdaf104774a None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:59.381926 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bbbf34-1b53-4aee-9a6d-9193e39f9b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:59.382645 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bbbf34-1b53-4aee-9a6d-9193e39f9b8b None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:59.382938 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bbbf34-1b53-4aee-9a6d-9193e39f9b8b None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:59.383223 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bbbf34-1b53-4aee-9a6d-9193e39f9b8b None admin] PATH_INFO: `/v3/services` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:59.383934 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bbbf34-1b53-4aee-9a6d-9193e39f9b8b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:59.384277 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bbbf34-1b53-4aee-9a6d-9193e39f9b8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:59.386266 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bbbf34-1b53-4aee-9a6d-9193e39f9b8b None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:59.390740 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 401/815] 10.222.0.30 () {56 vars in 1124 bytes} [Tue Jul 5 21:08:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:59.391514 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bbbf34-1b53-4aee-9a6d-9193e39f9b8b None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:59.448853 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:59.454564 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c42244-4f39-49eb-8bbc-3cdaf104774a None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:59.488881 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce30f802-dfe9-44d2-843c-a01feb99aa09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:59.489466 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bbbf34-1b53-4aee-9a6d-9193e39f9b8b None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:59.489584 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30f802-dfe9-44d2-843c-a01feb99aa09 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:59.489874 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30f802-dfe9-44d2-843c-a01feb99aa09 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:59.490285 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30f802-dfe9-44d2-843c-a01feb99aa09 None admin] PATH_INFO: `/v3/users/swift` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:59.498273 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce30f802-dfe9-44d2-843c-a01feb99aa09 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:59.499762 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce30f802-dfe9-44d2-843c-a01feb99aa09 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:59.514425 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-ce30f802-dfe9-44d2-843c-a01feb99aa09 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 21:08:59.514425 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:59.514425 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:59.514425 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:59.514425 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:59.514425 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:59.514425 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:59.514425 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:59.514425 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:59.514425 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:59.514425 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:59.514425 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:59.514425 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:08:59.514425 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:08:59.514425 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:08:59.514425 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:08:59.515409 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:59.515409 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:59.515409 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:08:59.515409 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:08:59.515409 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:08:59.515409 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:08:59.515409 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:59.515409 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:59.515409 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:59.515409 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:59.515409 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:59.515409 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:59.515409 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:59.515409 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:59.515409 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:59.515409 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:59.515409 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:59.515409 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:59.516349 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:59.516349 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:59.516349 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:08:59.516349 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:08:59.516349 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:08:59.516349 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:08:59.516349 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:08:59.516349 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:08:59.516349 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 21:08:59.516349 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:08:59.516349 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 415/816] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:08:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:59.516934 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce30f802-dfe9-44d2-843c-a01feb99aa09 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:59.519740 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:59.529270 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30144e0-c92a-472c-bf71-fa91536f82b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:59.530655 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30144e0-c92a-472c-bf71-fa91536f82b1 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:59.530655 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30144e0-c92a-472c-bf71-fa91536f82b1 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:59.530655 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30144e0-c92a-472c-bf71-fa91536f82b1 None admin] PATH_INFO: `/v3/projects` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:59.531304 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30144e0-c92a-472c-bf71-fa91536f82b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:59.531621 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30144e0-c92a-472c-bf71-fa91536f82b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:59.533054 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30144e0-c92a-472c-bf71-fa91536f82b1 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:59.545509 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 402/817] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:08:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:59.546338 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30144e0-c92a-472c-bf71-fa91536f82b1 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:59.618864 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce30f802-dfe9-44d2-843c-a01feb99aa09 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:59.647939 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30144e0-c92a-472c-bf71-fa91536f82b1 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:59.654059 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a210c-92c6-46d7-a2a9-146c5f448404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:59.654762 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a210c-92c6-46d7-a2a9-146c5f448404 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:59.655053 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a210c-92c6-46d7-a2a9-146c5f448404 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:59.655335 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a210c-92c6-46d7-a2a9-146c5f448404 None admin] PATH_INFO: `/v3/services` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:59.656042 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3a210c-92c6-46d7-a2a9-146c5f448404 None admin] RBAC: Adding query filter params (name=network) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:59.656355 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3a210c-92c6-46d7-a2a9-146c5f448404 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:59.657725 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3a210c-92c6-46d7-a2a9-146c5f448404 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:59.662324 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 416/818] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Jul 5 21:08:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:59.663108 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a210c-92c6-46d7-a2a9-146c5f448404 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:59.670633 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:59.688334 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c99a4-99df-4218-8628-dbf3f533bf12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:59.689134 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c99a4-99df-4218-8628-dbf3f533bf12 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:59.689671 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c99a4-99df-4218-8628-dbf3f533bf12 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:59.689950 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c99a4-99df-4218-8628-dbf3f533bf12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:59.697534 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c99a4-99df-4218-8628-dbf3f533bf12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:59.699290 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c99a4-99df-4218-8628-dbf3f533bf12 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:59.713482 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-cf6c99a4-99df-4218-8628-dbf3f533bf12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:08:59.713482 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:08:59.713482 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:08:59.713482 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:08:59.713482 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:08:59.713482 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:08:59.713482 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:08:59.713482 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:08:59.713482 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:08:59.713482 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:08:59.713482 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:08:59.713482 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:08:59.713482 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:08:59.713482 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:08:59.713482 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:08:59.714469 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:08:59.714469 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:08:59.714469 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:08:59.714469 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:08:59.714469 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:08:59.714469 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:08:59.714469 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:08:59.714469 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:08:59.714469 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:08:59.714469 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:08:59.714469 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:08:59.714469 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:08:59.714469 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:08:59.714469 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:08:59.714469 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:08:59.714469 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:08:59.714469 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:08:59.715387 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:08:59.715387 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:08:59.715387 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:08:59.715387 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:08:59.715387 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:08:59.715387 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:08:59.715387 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:08:59.715387 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:08:59.715387 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 403/819] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:08:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:08:59.715879 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c99a4-99df-4218-8628-dbf3f533bf12 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:59.730300 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:59.764135 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a210c-92c6-46d7-a2a9-146c5f448404 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:59.798083 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae74d9-5c08-4879-97ae-20145a3a999f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:59.798774 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae74d9-5c08-4879-97ae-20145a3a999f None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:59.799061 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae74d9-5c08-4879-97ae-20145a3a999f None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:59.799339 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae74d9-5c08-4879-97ae-20145a3a999f None admin] PATH_INFO: `/v3/services` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:59.800042 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae74d9-5c08-4879-97ae-20145a3a999f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:59.800361 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae74d9-5c08-4879-97ae-20145a3a999f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:59.801721 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae74d9-5c08-4879-97ae-20145a3a999f None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:59.807144 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 417/820] 10.222.0.30 () {56 vars in 1124 bytes} [Tue Jul 5 21:08:59 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:59.807811 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae74d9-5c08-4879-97ae-20145a3a999f None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:59.812546 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c99a4-99df-4218-8628-dbf3f533bf12 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:59.846665 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe6265-a7c9-4c89-a470-ab0c8bddbfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:59.847437 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe6265-a7c9-4c89-a470-ab0c8bddbfa7 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:59.847729 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe6265-a7c9-4c89-a470-ab0c8bddbfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:59.848012 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe6265-a7c9-4c89-a470-ab0c8bddbfa7 None admin] PATH_INFO: `/v3/users` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:59.848858 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fe6265-a7c9-4c89-a470-ab0c8bddbfa7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:59.849176 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fe6265-a7c9-4c89-a470-ab0c8bddbfa7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:59.850647 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fe6265-a7c9-4c89-a470-ab0c8bddbfa7 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:59.867417 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 404/821] 10.222.0.30 () {56 vars in 1135 bytes} [Tue Jul 5 21:08:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:59.868213 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe6265-a7c9-4c89-a470-ab0c8bddbfa7 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:59.902557 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:59.911370 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae74d9-5c08-4879-97ae-20145a3a999f None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:59.940422 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:59.945238 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b876e-9670-45cf-9e2e-397c24abe4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:59.946150 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b876e-9670-45cf-9e2e-397c24abe4d2 None admin] REQUEST_METHOD: `PUT` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:59.946464 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b876e-9670-45cf-9e2e-397c24abe4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:59.946778 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b876e-9670-45cf-9e2e-397c24abe4d2 None admin] PATH_INFO: `/v3/projects/ccd95a48530c4c86a3774301b969d6a9/users/e6cf35a185bc4707a4f2f7b56662354d/roles/601a166d56f647bda8256e971450cfdf` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:59.961780 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2b876e-9670-45cf-9e2e-397c24abe4d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=ccd95a48530c4c86a3774301b969d6a9, user_id=e6cf35a185bc4707a4f2f7b56662354d, role_id=601a166d56f647bda8256e971450cfdf)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:59.963495 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2b876e-9670-45cf-9e2e-397c24abe4d2 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:59.966755 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe6265-a7c9-4c89-a470-ab0c8bddbfa7 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:00.001030 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc1712-0dd9-47f9-968d-97c66f849ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:00.001686 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc1712-0dd9-47f9-968d-97c66f849ac0 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:00.001971 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc1712-0dd9-47f9-968d-97c66f849ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:00.002278 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc1712-0dd9-47f9-968d-97c66f849ac0 None admin] PATH_INFO: `/v3/services` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:00.002970 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc1712-0dd9-47f9-968d-97c66f849ac0 None admin] RBAC: Adding query filter params (type=network) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:00.003278 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc1712-0dd9-47f9-968d-97c66f849ac0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:00.004625 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc1712-0dd9-47f9-968d-97c66f849ac0 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:00.009852 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 405/822] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Jul 5 21:08:59 2022] GET /identity/v3/services?type=network => generated 350 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:00.010928 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc1712-0dd9-47f9-968d-97c66f849ac0 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:00.034248 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 418/823] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:08:59 2022] PUT /identity/v3/projects/ccd95a48530c4c86a3774301b969d6a9/users/e6cf35a185bc4707a4f2f7b56662354d/roles/601a166d56f647bda8256e971450cfdf => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:09:00.034969 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b876e-9670-45cf-9e2e-397c24abe4d2 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:00.120802 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:00.123951 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc1712-0dd9-47f9-968d-97c66f849ac0 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:00.150623 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b876e-9670-45cf-9e2e-397c24abe4d2 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:00.162206 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7a77f-6871-4cfe-b67c-3511bfab8829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:00.162894 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7a77f-6871-4cfe-b67c-3511bfab8829 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:00.163181 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7a77f-6871-4cfe-b67c-3511bfab8829 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:00.163463 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7a77f-6871-4cfe-b67c-3511bfab8829 None admin] PATH_INFO: `/v3/projects` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:00.164261 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d7a77f-6871-4cfe-b67c-3511bfab8829 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:00.164601 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d7a77f-6871-4cfe-b67c-3511bfab8829 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:00.167274 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d7a77f-6871-4cfe-b67c-3511bfab8829 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:00.183705 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 406/824] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:09:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:00.183705 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7a77f-6871-4cfe-b67c-3511bfab8829 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:00.198257 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea15eff-22dd-4295-818a-5b050d328360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:00.198942 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea15eff-22dd-4295-818a-5b050d328360 None admin] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:00.199233 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea15eff-22dd-4295-818a-5b050d328360 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:00.199516 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea15eff-22dd-4295-818a-5b050d328360 None admin] PATH_INFO: `/v3/endpoints` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:00.200269 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea15eff-22dd-4295-818a-5b050d328360 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:00.201691 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea15eff-22dd-4295-818a-5b050d328360 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:00.286544 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7a77f-6871-4cfe-b67c-3511bfab8829 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:00.314910 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 419/825] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Jul 5 21:09:00 2022] POST /identity/v3/endpoints => generated 346 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:09:00.315921 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea15eff-22dd-4295-818a-5b050d328360 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:00.346805 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c114ef-aaad-4602-88d6-f138f4801cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:00.348145 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c114ef-aaad-4602-88d6-f138f4801cc8 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:00.348583 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c114ef-aaad-4602-88d6-f138f4801cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:00.349258 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c114ef-aaad-4602-88d6-f138f4801cc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:00.362249 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c114ef-aaad-4602-88d6-f138f4801cc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:00.364096 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c114ef-aaad-4602-88d6-f138f4801cc8 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:00.366287 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:00.390366 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-37c114ef-aaad-4602-88d6-f138f4801cc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:00.390366 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:00.390366 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:00.390366 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:00.390366 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:00.390366 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:00.390366 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:00.390366 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:00.390366 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:00.390366 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:00.390366 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:00.390366 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:00.390366 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:09:00.390366 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:09:00.390366 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:09:00.391509 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:09:00.391509 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:00.391509 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:00.391509 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:00.391509 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:00.391509 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:00.391509 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:00.391509 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:00.391509 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:00.391509 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:00.391509 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:00.391509 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:00.391509 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:00.391509 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:00.391509 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:00.391509 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:00.391509 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:00.392596 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:09:00.392596 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:09:00.392596 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:00.392596 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:09:00.400664 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 407/826] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:09:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:00.400664 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c114ef-aaad-4602-88d6-f138f4801cc8 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:00.418650 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:00.453803 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea15eff-22dd-4295-818a-5b050d328360 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:00.500297 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9488ee01-9e51-44ba-8d67-11ac690824ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:00.503024 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488ee01-9e51-44ba-8d67-11ac690824ee None admin] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:00.503319 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488ee01-9e51-44ba-8d67-11ac690824ee None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:00.503716 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488ee01-9e51-44ba-8d67-11ac690824ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:00.504487 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9488ee01-9e51-44ba-8d67-11ac690824ee None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:00.505887 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9488ee01-9e51-44ba-8d67-11ac690824ee None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:00.543530 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c114ef-aaad-4602-88d6-f138f4801cc8 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:00.577769 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 420/827] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Jul 5 21:09:00 2022] POST /identity/v3/endpoints => generated 327 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:09:00.578972 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9488ee01-9e51-44ba-8d67-11ac690824ee None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:00.618425 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8bc4a2-2026-4d36-a77f-970c84f6c0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:00.620789 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bc4a2-2026-4d36-a77f-970c84f6c0a9 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:00.622157 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bc4a2-2026-4d36-a77f-970c84f6c0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:00.622659 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bc4a2-2026-4d36-a77f-970c84f6c0a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:00.623866 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8bc4a2-2026-4d36-a77f-970c84f6c0a9 None admin] RBAC: Adding query filter params (role.id=101b93f94624407f8c812ab86ebec32a, scope.project.id=ccd95a48530c4c86a3774301b969d6a9, user.id=be0701b0a7ff479e8b3214afaf618acd) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:00.624627 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8bc4a2-2026-4d36-a77f-970c84f6c0a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:00.627435 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8bc4a2-2026-4d36-a77f-970c84f6c0a9 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:00.642846 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 408/828] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:09:00 2022] GET /identity/v3/role_assignments?user.id=be0701b0a7ff479e8b3214afaf618acd&scope.project.id=ccd95a48530c4c86a3774301b969d6a9&role.id=101b93f94624407f8c812ab86ebec32a => generated 608 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:00.753073 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:00.765790 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9488ee01-9e51-44ba-8d67-11ac690824ee None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:00.819769 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a900a17-7593-4b23-a906-90eeaa9010f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:00.820918 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a900a17-7593-4b23-a906-90eeaa9010f4 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:00.821543 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a900a17-7593-4b23-a906-90eeaa9010f4 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:00.822864 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a900a17-7593-4b23-a906-90eeaa9010f4 None admin] PATH_INFO: `/v3/domains` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:00.824337 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a900a17-7593-4b23-a906-90eeaa9010f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:00.824665 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a900a17-7593-4b23-a906-90eeaa9010f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:00.826100 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a900a17-7593-4b23-a906-90eeaa9010f4 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:00.839453 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 421/829] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:09:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:00.845383 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8bc4a2-2026-4d36-a77f-970c84f6c0a9 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:00.928497 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:00.966934 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8bc4a2-2026-4d36-a77f-970c84f6c0a9 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:01.003253 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4de7ee3-1222-4394-bf55-4e0a1d4a8da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:01.004075 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de7ee3-1222-4394-bf55-4e0a1d4a8da9 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:01.004374 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de7ee3-1222-4394-bf55-4e0a1d4a8da9 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:01.004658 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de7ee3-1222-4394-bf55-4e0a1d4a8da9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:01.012077 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4de7ee3-1222-4394-bf55-4e0a1d4a8da9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:01.013533 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4de7ee3-1222-4394-bf55-4e0a1d4a8da9 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:01.028664 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-c4de7ee3-1222-4394-bf55-4e0a1d4a8da9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:09:01.028664 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:01.028664 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:01.028664 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:01.028664 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:01.028664 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:01.028664 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:01.028664 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:01.028664 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:01.028664 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:01.028664 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:01.028664 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:01.028664 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:09:01.028664 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:09:01.028664 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:09:01.029687 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:09:01.029687 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:01.029687 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:01.029687 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:01.029687 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:01.029687 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:01.029687 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:01.029687 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:01.029687 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:01.029687 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:01.029687 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:01.029687 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:01.029687 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:01.029687 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:01.029687 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:01.029687 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:01.029687 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:01.030742 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:09:01.030742 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:09:01.030742 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:09:01.030742 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:09:01.030742 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:09:01.030742 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:09:01.030742 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:09:01.030742 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:09:01.030742 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 409/830] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:09:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:01.035907 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a900a17-7593-4b23-a906-90eeaa9010f4 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:01.144950 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a900a17-7593-4b23-a906-90eeaa9010f4 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:01.179913 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed21b7-1f0e-4ebc-a40e-377a77874a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:01.180601 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed21b7-1f0e-4ebc-a40e-377a77874a7f None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:01.180888 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed21b7-1f0e-4ebc-a40e-377a77874a7f None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:01.181991 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed21b7-1f0e-4ebc-a40e-377a77874a7f None admin] PATH_INFO: `/v3/projects` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:01.183026 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bed21b7-1f0e-4ebc-a40e-377a77874a7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:01.183345 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bed21b7-1f0e-4ebc-a40e-377a77874a7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:01.184850 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bed21b7-1f0e-4ebc-a40e-377a77874a7f None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:01.199601 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 422/831] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:09:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:01.205047 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4de7ee3-1222-4394-bf55-4e0a1d4a8da9 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:01.323674 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4de7ee3-1222-4394-bf55-4e0a1d4a8da9 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:01.352544 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:01.361311 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb6a616-1c62-4c84-b410-8b476a5c5552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:01.362512 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6a616-1c62-4c84-b410-8b476a5c5552 None admin] REQUEST_METHOD: `PUT` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:01.363007 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6a616-1c62-4c84-b410-8b476a5c5552 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:01.363489 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6a616-1c62-4c84-b410-8b476a5c5552 None admin] PATH_INFO: `/v3/projects/ccd95a48530c4c86a3774301b969d6a9/users/e6761d76cc1d48579c7fda6125900648/roles/101b93f94624407f8c812ab86ebec32a` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:01.365662 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb6a616-1c62-4c84-b410-8b476a5c5552 None admin] RBAC: Authorizing `identity:create_grant(project_id=ccd95a48530c4c86a3774301b969d6a9, user_id=e6761d76cc1d48579c7fda6125900648, role_id=101b93f94624407f8c812ab86ebec32a)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:01.369380 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb6a616-1c62-4c84-b410-8b476a5c5552 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:01.440498 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 410/832] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:09:01 2022] PUT /identity/v3/projects/ccd95a48530c4c86a3774301b969d6a9/users/e6761d76cc1d48579c7fda6125900648/roles/101b93f94624407f8c812ab86ebec32a => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:09:02.121846 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12a2bf-8198-433f-a870-df8ebbeab35c None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:02.122891 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12a2bf-8198-433f-a870-df8ebbeab35c None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:02.123336 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12a2bf-8198-433f-a870-df8ebbeab35c None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:02.125008 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 423/833] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:09:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:02.132994 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73929853-41d4-4dc0-9fc0-771306bab6ea None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:02.132994 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73929853-41d4-4dc0-9fc0-771306bab6ea None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:02.132994 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73929853-41d4-4dc0-9fc0-771306bab6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:02.149391 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-73929853-41d4-4dc0-9fc0-771306bab6ea None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:02.151940 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-73929853-41d4-4dc0-9fc0-771306bab6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:02.223297 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 411/834] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:02 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:09:02.246902 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c12a2bf-8198-433f-a870-df8ebbeab35c None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:02.263127 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:02.358726 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c12a2bf-8198-433f-a870-df8ebbeab35c None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:02.394569 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef93cec-b792-4d6b-a315-5901af2f39f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:02.395385 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef93cec-b792-4d6b-a315-5901af2f39f5 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:02.395675 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef93cec-b792-4d6b-a315-5901af2f39f5 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:02.395957 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef93cec-b792-4d6b-a315-5901af2f39f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:02.406592 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef93cec-b792-4d6b-a315-5901af2f39f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:02.414681 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-4ef93cec-b792-4d6b-a315-5901af2f39f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:09:02.414681 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:02.414681 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:02.414681 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:02.414681 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:02.414681 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:02.414681 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:02.414681 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:02.414681 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:02.414681 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:02.414681 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:02.414681 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:02.414681 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:02.414681 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:02.414681 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:02.414681 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:02.416131 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:02.416131 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:02.416131 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:02.416131 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:02.416131 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:02.416131 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:02.416131 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:02.416131 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:02.416131 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:02.416131 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:02.416131 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:02.416131 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:02.416131 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:02.416131 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:02.416131 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:02.416131 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:02.417253 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:02.417253 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:02.417253 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:02.417253 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:02.417253 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:02.417253 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:02.417253 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:02.417253 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:02.417253 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:02.417253 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:02.417253 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:09:02.417253 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:02.417253 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 424/835] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:09:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:02.424341 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73929853-41d4-4dc0-9fc0-771306bab6ea None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:02.471716 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bad75-11c9-40ee-a244-0d15d5d07cff None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:02.472039 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bad75-11c9-40ee-a244-0d15d5d07cff None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:02.472289 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bad75-11c9-40ee-a244-0d15d5d07cff None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:02.473893 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 425/836] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:09:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:02.479530 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb922c7-acae-46ee-815e-7d0a7a50f62d None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:02.479896 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb922c7-acae-46ee-815e-7d0a7a50f62d None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:02.480266 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb922c7-acae-46ee-815e-7d0a7a50f62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:02.497406 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-ccb922c7-acae-46ee-815e-7d0a7a50f62d None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:02.498788 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-ccb922c7-acae-46ee-815e-7d0a7a50f62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:02.547937 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73929853-41d4-4dc0-9fc0-771306bab6ea None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:02.570996 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 426/837] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:02 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:09:02.571183 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:02.589344 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4195b6-213b-4dd6-864f-72f9c8912d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:02.590366 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4195b6-213b-4dd6-864f-72f9c8912d1d None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:02.590851 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4195b6-213b-4dd6-864f-72f9c8912d1d None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:02.591304 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4195b6-213b-4dd6-864f-72f9c8912d1d None admin] PATH_INFO: `/v3/roles` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:02.592284 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4195b6-213b-4dd6-864f-72f9c8912d1d None admin] RBAC: Adding query filter params (name=service) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:02.593251 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4195b6-213b-4dd6-864f-72f9c8912d1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:02.594147 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb922c7-acae-46ee-815e-7d0a7a50f62d None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:02.595127 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4195b6-213b-4dd6-864f-72f9c8912d1d None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:02.598429 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:02.605312 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 412/838] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:09:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:02.611516 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4195b6-213b-4dd6-864f-72f9c8912d1d None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:02.722145 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb922c7-acae-46ee-815e-7d0a7a50f62d None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:02.739505 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4195b6-213b-4dd6-864f-72f9c8912d1d None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:02.765611 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750e192-5d07-4cf7-b23c-fd6fc9e9f671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:02.767236 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750e192-5d07-4cf7-b23c-fd6fc9e9f671 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:02.767965 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750e192-5d07-4cf7-b23c-fd6fc9e9f671 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:02.768400 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750e192-5d07-4cf7-b23c-fd6fc9e9f671 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:02.769452 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a750e192-5d07-4cf7-b23c-fd6fc9e9f671 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:02.771437 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a750e192-5d07-4cf7-b23c-fd6fc9e9f671 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:02.787311 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-a750e192-5d07-4cf7-b23c-fd6fc9e9f671 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 21:09:02.787311 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:02.787311 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:09:02.787311 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:09:02.787311 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:09:02.787311 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:09:02.787311 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:09:02.787311 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:09:02.787311 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 21:09:02.787311 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:02.787311 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:09:02.787311 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:02.787311 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:02.787311 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:02.787311 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:02.787311 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:02.787311 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:02.788331 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:02.788331 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:02.788331 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:02.788331 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:02.788331 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:02.788331 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:02.788331 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:09:02.788331 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:09:02.788331 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:09:02.788331 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:09:02.788331 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:02.788331 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:02.788331 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:02.788331 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:02.788331 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:02.788331 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:02.789182 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:02.789182 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:02.789182 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:02.789182 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:02.789182 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:02.789182 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:02.789182 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:02.789182 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:02.789182 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:02.789182 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:02.789182 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:09:02.789182 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:09:02.789182 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 21:09:02.789182 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:02.794067 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 427/839] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:09:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:09:02.795116 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750e192-5d07-4cf7-b23c-fd6fc9e9f671 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:02.796143 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280d52a-0562-4486-8136-e6088a310c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:02.797187 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280d52a-0562-4486-8136-e6088a310c57 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:02.797985 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280d52a-0562-4486-8136-e6088a310c57 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:02.799457 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280d52a-0562-4486-8136-e6088a310c57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:02.813845 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280d52a-0562-4486-8136-e6088a310c57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:02.816371 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280d52a-0562-4486-8136-e6088a310c57 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:02.840131 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-3280d52a-0562-4486-8136-e6088a310c57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:02.840131 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:02.840131 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:02.840131 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:02.840131 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:02.840131 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:02.840131 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:02.840131 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:02.840131 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:02.840131 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:02.840131 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:02.840131 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:02.840131 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:09:02.840131 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:09:02.840131 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:09:02.841052 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:09:02.841052 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:02.841052 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:02.841052 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:02.841052 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:02.841052 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:02.841052 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:02.841052 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:02.841052 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:02.841052 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:02.841052 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:02.841052 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:02.841052 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:02.841052 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:02.841052 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:02.841052 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:02.841052 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:02.841962 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:09:02.841962 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:09:02.841962 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:02.841962 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:09:02.843685 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 413/840] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:09:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:02.849126 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280d52a-0562-4486-8136-e6088a310c57 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:02.879658 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:02.882660 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:02.925072 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750e192-5d07-4cf7-b23c-fd6fc9e9f671 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:02.960307 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280d52a-0562-4486-8136-e6088a310c57 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:02.976855 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b0788-9da2-4f40-a270-d6c7fb73aa00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:02.978245 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b0788-9da2-4f40-a270-d6c7fb73aa00 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:02.979122 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b0788-9da2-4f40-a270-d6c7fb73aa00 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:02.979628 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b0788-9da2-4f40-a270-d6c7fb73aa00 None admin] PATH_INFO: `/v3/services` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:02.980550 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b0788-9da2-4f40-a270-d6c7fb73aa00 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:02.981061 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b0788-9da2-4f40-a270-d6c7fb73aa00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:02.983522 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b0788-9da2-4f40-a270-d6c7fb73aa00 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:02.990914 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 428/841] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:09:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:02.998267 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b0788-9da2-4f40-a270-d6c7fb73aa00 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:03.001979 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778e1e4-cb26-4313-ab4d-0119f7097064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:03.003399 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778e1e4-cb26-4313-ab4d-0119f7097064 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:03.003399 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778e1e4-cb26-4313-ab4d-0119f7097064 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:03.003399 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778e1e4-cb26-4313-ab4d-0119f7097064 None admin] PATH_INFO: `/v3/domains` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:03.004589 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5778e1e4-cb26-4313-ab4d-0119f7097064 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:03.004906 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5778e1e4-cb26-4313-ab4d-0119f7097064 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:03.006313 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5778e1e4-cb26-4313-ab4d-0119f7097064 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:03.019435 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 414/842] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:09:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:03.020740 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233d88e-f4de-48a8-9a03-8c34ea1c3a78 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:03.021034 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233d88e-f4de-48a8-9a03-8c34ea1c3a78 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:03.021314 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233d88e-f4de-48a8-9a03-8c34ea1c3a78 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:03.022817 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 415/843] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:03.025652 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233d88e-f4de-48a8-9a03-8c34ea1c3a78 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:03.114493 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b0788-9da2-4f40-a270-d6c7fb73aa00 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:03.127357 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:03.137555 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233d88e-f4de-48a8-9a03-8c34ea1c3a78 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:03.148592 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:03.154090 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc341e-ca58-4e23-ab4e-0df0b0631c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:03.154818 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc341e-ca58-4e23-ab4e-0df0b0631c9c None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:03.155105 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc341e-ca58-4e23-ab4e-0df0b0631c9c None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:03.155502 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc341e-ca58-4e23-ab4e-0df0b0631c9c None admin] PATH_INFO: `/v3/services` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:03.156210 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc341e-ca58-4e23-ab4e-0df0b0631c9c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:03.156524 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc341e-ca58-4e23-ab4e-0df0b0631c9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:03.157897 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc341e-ca58-4e23-ab4e-0df0b0631c9c None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:03.162623 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 429/844] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:09:02 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:03.164018 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da7cac-0194-40cd-ba40-20c6ccc93d89 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:03.164313 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da7cac-0194-40cd-ba40-20c6ccc93d89 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:03.164594 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da7cac-0194-40cd-ba40-20c6ccc93d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:03.182868 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-28da7cac-0194-40cd-ba40-20c6ccc93d89 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:03.184109 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-28da7cac-0194-40cd-ba40-20c6ccc93d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:03.195177 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4f158-ae61-4436-aba1-1969b5b1b152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:03.197237 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4f158-ae61-4436-aba1-1969b5b1b152 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:03.197809 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4f158-ae61-4436-aba1-1969b5b1b152 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:03.198650 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4f158-ae61-4436-aba1-1969b5b1b152 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:03.211780 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e4f158-ae61-4436-aba1-1969b5b1b152 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:03.213977 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e4f158-ae61-4436-aba1-1969b5b1b152 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:03.238418 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-83e4f158-ae61-4436-aba1-1969b5b1b152 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 21:09:03.238418 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:03.238418 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:03.238418 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:03.238418 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:03.238418 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:03.238418 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:03.238418 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:03.238418 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:03.238418 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:03.238418 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:03.238418 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:03.238418 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:09:03.238418 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:09:03.238418 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:09:03.238418 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:09:03.239424 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:03.239424 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:03.239424 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:09:03.239424 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:09:03.239424 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:09:03.239424 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:09:03.239424 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:03.239424 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:03.239424 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:03.239424 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:03.239424 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:03.239424 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:03.239424 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:03.239424 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:03.239424 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:03.239424 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:03.239424 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:03.239424 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:03.240408 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:03.240408 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:03.240408 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:09:03.240408 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:09:03.240408 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:09:03.240408 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:09:03.240408 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:09:03.240408 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:09:03.240408 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 21:09:03.240408 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:09:03.243891 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 416/845] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Jul 5 21:09:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:03.249569 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4f158-ae61-4436-aba1-1969b5b1b152 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:03.276469 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 430/846] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:03 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:09:03.299713 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da7cac-0194-40cd-ba40-20c6ccc93d89 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:03.425604 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da7cac-0194-40cd-ba40-20c6ccc93d89 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:03.455126 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:03.464902 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc230161-6972-4a52-a833-3e6e99cf98c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:03.465845 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc230161-6972-4a52-a833-3e6e99cf98c4 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:03.466157 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc230161-6972-4a52-a833-3e6e99cf98c4 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:03.466439 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc230161-6972-4a52-a833-3e6e99cf98c4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:03.467099 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc230161-6972-4a52-a833-3e6e99cf98c4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:03.468475 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc230161-6972-4a52-a833-3e6e99cf98c4 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:03.481573 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-dc230161-6972-4a52-a833-3e6e99cf98c4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 21:09:03.481573 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:03.481573 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:09:03.481573 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:09:03.481573 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:09:03.481573 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:09:03.481573 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:09:03.481573 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:09:03.481573 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 21:09:03.481573 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:03.481573 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:09:03.481573 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:03.481573 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:03.481573 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:03.481573 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:03.481573 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:03.482617 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:03.482617 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:03.482617 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:03.482617 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:03.482617 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:03.482617 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:03.482617 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:03.482617 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:09:03.482617 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:09:03.482617 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:09:03.482617 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:09:03.482617 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:03.482617 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:03.482617 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:03.482617 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:03.482617 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:03.483752 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:03.483752 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:03.483752 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:03.483752 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:03.483752 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:03.483752 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:03.483752 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:03.483752 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:03.483752 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:03.483752 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:03.483752 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:03.483752 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:09:03.483752 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:09:03.483752 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 21:09:03.483752 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:03.483752 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 431/847] 10.222.0.30 () {56 vars in 1132 bytes} [Tue Jul 5 21:09:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:09:03.489516 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc230161-6972-4a52-a833-3e6e99cf98c4 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:03.507035 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4f158-ae61-4436-aba1-1969b5b1b152 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:03.542875 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fab8d7-3367-4163-b392-3d691bfa0860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:03.543598 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fab8d7-3367-4163-b392-3d691bfa0860 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:03.543888 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fab8d7-3367-4163-b392-3d691bfa0860 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:03.544171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fab8d7-3367-4163-b392-3d691bfa0860 None admin] PATH_INFO: `/v3/users` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:03.545018 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fab8d7-3367-4163-b392-3d691bfa0860 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:03.545334 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fab8d7-3367-4163-b392-3d691bfa0860 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:03.546813 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fab8d7-3367-4163-b392-3d691bfa0860 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:03.570353 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 417/848] 10.222.0.30 () {56 vars in 1149 bytes} [Tue Jul 5 21:09:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:03.571284 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fab8d7-3367-4163-b392-3d691bfa0860 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:03.595231 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:03.600990 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc230161-6972-4a52-a833-3e6e99cf98c4 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:03.637597 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf472934-55e4-4c98-88cc-9cd0e91c2af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:03.638319 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf472934-55e4-4c98-88cc-9cd0e91c2af2 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:03.638607 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf472934-55e4-4c98-88cc-9cd0e91c2af2 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:03.638984 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf472934-55e4-4c98-88cc-9cd0e91c2af2 None admin] PATH_INFO: `/v3/services` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:03.639587 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf472934-55e4-4c98-88cc-9cd0e91c2af2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:03.639899 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf472934-55e4-4c98-88cc-9cd0e91c2af2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:03.641264 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf472934-55e4-4c98-88cc-9cd0e91c2af2 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:03.646182 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 432/849] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Jul 5 21:09:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:03.647493 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c9ae7-bf16-4c32-b470-8c33acf39798 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:03.647798 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c9ae7-bf16-4c32-b470-8c33acf39798 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:03.648080 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c9ae7-bf16-4c32-b470-8c33acf39798 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:03.649418 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 433/850] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:03.654258 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c9ae7-bf16-4c32-b470-8c33acf39798 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:03.689821 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fab8d7-3367-4163-b392-3d691bfa0860 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:03.720580 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:03.727045 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7adc58-8433-442c-999c-a3ff2103f474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:03.731577 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7adc58-8433-442c-999c-a3ff2103f474 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:03.731577 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7adc58-8433-442c-999c-a3ff2103f474 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:03.731577 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7adc58-8433-442c-999c-a3ff2103f474 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:03.768992 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c9ae7-bf16-4c32-b470-8c33acf39798 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:03.798886 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7adc58-8433-442c-999c-a3ff2103f474 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:03.800642 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7adc58-8433-442c-999c-a3ff2103f474 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:03.807992 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf737cd-fc26-495a-8b62-4cc37a4e275c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:03.809158 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf737cd-fc26-495a-8b62-4cc37a4e275c None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:03.809449 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf737cd-fc26-495a-8b62-4cc37a4e275c None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:03.809728 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf737cd-fc26-495a-8b62-4cc37a4e275c None admin] PATH_INFO: `/v3/services` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:03.810468 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf737cd-fc26-495a-8b62-4cc37a4e275c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:03.811242 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf737cd-fc26-495a-8b62-4cc37a4e275c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:03.812599 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:03.813765 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf737cd-fc26-495a-8b62-4cc37a4e275c None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:03.830315 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 434/851] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Jul 5 21:09:03 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:03.830315 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311c335-d497-483a-90f6-22436ab85ef0 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:03.830315 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311c335-d497-483a-90f6-22436ab85ef0 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:03.830315 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311c335-d497-483a-90f6-22436ab85ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:03.853571 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-7311c335-d497-483a-90f6-22436ab85ef0 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:03.855145 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-7311c335-d497-483a-90f6-22436ab85ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:03.926533 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 418/852] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:09:03 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:09:03.928674 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7adc58-8433-442c-999c-a3ff2103f474 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:03.966314 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 435/853] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:03 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:09:03.990107 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311c335-d497-483a-90f6-22436ab85ef0 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:04.047900 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7adc58-8433-442c-999c-a3ff2103f474 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:04.053974 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:04.061920 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:04.086112 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd9308-1ce4-4f30-bec7-e25d6085f707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:04.087064 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd9308-1ce4-4f30-bec7-e25d6085f707 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:04.087528 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd9308-1ce4-4f30-bec7-e25d6085f707 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:04.087930 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd9308-1ce4-4f30-bec7-e25d6085f707 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:04.099008 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd9308-1ce4-4f30-bec7-e25d6085f707 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:04.100530 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd9308-1ce4-4f30-bec7-e25d6085f707 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:04.120536 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-d7fd9308-1ce4-4f30-bec7-e25d6085f707 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:04.120536 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:04.120536 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:04.120536 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:04.120536 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:04.120536 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:04.120536 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:04.120536 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:04.120536 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:04.120536 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:04.120536 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:04.120536 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:04.120536 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:09:04.120536 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:09:04.120536 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:09:04.122625 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:09:04.122625 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:04.122625 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:04.122625 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:04.122625 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:04.122625 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:04.122625 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:04.122625 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:04.122625 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:04.122625 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:04.122625 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:04.122625 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:04.122625 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:04.122625 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:04.122625 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:04.122625 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:04.122625 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:04.123841 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:09:04.123841 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:09:04.123841 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:04.123841 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:09:04.123841 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 419/854] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:09:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:09:04.125110 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311c335-d497-483a-90f6-22436ab85ef0 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:04.131117 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd9308-1ce4-4f30-bec7-e25d6085f707 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:04.174227 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d20360e-672f-4258-ad13-15ad7cc949df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:04.174227 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20360e-672f-4258-ad13-15ad7cc949df None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:04.174227 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20360e-672f-4258-ad13-15ad7cc949df None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:04.174227 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20360e-672f-4258-ad13-15ad7cc949df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:04.184647 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d20360e-672f-4258-ad13-15ad7cc949df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:04.192912 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-0d20360e-672f-4258-ad13-15ad7cc949df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:09:04.192912 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:04.192912 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:04.192912 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:04.192912 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:04.192912 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:04.192912 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:04.192912 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:04.192912 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:04.192912 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:04.192912 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:04.192912 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:04.192912 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:04.192912 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:04.192912 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:04.192912 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:04.193876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:04.193876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:04.193876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:04.193876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:04.193876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:04.193876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:04.193876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:04.193876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:04.193876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:04.193876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:04.193876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:04.193876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:04.193876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:04.193876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:04.193876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:04.193876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:04.195169 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:04.195169 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:04.195169 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:04.195169 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:04.195169 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:04.195169 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:04.195169 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:04.195169 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:04.195169 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:04.195169 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:04.195169 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:09:04.195169 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:04.195169 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 436/855] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:09:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:09:04.202430 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d20360e-672f-4258-ad13-15ad7cc949df None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:04.258038 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd9308-1ce4-4f30-bec7-e25d6085f707 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:04.294097 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75629793-7b93-4f1d-9a82-befbf5be2241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:04.295140 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75629793-7b93-4f1d-9a82-befbf5be2241 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:04.295674 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75629793-7b93-4f1d-9a82-befbf5be2241 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:04.296177 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75629793-7b93-4f1d-9a82-befbf5be2241 None admin] PATH_INFO: `/v3/domains` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:04.297139 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75629793-7b93-4f1d-9a82-befbf5be2241 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:04.297676 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75629793-7b93-4f1d-9a82-befbf5be2241 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:04.299367 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75629793-7b93-4f1d-9a82-befbf5be2241 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:04.319731 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 420/856] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:09:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:04.326855 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75629793-7b93-4f1d-9a82-befbf5be2241 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:04.335242 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d20360e-672f-4258-ad13-15ad7cc949df None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:04.348255 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:04.361937 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:04.377433 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5ee59-94c6-4b1c-8bf1-7e189ba4c869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:04.378630 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5ee59-94c6-4b1c-8bf1-7e189ba4c869 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:04.379139 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5ee59-94c6-4b1c-8bf1-7e189ba4c869 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:04.379618 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5ee59-94c6-4b1c-8bf1-7e189ba4c869 None admin] PATH_INFO: `/v3/roles` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:04.380591 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda5ee59-94c6-4b1c-8bf1-7e189ba4c869 None admin] RBAC: Adding query filter params (name=admin) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:04.381103 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda5ee59-94c6-4b1c-8bf1-7e189ba4c869 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:04.382743 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda5ee59-94c6-4b1c-8bf1-7e189ba4c869 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:04.397890 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 437/857] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:09:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:04.399509 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5ee59-94c6-4b1c-8bf1-7e189ba4c869 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:04.456674 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75629793-7b93-4f1d-9a82-befbf5be2241 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:04.492034 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c507e7-a053-43b6-a623-cfd7ab4986de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:04.493211 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c507e7-a053-43b6-a623-cfd7ab4986de None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:04.494364 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c507e7-a053-43b6-a623-cfd7ab4986de None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:04.494859 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c507e7-a053-43b6-a623-cfd7ab4986de None admin] PATH_INFO: `/v3/projects/service` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:04.502335 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c507e7-a053-43b6-a623-cfd7ab4986de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:04.504020 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c507e7-a053-43b6-a623-cfd7ab4986de None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:04.518673 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-26c507e7-a053-43b6-a623-cfd7ab4986de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:09:04.518673 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:04.518673 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:04.518673 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:04.518673 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:04.518673 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:04.518673 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:04.518673 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:04.518673 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:04.518673 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:04.518673 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:04.518673 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:04.518673 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:09:04.518673 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:09:04.518673 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:09:04.519576 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:09:04.519576 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:04.519576 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:04.519576 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:04.519576 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:04.519576 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:04.519576 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:04.519576 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:04.519576 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:04.519576 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:04.519576 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:04.519576 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:04.519576 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:04.519576 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:04.519576 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:04.519576 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:04.519576 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:04.520477 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:09:04.520477 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:09:04.520477 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:09:04.520477 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:09:04.520477 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:09:04.520477 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:09:04.520477 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:09:04.520477 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:09:04.520916 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5ee59-94c6-4b1c-8bf1-7e189ba4c869 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:04.527417 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 421/858] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:09:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:09:04.528943 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c507e7-a053-43b6-a623-cfd7ab4986de None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:04.565205 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07594d31-a96f-43a1-9d20-327153766470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:04.566216 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07594d31-a96f-43a1-9d20-327153766470 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:04.566512 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07594d31-a96f-43a1-9d20-327153766470 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:04.566796 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07594d31-a96f-43a1-9d20-327153766470 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:04.581782 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07594d31-a96f-43a1-9d20-327153766470 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:04.583547 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07594d31-a96f-43a1-9d20-327153766470 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:04.605792 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-07594d31-a96f-43a1-9d20-327153766470 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:04.605792 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:04.605792 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:04.605792 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:04.605792 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:04.605792 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:04.605792 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:04.605792 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:04.605792 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:04.605792 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:04.605792 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:04.605792 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:04.605792 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:09:04.605792 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:09:04.605792 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:09:04.606764 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:09:04.606764 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:04.606764 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:04.606764 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:04.606764 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:04.606764 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:04.606764 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:04.606764 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:04.606764 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:04.606764 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:04.606764 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:04.606764 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:04.606764 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:04.606764 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:04.606764 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:04.606764 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:04.606764 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:04.607687 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:09:04.607687 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:09:04.607687 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:04.607687 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:04.614200 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 438/859] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:09:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:04.615689 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07594d31-a96f-43a1-9d20-327153766470 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:04.621808 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:04.644641 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:04.646264 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c507e7-a053-43b6-a623-cfd7ab4986de None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:04.692186 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54534e5b-a95f-4d5b-a7cd-f20cba5c1dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:04.693176 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54534e5b-a95f-4d5b-a7cd-f20cba5c1dca None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:04.693472 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54534e5b-a95f-4d5b-a7cd-f20cba5c1dca None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:04.693753 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54534e5b-a95f-4d5b-a7cd-f20cba5c1dca None admin] PATH_INFO: `/v3/projects` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:04.695133 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54534e5b-a95f-4d5b-a7cd-f20cba5c1dca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:04.695476 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54534e5b-a95f-4d5b-a7cd-f20cba5c1dca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:04.697761 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54534e5b-a95f-4d5b-a7cd-f20cba5c1dca None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:04.718157 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 422/860] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:09:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:04.720558 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54534e5b-a95f-4d5b-a7cd-f20cba5c1dca None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:04.736481 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07594d31-a96f-43a1-9d20-327153766470 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:04.773997 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed4c06-8950-4a6b-b79a-2563fd34ac6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:04.774881 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed4c06-8950-4a6b-b79a-2563fd34ac6c None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:04.775299 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed4c06-8950-4a6b-b79a-2563fd34ac6c None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:04.775609 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed4c06-8950-4a6b-b79a-2563fd34ac6c None admin] PATH_INFO: `/v3/domains` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:04.776398 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed4c06-8950-4a6b-b79a-2563fd34ac6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:04.777054 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed4c06-8950-4a6b-b79a-2563fd34ac6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:04.778667 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed4c06-8950-4a6b-b79a-2563fd34ac6c None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:04.796382 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 439/861] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:09:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:04.797937 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed4c06-8950-4a6b-b79a-2563fd34ac6c None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:04.856464 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54534e5b-a95f-4d5b-a7cd-f20cba5c1dca None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:04.888247 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:04.903207 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb4e28-cfdd-493a-9f4a-d099e5ace906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:04.904398 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb4e28-cfdd-493a-9f4a-d099e5ace906 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:04.905022 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb4e28-cfdd-493a-9f4a-d099e5ace906 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:04.905867 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb4e28-cfdd-493a-9f4a-d099e5ace906 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:04.907189 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb4e28-cfdd-493a-9f4a-d099e5ace906 None admin] RBAC: Adding query filter params (role.id=601a166d56f647bda8256e971450cfdf, scope.project.id=ccd95a48530c4c86a3774301b969d6a9, user.id=e6cf35a185bc4707a4f2f7b56662354d) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:04.907696 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb4e28-cfdd-493a-9f4a-d099e5ace906 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:04.908821 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed4c06-8950-4a6b-b79a-2563fd34ac6c None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:04.909564 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb4e28-cfdd-493a-9f4a-d099e5ace906 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:04.919400 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 423/862] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:09:04 2022] GET /identity/v3/role_assignments?user.id=e6cf35a185bc4707a4f2f7b56662354d&scope.project.id=ccd95a48530c4c86a3774301b969d6a9&role.id=601a166d56f647bda8256e971450cfdf => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:04.962096 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca49b7f-de85-4317-9da8-a90b3c281568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:04.963912 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca49b7f-de85-4317-9da8-a90b3c281568 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:04.964184 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca49b7f-de85-4317-9da8-a90b3c281568 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:04.964467 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca49b7f-de85-4317-9da8-a90b3c281568 None admin] PATH_INFO: `/v3/users/swift` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:04.973569 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca49b7f-de85-4317-9da8-a90b3c281568 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:04.975087 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca49b7f-de85-4317-9da8-a90b3c281568 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:04.992197 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-bca49b7f-de85-4317-9da8-a90b3c281568 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 21:09:04.992197 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:04.992197 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:04.992197 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:04.992197 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:04.992197 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:04.992197 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:04.992197 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:04.992197 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:04.992197 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:04.992197 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:04.992197 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:04.992197 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:09:04.992197 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:09:04.992197 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:09:04.992197 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:09:04.993253 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:04.993253 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:04.993253 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:09:04.993253 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:09:04.993253 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:09:04.993253 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:09:04.993253 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:04.993253 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:04.993253 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:04.993253 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:04.993253 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:04.993253 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:04.993253 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:04.993253 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:04.993253 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:04.993253 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:04.993253 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:04.993253 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:04.994773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:04.994773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:04.994773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:09:04.994773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:09:04.994773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:09:04.994773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:09:04.994773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:09:04.994773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:09:04.994773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 21:09:04.994773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:04.998674 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 440/863] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:09:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:05.001003 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb4e28-cfdd-493a-9f4a-d099e5ace906 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:05.012989 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:05.122871 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb4e28-cfdd-493a-9f4a-d099e5ace906 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:05.159010 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dbe4f4-a012-493a-8408-5850d07eb137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:05.160006 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbe4f4-a012-493a-8408-5850d07eb137 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:05.160299 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbe4f4-a012-493a-8408-5850d07eb137 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:05.160584 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbe4f4-a012-493a-8408-5850d07eb137 None admin] PATH_INFO: `/v3/users` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:05.161422 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dbe4f4-a012-493a-8408-5850d07eb137 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:05.161737 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dbe4f4-a012-493a-8408-5850d07eb137 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:05.163517 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dbe4f4-a012-493a-8408-5850d07eb137 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:05.183050 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 424/864] 10.222.0.30 () {56 vars in 1135 bytes} [Tue Jul 5 21:09:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:05.188734 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca49b7f-de85-4317-9da8-a90b3c281568 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:05.281233 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991299d-996f-4777-979b-9d7316450fd6 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:05.281743 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991299d-996f-4777-979b-9d7316450fd6 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:05.281820 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991299d-996f-4777-979b-9d7316450fd6 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:05.283435 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 425/865] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:09:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:05.288616 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211898f-cc49-4085-8a75-bc6412159ee8 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:05.288903 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211898f-cc49-4085-8a75-bc6412159ee8 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:05.289186 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211898f-cc49-4085-8a75-bc6412159ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:05.301499 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca49b7f-de85-4317-9da8-a90b3c281568 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:05.307938 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-8211898f-cc49-4085-8a75-bc6412159ee8 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:05.309158 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-8211898f-cc49-4085-8a75-bc6412159ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:05.348586 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de9395-22e1-46ff-b51b-da29b388f30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:05.349584 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de9395-22e1-46ff-b51b-da29b388f30f None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:05.350076 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de9395-22e1-46ff-b51b-da29b388f30f None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:05.350561 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de9395-22e1-46ff-b51b-da29b388f30f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:05.367299 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:05.379349 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:05.394258 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 426/866] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:05 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:09:05.412957 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8211898f-cc49-4085-8a75-bc6412159ee8 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:05.441031 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de9395-22e1-46ff-b51b-da29b388f30f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:05.443337 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de9395-22e1-46ff-b51b-da29b388f30f None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:05.528217 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8211898f-cc49-4085-8a75-bc6412159ee8 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:05.566578 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389bec53-0c96-429b-b586-65cdb8e5b276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:05.567386 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bec53-0c96-429b-b586-65cdb8e5b276 None admin] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:05.567680 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bec53-0c96-429b-b586-65cdb8e5b276 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:05.567957 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bec53-0c96-429b-b586-65cdb8e5b276 None admin] PATH_INFO: `/v3/services` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:05.568842 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389bec53-0c96-429b-b586-65cdb8e5b276 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:05.570178 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389bec53-0c96-429b-b586-65cdb8e5b276 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:05.579751 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 441/867] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:09:05 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 05 21:09:05.585365 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de9395-22e1-46ff-b51b-da29b388f30f None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:05.632502 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:05.654567 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 427/868] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Jul 5 21:09:05 2022] POST /identity/v3/services => generated 251 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:09:05.705529 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de9395-22e1-46ff-b51b-da29b388f30f None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:05.753089 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ba7ca-d485-42bf-8d0c-7cf6f678eb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:05.753896 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ba7ca-d485-42bf-8d0c-7cf6f678eb8a None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:05.754218 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ba7ca-d485-42bf-8d0c-7cf6f678eb8a None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:05.754503 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ba7ca-d485-42bf-8d0c-7cf6f678eb8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:05.766310 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935ba7ca-d485-42bf-8d0c-7cf6f678eb8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:05.767873 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935ba7ca-d485-42bf-8d0c-7cf6f678eb8a None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:05.788794 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-935ba7ca-d485-42bf-8d0c-7cf6f678eb8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:05.788794 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:05.788794 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:05.788794 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:05.788794 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:05.788794 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:05.788794 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:05.788794 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:05.788794 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:05.788794 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:05.788794 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:05.788794 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:05.788794 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:09:05.788794 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:09:05.788794 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:09:05.789773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:09:05.789773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:05.789773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:05.789773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:05.789773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:05.789773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:05.789773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:05.789773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:05.789773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:05.789773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:05.789773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:05.789773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:05.789773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:05.789773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:05.789773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:05.789773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:05.789773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:05.791279 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:09:05.791279 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:09:05.791279 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:05.791279 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:05.791279 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 442/869] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:09:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:05.797797 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389bec53-0c96-429b-b586-65cdb8e5b276 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:05.857862 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:05.905907 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389bec53-0c96-429b-b586-65cdb8e5b276 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:05.942917 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2ed9a-5cd1-405d-ac4b-0560b000d5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:05.944007 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2ed9a-5cd1-405d-ac4b-0560b000d5f3 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:05.944496 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2ed9a-5cd1-405d-ac4b-0560b000d5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:05.944974 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2ed9a-5cd1-405d-ac4b-0560b000d5f3 None admin] PATH_INFO: `/v3/domains` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:05.945947 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb2ed9a-5cd1-405d-ac4b-0560b000d5f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:05.946510 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb2ed9a-5cd1-405d-ac4b-0560b000d5f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:05.948761 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb2ed9a-5cd1-405d-ac4b-0560b000d5f3 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:05.961549 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 428/870] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:09:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:05.961847 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5014e65-ffe2-42ac-8a07-44eecdb77229 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:05.966153 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5014e65-ffe2-42ac-8a07-44eecdb77229 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:05.966153 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5014e65-ffe2-42ac-8a07-44eecdb77229 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:05.966153 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 443/871] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:09:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:05.968394 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2ed9a-5cd1-405d-ac4b-0560b000d5f3 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:05.969700 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694208f-f5b3-4097-99ab-5fe9c5312fc6 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:05.970000 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694208f-f5b3-4097-99ab-5fe9c5312fc6 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:05.970314 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694208f-f5b3-4097-99ab-5fe9c5312fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:05.988334 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-e694208f-f5b3-4097-99ab-5fe9c5312fc6 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:05.989541 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-e694208f-f5b3-4097-99ab-5fe9c5312fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:06.083205 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2ed9a-5cd1-405d-ac4b-0560b000d5f3 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:06.092115 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 444/872] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:05 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:09:06.099469 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:06.116642 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694208f-f5b3-4097-99ab-5fe9c5312fc6 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:06.126028 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15eaa2-34a2-4575-a654-697d30f4bd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:06.127336 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15eaa2-34a2-4575-a654-697d30f4bd25 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:06.127846 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15eaa2-34a2-4575-a654-697d30f4bd25 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:06.128350 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15eaa2-34a2-4575-a654-697d30f4bd25 None admin] PATH_INFO: `/v3/projects/service` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:06.136970 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e15eaa2-34a2-4575-a654-697d30f4bd25 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:06.138775 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e15eaa2-34a2-4575-a654-697d30f4bd25 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:06.142819 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:06.154301 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-7e15eaa2-34a2-4575-a654-697d30f4bd25 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:09:06.154301 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:06.154301 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:06.154301 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:06.154301 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:06.154301 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:06.154301 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:06.154301 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:06.154301 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:06.154301 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:06.154301 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:06.154301 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:06.154301 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:09:06.154301 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:09:06.154301 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:09:06.155242 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:09:06.155242 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:06.155242 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:06.155242 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:06.155242 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:06.155242 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:06.155242 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:06.155242 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:06.155242 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:06.155242 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:06.155242 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:06.155242 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:06.155242 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:06.155242 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:06.155242 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:06.155242 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:06.155242 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:06.156188 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:09:06.156188 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:09:06.156188 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:09:06.156188 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:09:06.156188 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:09:06.156188 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:09:06.156188 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:09:06.156188 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:09:06.163477 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 429/873] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:09:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:06.164749 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15eaa2-34a2-4575-a654-697d30f4bd25 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:06.233420 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694208f-f5b3-4097-99ab-5fe9c5312fc6 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:06.271442 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06da32-5360-46de-ab9f-7234ae204292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:06.272121 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06da32-5360-46de-ab9f-7234ae204292 None admin] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:06.272410 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06da32-5360-46de-ab9f-7234ae204292 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:06.272692 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06da32-5360-46de-ab9f-7234ae204292 None admin] PATH_INFO: `/v3/services` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:06.273426 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06da32-5360-46de-ab9f-7234ae204292 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:06.274479 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15eaa2-34a2-4575-a654-697d30f4bd25 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:06.274885 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06da32-5360-46de-ab9f-7234ae204292 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:06.310444 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455e4e8-f872-420d-9435-329b9675beb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:06.311859 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455e4e8-f872-420d-9435-329b9675beb0 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:06.312216 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455e4e8-f872-420d-9435-329b9675beb0 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:06.312617 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455e4e8-f872-420d-9435-329b9675beb0 None admin] PATH_INFO: `/v3/projects` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:06.313563 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455e4e8-f872-420d-9435-329b9675beb0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:06.313982 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455e4e8-f872-420d-9435-329b9675beb0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:06.315807 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455e4e8-f872-420d-9435-329b9675beb0 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:06.331061 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 430/874] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:09:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:06.336118 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455e4e8-f872-420d-9435-329b9675beb0 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:06.358471 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 445/875] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Jul 5 21:09:06 2022] POST /identity/v3/services => generated 269 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:09:06.380165 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:06.455437 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455e4e8-f872-420d-9435-329b9675beb0 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:06.504013 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0378f1a1-3594-4ec2-ab01-e70c55960d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:06.505071 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378f1a1-3594-4ec2-ab01-e70c55960d41 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:06.505561 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378f1a1-3594-4ec2-ab01-e70c55960d41 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:06.506038 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378f1a1-3594-4ec2-ab01-e70c55960d41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:06.507128 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0378f1a1-3594-4ec2-ab01-e70c55960d41 None admin] RBAC: Adding query filter params (role.id=101b93f94624407f8c812ab86ebec32a, scope.project.id=ccd95a48530c4c86a3774301b969d6a9, user.id=e6761d76cc1d48579c7fda6125900648) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:06.507647 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0378f1a1-3594-4ec2-ab01-e70c55960d41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:06.509433 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0378f1a1-3594-4ec2-ab01-e70c55960d41 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:06.516936 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 431/876] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:09:06 2022] GET /identity/v3/role_assignments?user.id=e6761d76cc1d48579c7fda6125900648&scope.project.id=ccd95a48530c4c86a3774301b969d6a9&role.id=101b93f94624407f8c812ab86ebec32a => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:07.132014 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22fba1-66c6-40c4-9e52-a5fef03a2170 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:07.132437 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22fba1-66c6-40c4-9e52-a5fef03a2170 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:07.132632 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22fba1-66c6-40c4-9e52-a5fef03a2170 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:07.134770 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 446/877] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:09:07.140148 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de81658-1414-445b-b81a-ed197a10d7da None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:07.140590 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de81658-1414-445b-b81a-ed197a10d7da None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:07.140876 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de81658-1414-445b-b81a-ed197a10d7da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:07.158089 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-6de81658-1414-445b-b81a-ed197a10d7da None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:07.159308 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-6de81658-1414-445b-b81a-ed197a10d7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:07.230058 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 432/878] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:07 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:09:07.252882 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a22fba1-66c6-40c4-9e52-a5fef03a2170 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:07.341962 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:07.362610 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a22fba1-66c6-40c4-9e52-a5fef03a2170 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:07.398103 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871b9b6-ac42-46da-8859-30661c2ff8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:07.398887 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871b9b6-ac42-46da-8859-30661c2ff8bd None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:07.399566 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871b9b6-ac42-46da-8859-30661c2ff8bd None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:07.399947 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871b9b6-ac42-46da-8859-30661c2ff8bd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:07.410359 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871b9b6-ac42-46da-8859-30661c2ff8bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:07.418817 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-3871b9b6-ac42-46da-8859-30661c2ff8bd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 21:09:07.418817 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:07.418817 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:07.418817 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:07.418817 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:07.418817 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:07.418817 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:07.418817 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:07.418817 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:07.418817 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:07.418817 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:07.418817 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:07.418817 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:07.418817 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:07.418817 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:07.418817 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:07.419762 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:07.419762 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:07.419762 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:07.419762 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:07.419762 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:07.419762 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:07.419762 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:07.419762 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:07.419762 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:07.419762 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:07.419762 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:07.419762 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:07.419762 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:07.419762 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:07.419762 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:07.419762 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:07.420608 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:07.420608 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:07.420608 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:07.420608 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:07.420608 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:07.420608 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:07.420608 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:07.420608 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:07.420608 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:07.420608 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:07.420608 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 21:09:07.420608 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:07.420608 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 447/879] 10.222.0.30 () {56 vars in 1120 bytes} [Tue Jul 5 21:09:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:07.426245 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de81658-1414-445b-b81a-ed197a10d7da None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:07.459546 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:07.531832 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de81658-1414-445b-b81a-ed197a10d7da None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:07.569043 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f21ac8-85d9-4b60-9121-c72b29b9dd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:07.569865 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f21ac8-85d9-4b60-9121-c72b29b9dd57 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:07.570168 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f21ac8-85d9-4b60-9121-c72b29b9dd57 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:07.570454 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f21ac8-85d9-4b60-9121-c72b29b9dd57 None admin] PATH_INFO: `/v3/roles` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:07.571201 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f21ac8-85d9-4b60-9121-c72b29b9dd57 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:07.571517 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f21ac8-85d9-4b60-9121-c72b29b9dd57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:07.573093 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f21ac8-85d9-4b60-9121-c72b29b9dd57 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:07.581849 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 433/880] 10.222.0.30 () {56 vars in 1115 bytes} [Tue Jul 5 21:09:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:07.587179 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871b9b6-ac42-46da-8859-30661c2ff8bd None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:07.694632 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871b9b6-ac42-46da-8859-30661c2ff8bd None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:07.730544 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc450c5-8ca2-46f0-af06-7d7da413ae03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:07.731540 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc450c5-8ca2-46f0-af06-7d7da413ae03 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:07.731827 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc450c5-8ca2-46f0-af06-7d7da413ae03 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:07.732106 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc450c5-8ca2-46f0-af06-7d7da413ae03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:07.741135 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:07.743370 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc450c5-8ca2-46f0-af06-7d7da413ae03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:07.745144 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc450c5-8ca2-46f0-af06-7d7da413ae03 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:07.763354 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-3bc450c5-8ca2-46f0-af06-7d7da413ae03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:07.763354 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:07.763354 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:07.763354 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:07.763354 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:07.763354 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:07.763354 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:07.763354 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:07.763354 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:07.763354 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:07.763354 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:07.763354 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:07.763354 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:09:07.763354 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:09:07.763354 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:09:07.765435 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:09:07.765435 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:07.765435 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:07.765435 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:07.765435 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:07.765435 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:07.765435 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:07.765435 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:07.765435 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:07.765435 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:07.765435 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:07.765435 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:07.765435 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:07.765435 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:07.765435 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:07.765435 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:07.765435 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:07.767624 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:09:07.767624 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:09:07.767624 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:07.767624 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:07.767624 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 448/881] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:09:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:07.770599 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f21ac8-85d9-4b60-9121-c72b29b9dd57 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:07.811811 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0568a-04b5-4771-a4e3-fbc868b327c7 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:07.812509 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0568a-04b5-4771-a4e3-fbc868b327c7 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:07.812823 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0568a-04b5-4771-a4e3-fbc868b327c7 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:07.815028 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 449/882] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:09:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:09:07.819814 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10dc16a-6a67-467d-8bd1-f683d0a431a8 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:07.820109 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10dc16a-6a67-467d-8bd1-f683d0a431a8 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:07.820393 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10dc16a-6a67-467d-8bd1-f683d0a431a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:07.838003 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-d10dc16a-6a67-467d-8bd1-f683d0a431a8 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:07.839272 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-d10dc16a-6a67-467d-8bd1-f683d0a431a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:07.879708 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f21ac8-85d9-4b60-9121-c72b29b9dd57 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:07.882493 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:07.914245 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 450/883] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:07 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:09:07.918631 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56330db7-d0fb-45c6-8632-c1fba871d8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:07.919312 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56330db7-d0fb-45c6-8632-c1fba871d8fc None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:07.919607 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56330db7-d0fb-45c6-8632-c1fba871d8fc None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:07.919892 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56330db7-d0fb-45c6-8632-c1fba871d8fc None admin] PATH_INFO: `/v3/domains` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:07.920621 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56330db7-d0fb-45c6-8632-c1fba871d8fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:07.920945 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56330db7-d0fb-45c6-8632-c1fba871d8fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:07.922349 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56330db7-d0fb-45c6-8632-c1fba871d8fc None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:07.933076 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10dc16a-6a67-467d-8bd1-f683d0a431a8 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:07.938550 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 434/884] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:09:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:07.944807 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56330db7-d0fb-45c6-8632-c1fba871d8fc None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:08.060391 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10dc16a-6a67-467d-8bd1-f683d0a431a8 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:08.066482 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56330db7-d0fb-45c6-8632-c1fba871d8fc None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:08.089849 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:08.107058 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a157f-aaa2-4775-869a-38d056fa384d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:08.113450 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a157f-aaa2-4775-869a-38d056fa384d None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:08.113450 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a157f-aaa2-4775-869a-38d056fa384d None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:08.113450 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a157f-aaa2-4775-869a-38d056fa384d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:08.113450 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a157f-aaa2-4775-869a-38d056fa384d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:08.113734 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05098f-5d47-4eff-afea-4410ad1cfdee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:08.113734 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05098f-5d47-4eff-afea-4410ad1cfdee None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:08.113734 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05098f-5d47-4eff-afea-4410ad1cfdee None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:08.113734 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05098f-5d47-4eff-afea-4410ad1cfdee None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:08.114223 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a157f-aaa2-4775-869a-38d056fa384d None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:08.120348 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d05098f-5d47-4eff-afea-4410ad1cfdee None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:08.121810 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d05098f-5d47-4eff-afea-4410ad1cfdee None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:08.128110 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-287a157f-aaa2-4775-869a-38d056fa384d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 21:09:08.128110 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:08.128110 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:09:08.128110 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:09:08.128110 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:09:08.128110 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:09:08.128110 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:09:08.128110 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:09:08.128110 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 21:09:08.128110 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:08.128110 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:09:08.128110 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:08.128110 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:08.128110 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:08.128110 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:08.128110 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:08.128110 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:08.129093 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:08.129093 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:08.129093 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:08.129093 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:08.129093 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:08.129093 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:08.129093 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:09:08.129093 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:09:08.129093 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:09:08.129093 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:09:08.129093 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:08.129093 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:08.129093 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:08.129093 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:08.129093 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:08.129093 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:08.129943 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:08.129943 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:08.129943 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:08.129943 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:08.129943 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:08.129943 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:08.129943 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:08.129943 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:08.129943 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:08.129943 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:08.129943 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:09:08.129943 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:09:08.129943 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 21:09:08.129943 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:08.138021 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 451/885] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:09:07 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:09:08.139194 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a157f-aaa2-4775-869a-38d056fa384d None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:08.139303 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-7d05098f-5d47-4eff-afea-4410ad1cfdee None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 21:09:08.139303 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:08.139303 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:08.139303 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:08.139303 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:08.139303 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:08.139303 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:08.139303 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:08.139303 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:08.139303 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:08.139303 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:08.139303 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:08.139303 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:09:08.139303 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:09:08.139303 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:09:08.139303 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:09:08.140319 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:08.140319 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:08.140319 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:09:08.140319 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:09:08.140319 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:09:08.140319 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:09:08.140319 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:08.140319 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:08.140319 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:08.140319 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:08.140319 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:08.140319 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:08.140319 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:08.140319 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:08.140319 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:08.140319 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:08.140319 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:08.140319 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:08.141364 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:08.141364 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:08.141364 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:09:08.141364 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:09:08.141364 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:09:08.141364 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:09:08.141364 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:09:08.141364 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:09:08.141364 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 21:09:08.141364 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:09:08.145964 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 435/886] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Jul 5 21:09:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:09:08.149525 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05098f-5d47-4eff-afea-4410ad1cfdee None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:08.160924 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:08.257582 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a157f-aaa2-4775-869a-38d056fa384d None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:08.268146 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05098f-5d47-4eff-afea-4410ad1cfdee None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:08.296008 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119e76f-4ecb-4761-94f0-9106c5550cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:08.296771 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119e76f-4ecb-4761-94f0-9106c5550cb8 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:08.297316 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119e76f-4ecb-4761-94f0-9106c5550cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:08.297885 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119e76f-4ecb-4761-94f0-9106c5550cb8 None admin] PATH_INFO: `/v3/services` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:08.298836 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119e76f-4ecb-4761-94f0-9106c5550cb8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:08.299398 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119e76f-4ecb-4761-94f0-9106c5550cb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:08.301057 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119e76f-4ecb-4761-94f0-9106c5550cb8 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:08.310458 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 452/887] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:09:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:08.311891 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606deaa-fcdb-4849-81de-f9421b0a2c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:08.312022 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606deaa-fcdb-4849-81de-f9421b0a2c88 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:08.312247 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606deaa-fcdb-4849-81de-f9421b0a2c88 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:08.312536 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606deaa-fcdb-4849-81de-f9421b0a2c88 None admin] PATH_INFO: `/v3/users` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:08.313455 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6606deaa-fcdb-4849-81de-f9421b0a2c88 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:08.313777 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6606deaa-fcdb-4849-81de-f9421b0a2c88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:08.315540 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119e76f-4ecb-4761-94f0-9106c5550cb8 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:08.317064 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6606deaa-fcdb-4849-81de-f9421b0a2c88 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:08.342194 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 436/888] 10.222.0.30 () {56 vars in 1149 bytes} [Tue Jul 5 21:09:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:08.343253 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606deaa-fcdb-4849-81de-f9421b0a2c88 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:08.372477 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:08.413027 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:08.427992 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119e76f-4ecb-4761-94f0-9106c5550cb8 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:08.457091 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606deaa-fcdb-4849-81de-f9421b0a2c88 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:08.466443 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588bd3e-f011-4140-ab38-42a99a85ff70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:08.467427 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588bd3e-f011-4140-ab38-42a99a85ff70 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:08.468011 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588bd3e-f011-4140-ab38-42a99a85ff70 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:08.468491 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588bd3e-f011-4140-ab38-42a99a85ff70 None admin] PATH_INFO: `/v3/services` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:08.469518 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588bd3e-f011-4140-ab38-42a99a85ff70 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:08.470044 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588bd3e-f011-4140-ab38-42a99a85ff70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:08.471695 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588bd3e-f011-4140-ab38-42a99a85ff70 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:08.482377 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 453/889] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:09:08 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:08.483809 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588bd3e-f011-4140-ab38-42a99a85ff70 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:08.495379 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9770d9b2-fee1-4449-bac9-405bee369a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:08.496063 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770d9b2-fee1-4449-bac9-405bee369a2c None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:08.496349 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770d9b2-fee1-4449-bac9-405bee369a2c None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:08.496634 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770d9b2-fee1-4449-bac9-405bee369a2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:08.569231 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9770d9b2-fee1-4449-bac9-405bee369a2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:08.570651 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9770d9b2-fee1-4449-bac9-405bee369a2c None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:08.595647 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588bd3e-f011-4140-ab38-42a99a85ff70 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:08.613565 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:08.635761 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:08.636073 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb34d94-ca48-43d1-97d6-2479f66394b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:08.636691 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb34d94-ca48-43d1-97d6-2479f66394b3 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:08.636985 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb34d94-ca48-43d1-97d6-2479f66394b3 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:08.637270 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb34d94-ca48-43d1-97d6-2479f66394b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:08.638072 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb34d94-ca48-43d1-97d6-2479f66394b3 None admin] RBAC: Adding query filter params (interface=public, service_id=ef3c54737d644816a69cd30efde91baf, region_id=RegionOne) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:08.638442 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb34d94-ca48-43d1-97d6-2479f66394b3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:08.639874 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb34d94-ca48-43d1-97d6-2479f66394b3 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:08.646121 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 454/890] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Jul 5 21:09:08 2022] GET /identity/v3/endpoints?service_id=ef3c54737d644816a69cd30efde91baf&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:08.653000 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668c99f-2c5e-457b-9004-744099523d89 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:08.653000 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668c99f-2c5e-457b-9004-744099523d89 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:08.653000 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668c99f-2c5e-457b-9004-744099523d89 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:08.653000 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 455/891] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:09:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:08.653000 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb1497-536b-4c9f-9291-100200b7c62b None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:08.653000 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb1497-536b-4c9f-9291-100200b7c62b None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:08.653414 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb1497-536b-4c9f-9291-100200b7c62b None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:08.653414 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 456/892] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:09:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:08.653414 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb1497-536b-4c9f-9291-100200b7c62b None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:08.677343 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 437/893] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:09:08 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:09:08.678750 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b765b-2e0e-4658-a8f2-ead76f25ff6e None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:08.679054 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b765b-2e0e-4658-a8f2-ead76f25ff6e None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:08.679344 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b765b-2e0e-4658-a8f2-ead76f25ff6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:08.696199 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-4e9b765b-2e0e-4658-a8f2-ead76f25ff6e None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:08.697402 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-4e9b765b-2e0e-4658-a8f2-ead76f25ff6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:08.756110 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb1497-536b-4c9f-9291-100200b7c62b None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:08.763337 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 438/894] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:08 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:09:08.764680 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668369be-2425-4074-bf07-8dfb1c237daf None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:08.764989 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668369be-2425-4074-bf07-8dfb1c237daf None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:08.765276 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668369be-2425-4074-bf07-8dfb1c237daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:08.781652 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-668369be-2425-4074-bf07-8dfb1c237daf None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:08.782883 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-668369be-2425-4074-bf07-8dfb1c237daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:08.800451 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a4f02-ccd3-4395-aac1-c2e31daf39e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:08.801121 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a4f02-ccd3-4395-aac1-c2e31daf39e0 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:08.801408 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a4f02-ccd3-4395-aac1-c2e31daf39e0 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:08.801690 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a4f02-ccd3-4395-aac1-c2e31daf39e0 None admin] PATH_INFO: `/v3/services` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:08.802425 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a4f02-ccd3-4395-aac1-c2e31daf39e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:08.803771 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a4f02-ccd3-4395-aac1-c2e31daf39e0 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:08.809595 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 457/895] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Jul 5 21:09:08 2022] GET /identity/v3/services => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:09:08.810460 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a4f02-ccd3-4395-aac1-c2e31daf39e0 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:08.861924 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:08.863088 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 439/896] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:08 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:09:08.863986 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668369be-2425-4074-bf07-8dfb1c237daf None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:08.895540 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:08.947394 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a4f02-ccd3-4395-aac1-c2e31daf39e0 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:08.980476 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668369be-2425-4074-bf07-8dfb1c237daf None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:08.988280 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5be82c-1500-4061-8ccf-74c6ea017d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:08.988734 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5be82c-1500-4061-8ccf-74c6ea017d08 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:08.989025 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5be82c-1500-4061-8ccf-74c6ea017d08 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:08.989308 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5be82c-1500-4061-8ccf-74c6ea017d08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:09.003565 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5be82c-1500-4061-8ccf-74c6ea017d08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:09.005029 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5be82c-1500-4061-8ccf-74c6ea017d08 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:09.016862 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d91ab-59d6-433e-89ac-7f1ac4109198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:09.017685 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d91ab-59d6-433e-89ac-7f1ac4109198 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:09.017977 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d91ab-59d6-433e-89ac-7f1ac4109198 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:09.018290 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d91ab-59d6-433e-89ac-7f1ac4109198 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:09.018944 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14d91ab-59d6-433e-89ac-7f1ac4109198 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:09.020312 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14d91ab-59d6-433e-89ac-7f1ac4109198 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:09.022932 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-5c5be82c-1500-4061-8ccf-74c6ea017d08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:09.022932 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:09.022932 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:09.022932 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:09.022932 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:09.022932 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:09.022932 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:09.022932 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:09.022932 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:09.022932 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:09.022932 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:09.022932 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:09.022932 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:09:09.022932 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:09:09.022932 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:09:09.023821 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:09:09.023821 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:09.023821 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:09.023821 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:09.023821 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:09.023821 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:09.023821 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:09.023821 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:09.023821 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:09.023821 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:09.023821 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:09.023821 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:09.023821 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:09.023821 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:09.023821 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:09.023821 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:09.023821 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:09.025238 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:09:09.025238 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:09:09.025238 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:09.025238 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:09.025238 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 458/897] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:09:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:09.025911 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5be82c-1500-4061-8ccf-74c6ea017d08 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:09.036074 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-e14d91ab-59d6-433e-89ac-7f1ac4109198 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 21:09:09.036074 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:09.036074 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:09:09.036074 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:09:09.036074 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:09:09.036074 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:09:09.036074 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:09:09.036074 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:09:09.036074 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 21:09:09.036074 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:09:09.036074 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:09:09.036074 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:09:09.036074 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:09.036074 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:09.036074 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:09.036074 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:09.037099 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:09.037099 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:09.037099 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:09.037099 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:09.037099 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:09.037099 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:09.037099 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:09.037099 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:09:09.037099 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:09:09.037099 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:09:09.037099 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:09:09.037099 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:09.037099 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:09.037099 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:09.037099 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:09.037099 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:09.038029 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:09.038029 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:09.038029 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:09.038029 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:09.038029 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:09.038029 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:09.038029 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:09.038029 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:09.038029 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:09.038029 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:09.038029 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:09.038029 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:09:09.038029 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:09:09.038029 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 21:09:09.038029 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:09:09.042404 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 440/898] 10.222.0.30 () {56 vars in 1132 bytes} [Tue Jul 5 21:09:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:09.043465 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d91ab-59d6-433e-89ac-7f1ac4109198 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:09.131959 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:09.139520 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5be82c-1500-4061-8ccf-74c6ea017d08 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:09.143106 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:09.155599 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d91ab-59d6-433e-89ac-7f1ac4109198 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:09.174255 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac8338-ba45-417d-ac65-1b5ad35741f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:09.175108 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac8338-ba45-417d-ac65-1b5ad35741f9 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:09.175400 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac8338-ba45-417d-ac65-1b5ad35741f9 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:09.175684 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac8338-ba45-417d-ac65-1b5ad35741f9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:09.176344 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ac8338-ba45-417d-ac65-1b5ad35741f9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:09.178260 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ac8338-ba45-417d-ac65-1b5ad35741f9 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:09.190459 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5cd102-4e4a-4e50-a0d5-29072e1d9973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:09.190979 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-c6ac8338-ba45-417d-ac65-1b5ad35741f9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:09:09.190979 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:09.190979 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:09:09.190979 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:09:09.190979 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:09:09.190979 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:09:09.190979 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:09:09.190979 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:09:09.190979 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:09:09.190979 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:09.190979 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:09:09.190979 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:09.190979 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:09.190979 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:09.190979 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:09.190979 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:09.190979 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:09.191986 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:09.191986 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:09.191986 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:09.191986 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:09.191986 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:09.191986 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:09.191986 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:09:09.191986 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:09:09.191986 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:09:09.191986 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:09:09.191986 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:09.191986 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:09.191986 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:09.191986 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:09.191986 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:09.191986 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:09.192835 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:09.192835 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:09.192835 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:09.192835 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:09.192835 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:09.192835 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:09.192835 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:09.192835 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:09.192835 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:09.192835 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:09.192835 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:09:09.192835 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:09:09.192835 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:09:09.192835 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:09.193584 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cd102-4e4a-4e50-a0d5-29072e1d9973 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:09.193584 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cd102-4e4a-4e50-a0d5-29072e1d9973 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:09.193584 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cd102-4e4a-4e50-a0d5-29072e1d9973 None admin] PATH_INFO: `/v3/domains` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:09.193773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 459/899] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Jul 5 21:09:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:09.193773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac8338-ba45-417d-ac65-1b5ad35741f9 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:09.197330 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5cd102-4e4a-4e50-a0d5-29072e1d9973 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:09.197662 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5cd102-4e4a-4e50-a0d5-29072e1d9973 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:09.199080 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5cd102-4e4a-4e50-a0d5-29072e1d9973 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:09.215969 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 441/900] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:09:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:09.215969 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5cd102-4e4a-4e50-a0d5-29072e1d9973 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:09.303892 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac8338-ba45-417d-ac65-1b5ad35741f9 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:09.328594 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5cd102-4e4a-4e50-a0d5-29072e1d9973 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:09.347856 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98e2d4-bb2a-4f25-8f13-0186a6cf0f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:09.348559 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98e2d4-bb2a-4f25-8f13-0186a6cf0f79 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:09.348848 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98e2d4-bb2a-4f25-8f13-0186a6cf0f79 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:09.349128 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98e2d4-bb2a-4f25-8f13-0186a6cf0f79 None admin] PATH_INFO: `/v3/services` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:09.349841 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe98e2d4-bb2a-4f25-8f13-0186a6cf0f79 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:09.350187 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe98e2d4-bb2a-4f25-8f13-0186a6cf0f79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:09.351570 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe98e2d4-bb2a-4f25-8f13-0186a6cf0f79 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:09.361512 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 460/901] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Jul 5 21:09:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:09.361512 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98e2d4-bb2a-4f25-8f13-0186a6cf0f79 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:09.371637 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c0eee-f2c2-409c-afcf-59d579f723c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:09.372446 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c0eee-f2c2-409c-afcf-59d579f723c0 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:09.372645 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c0eee-f2c2-409c-afcf-59d579f723c0 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:09.372885 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c0eee-f2c2-409c-afcf-59d579f723c0 None admin] PATH_INFO: `/v3/services` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:09.373601 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c0eee-f2c2-409c-afcf-59d579f723c0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:09.373918 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c0eee-f2c2-409c-afcf-59d579f723c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:09.375331 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c0eee-f2c2-409c-afcf-59d579f723c0 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:09.380152 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 442/902] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Jul 5 21:09:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:09.380925 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c0eee-f2c2-409c-afcf-59d579f723c0 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:09.391542 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:09.396383 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:09.471475 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98e2d4-bb2a-4f25-8f13-0186a6cf0f79 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:09.487256 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c0eee-f2c2-409c-afcf-59d579f723c0 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:09.507323 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0042ff-ae62-4168-aff9-81f9302a7a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:09.508366 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0042ff-ae62-4168-aff9-81f9302a7a65 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:09.508806 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0042ff-ae62-4168-aff9-81f9302a7a65 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:09.509085 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0042ff-ae62-4168-aff9-81f9302a7a65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:09.516353 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0042ff-ae62-4168-aff9-81f9302a7a65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:09.518009 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0042ff-ae62-4168-aff9-81f9302a7a65 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:09.522476 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8a495-828b-44cf-b381-21dc33e89226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:09.523160 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8a495-828b-44cf-b381-21dc33e89226 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:09.523455 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8a495-828b-44cf-b381-21dc33e89226 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:09.523743 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8a495-828b-44cf-b381-21dc33e89226 None admin] PATH_INFO: `/v3/services` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:09.524453 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8a495-828b-44cf-b381-21dc33e89226 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:09.525338 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8a495-828b-44cf-b381-21dc33e89226 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:09.526740 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8a495-828b-44cf-b381-21dc33e89226 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:09.536357 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 443/903] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Jul 5 21:09:09 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:09.536357 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8a495-828b-44cf-b381-21dc33e89226 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:09.536620 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-ca0042ff-ae62-4168-aff9-81f9302a7a65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:09:09.536620 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:09.536620 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:09.536620 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:09.536620 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:09.536620 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:09.536620 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:09.536620 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:09.536620 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:09.536620 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:09.536620 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:09.536620 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:09.536620 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:09:09.536620 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:09:09.536620 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:09:09.537629 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:09:09.537629 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:09.537629 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:09.537629 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:09.537629 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:09.537629 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:09.537629 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:09.537629 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:09.537629 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:09.537629 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:09.537629 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:09.537629 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:09.537629 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:09.537629 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:09.537629 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:09.537629 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:09.537629 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:09.539303 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:09:09.539303 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:09:09.539303 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:09:09.539303 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:09:09.539303 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:09:09.539303 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:09:09.539303 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:09:09.539303 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:09.539303 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 461/904] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:09:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:09.539923 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0042ff-ae62-4168-aff9-81f9302a7a65 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:09.620324 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:09.626226 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:09.643610 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8a495-828b-44cf-b381-21dc33e89226 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:09.644310 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0042ff-ae62-4168-aff9-81f9302a7a65 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:09.681716 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76021b3c-7623-4b2b-bc1a-4d2b30b42a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:09.682075 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61428c8-6e8e-4042-8e61-4086ef2de89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:09.682789 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61428c8-6e8e-4042-8e61-4086ef2de89e None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:09.683082 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61428c8-6e8e-4042-8e61-4086ef2de89e None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:09.683366 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61428c8-6e8e-4042-8e61-4086ef2de89e None admin] PATH_INFO: `/v3/endpoints` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:09.683641 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76021b3c-7623-4b2b-bc1a-4d2b30b42a4b None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:09.684144 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76021b3c-7623-4b2b-bc1a-4d2b30b42a4b None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:09.684250 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61428c8-6e8e-4042-8e61-4086ef2de89e None admin] RBAC: Adding query filter params (interface=public, service_id=8ac3376cc6984ea4be43710b57d2950d, region_id=RegionOne) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:09.684469 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61428c8-6e8e-4042-8e61-4086ef2de89e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:09.684916 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76021b3c-7623-4b2b-bc1a-4d2b30b42a4b None admin] PATH_INFO: `/v3/services` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:09.685831 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76021b3c-7623-4b2b-bc1a-4d2b30b42a4b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:09.685938 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61428c8-6e8e-4042-8e61-4086ef2de89e None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:09.686469 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76021b3c-7623-4b2b-bc1a-4d2b30b42a4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:09.688080 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76021b3c-7623-4b2b-bc1a-4d2b30b42a4b None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:09.695759 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 462/905] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Jul 5 21:09:09 2022] GET /identity/v3/endpoints?service_id=8ac3376cc6984ea4be43710b57d2950d&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:09.695759 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61428c8-6e8e-4042-8e61-4086ef2de89e None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:09.698376 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 444/906] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Jul 5 21:09:09 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:09.699504 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76021b3c-7623-4b2b-bc1a-4d2b30b42a4b None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:09.821657 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61428c8-6e8e-4042-8e61-4086ef2de89e None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:09.834438 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76021b3c-7623-4b2b-bc1a-4d2b30b42a4b None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:09.865121 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c339db38-33c8-49f6-803e-26a617adb552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:09.866080 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c339db38-33c8-49f6-803e-26a617adb552 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:09.866405 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c339db38-33c8-49f6-803e-26a617adb552 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:09.866694 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c339db38-33c8-49f6-803e-26a617adb552 None admin] PATH_INFO: `/v3/projects` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:09.868162 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c339db38-33c8-49f6-803e-26a617adb552 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:09.868669 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c339db38-33c8-49f6-803e-26a617adb552 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:09.871241 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c339db38-33c8-49f6-803e-26a617adb552 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:09.878553 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a574dfdd-b5cf-412f-af0b-e0f294dd1b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:09.879515 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574dfdd-b5cf-412f-af0b-e0f294dd1b4b None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:09.880030 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574dfdd-b5cf-412f-af0b-e0f294dd1b4b None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:09.880532 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574dfdd-b5cf-412f-af0b-e0f294dd1b4b None admin] PATH_INFO: `/v3/services` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:09.881429 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a574dfdd-b5cf-412f-af0b-e0f294dd1b4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:09.883064 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a574dfdd-b5cf-412f-af0b-e0f294dd1b4b None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:09.883517 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 463/907] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:09:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:09.891533 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c339db38-33c8-49f6-803e-26a617adb552 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:09.892151 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 445/908] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Jul 5 21:09:09 2022] GET /identity/v3/services => generated 1268 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:09:09.901877 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:10.010149 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c339db38-33c8-49f6-803e-26a617adb552 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:10.047975 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd0bdc-d9d8-46e1-be01-204594632b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:10.048651 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd0bdc-d9d8-46e1-be01-204594632b80 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:10.048943 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd0bdc-d9d8-46e1-be01-204594632b80 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:10.049230 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd0bdc-d9d8-46e1-be01-204594632b80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:10.050820 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd0bdc-d9d8-46e1-be01-204594632b80 None admin] RBAC: Adding query filter params (role.id=f3bc75c520ed4d52a97c45df41973dd0, scope.project.id=ccd95a48530c4c86a3774301b969d6a9, user.id=e6cf35a185bc4707a4f2f7b56662354d) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:10.050820 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd0bdc-d9d8-46e1-be01-204594632b80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:10.052789 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd0bdc-d9d8-46e1-be01-204594632b80 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:10.059145 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 464/909] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:09:09 2022] GET /identity/v3/role_assignments?user.id=e6cf35a185bc4707a4f2f7b56662354d&scope.project.id=ccd95a48530c4c86a3774301b969d6a9&role.id=f3bc75c520ed4d52a97c45df41973dd0 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:11.077278 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060487cb-7185-40d5-a8b9-0bac216952bd None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:11.077805 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060487cb-7185-40d5-a8b9-0bac216952bd None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:11.077884 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060487cb-7185-40d5-a8b9-0bac216952bd None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:11.079497 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 446/910] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:11.084804 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93268dc-fc4c-4289-a955-eabbc32f0b85 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:11.085200 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93268dc-fc4c-4289-a955-eabbc32f0b85 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:11.085384 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93268dc-fc4c-4289-a955-eabbc32f0b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:11.102687 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-f93268dc-fc4c-4289-a955-eabbc32f0b85 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:11.104303 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-f93268dc-fc4c-4289-a955-eabbc32f0b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:11.176733 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:11.182955 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 465/911] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:11 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:09:11.205962 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060487cb-7185-40d5-a8b9-0bac216952bd None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:11.210028 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:11.321636 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060487cb-7185-40d5-a8b9-0bac216952bd None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:11.359303 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f4fca-bdfe-439f-8b25-93088dee30be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:11.360444 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f4fca-bdfe-439f-8b25-93088dee30be None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:11.360935 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f4fca-bdfe-439f-8b25-93088dee30be None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:11.361414 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f4fca-bdfe-439f-8b25-93088dee30be None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:11.362326 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f4fca-bdfe-439f-8b25-93088dee30be None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:11.363904 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f4fca-bdfe-439f-8b25-93088dee30be None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:11.376828 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-de7f4fca-bdfe-439f-8b25-93088dee30be None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 21:09:11.376828 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:11.376828 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:09:11.376828 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:09:11.376828 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:09:11.376828 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:09:11.376828 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:09:11.376828 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:09:11.376828 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 21:09:11.376828 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:09:11.376828 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:09:11.376828 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:09:11.376828 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:11.376828 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:11.376828 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:11.376828 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:11.376828 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:11.377831 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:11.377831 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:11.377831 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:11.377831 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:11.377831 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:11.377831 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:11.377831 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:09:11.377831 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:09:11.377831 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:09:11.377831 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:09:11.377831 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:11.377831 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:11.377831 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:11.377831 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:11.377831 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:11.377831 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:11.378702 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:11.378702 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:11.378702 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:11.378702 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:11.378702 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:11.378702 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:11.378702 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:11.378702 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:11.378702 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:11.378702 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:11.378702 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:09:11.378702 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:09:11.378702 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 21:09:11.378702 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:09:11.381599 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 447/912] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:09:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:11.387317 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93268dc-fc4c-4289-a955-eabbc32f0b85 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:11.490941 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93268dc-fc4c-4289-a955-eabbc32f0b85 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:11.527920 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb640846-5491-4662-ade2-4ad9a38aea1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:11.528598 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb640846-5491-4662-ade2-4ad9a38aea1a None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:11.528891 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb640846-5491-4662-ade2-4ad9a38aea1a None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:11.529174 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb640846-5491-4662-ade2-4ad9a38aea1a None admin] PATH_INFO: `/v3/services` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:11.529894 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb640846-5491-4662-ade2-4ad9a38aea1a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:11.530243 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb640846-5491-4662-ade2-4ad9a38aea1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:11.531626 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb640846-5491-4662-ade2-4ad9a38aea1a None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:11.536864 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 466/913] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:09:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:11.543021 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f4fca-bdfe-439f-8b25-93088dee30be None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:11.615165 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:11.648687 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f4fca-bdfe-439f-8b25-93088dee30be None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:11.684956 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca214e4-3bf0-4980-a4ae-df3e2ca76f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:11.685637 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca214e4-3bf0-4980-a4ae-df3e2ca76f0b None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:11.685927 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca214e4-3bf0-4980-a4ae-df3e2ca76f0b None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:11.686239 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca214e4-3bf0-4980-a4ae-df3e2ca76f0b None admin] PATH_INFO: `/v3/services` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:11.686953 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca214e4-3bf0-4980-a4ae-df3e2ca76f0b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:11.687265 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca214e4-3bf0-4980-a4ae-df3e2ca76f0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:11.688641 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca214e4-3bf0-4980-a4ae-df3e2ca76f0b None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:11.694273 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 448/914] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:09:11 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:11.700150 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb640846-5491-4662-ade2-4ad9a38aea1a None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:11.773249 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:11.818823 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb640846-5491-4662-ade2-4ad9a38aea1a None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:11.856092 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57117a3-c668-4797-8807-157ca6d0ea62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:11.856772 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57117a3-c668-4797-8807-157ca6d0ea62 None admin] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:11.857068 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57117a3-c668-4797-8807-157ca6d0ea62 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:11.857355 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57117a3-c668-4797-8807-157ca6d0ea62 None admin] PATH_INFO: `/v3/endpoints` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:11.858117 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57117a3-c668-4797-8807-157ca6d0ea62 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:11.859529 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57117a3-c668-4797-8807-157ca6d0ea62 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:11.918208 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b916742-280d-47de-a01b-653163253e83 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:11.918451 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b916742-280d-47de-a01b-653163253e83 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:11.918786 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b916742-280d-47de-a01b-653163253e83 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:11.920506 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 449/915] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:09:11.925831 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5f90a-849f-408b-ae9f-2bd4297318f6 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:11.934272 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5f90a-849f-408b-ae9f-2bd4297318f6 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:11.934272 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5f90a-849f-408b-ae9f-2bd4297318f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:11.934482 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 467/916] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Jul 5 21:09:11 2022] POST /identity/v3/endpoints => generated 346 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:09:11.947492 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-1db5f90a-849f-408b-ae9f-2bd4297318f6 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:11.949078 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-1db5f90a-849f-408b-ae9f-2bd4297318f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:12.034804 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 450/917] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:11 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:09:12.058611 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57117a3-c668-4797-8807-157ca6d0ea62 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:12.162485 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0f9f4-72a9-45ce-b1c3-cbb6155a2da9 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:12.163002 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0f9f4-72a9-45ce-b1c3-cbb6155a2da9 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:12.163105 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0f9f4-72a9-45ce-b1c3-cbb6155a2da9 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:12.164681 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 451/918] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:09:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:12.172925 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c231132-8b7d-46ac-ace8-3dedf5e7c219 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:12.173177 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c231132-8b7d-46ac-ace8-3dedf5e7c219 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:12.173432 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c231132-8b7d-46ac-ace8-3dedf5e7c219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:12.177298 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57117a3-c668-4797-8807-157ca6d0ea62 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:12.195833 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-2c231132-8b7d-46ac-ace8-3dedf5e7c219 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:12.198502 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-2c231132-8b7d-46ac-ace8-3dedf5e7c219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:12.199376 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:12.215259 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072f59f-e338-474c-af60-1e08ab156e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:12.216165 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072f59f-e338-474c-af60-1e08ab156e5f None admin] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:12.216319 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072f59f-e338-474c-af60-1e08ab156e5f None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:12.216565 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072f59f-e338-474c-af60-1e08ab156e5f None admin] PATH_INFO: `/v3/services` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:12.217300 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8072f59f-e338-474c-af60-1e08ab156e5f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:12.218780 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8072f59f-e338-474c-af60-1e08ab156e5f None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:12.268136 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:12.282656 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 452/919] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:12 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:09:12.284305 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce272d3-7e30-4791-b111-bfaef510ab18 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:12.284417 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce272d3-7e30-4791-b111-bfaef510ab18 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:12.284664 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce272d3-7e30-4791-b111-bfaef510ab18 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:12.286189 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 453/920] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:09:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:12.293728 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 468/921] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Jul 5 21:09:12 2022] POST /identity/v3/services => generated 241 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:09:12.297637 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11536cbd-c079-48a7-8cdd-372cdd21e366 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:12.298855 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11536cbd-c079-48a7-8cdd-372cdd21e366 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:12.298855 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11536cbd-c079-48a7-8cdd-372cdd21e366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:12.311675 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072f59f-e338-474c-af60-1e08ab156e5f None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:12.329620 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-11536cbd-c079-48a7-8cdd-372cdd21e366 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:12.333644 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-11536cbd-c079-48a7-8cdd-372cdd21e366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:12.427600 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 454/922] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:09:12.452500 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11536cbd-c079-48a7-8cdd-372cdd21e366 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:12.454051 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072f59f-e338-474c-af60-1e08ab156e5f None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:12.498722 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff848f-810a-4681-9949-57c17faf9d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:12.499550 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff848f-810a-4681-9949-57c17faf9d0c None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:12.499833 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff848f-810a-4681-9949-57c17faf9d0c None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:12.500111 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff848f-810a-4681-9949-57c17faf9d0c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:12.500773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff848f-810a-4681-9949-57c17faf9d0c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:12.502866 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff848f-810a-4681-9949-57c17faf9d0c None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:12.517228 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-64ff848f-810a-4681-9949-57c17faf9d0c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 21:09:12.517228 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:12.517228 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:09:12.517228 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:09:12.517228 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:09:12.517228 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:09:12.517228 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:09:12.517228 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:09:12.517228 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 21:09:12.517228 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:12.517228 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:09:12.517228 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:12.517228 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:12.517228 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:12.517228 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:12.517228 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:12.518359 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:12.518359 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:12.518359 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:12.518359 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:12.518359 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:12.518359 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:12.518359 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:12.518359 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:09:12.518359 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:09:12.518359 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:09:12.518359 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:09:12.518359 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:12.518359 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:12.518359 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:12.518359 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:12.518359 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:12.519289 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:12.519289 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:12.519289 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:12.519289 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:12.519289 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:12.519289 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:12.519289 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:12.519289 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:12.519289 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:12.519289 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:12.519289 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:12.519289 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:09:12.519289 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:09:12.519289 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 21:09:12.519289 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:12.519289 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 469/923] 10.222.0.30 () {56 vars in 1132 bytes} [Tue Jul 5 21:09:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:12.527599 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff848f-810a-4681-9949-57c17faf9d0c None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:12.576346 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:12.591138 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11536cbd-c079-48a7-8cdd-372cdd21e366 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:12.606452 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:12.628590 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90971f-b476-430a-b43a-95152806359b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:12.629669 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90971f-b476-430a-b43a-95152806359b None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:12.630240 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90971f-b476-430a-b43a-95152806359b None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:12.636691 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90971f-b476-430a-b43a-95152806359b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:12.636827 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff848f-810a-4681-9949-57c17faf9d0c None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:12.642671 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d90971f-b476-430a-b43a-95152806359b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:12.651415 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-1d90971f-b476-430a-b43a-95152806359b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 21:09:12.651415 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:12.651415 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:12.651415 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:12.651415 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:12.651415 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:12.651415 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:12.651415 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:12.651415 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:12.651415 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:12.651415 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:12.651415 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:12.651415 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:12.651415 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:12.651415 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:12.651415 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:12.652606 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:12.652606 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:12.652606 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:12.652606 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:12.652606 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:12.652606 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:12.652606 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:12.652606 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:12.652606 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:12.652606 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:12.652606 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:12.652606 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:12.652606 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:12.652606 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:12.652606 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:12.652606 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:12.653632 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:12.653632 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:12.653632 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:12.653632 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:12.653632 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:12.653632 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:12.653632 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:12.653632 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:12.653632 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:12.653632 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:12.653632 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 21:09:12.653632 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:09:12.656105 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 455/924] 10.222.0.30 () {56 vars in 1120 bytes} [Tue Jul 5 21:09:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:09:12.662559 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90971f-b476-430a-b43a-95152806359b None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:12.674154 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1dca6f-b457-4cd8-b588-c645411314d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:12.677248 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1dca6f-b457-4cd8-b588-c645411314d5 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:12.677248 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1dca6f-b457-4cd8-b588-c645411314d5 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:12.677248 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1dca6f-b457-4cd8-b588-c645411314d5 None admin] PATH_INFO: `/v3/services` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:12.677248 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1dca6f-b457-4cd8-b588-c645411314d5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:12.677248 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1dca6f-b457-4cd8-b588-c645411314d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:12.678239 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1dca6f-b457-4cd8-b588-c645411314d5 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:12.684182 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 470/925] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Jul 5 21:09:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:12.689975 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1dca6f-b457-4cd8-b588-c645411314d5 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:12.778843 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90971f-b476-430a-b43a-95152806359b None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:12.818595 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f745c5-2aaa-4a4d-95e9-ddf882baf590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:12.819388 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f745c5-2aaa-4a4d-95e9-ddf882baf590 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:12.819754 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f745c5-2aaa-4a4d-95e9-ddf882baf590 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:12.820110 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f745c5-2aaa-4a4d-95e9-ddf882baf590 None admin] PATH_INFO: `/v3/roles` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:12.820973 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f745c5-2aaa-4a4d-95e9-ddf882baf590 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:12.821409 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f745c5-2aaa-4a4d-95e9-ddf882baf590 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:12.825239 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f745c5-2aaa-4a4d-95e9-ddf882baf590 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:12.832730 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1dca6f-b457-4cd8-b588-c645411314d5 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:12.838313 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 456/926] 10.222.0.30 () {56 vars in 1115 bytes} [Tue Jul 5 21:09:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:12.839263 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f745c5-2aaa-4a4d-95e9-ddf882baf590 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:12.848695 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:12.876676 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9138549-d41e-40a5-b09b-6c66cb0a86eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:12.877720 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9138549-d41e-40a5-b09b-6c66cb0a86eb None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:12.878246 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9138549-d41e-40a5-b09b-6c66cb0a86eb None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:12.878757 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9138549-d41e-40a5-b09b-6c66cb0a86eb None admin] PATH_INFO: `/v3/services` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:12.879670 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9138549-d41e-40a5-b09b-6c66cb0a86eb None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:12.880185 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9138549-d41e-40a5-b09b-6c66cb0a86eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:12.881816 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9138549-d41e-40a5-b09b-6c66cb0a86eb None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:12.882734 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:12.888456 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 471/927] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Jul 5 21:09:12 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:12.894707 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9138549-d41e-40a5-b09b-6c66cb0a86eb None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:12.945002 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f745c5-2aaa-4a4d-95e9-ddf882baf590 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:12.981282 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974fc161-4fda-4cd5-bc68-e8f261c0e071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:12.982091 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fc161-4fda-4cd5-bc68-e8f261c0e071 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:12.982426 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fc161-4fda-4cd5-bc68-e8f261c0e071 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:12.982712 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fc161-4fda-4cd5-bc68-e8f261c0e071 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:12.993737 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974fc161-4fda-4cd5-bc68-e8f261c0e071 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:12.995284 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974fc161-4fda-4cd5-bc68-e8f261c0e071 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:13.002048 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9138549-d41e-40a5-b09b-6c66cb0a86eb None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:13.013647 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-974fc161-4fda-4cd5-bc68-e8f261c0e071 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:13.013647 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:13.013647 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:13.013647 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:13.013647 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:13.013647 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:13.013647 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:13.013647 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:13.013647 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:13.013647 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:13.013647 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:13.013647 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:13.013647 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:09:13.013647 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:09:13.013647 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:09:13.014826 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:09:13.014826 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:13.014826 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:13.014826 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:13.014826 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:13.014826 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:13.014826 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:13.014826 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:13.014826 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:13.014826 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:13.014826 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:13.014826 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:13.014826 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:13.014826 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:13.014826 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:13.014826 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:13.014826 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:13.015746 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:09:13.015746 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:09:13.015746 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:13.015746 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:09:13.019416 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 457/928] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:09:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:13.020695 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974fc161-4fda-4cd5-bc68-e8f261c0e071 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:13.042275 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb0700-8a55-45f1-b700-fdc8ae9b1964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:13.043352 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb0700-8a55-45f1-b700-fdc8ae9b1964 None admin] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:13.043947 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb0700-8a55-45f1-b700-fdc8ae9b1964 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:13.044491 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb0700-8a55-45f1-b700-fdc8ae9b1964 None admin] PATH_INFO: `/v3/endpoints` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:13.045537 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb0700-8a55-45f1-b700-fdc8ae9b1964 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:13.047401 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb0700-8a55-45f1-b700-fdc8ae9b1964 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:13.114297 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:13.127065 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974fc161-4fda-4cd5-bc68-e8f261c0e071 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:13.138748 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 472/929] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Jul 5 21:09:12 2022] POST /identity/v3/endpoints => generated 347 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:09:13.182042 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39cf248-786c-4c3d-be03-adbf99d52dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:13.183595 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cf248-786c-4c3d-be03-adbf99d52dfb None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:13.184081 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cf248-786c-4c3d-be03-adbf99d52dfb None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:13.184568 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cf248-786c-4c3d-be03-adbf99d52dfb None admin] PATH_INFO: `/v3/domains` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:13.185596 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39cf248-786c-4c3d-be03-adbf99d52dfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:13.186110 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39cf248-786c-4c3d-be03-adbf99d52dfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:13.188035 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39cf248-786c-4c3d-be03-adbf99d52dfb None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:13.208784 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 458/930] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:09:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:13.210809 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb0700-8a55-45f1-b700-fdc8ae9b1964 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:13.244754 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:13.324605 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb0700-8a55-45f1-b700-fdc8ae9b1964 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:13.361928 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c474c2bc-137f-485f-be92-44e9fe1a00c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:13.363697 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474c2bc-137f-485f-be92-44e9fe1a00c3 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:13.363697 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474c2bc-137f-485f-be92-44e9fe1a00c3 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:13.363697 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474c2bc-137f-485f-be92-44e9fe1a00c3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:13.372034 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c474c2bc-137f-485f-be92-44e9fe1a00c3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:13.373496 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c474c2bc-137f-485f-be92-44e9fe1a00c3 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:13.389837 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-c474c2bc-137f-485f-be92-44e9fe1a00c3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 21:09:13.389837 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:13.389837 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:13.389837 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:13.389837 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:13.389837 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:13.389837 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:13.389837 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:13.389837 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:13.389837 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:13.389837 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:13.389837 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:13.389837 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:09:13.389837 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:09:13.389837 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:09:13.389837 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:09:13.390914 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:13.390914 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:13.390914 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:09:13.390914 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:09:13.390914 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:09:13.390914 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:09:13.390914 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:13.390914 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:13.390914 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:13.390914 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:13.390914 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:13.390914 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:13.390914 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:13.390914 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:13.390914 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:13.390914 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:13.390914 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:13.390914 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:13.391880 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:13.391880 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:13.391880 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:09:13.391880 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:09:13.391880 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:09:13.391880 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:09:13.391880 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:09:13.391880 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:09:13.391880 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 21:09:13.391880 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:13.395117 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 473/931] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Jul 5 21:09:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:13.397150 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39cf248-786c-4c3d-be03-adbf99d52dfb None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:13.504040 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39cf248-786c-4c3d-be03-adbf99d52dfb None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:13.542927 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5e551-6297-4b0a-a58c-0c5bf1458360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:13.543618 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5e551-6297-4b0a-a58c-0c5bf1458360 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:13.543903 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5e551-6297-4b0a-a58c-0c5bf1458360 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:13.544183 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5e551-6297-4b0a-a58c-0c5bf1458360 None admin] PATH_INFO: `/v3/users` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:13.545158 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f5e551-6297-4b0a-a58c-0c5bf1458360 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:13.545521 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f5e551-6297-4b0a-a58c-0c5bf1458360 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:13.546991 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f5e551-6297-4b0a-a58c-0c5bf1458360 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:13.571575 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 459/932] 10.222.0.30 () {56 vars in 1149 bytes} [Tue Jul 5 21:09:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:13.573643 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c474c2bc-137f-485f-be92-44e9fe1a00c3 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:13.667974 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:13.680454 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c474c2bc-137f-485f-be92-44e9fe1a00c3 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:13.716124 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d8620-c262-4d50-9897-67590b74651d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:13.716928 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d8620-c262-4d50-9897-67590b74651d None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:13.717247 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d8620-c262-4d50-9897-67590b74651d None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:13.717563 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d8620-c262-4d50-9897-67590b74651d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:13.729537 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22d8620-c262-4d50-9897-67590b74651d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:13.731065 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22d8620-c262-4d50-9897-67590b74651d None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:13.749715 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-d22d8620-c262-4d50-9897-67590b74651d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:13.749715 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:13.749715 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:13.749715 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:13.749715 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:13.749715 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:13.749715 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:13.749715 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:13.749715 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:13.749715 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:13.749715 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:13.749715 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:13.749715 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:09:13.749715 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:09:13.749715 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:09:13.750752 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:09:13.750752 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:13.750752 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:13.750752 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:13.750752 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:13.750752 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:13.750752 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:13.750752 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:13.750752 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:13.750752 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:13.750752 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:13.750752 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:13.750752 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:13.750752 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:13.750752 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:13.750752 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:13.750752 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:13.751661 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:09:13.751661 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:09:13.751661 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:13.751661 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:13.755717 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 474/933] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:09:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:13.757007 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5e551-6297-4b0a-a58c-0c5bf1458360 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:13.760022 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:13.862628 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5e551-6297-4b0a-a58c-0c5bf1458360 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:13.898772 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befaa72f-d265-47e2-b8ea-21f75b39d1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:13.899443 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befaa72f-d265-47e2-b8ea-21f75b39d1ec None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:13.899815 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befaa72f-d265-47e2-b8ea-21f75b39d1ec None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:13.900255 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befaa72f-d265-47e2-b8ea-21f75b39d1ec None admin] PATH_INFO: `/v3/domains` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:13.900984 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befaa72f-d265-47e2-b8ea-21f75b39d1ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:13.901300 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befaa72f-d265-47e2-b8ea-21f75b39d1ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:13.902755 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befaa72f-d265-47e2-b8ea-21f75b39d1ec None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:13.919732 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 460/934] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:09:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:13.921333 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d8620-c262-4d50-9897-67590b74651d None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:14.030855 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d8620-c262-4d50-9897-67590b74651d None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:14.066986 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94905c2a-6d0f-474c-9ec5-60c6c1b3b97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:14.067795 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94905c2a-6d0f-474c-9ec5-60c6c1b3b97a None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:14.068080 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94905c2a-6d0f-474c-9ec5-60c6c1b3b97a None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:14.068360 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94905c2a-6d0f-474c-9ec5-60c6c1b3b97a None admin] PATH_INFO: `/v3/projects/service` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:14.075587 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94905c2a-6d0f-474c-9ec5-60c6c1b3b97a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:14.077034 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94905c2a-6d0f-474c-9ec5-60c6c1b3b97a None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:14.079681 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:14.092424 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-94905c2a-6d0f-474c-9ec5-60c6c1b3b97a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:09:14.092424 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:14.092424 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:14.092424 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:14.092424 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:14.092424 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:14.092424 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:14.092424 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:14.092424 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:14.092424 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:14.092424 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:14.092424 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:14.092424 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:09:14.092424 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:09:14.092424 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:09:14.098377 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:09:14.098377 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:14.098377 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:14.098377 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:14.098377 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:14.098377 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:14.098377 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:14.098377 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:14.098377 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:14.098377 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:14.098377 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:14.098377 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:14.098377 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:14.098377 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:14.098377 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:14.098377 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:14.098377 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:14.100875 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:09:14.100875 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:09:14.100875 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:09:14.100875 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:09:14.100875 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:09:14.100875 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:09:14.100875 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:09:14.100875 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:14.100875 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 475/935] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:09:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:14.102018 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befaa72f-d265-47e2-b8ea-21f75b39d1ec None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:14.126301 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a553244-7ce3-4d64-9736-6db46f79e9a9 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:14.131901 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a553244-7ce3-4d64-9736-6db46f79e9a9 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:14.131901 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a553244-7ce3-4d64-9736-6db46f79e9a9 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:14.131901 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 476/936] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:14.134063 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542ca91-ae80-482e-be67-f7173abee7b0 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:14.134440 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542ca91-ae80-482e-be67-f7173abee7b0 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:14.134730 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542ca91-ae80-482e-be67-f7173abee7b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:14.153055 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-7542ca91-ae80-482e-be67-f7173abee7b0 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:14.154317 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-7542ca91-ae80-482e-be67-f7173abee7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:14.174573 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:14.231491 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befaa72f-d265-47e2-b8ea-21f75b39d1ec None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:14.238472 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 477/937] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:09:14.258818 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542ca91-ae80-482e-be67-f7173abee7b0 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:14.267521 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41d609-1908-4f6a-9f1d-7d77f43f2a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:14.268697 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41d609-1908-4f6a-9f1d-7d77f43f2a17 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:14.268985 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41d609-1908-4f6a-9f1d-7d77f43f2a17 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:14.269265 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41d609-1908-4f6a-9f1d-7d77f43f2a17 None admin] PATH_INFO: `/v3/projects` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:14.270537 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed41d609-1908-4f6a-9f1d-7d77f43f2a17 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:14.270862 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed41d609-1908-4f6a-9f1d-7d77f43f2a17 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:14.272973 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed41d609-1908-4f6a-9f1d-7d77f43f2a17 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:14.294387 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 461/938] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:09:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:14.297189 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41d609-1908-4f6a-9f1d-7d77f43f2a17 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:14.395700 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542ca91-ae80-482e-be67-f7173abee7b0 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:14.412031 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41d609-1908-4f6a-9f1d-7d77f43f2a17 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:14.438708 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:14.439422 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:14.444938 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170bdfb0-439f-4f21-b6c8-f099e6e575ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:14.445606 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170bdfb0-439f-4f21-b6c8-f099e6e575ad None admin] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:14.445890 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170bdfb0-439f-4f21-b6c8-f099e6e575ad None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:14.446187 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170bdfb0-439f-4f21-b6c8-f099e6e575ad None admin] PATH_INFO: `/v3/projects` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:14.447101 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170bdfb0-439f-4f21-b6c8-f099e6e575ad None admin] RBAC: Authorizing `identity:create_project()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:14.448562 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170bdfb0-439f-4f21-b6c8-f099e6e575ad None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:14.451161 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: WARNING keystone.server.flask.common [None req-170bdfb0-439f-4f21-b6c8-f099e6e575ad None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 05 21:09:14.451464 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822e72d-915d-42bd-b64b-cad01ab237e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:14.452359 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822e72d-915d-42bd-b64b-cad01ab237e4 None admin] REQUEST_METHOD: `PUT` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:14.452646 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822e72d-915d-42bd-b64b-cad01ab237e4 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:14.453111 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822e72d-915d-42bd-b64b-cad01ab237e4 None admin] PATH_INFO: `/v3/projects/ccd95a48530c4c86a3774301b969d6a9/users/e6cf35a185bc4707a4f2f7b56662354d/roles/f3bc75c520ed4d52a97c45df41973dd0` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:14.455352 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8822e72d-915d-42bd-b64b-cad01ab237e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=ccd95a48530c4c86a3774301b969d6a9, user_id=e6cf35a185bc4707a4f2f7b56662354d, role_id=f3bc75c520ed4d52a97c45df41973dd0)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:14.456775 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8822e72d-915d-42bd-b64b-cad01ab237e4 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:14.497006 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.sql.core [None req-170bdfb0-439f-4f21-b6c8-f099e6e575ad None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 05 21:09:14.497006 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 05 21:09:14.497006 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [parameters: {'id': 'b1a3c349ac2c4642aa53a80fe4cdd39f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 05 21:09:14.497006 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=108009) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 05 21:09:14.513359 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-170bdfb0-439f-4f21-b6c8-f099e6e575ad None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b1a3c349ac2c4642aa53a80fe4cdd39f.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b1a3c349ac2c4642aa53a80fe4cdd39f. Jul 05 21:09:14.513359 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:14.513359 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 21:09:14.513359 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 21:09:14.513359 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 21:09:14.513359 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 21:09:14.513359 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 21:09:14.513359 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 21:09:14.513359 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 21:09:14.513359 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application conn.query(q) Jul 05 21:09:14.513359 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 21:09:14.513359 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 21:09:14.513359 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 21:09:14.514310 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application result.read() Jul 05 21:09:14.514310 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 21:09:14.514310 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 21:09:14.514310 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 21:09:14.514310 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 21:09:14.514310 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 21:09:14.514310 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 21:09:14.514310 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 21:09:14.514310 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 21:09:14.514310 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 05 21:09:14.514310 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:14.514310 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 05 21:09:14.514310 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:14.514310 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:14.514310 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 05 21:09:14.514310 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 05 21:09:14.514310 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 05 21:09:14.514310 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 05 21:09:14.515299 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 21:09:14.515299 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application next(self.gen) Jul 05 21:09:14.515299 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 05 21:09:14.515299 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application yield resource Jul 05 21:09:14.515299 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 21:09:14.515299 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application next(self.gen) Jul 05 21:09:14.515299 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 05 21:09:14.515299 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application self.session.rollback() Jul 05 21:09:14.515299 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 05 21:09:14.515299 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application self.force_reraise() Jul 05 21:09:14.515299 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 05 21:09:14.515299 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise self.value Jul 05 21:09:14.515299 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 05 21:09:14.515299 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 05 21:09:14.515299 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 05 21:09:14.515299 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application session.commit() Jul 05 21:09:14.515299 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 05 21:09:14.516245 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 05 21:09:14.516245 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 05 21:09:14.516245 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application self._prepare_impl() Jul 05 21:09:14.516245 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 05 21:09:14.516245 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application self.session.flush() Jul 05 21:09:14.516245 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 05 21:09:14.516245 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application self._flush(objects) Jul 05 21:09:14.516245 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 05 21:09:14.516245 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 05 21:09:14.516245 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 05 21:09:14.516245 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application compat.raise_( Jul 05 21:09:14.516245 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 21:09:14.516245 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception Jul 05 21:09:14.516245 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 05 21:09:14.516245 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application flush_context.execute() Jul 05 21:09:14.516245 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 05 21:09:14.516245 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rec.execute(self) Jul 05 21:09:14.517151 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 05 21:09:14.517151 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 05 21:09:14.517151 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 05 21:09:14.517151 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 05 21:09:14.517151 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 05 21:09:14.517151 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 05 21:09:14.517151 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 05 21:09:14.517151 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 05 21:09:14.517151 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 05 21:09:14.517151 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 05 21:09:14.517151 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 05 21:09:14.517151 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 05 21:09:14.517151 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 05 21:09:14.517151 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 05 21:09:14.517151 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 05 21:09:14.519454 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 05 21:09:14.519454 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 21:09:14.519454 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception Jul 05 21:09:14.519454 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 21:09:14.519454 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 21:09:14.519454 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 21:09:14.519454 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 21:09:14.519454 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 21:09:14.519454 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 21:09:14.519454 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 21:09:14.519454 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application conn.query(q) Jul 05 21:09:14.519454 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 21:09:14.519454 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 21:09:14.519454 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 21:09:14.519454 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application result.read() Jul 05 21:09:14.519454 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 21:09:14.519454 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 21:09:14.521552 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 21:09:14.521552 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 21:09:14.521552 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 21:09:14.521552 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 21:09:14.521552 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 21:09:14.521552 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 21:09:14.521552 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 05 21:09:14.521552 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 05 21:09:14.521552 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [parameters: {'id': 'b1a3c349ac2c4642aa53a80fe4cdd39f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 05 21:09:14.521552 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 05 21:09:14.521552 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:14.521552 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:09:14.521552 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:14.521552 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:14.521552 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 05 21:09:14.523618 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 05 21:09:14.523618 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 05 21:09:14.523618 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 05 21:09:14.523618 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 05 21:09:14.523618 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:14.523618 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:09:14.523618 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:14.523618 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:14.523618 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:14.523618 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:14.523618 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:14.523618 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:14.523618 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:14.523618 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:14.523618 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:14.523618 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:14.523618 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:14.526386 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:14.526386 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 05 21:09:14.526386 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 05 21:09:14.526386 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:14.526386 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:14.526386 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 05 21:09:14.526386 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 05 21:09:14.526386 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b1a3c349ac2c4642aa53a80fe4cdd39f. Jul 05 21:09:14.526386 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:14.526386 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 478/939] 10.222.0.30 () {60 vars in 1140 bytes} [Tue Jul 5 21:09:14 2022] POST /identity/v3/projects => generated 262 bytes in 257 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:14.526386 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99106d25-2f34-4654-a517-bba005adc5f7 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:14.526386 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99106d25-2f34-4654-a517-bba005adc5f7 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:14.528018 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99106d25-2f34-4654-a517-bba005adc5f7 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:14.528018 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 479/940] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:09:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:14.528018 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99106d25-2f34-4654-a517-bba005adc5f7 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:14.534737 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 462/941] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:09:14 2022] PUT /identity/v3/projects/ccd95a48530c4c86a3774301b969d6a9/users/e6cf35a185bc4707a4f2f7b56662354d/roles/f3bc75c520ed4d52a97c45df41973dd0 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:09:14.542932 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8041439-a39d-47a6-9071-a27414e2b8a8 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:14.543366 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8041439-a39d-47a6-9071-a27414e2b8a8 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:14.543574 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8041439-a39d-47a6-9071-a27414e2b8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:14.587132 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-b8041439-a39d-47a6-9071-a27414e2b8a8 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:14.588652 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-b8041439-a39d-47a6-9071-a27414e2b8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:14.656607 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99106d25-2f34-4654-a517-bba005adc5f7 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:14.686833 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 463/942] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:09:14.694586 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e9abad-dae2-421d-930e-c29ef78996f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:14.695403 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9abad-dae2-421d-930e-c29ef78996f3 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:14.695686 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9abad-dae2-421d-930e-c29ef78996f3 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:14.697960 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9abad-dae2-421d-930e-c29ef78996f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:14.703852 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8041439-a39d-47a6-9071-a27414e2b8a8 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:14.704965 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e9abad-dae2-421d-930e-c29ef78996f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:14.706825 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e9abad-dae2-421d-930e-c29ef78996f3 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:14.725327 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-f1e9abad-dae2-421d-930e-c29ef78996f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:09:14.725327 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:14.725327 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:14.725327 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:14.725327 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:14.725327 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:14.725327 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:14.725327 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:14.725327 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:14.725327 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:14.725327 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:14.725327 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:14.725327 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:09:14.725327 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:09:14.725327 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:09:14.726323 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:09:14.726323 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:14.726323 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:14.726323 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:14.726323 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:14.726323 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:14.726323 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:14.726323 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:14.726323 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:14.726323 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:14.726323 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:14.726323 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:14.726323 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:14.726323 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:14.726323 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:14.726323 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:14.726323 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:14.727208 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:09:14.727208 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:09:14.727208 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:09:14.727208 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:09:14.727208 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:09:14.727208 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:09:14.727208 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:09:14.727208 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:14.727208 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 480/943] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:09:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:14.735217 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e9abad-dae2-421d-930e-c29ef78996f3 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:14.787168 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:14.833121 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8041439-a39d-47a6-9071-a27414e2b8a8 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:14.854476 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e9abad-dae2-421d-930e-c29ef78996f3 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:14.854897 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:14.889825 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e234dd14-d9a6-4730-b0ec-09f10dedc03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:14.891140 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234dd14-d9a6-4730-b0ec-09f10dedc03a None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:14.891481 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a84a2-d3cb-447f-95c0-03ead38e6aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:14.891930 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234dd14-d9a6-4730-b0ec-09f10dedc03a None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:14.892149 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a84a2-d3cb-447f-95c0-03ead38e6aa9 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:14.892438 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a84a2-d3cb-447f-95c0-03ead38e6aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:14.892774 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a84a2-d3cb-447f-95c0-03ead38e6aa9 None admin] PATH_INFO: `/v3/projects` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:14.893050 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234dd14-d9a6-4730-b0ec-09f10dedc03a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:14.893538 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a84a2-d3cb-447f-95c0-03ead38e6aa9 None admin] RBAC: Adding query filter params (name=service) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:14.893899 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a84a2-d3cb-447f-95c0-03ead38e6aa9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:14.894380 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e234dd14-d9a6-4730-b0ec-09f10dedc03a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:14.896121 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a84a2-d3cb-447f-95c0-03ead38e6aa9 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:14.896360 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e234dd14-d9a6-4730-b0ec-09f10dedc03a None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:14.912111 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-e234dd14-d9a6-4730-b0ec-09f10dedc03a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:09:14.912111 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:14.912111 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:09:14.912111 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:09:14.912111 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:09:14.912111 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:09:14.912111 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:09:14.912111 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:09:14.912111 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:09:14.912111 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:09:14.912111 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:09:14.912111 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:09:14.912111 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:14.912111 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:14.912111 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:14.912111 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:14.912111 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:14.913189 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:14.913189 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:14.913189 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:14.913189 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:14.913189 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:14.913189 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:14.913189 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:09:14.913189 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:09:14.913189 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:09:14.913189 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:09:14.913189 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:14.913189 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:14.913189 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:14.913189 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:14.913189 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:14.913189 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:14.914040 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:14.914040 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:14.914040 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:14.914040 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:14.914040 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:14.914040 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:14.914040 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:14.914040 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:14.914040 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:14.914040 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:14.914040 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:09:14.914040 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:09:14.914040 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:09:14.914040 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:09:14.917042 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 464/944] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Jul 5 21:09:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:09:14.922157 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 481/945] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Jul 5 21:09:14 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:14.927930 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e234dd14-d9a6-4730-b0ec-09f10dedc03a None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:15.052534 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e234dd14-d9a6-4730-b0ec-09f10dedc03a None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:15.096280 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be6e49-058f-4f07-81f6-f96c996db891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:15.096969 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be6e49-058f-4f07-81f6-f96c996db891 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:15.097260 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be6e49-058f-4f07-81f6-f96c996db891 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:15.097546 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be6e49-058f-4f07-81f6-f96c996db891 None admin] PATH_INFO: `/v3/services` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:15.098332 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be6e49-058f-4f07-81f6-f96c996db891 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:15.098654 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be6e49-058f-4f07-81f6-f96c996db891 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:15.100045 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be6e49-058f-4f07-81f6-f96c996db891 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:15.106902 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 465/946] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Jul 5 21:09:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:15.112286 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a84a2-d3cb-447f-95c0-03ead38e6aa9 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:15.224241 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a84a2-d3cb-447f-95c0-03ead38e6aa9 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:15.232864 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:15.262862 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796cd2b-4987-4d04-b993-21fccad1461d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:15.263636 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796cd2b-4987-4d04-b993-21fccad1461d None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:15.263820 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796cd2b-4987-4d04-b993-21fccad1461d None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:15.264104 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796cd2b-4987-4d04-b993-21fccad1461d None admin] PATH_INFO: `/v3/services` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:15.264828 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c796cd2b-4987-4d04-b993-21fccad1461d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:15.265144 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c796cd2b-4987-4d04-b993-21fccad1461d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:15.266622 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c796cd2b-4987-4d04-b993-21fccad1461d None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:15.272227 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 482/947] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Jul 5 21:09:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:15.279251 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be6e49-058f-4f07-81f6-f96c996db891 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:15.334351 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:15.345208 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55861924-fec2-49e3-8d05-054a98a34c9e None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:15.345508 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55861924-fec2-49e3-8d05-054a98a34c9e None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:15.345791 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55861924-fec2-49e3-8d05-054a98a34c9e None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:15.350945 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 483/948] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:09:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:15.353278 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b55d89-5bad-4943-b7a4-7cf1dd39e3e1 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:15.353608 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b55d89-5bad-4943-b7a4-7cf1dd39e3e1 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:15.353934 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b55d89-5bad-4943-b7a4-7cf1dd39e3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:15.371722 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-d3b55d89-5bad-4943-b7a4-7cf1dd39e3e1 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:15.373193 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-d3b55d89-5bad-4943-b7a4-7cf1dd39e3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:15.406928 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be6e49-058f-4f07-81f6-f96c996db891 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:15.444320 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f2c888-b0af-4bd4-ac6d-60317c0ad252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:15.444917 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2c888-b0af-4bd4-ac6d-60317c0ad252 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:15.445207 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2c888-b0af-4bd4-ac6d-60317c0ad252 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:15.445491 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2c888-b0af-4bd4-ac6d-60317c0ad252 None admin] PATH_INFO: `/v3/endpoints` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:15.446314 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f2c888-b0af-4bd4-ac6d-60317c0ad252 None admin] RBAC: Adding query filter params (interface=public, service_id=ac03c3512493489f9de8e83fd01643d7, region_id=RegionOne) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:15.446692 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f2c888-b0af-4bd4-ac6d-60317c0ad252 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:15.448072 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f2c888-b0af-4bd4-ac6d-60317c0ad252 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:15.462186 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 466/949] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Jul 5 21:09:15 2022] GET /identity/v3/endpoints?service_id=ac03c3512493489f9de8e83fd01643d7&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:15.462400 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 484/950] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:09:15.463923 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f2c888-b0af-4bd4-ac6d-60317c0ad252 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:15.487393 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b55d89-5bad-4943-b7a4-7cf1dd39e3e1 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:15.588740 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b55d89-5bad-4943-b7a4-7cf1dd39e3e1 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:15.590488 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:15.592806 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f2c888-b0af-4bd4-ac6d-60317c0ad252 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:15.596099 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:15.629743 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94222c77-6215-4ca7-9155-5535a0442cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:15.630385 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94222c77-6215-4ca7-9155-5535a0442cbd None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:15.630676 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94222c77-6215-4ca7-9155-5535a0442cbd None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:15.631017 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94222c77-6215-4ca7-9155-5535a0442cbd None admin] PATH_INFO: `/v3/services` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:15.631707 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94222c77-6215-4ca7-9155-5535a0442cbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:15.633346 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94222c77-6215-4ca7-9155-5535a0442cbd None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:15.633867 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa4e96-4c39-47e7-b7fb-84e32caf4f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:15.636160 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa4e96-4c39-47e7-b7fb-84e32caf4f39 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:15.636617 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa4e96-4c39-47e7-b7fb-84e32caf4f39 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:15.637101 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa4e96-4c39-47e7-b7fb-84e32caf4f39 None admin] PATH_INFO: `/v3/services/compute` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:15.638215 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa4e96-4c39-47e7-b7fb-84e32caf4f39 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:15.639752 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa4e96-4c39-47e7-b7fb-84e32caf4f39 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:15.646505 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 467/951] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Jul 5 21:09:15 2022] GET /identity/v3/services => generated 1497 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:09:15.658331 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-91fa4e96-4c39-47e7-b7fb-84e32caf4f39 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 21:09:15.658331 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:15.658331 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:09:15.658331 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:09:15.658331 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:09:15.658331 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:09:15.658331 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:09:15.658331 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:09:15.658331 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 21:09:15.658331 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:15.658331 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:09:15.658331 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:15.658331 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:15.658331 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:15.658331 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:15.658331 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:15.658331 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:15.659510 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:15.659510 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:15.659510 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:15.659510 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:15.659510 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:15.659510 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:15.659510 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:09:15.659510 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:09:15.659510 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:09:15.659510 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:09:15.659510 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:15.659510 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:15.659510 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:15.659510 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:15.659510 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:15.659510 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:15.660400 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:15.660400 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:15.660400 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:15.660400 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:15.660400 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:15.660400 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:15.660400 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:15.660400 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:15.660400 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:15.660400 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:15.660400 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:09:15.660400 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:09:15.660400 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 21:09:15.660400 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:15.660400 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 485/952] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:09:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:09:15.671335 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94222c77-6215-4ca7-9155-5535a0442cbd None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:15.789469 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94222c77-6215-4ca7-9155-5535a0442cbd None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:15.826330 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f1ac60-e99d-461b-85f2-ee684d6b2904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:15.827363 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1ac60-e99d-461b-85f2-ee684d6b2904 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:15.827869 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1ac60-e99d-461b-85f2-ee684d6b2904 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:15.828462 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1ac60-e99d-461b-85f2-ee684d6b2904 None admin] PATH_INFO: `/v3/services` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:15.829374 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f1ac60-e99d-461b-85f2-ee684d6b2904 None admin] RBAC: Adding query filter params (name=compute) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:15.829883 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f1ac60-e99d-461b-85f2-ee684d6b2904 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:15.831496 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f1ac60-e99d-461b-85f2-ee684d6b2904 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:15.837111 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 468/953] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Jul 5 21:09:15 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:15.843686 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa4e96-4c39-47e7-b7fb-84e32caf4f39 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:15.950085 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa4e96-4c39-47e7-b7fb-84e32caf4f39 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:15.984459 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613edfe-ef1f-4d8d-9c0e-49ecb7b6035a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:15.985468 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613edfe-ef1f-4d8d-9c0e-49ecb7b6035a None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:15.985953 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613edfe-ef1f-4d8d-9c0e-49ecb7b6035a None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:15.986482 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613edfe-ef1f-4d8d-9c0e-49ecb7b6035a None admin] PATH_INFO: `/v3/services` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:15.987384 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613edfe-ef1f-4d8d-9c0e-49ecb7b6035a None admin] RBAC: Adding query filter params (type=compute) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:15.987905 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613edfe-ef1f-4d8d-9c0e-49ecb7b6035a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:15.989478 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613edfe-ef1f-4d8d-9c0e-49ecb7b6035a None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:15.995562 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 486/954] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Jul 5 21:09:15 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:16.767237 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931753b-646b-4014-bf2c-b747fb44f692 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:16.767776 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931753b-646b-4014-bf2c-b747fb44f692 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:16.767864 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931753b-646b-4014-bf2c-b747fb44f692 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:16.769432 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 469/955] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:16.774662 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591831dd-35f1-44f8-bf7d-d185287cf4c0 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:16.775725 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591831dd-35f1-44f8-bf7d-d185287cf4c0 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:16.776027 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591831dd-35f1-44f8-bf7d-d185287cf4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:16.793930 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-591831dd-35f1-44f8-bf7d-d185287cf4c0 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:16.795193 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-591831dd-35f1-44f8-bf7d-d185287cf4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:16.821827 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:16.866124 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 487/956] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:09:16.890927 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931753b-646b-4014-bf2c-b747fb44f692 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:16.924262 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:17.000392 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931753b-646b-4014-bf2c-b747fb44f692 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:17.034894 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978381b2-46d6-442c-8f59-df53fd035682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:17.035639 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978381b2-46d6-442c-8f59-df53fd035682 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:17.035927 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978381b2-46d6-442c-8f59-df53fd035682 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:17.036206 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978381b2-46d6-442c-8f59-df53fd035682 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:17.047456 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978381b2-46d6-442c-8f59-df53fd035682 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:17.055704 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-978381b2-46d6-442c-8f59-df53fd035682 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 21:09:17.055704 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:17.055704 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:17.055704 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:17.055704 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:17.055704 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:17.055704 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:17.055704 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:17.055704 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:17.055704 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:17.055704 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:17.055704 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:17.055704 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:17.055704 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:17.055704 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:17.055704 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:17.057472 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:17.057472 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:17.057472 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:17.057472 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:17.057472 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:17.057472 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:17.057472 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:17.057472 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:17.057472 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:17.057472 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:17.057472 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:17.057472 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:17.057472 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:17.057472 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:17.057472 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:17.057472 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:17.058948 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:17.058948 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:17.058948 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:17.058948 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:17.058948 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:17.058948 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:17.058948 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:17.058948 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:17.058948 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:17.058948 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:17.058948 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 21:09:17.058948 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:09:17.058948 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 470/957] 10.222.0.30 () {56 vars in 1120 bytes} [Tue Jul 5 21:09:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:17.067397 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591831dd-35f1-44f8-bf7d-d185287cf4c0 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:17.132732 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25315e4-18f3-4e7d-8ef5-c8522137ef2c None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:17.133084 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25315e4-18f3-4e7d-8ef5-c8522137ef2c None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:17.133312 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25315e4-18f3-4e7d-8ef5-c8522137ef2c None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:17.135059 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 471/958] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:17.140570 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4fb73-c6d9-4d50-9cfc-615757020cd1 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:17.140919 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4fb73-c6d9-4d50-9cfc-615757020cd1 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:17.141210 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4fb73-c6d9-4d50-9cfc-615757020cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:17.159295 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-d9d4fb73-c6d9-4d50-9cfc-615757020cd1 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:17.160497 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-d9d4fb73-c6d9-4d50-9cfc-615757020cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:17.186737 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591831dd-35f1-44f8-bf7d-d185287cf4c0 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:17.230772 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb654f-5d50-443d-bfc3-eff25b63ce36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:17.231459 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb654f-5d50-443d-bfc3-eff25b63ce36 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:17.231749 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb654f-5d50-443d-bfc3-eff25b63ce36 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:17.232032 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb654f-5d50-443d-bfc3-eff25b63ce36 None admin] PATH_INFO: `/v3/roles` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:17.232794 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bb654f-5d50-443d-bfc3-eff25b63ce36 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:17.233381 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bb654f-5d50-443d-bfc3-eff25b63ce36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:17.234887 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bb654f-5d50-443d-bfc3-eff25b63ce36 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:17.235515 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 472/959] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:09:17.250470 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 488/960] 10.222.0.30 () {56 vars in 1115 bytes} [Tue Jul 5 21:09:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:17.258194 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d4fb73-c6d9-4d50-9cfc-615757020cd1 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:17.262358 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb654f-5d50-443d-bfc3-eff25b63ce36 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:17.284519 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:17.288695 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:17.377699 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d4fb73-c6d9-4d50-9cfc-615757020cd1 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:17.378429 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb654f-5d50-443d-bfc3-eff25b63ce36 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:17.413872 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e098ec09-ce13-4dd2-97b2-bbc3c11633b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:17.415104 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098ec09-ce13-4dd2-97b2-bbc3c11633b3 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:17.416047 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098ec09-ce13-4dd2-97b2-bbc3c11633b3 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:17.416187 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6609ab3a-309d-40ee-a075-f9ff0812c328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:17.416607 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098ec09-ce13-4dd2-97b2-bbc3c11633b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:17.417019 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609ab3a-309d-40ee-a075-f9ff0812c328 None admin] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:17.417413 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609ab3a-309d-40ee-a075-f9ff0812c328 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:17.417831 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609ab3a-309d-40ee-a075-f9ff0812c328 None admin] PATH_INFO: `/v3/users` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:17.418670 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6609ab3a-309d-40ee-a075-f9ff0812c328 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:17.420358 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6609ab3a-309d-40ee-a075-f9ff0812c328 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:17.428286 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e098ec09-ce13-4dd2-97b2-bbc3c11633b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:17.429920 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e098ec09-ce13-4dd2-97b2-bbc3c11633b3 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:17.449044 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-e098ec09-ce13-4dd2-97b2-bbc3c11633b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:17.449044 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:17.449044 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:17.449044 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:17.449044 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:17.449044 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:17.449044 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:17.449044 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:17.449044 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:17.449044 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:17.449044 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:17.449044 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:17.449044 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:09:17.449044 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:09:17.449044 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:09:17.450008 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:09:17.450008 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:17.450008 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:17.450008 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:17.450008 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:17.450008 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:17.450008 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:17.450008 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:17.450008 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:17.450008 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:17.450008 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:17.450008 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:17.450008 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:17.450008 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:17.450008 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:17.450008 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:17.450008 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:17.451313 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:09:17.451313 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:09:17.451313 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:17.451313 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:09:17.451948 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 473/961] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:09:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:17.455668 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e098ec09-ce13-4dd2-97b2-bbc3c11633b3 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:17.492139 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.sql.core [None req-6609ab3a-309d-40ee-a075-f9ff0812c328 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 05 21:09:17.492139 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 05 21:09:17.492139 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [parameters: {'user_id': 'dfbbef7b22f341be8734f4645ff39560', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 05 21:09:17.492139 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=108009) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 05 21:09:17.499691 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-6609ab3a-309d-40ee-a075-f9ff0812c328 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 05 21:09:17.499691 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:17.499691 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 21:09:17.499691 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 21:09:17.499691 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 21:09:17.499691 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 21:09:17.499691 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 21:09:17.499691 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 21:09:17.499691 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 21:09:17.499691 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application conn.query(q) Jul 05 21:09:17.499691 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 21:09:17.499691 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 21:09:17.499691 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 21:09:17.499691 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application result.read() Jul 05 21:09:17.499691 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 21:09:17.500637 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 21:09:17.500637 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 21:09:17.500637 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 21:09:17.500637 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 21:09:17.500637 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 21:09:17.500637 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 21:09:17.500637 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 21:09:17.500637 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 05 21:09:17.500637 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:17.500637 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 05 21:09:17.500637 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:17.500637 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:17.500637 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 05 21:09:17.500637 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 05 21:09:17.500637 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 05 21:09:17.500637 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 05 21:09:17.500637 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 21:09:17.500637 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application next(self.gen) Jul 05 21:09:17.501611 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 05 21:09:17.501611 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application yield resource Jul 05 21:09:17.501611 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 21:09:17.501611 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application next(self.gen) Jul 05 21:09:17.501611 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 05 21:09:17.501611 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application self.session.rollback() Jul 05 21:09:17.501611 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 05 21:09:17.501611 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application self.force_reraise() Jul 05 21:09:17.501611 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 05 21:09:17.501611 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise self.value Jul 05 21:09:17.501611 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 05 21:09:17.501611 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 05 21:09:17.501611 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 05 21:09:17.501611 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application session.commit() Jul 05 21:09:17.501611 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 05 21:09:17.501611 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 05 21:09:17.501611 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 05 21:09:17.502589 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application self._prepare_impl() Jul 05 21:09:17.502589 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 05 21:09:17.502589 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application self.session.flush() Jul 05 21:09:17.502589 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 05 21:09:17.502589 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application self._flush(objects) Jul 05 21:09:17.502589 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 05 21:09:17.502589 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 05 21:09:17.502589 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 05 21:09:17.502589 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application compat.raise_( Jul 05 21:09:17.502589 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 21:09:17.502589 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception Jul 05 21:09:17.502589 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 05 21:09:17.502589 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application flush_context.execute() Jul 05 21:09:17.502589 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 05 21:09:17.502589 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rec.execute(self) Jul 05 21:09:17.502589 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 05 21:09:17.502589 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 05 21:09:17.503528 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 05 21:09:17.503528 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 05 21:09:17.503528 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 05 21:09:17.503528 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 05 21:09:17.503528 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 05 21:09:17.503528 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 05 21:09:17.503528 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 05 21:09:17.503528 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 05 21:09:17.503528 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 05 21:09:17.503528 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 05 21:09:17.503528 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 05 21:09:17.503528 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 05 21:09:17.503528 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 05 21:09:17.503528 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 05 21:09:17.503528 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 21:09:17.503528 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception Jul 05 21:09:17.504399 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 21:09:17.504399 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 21:09:17.504399 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 21:09:17.504399 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 21:09:17.504399 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 21:09:17.504399 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 21:09:17.504399 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 21:09:17.504399 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application conn.query(q) Jul 05 21:09:17.504399 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 21:09:17.504399 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 21:09:17.504399 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 21:09:17.504399 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application result.read() Jul 05 21:09:17.504399 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 21:09:17.504399 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 21:09:17.504399 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 21:09:17.504399 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 21:09:17.507305 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 21:09:17.507305 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 21:09:17.507305 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 21:09:17.507305 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 21:09:17.507305 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 05 21:09:17.507305 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 05 21:09:17.507305 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [parameters: {'user_id': 'dfbbef7b22f341be8734f4645ff39560', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 05 21:09:17.507305 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 05 21:09:17.507305 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:17.507305 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:09:17.507305 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:17.507305 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:17.507305 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:17.507305 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:17.507305 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:17.509770 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:17.509770 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:17.509770 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:17.509770 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:17.509770 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:17.509770 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:17.509770 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:17.509770 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 05 21:09:17.509770 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 05 21:09:17.509770 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:17.509770 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:17.509770 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:09:17.509770 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:09:17.509770 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:09:17.509770 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:09:17.509770 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 05 21:09:17.509770 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 05 21:09:17.513273 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 05 21:09:17.513273 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 05 21:09:17.513273 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 05 21:09:17.513273 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 05 21:09:17.513273 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 05 21:09:17.513273 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:17.513273 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 489/962] 10.222.0.30 () {60 vars in 1131 bytes} [Tue Jul 5 21:09:17 2022] POST /identity/v3/users => generated 160 bytes in 244 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:09:17.513273 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6609ab3a-309d-40ee-a075-f9ff0812c328 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:17.559637 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:17.585599 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e098ec09-ce13-4dd2-97b2-bbc3c11633b3 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:17.610623 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:17.624333 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e70e3d-e65e-4bac-932e-cff9ce5a4623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:17.625010 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e70e3d-e65e-4bac-932e-cff9ce5a4623 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:17.625296 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e70e3d-e65e-4bac-932e-cff9ce5a4623 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:17.625577 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e70e3d-e65e-4bac-932e-cff9ce5a4623 None admin] PATH_INFO: `/v3/domains` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:17.626338 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e70e3d-e65e-4bac-932e-cff9ce5a4623 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:17.626649 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e70e3d-e65e-4bac-932e-cff9ce5a4623 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:17.628017 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e70e3d-e65e-4bac-932e-cff9ce5a4623 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:17.636589 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6609ab3a-309d-40ee-a075-f9ff0812c328 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:17.650732 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 474/963] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:17.653741 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e70e3d-e65e-4bac-932e-cff9ce5a4623 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:17.703573 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e3db8-1a57-41f3-8d1b-2c8a963c82ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:17.705353 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e3db8-1a57-41f3-8d1b-2c8a963c82ea None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:17.706100 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e3db8-1a57-41f3-8d1b-2c8a963c82ea None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:17.706918 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e3db8-1a57-41f3-8d1b-2c8a963c82ea None admin] PATH_INFO: `/v3/users/cinder` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:17.721076 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7e3db8-1a57-41f3-8d1b-2c8a963c82ea None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:17.724364 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7e3db8-1a57-41f3-8d1b-2c8a963c82ea None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:17.753343 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-8f7e3db8-1a57-41f3-8d1b-2c8a963c82ea None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 21:09:17.753343 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:17.753343 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:17.753343 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:17.753343 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:17.753343 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:17.753343 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:17.753343 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:17.753343 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:17.753343 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:17.753343 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:17.753343 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:17.753343 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:09:17.753343 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:09:17.753343 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:09:17.753343 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:09:17.755476 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:17.755476 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:17.755476 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:09:17.755476 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:09:17.755476 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:09:17.755476 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:09:17.755476 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:17.755476 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:17.755476 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:17.755476 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:17.755476 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:17.755476 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:17.755476 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:17.755476 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:17.755476 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:17.755476 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:17.755476 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:17.755476 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:17.757353 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:17.757353 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:17.757353 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:09:17.757353 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:09:17.757353 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:09:17.757353 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:09:17.757353 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:09:17.757353 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:09:17.757353 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 21:09:17.757353 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:17.761755 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 490/964] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:09:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:17.767617 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e3db8-1a57-41f3-8d1b-2c8a963c82ea None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:17.819590 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e70e3d-e65e-4bac-932e-cff9ce5a4623 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:17.857334 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e341eead-cdeb-42ca-baf9-69182de5f3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:17.858185 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341eead-cdeb-42ca-baf9-69182de5f3e2 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:17.858504 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341eead-cdeb-42ca-baf9-69182de5f3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:17.858757 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341eead-cdeb-42ca-baf9-69182de5f3e2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:17.861056 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:17.867352 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e341eead-cdeb-42ca-baf9-69182de5f3e2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:17.868846 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e341eead-cdeb-42ca-baf9-69182de5f3e2 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:17.875749 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e3db8-1a57-41f3-8d1b-2c8a963c82ea None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:17.883557 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-e341eead-cdeb-42ca-baf9-69182de5f3e2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 21:09:17.883557 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:17.883557 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:17.883557 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:17.883557 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:17.883557 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:17.883557 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:17.883557 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:17.883557 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:17.883557 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:17.883557 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:17.883557 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:17.883557 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:09:17.883557 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:09:17.883557 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:09:17.883557 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:09:17.891095 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:17.891095 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:17.891095 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:09:17.891095 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:09:17.891095 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:09:17.891095 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:09:17.891095 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:17.891095 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:17.891095 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:17.891095 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:17.891095 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:17.891095 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:17.891095 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:17.891095 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:17.891095 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:17.891095 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:17.891095 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:17.891095 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:17.892779 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:17.892779 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:17.892779 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:09:17.892779 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:09:17.892779 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:09:17.892779 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:09:17.892779 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:09:17.892779 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:09:17.892779 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 21:09:17.892779 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:09:17.892779 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 475/965] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Jul 5 21:09:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:09:17.892779 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b918b5-ee82-479a-bf2b-49b30c9470da None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:17.892779 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b918b5-ee82-479a-bf2b-49b30c9470da None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:17.893696 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b918b5-ee82-479a-bf2b-49b30c9470da None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:17.893696 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 476/966] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:09:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:17.893696 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b918b5-ee82-479a-bf2b-49b30c9470da None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:17.922638 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3163062-b5ed-4861-897c-90307a7a47ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:17.923623 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3163062-b5ed-4861-897c-90307a7a47ad None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:17.924049 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3163062-b5ed-4861-897c-90307a7a47ad None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:17.924459 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3163062-b5ed-4861-897c-90307a7a47ad None admin] PATH_INFO: `/v3/users` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:17.925276 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3163062-b5ed-4861-897c-90307a7a47ad None admin] RBAC: Adding query filter params (name=cinder) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:17.925590 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3163062-b5ed-4861-897c-90307a7a47ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:17.927057 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3163062-b5ed-4861-897c-90307a7a47ad None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:17.969194 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:17.986166 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 491/967] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:09:17 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:17.986166 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d64cf-064e-462d-bffd-70715709393e None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:17.986166 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d64cf-064e-462d-bffd-70715709393e None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:17.986166 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d64cf-064e-462d-bffd-70715709393e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:18.004269 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b918b5-ee82-479a-bf2b-49b30c9470da None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:18.009697 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-fd4d64cf-064e-462d-bffd-70715709393e None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:18.011407 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-fd4d64cf-064e-462d-bffd-70715709393e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:18.053096 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075bcde-46fa-4874-a3e0-fde087271f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:18.053797 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075bcde-46fa-4874-a3e0-fde087271f20 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:18.054091 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075bcde-46fa-4874-a3e0-fde087271f20 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:18.054403 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075bcde-46fa-4874-a3e0-fde087271f20 None admin] PATH_INFO: `/v3/users` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:18.055264 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1075bcde-46fa-4874-a3e0-fde087271f20 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:18.055586 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1075bcde-46fa-4874-a3e0-fde087271f20 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:18.057838 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1075bcde-46fa-4874-a3e0-fde087271f20 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:18.086304 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 477/968] 10.222.0.30 () {56 vars in 1149 bytes} [Tue Jul 5 21:09:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:18.087946 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075bcde-46fa-4874-a3e0-fde087271f20 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:18.095060 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 492/969] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:09:18.096546 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7c524-dfc8-4964-bc6a-6fe8abe7dcd3 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:18.096913 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7c524-dfc8-4964-bc6a-6fe8abe7dcd3 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:18.097271 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7c524-dfc8-4964-bc6a-6fe8abe7dcd3 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:18.099687 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 493/970] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:09:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:18.115966 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93c0a1-4da9-4aa5-ace1-e3c00da3b196 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:18.116398 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93c0a1-4da9-4aa5-ace1-e3c00da3b196 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:18.116806 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93c0a1-4da9-4aa5-ace1-e3c00da3b196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:18.135516 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-0a93c0a1-4da9-4aa5-ace1-e3c00da3b196 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:18.136854 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-0a93c0a1-4da9-4aa5-ace1-e3c00da3b196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:18.164692 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:18.220660 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 494/971] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:09:18.220660 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a93c0a1-4da9-4aa5-ace1-e3c00da3b196 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:18.223254 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075bcde-46fa-4874-a3e0-fde087271f20 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:18.258637 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31da31b-a5d3-4d51-a253-c684cc3319ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:18.259321 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31da31b-a5d3-4d51-a253-c684cc3319ff None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:18.259607 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31da31b-a5d3-4d51-a253-c684cc3319ff None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:18.259886 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31da31b-a5d3-4d51-a253-c684cc3319ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:18.286030 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:18.328249 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31da31b-a5d3-4d51-a253-c684cc3319ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:18.328444 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a93c0a1-4da9-4aa5-ace1-e3c00da3b196 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:18.329712 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31da31b-a5d3-4d51-a253-c684cc3319ff None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:18.361643 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f733fc-cf13-4357-b1ef-aa1a2e51271f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:18.362409 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f733fc-cf13-4357-b1ef-aa1a2e51271f None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:18.362699 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f733fc-cf13-4357-b1ef-aa1a2e51271f None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:18.362977 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f733fc-cf13-4357-b1ef-aa1a2e51271f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:18.363632 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f733fc-cf13-4357-b1ef-aa1a2e51271f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:18.364998 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f733fc-cf13-4357-b1ef-aa1a2e51271f None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:18.377290 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-a9f733fc-cf13-4357-b1ef-aa1a2e51271f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:09:18.377290 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:18.377290 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:09:18.377290 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:09:18.377290 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:09:18.377290 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:09:18.377290 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:09:18.377290 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:09:18.377290 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:09:18.377290 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:18.377290 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:09:18.377290 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:18.377290 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:18.377290 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:18.377290 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:18.377290 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:18.377290 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:18.378518 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:18.378518 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:18.378518 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:18.378518 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:18.378518 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:18.378518 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:18.378518 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:09:18.378518 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:09:18.378518 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:09:18.378518 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:09:18.378518 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:18.378518 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:18.378518 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:18.378518 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:18.378518 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:18.378518 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:18.379376 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:18.379376 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:18.379376 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:18.379376 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:18.379376 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:18.379376 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:18.379376 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:18.379376 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:18.379376 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:18.379376 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:18.379376 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:09:18.379376 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:09:18.379376 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:09:18.379376 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:18.379376 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 495/972] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Jul 5 21:09:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:18.380202 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f733fc-cf13-4357-b1ef-aa1a2e51271f None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:18.380670 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:18.432567 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 478/973] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:09:18 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 05 21:09:18.433400 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31da31b-a5d3-4d51-a253-c684cc3319ff None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:18.484796 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f733fc-cf13-4357-b1ef-aa1a2e51271f None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:18.510499 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:18.520831 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e1f93-01af-48fc-a5ba-be5c94e12f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:18.521508 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e1f93-01af-48fc-a5ba-be5c94e12f49 None admin] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:18.521794 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e1f93-01af-48fc-a5ba-be5c94e12f49 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:18.522075 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e1f93-01af-48fc-a5ba-be5c94e12f49 None admin] PATH_INFO: `/v3/services` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:18.522826 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e1f93-01af-48fc-a5ba-be5c94e12f49 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:18.524201 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e1f93-01af-48fc-a5ba-be5c94e12f49 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:18.532022 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31da31b-a5d3-4d51-a253-c684cc3319ff None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:18.566359 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac06df-2642-4998-90b7-1d07f4a6fdfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:18.567028 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac06df-2642-4998-90b7-1d07f4a6fdfe None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:18.567318 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac06df-2642-4998-90b7-1d07f4a6fdfe None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:18.567599 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac06df-2642-4998-90b7-1d07f4a6fdfe None admin] PATH_INFO: `/v3/services` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:18.568305 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac06df-2642-4998-90b7-1d07f4a6fdfe None admin] RBAC: Adding query filter params (name=object-store) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:18.568621 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac06df-2642-4998-90b7-1d07f4a6fdfe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:18.570107 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac06df-2642-4998-90b7-1d07f4a6fdfe None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:18.575428 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 479/974] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Jul 5 21:09:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:18.576443 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac06df-2642-4998-90b7-1d07f4a6fdfe None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:18.594743 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:18.617524 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 496/975] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Jul 5 21:09:18 2022] POST /identity/v3/services => generated 242 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:09:18.618937 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e1f93-01af-48fc-a5ba-be5c94e12f49 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:18.689200 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac06df-2642-4998-90b7-1d07f4a6fdfe None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:18.734896 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52105cdc-6b9c-406e-a0e7-01928d0d0e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:18.735718 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52105cdc-6b9c-406e-a0e7-01928d0d0e46 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:18.736009 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52105cdc-6b9c-406e-a0e7-01928d0d0e46 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:18.736475 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52105cdc-6b9c-406e-a0e7-01928d0d0e46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:18.738031 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e1f93-01af-48fc-a5ba-be5c94e12f49 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:18.750100 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52105cdc-6b9c-406e-a0e7-01928d0d0e46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:18.751954 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52105cdc-6b9c-406e-a0e7-01928d0d0e46 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:18.771206 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-52105cdc-6b9c-406e-a0e7-01928d0d0e46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:18.771206 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:18.771206 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:18.771206 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:18.771206 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:18.771206 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:18.771206 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:18.771206 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:18.771206 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:18.771206 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:18.771206 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:18.771206 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:18.771206 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:09:18.771206 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:09:18.771206 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:09:18.772240 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:09:18.772240 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:18.772240 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:18.772240 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:18.772240 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:18.772240 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:18.772240 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:18.772240 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:18.772240 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:18.772240 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:18.772240 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:18.772240 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:18.772240 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:18.772240 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:18.772240 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:18.772240 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:18.772240 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:18.773518 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:09:18.773518 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:09:18.773518 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:18.773518 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:09:18.773518 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 480/976] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:09:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:18.778052 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52105cdc-6b9c-406e-a0e7-01928d0d0e46 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:18.778981 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa3c45-61a6-468b-b3a8-6ed3e718c29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:18.779671 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa3c45-61a6-468b-b3a8-6ed3e718c29c None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:18.779960 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa3c45-61a6-468b-b3a8-6ed3e718c29c None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:18.780245 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa3c45-61a6-468b-b3a8-6ed3e718c29c None admin] PATH_INFO: `/v3/services` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:18.780970 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aa3c45-61a6-468b-b3a8-6ed3e718c29c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:18.781283 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aa3c45-61a6-468b-b3a8-6ed3e718c29c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:18.783009 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aa3c45-61a6-468b-b3a8-6ed3e718c29c None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:18.788340 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 497/977] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Jul 5 21:09:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:18.794158 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa3c45-61a6-468b-b3a8-6ed3e718c29c None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:18.843685 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:18.851945 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:18.893313 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52105cdc-6b9c-406e-a0e7-01928d0d0e46 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:18.898366 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa3c45-61a6-468b-b3a8-6ed3e718c29c None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:18.933006 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bbc510-fca4-4b82-a7fb-ef3cf9fb53f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:18.933843 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbc510-fca4-4b82-a7fb-ef3cf9fb53f0 None admin] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:18.934238 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbc510-fca4-4b82-a7fb-ef3cf9fb53f0 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:18.934595 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbc510-fca4-4b82-a7fb-ef3cf9fb53f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:18.934733 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0321edd-1b10-489f-8974-8bec36dfea73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:18.935544 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0321edd-1b10-489f-8974-8bec36dfea73 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:18.935662 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bbc510-fca4-4b82-a7fb-ef3cf9fb53f0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:18.936133 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0321edd-1b10-489f-8974-8bec36dfea73 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:18.936418 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0321edd-1b10-489f-8974-8bec36dfea73 None admin] PATH_INFO: `/v3/domains` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:18.937151 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0321edd-1b10-489f-8974-8bec36dfea73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:18.937465 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0321edd-1b10-489f-8974-8bec36dfea73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:18.938340 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bbc510-fca4-4b82-a7fb-ef3cf9fb53f0 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:18.938860 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0321edd-1b10-489f-8974-8bec36dfea73 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:18.952059 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 481/978] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:09:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:18.957787 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0321edd-1b10-489f-8974-8bec36dfea73 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:19.022163 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 498/979] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Jul 5 21:09:18 2022] POST /identity/v3/endpoints => generated 349 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:09:19.075467 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0321edd-1b10-489f-8974-8bec36dfea73 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:19.101383 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:19.120241 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15012bfe-a4ad-44ef-86c9-65cb66d00afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:19.121070 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15012bfe-a4ad-44ef-86c9-65cb66d00afa None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:19.121354 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15012bfe-a4ad-44ef-86c9-65cb66d00afa None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:19.121631 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15012bfe-a4ad-44ef-86c9-65cb66d00afa None admin] PATH_INFO: `/v3/projects/service` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:19.129234 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15012bfe-a4ad-44ef-86c9-65cb66d00afa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:19.130751 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15012bfe-a4ad-44ef-86c9-65cb66d00afa None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:19.146313 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-15012bfe-a4ad-44ef-86c9-65cb66d00afa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:09:19.146313 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:19.146313 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:19.146313 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:19.146313 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:19.146313 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:19.146313 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:19.146313 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:19.146313 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:19.146313 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:19.146313 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:19.146313 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:19.146313 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:09:19.146313 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:09:19.146313 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:09:19.147400 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:09:19.147400 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:19.147400 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:19.147400 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:19.147400 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:19.147400 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:19.147400 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:19.147400 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:19.147400 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:19.147400 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:19.147400 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:19.147400 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:19.147400 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:19.147400 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:19.147400 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:19.147400 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:19.147400 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:19.148415 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:09:19.148415 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:09:19.148415 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:09:19.148415 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:09:19.148415 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:09:19.148415 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:09:19.148415 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:09:19.148415 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:09:19.152994 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 482/980] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:09:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:09:19.154446 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bbc510-fca4-4b82-a7fb-ef3cf9fb53f0 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:19.260382 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:19.263903 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bbc510-fca4-4b82-a7fb-ef3cf9fb53f0 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:19.299228 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1499a50-b152-4914-97fc-67ada2cc7d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:19.299898 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1499a50-b152-4914-97fc-67ada2cc7d50 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:19.300184 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1499a50-b152-4914-97fc-67ada2cc7d50 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:19.300471 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1499a50-b152-4914-97fc-67ada2cc7d50 None admin] PATH_INFO: `/v3/projects` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:19.302159 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1499a50-b152-4914-97fc-67ada2cc7d50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:19.302159 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1499a50-b152-4914-97fc-67ada2cc7d50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:19.304112 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1499a50-b152-4914-97fc-67ada2cc7d50 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:19.320109 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 499/981] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:09:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:19.326052 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15012bfe-a4ad-44ef-86c9-65cb66d00afa None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:19.428204 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15012bfe-a4ad-44ef-86c9-65cb66d00afa None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:19.461618 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17062b2c-faf6-43b2-98c3-0c02052759cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:19.462919 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17062b2c-faf6-43b2-98c3-0c02052759cb None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:19.463253 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17062b2c-faf6-43b2-98c3-0c02052759cb None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:19.463563 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17062b2c-faf6-43b2-98c3-0c02052759cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:19.464626 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17062b2c-faf6-43b2-98c3-0c02052759cb None admin] RBAC: Adding query filter params (role.id=f3bc75c520ed4d52a97c45df41973dd0, scope.project.id=ccd95a48530c4c86a3774301b969d6a9, user.id=e6cf35a185bc4707a4f2f7b56662354d) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:19.464936 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17062b2c-faf6-43b2-98c3-0c02052759cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:19.466382 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17062b2c-faf6-43b2-98c3-0c02052759cb None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:19.472560 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 483/982] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:09:19 2022] GET /identity/v3/role_assignments?user.id=e6cf35a185bc4707a4f2f7b56662354d&scope.project.id=ccd95a48530c4c86a3774301b969d6a9&role.id=f3bc75c520ed4d52a97c45df41973dd0 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:20.698000 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c67ba-9819-463b-bef4-ac3b755e9556 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:20.698544 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c67ba-9819-463b-bef4-ac3b755e9556 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:20.698658 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c67ba-9819-463b-bef4-ac3b755e9556 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:20.700036 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 500/983] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:20.705205 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf94a17-a6c4-4e13-a6c0-428f5882ccf4 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:20.705586 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf94a17-a6c4-4e13-a6c0-428f5882ccf4 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:20.705779 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf94a17-a6c4-4e13-a6c0-428f5882ccf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:20.722649 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-7cf94a17-a6c4-4e13-a6c0-428f5882ccf4 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:20.723847 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-7cf94a17-a6c4-4e13-a6c0-428f5882ccf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:20.766384 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:20.794102 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 484/984] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:20 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:09:20.817711 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c67ba-9819-463b-bef4-ac3b755e9556 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:20.920545 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c67ba-9819-463b-bef4-ac3b755e9556 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:20.955619 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861935da-312c-4ea3-8429-950e8514a23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:20.956352 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861935da-312c-4ea3-8429-950e8514a23f None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:20.956702 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861935da-312c-4ea3-8429-950e8514a23f None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:20.956993 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861935da-312c-4ea3-8429-950e8514a23f None admin] PATH_INFO: `/v3/services/compute` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:20.957662 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861935da-312c-4ea3-8429-950e8514a23f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:20.959077 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861935da-312c-4ea3-8429-950e8514a23f None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:20.971965 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-861935da-312c-4ea3-8429-950e8514a23f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 21:09:20.971965 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:20.971965 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:09:20.971965 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:09:20.971965 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:09:20.971965 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:09:20.971965 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:09:20.971965 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:09:20.971965 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 21:09:20.971965 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:20.971965 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:09:20.971965 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:20.971965 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:20.971965 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:20.971965 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:20.971965 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:20.971965 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:20.973049 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:20.973049 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:20.973049 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:20.973049 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:20.973049 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:20.973049 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:20.973049 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:09:20.973049 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:09:20.973049 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:09:20.973049 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:09:20.973049 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:20.973049 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:20.973049 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:20.973049 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:20.973049 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:20.973049 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:20.973903 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:20.973903 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:20.973903 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:20.973903 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:20.973903 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:20.973903 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:20.973903 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:20.973903 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:20.973903 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:20.973903 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:20.973903 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:09:20.973903 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:09:20.973903 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 21:09:20.973903 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:20.979154 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 501/985] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:09:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:20.980286 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf94a17-a6c4-4e13-a6c0-428f5882ccf4 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:21.066022 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b24b54-aa89-443a-8d25-30fa4b792fd7 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:21.066390 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b24b54-aa89-443a-8d25-30fa4b792fd7 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:21.066683 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b24b54-aa89-443a-8d25-30fa4b792fd7 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:21.068373 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 502/986] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:09:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:21.074058 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442bcb89-42fa-4719-a068-ef58513c4c54 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:21.074381 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442bcb89-42fa-4719-a068-ef58513c4c54 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:21.074672 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442bcb89-42fa-4719-a068-ef58513c4c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:21.088694 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf94a17-a6c4-4e13-a6c0-428f5882ccf4 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:21.093133 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-442bcb89-42fa-4719-a068-ef58513c4c54 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:21.094395 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-442bcb89-42fa-4719-a068-ef58513c4c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:21.112612 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:21.127681 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a64c57-e2a6-4cbc-b478-8db5282f547d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:21.128545 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a64c57-e2a6-4cbc-b478-8db5282f547d None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:21.128839 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a64c57-e2a6-4cbc-b478-8db5282f547d None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:21.129121 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a64c57-e2a6-4cbc-b478-8db5282f547d None admin] PATH_INFO: `/v3/services` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:21.129838 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a64c57-e2a6-4cbc-b478-8db5282f547d None admin] RBAC: Adding query filter params (name=compute) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:21.130171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a64c57-e2a6-4cbc-b478-8db5282f547d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:21.131556 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a64c57-e2a6-4cbc-b478-8db5282f547d None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:21.137577 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 485/987] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Jul 5 21:09:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:21.142735 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a64c57-e2a6-4cbc-b478-8db5282f547d None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:21.172258 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 503/988] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:21 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:09:21.188206 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:21.194347 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442bcb89-42fa-4719-a068-ef58513c4c54 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:21.252779 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a64c57-e2a6-4cbc-b478-8db5282f547d None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:21.287142 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc54f8-e617-4759-b964-c46ee9391576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:21.287813 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc54f8-e617-4759-b964-c46ee9391576 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:21.288105 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc54f8-e617-4759-b964-c46ee9391576 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:21.288378 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc54f8-e617-4759-b964-c46ee9391576 None admin] PATH_INFO: `/v3/services` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:21.289083 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc54f8-e617-4759-b964-c46ee9391576 None admin] RBAC: Adding query filter params (type=compute) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:21.289393 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc54f8-e617-4759-b964-c46ee9391576 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:21.290893 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc54f8-e617-4759-b964-c46ee9391576 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:21.295741 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 486/989] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Jul 5 21:09:21 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:21.301368 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc54f8-e617-4759-b964-c46ee9391576 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:21.325382 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442bcb89-42fa-4719-a068-ef58513c4c54 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:21.362962 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a2a73-d7a4-41d2-a1ae-debc8fe479a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:21.364004 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a2a73-d7a4-41d2-a1ae-debc8fe479a3 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:21.364449 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a2a73-d7a4-41d2-a1ae-debc8fe479a3 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:21.364731 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a2a73-d7a4-41d2-a1ae-debc8fe479a3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:21.365384 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8a2a73-d7a4-41d2-a1ae-debc8fe479a3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:21.366790 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8a2a73-d7a4-41d2-a1ae-debc8fe479a3 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:21.379106 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-5c8a2a73-d7a4-41d2-a1ae-debc8fe479a3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:09:21.379106 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:21.379106 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:09:21.379106 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:09:21.379106 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:09:21.379106 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:09:21.379106 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:09:21.379106 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:09:21.379106 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:09:21.379106 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:21.379106 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:09:21.379106 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:21.379106 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:21.379106 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:21.379106 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:21.379106 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:21.379106 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:21.380149 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:21.380149 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:21.380149 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:21.380149 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:21.380149 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:21.380149 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:21.380149 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:09:21.380149 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:09:21.380149 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:09:21.380149 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:09:21.380149 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:21.380149 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:21.380149 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:21.380149 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:21.380149 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:21.380149 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:21.383145 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:21.383145 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:21.383145 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:21.383145 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:21.383145 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:21.383145 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:21.383145 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:21.383145 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:21.383145 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:21.383145 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:21.383145 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:09:21.383145 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:09:21.383145 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:09:21.383145 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:21.383145 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 504/990] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Jul 5 21:09:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:09:21.386952 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a2a73-d7a4-41d2-a1ae-debc8fe479a3 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:21.407824 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:21.413437 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc54f8-e617-4759-b964-c46ee9391576 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:21.415127 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:21.451816 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa048cc-f8bf-4c94-840a-0ad6042c93c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:21.452539 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa048cc-f8bf-4c94-840a-0ad6042c93c0 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:21.452875 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa048cc-f8bf-4c94-840a-0ad6042c93c0 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:21.453215 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa048cc-f8bf-4c94-840a-0ad6042c93c0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:21.454006 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa048cc-f8bf-4c94-840a-0ad6042c93c0 None admin] RBAC: Adding query filter params (interface=public, service_id=18e18a57271a48359edbce6c3a82e8b2, region_id=RegionOne) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:21.454363 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa048cc-f8bf-4c94-840a-0ad6042c93c0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:21.455726 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa048cc-f8bf-4c94-840a-0ad6042c93c0 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:21.465635 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 487/991] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Jul 5 21:09:21 2022] GET /identity/v3/endpoints?service_id=18e18a57271a48359edbce6c3a82e8b2&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:21.466725 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa048cc-f8bf-4c94-840a-0ad6042c93c0 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:21.499933 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a2a73-d7a4-41d2-a1ae-debc8fe479a3 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:21.535936 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3440ba06-ff02-40de-9db4-acc283a348cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:21.536529 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440ba06-ff02-40de-9db4-acc283a348cd None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:21.536817 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440ba06-ff02-40de-9db4-acc283a348cd None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:21.537096 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440ba06-ff02-40de-9db4-acc283a348cd None admin] PATH_INFO: `/v3/services` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:21.537813 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3440ba06-ff02-40de-9db4-acc283a348cd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:21.538145 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3440ba06-ff02-40de-9db4-acc283a348cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:21.539516 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3440ba06-ff02-40de-9db4-acc283a348cd None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:21.544479 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 505/992] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Jul 5 21:09:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:21.545705 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d8ad5-468b-4a29-ac88-066d2841b800 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:21.545995 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d8ad5-468b-4a29-ac88-066d2841b800 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:21.546309 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d8ad5-468b-4a29-ac88-066d2841b800 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:21.547548 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 506/993] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:09:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:21.549884 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d8ad5-468b-4a29-ac88-066d2841b800 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:21.574907 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa048cc-f8bf-4c94-840a-0ad6042c93c0 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:21.607342 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859faf9e-cb86-44a2-84d6-3a8c9488c1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:21.608007 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859faf9e-cb86-44a2-84d6-3a8c9488c1ec None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:21.608292 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859faf9e-cb86-44a2-84d6-3a8c9488c1ec None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:21.608567 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859faf9e-cb86-44a2-84d6-3a8c9488c1ec None admin] PATH_INFO: `/v3/services` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:21.609243 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859faf9e-cb86-44a2-84d6-3a8c9488c1ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:21.610641 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859faf9e-cb86-44a2-84d6-3a8c9488c1ec None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:21.616658 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 488/994] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Jul 5 21:09:21 2022] GET /identity/v3/services => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:09:21.617876 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c7db8-704b-4668-9762-5cd635371348 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:21.618257 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c7db8-704b-4668-9762-5cd635371348 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:21.619082 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c7db8-704b-4668-9762-5cd635371348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:21.644013 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-384c7db8-704b-4668-9762-5cd635371348 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:21.645249 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-384c7db8-704b-4668-9762-5cd635371348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:21.645828 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:21.669388 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d8ad5-468b-4a29-ac88-066d2841b800 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:21.673150 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:21.710736 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703701f-2996-4b85-a903-f564308fed18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:21.711413 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703701f-2996-4b85-a903-f564308fed18 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:21.711699 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703701f-2996-4b85-a903-f564308fed18 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:21.711980 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703701f-2996-4b85-a903-f564308fed18 None admin] PATH_INFO: `/v3/services` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:21.712736 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c703701f-2996-4b85-a903-f564308fed18 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:21.713053 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c703701f-2996-4b85-a903-f564308fed18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:21.714477 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c703701f-2996-4b85-a903-f564308fed18 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:21.725935 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 507/995] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Jul 5 21:09:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:21.727222 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703701f-2996-4b85-a903-f564308fed18 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:21.728164 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 489/996] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:21 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:09:21.751106 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c7db8-704b-4668-9762-5cd635371348 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:21.846167 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703701f-2996-4b85-a903-f564308fed18 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:21.859714 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c7db8-704b-4668-9762-5cd635371348 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:21.881773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b2ce7-e89a-4e1b-ba3b-c0bf55869ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:21.882465 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b2ce7-e89a-4e1b-ba3b-c0bf55869ae3 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:21.882761 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b2ce7-e89a-4e1b-ba3b-c0bf55869ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:21.883037 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b2ce7-e89a-4e1b-ba3b-c0bf55869ae3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:21.883825 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9b2ce7-e89a-4e1b-ba3b-c0bf55869ae3 None admin] RBAC: Adding query filter params (interface=admin, service_id=ac03c3512493489f9de8e83fd01643d7, region_id=RegionOne) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:21.884211 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9b2ce7-e89a-4e1b-ba3b-c0bf55869ae3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:21.885768 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9b2ce7-e89a-4e1b-ba3b-c0bf55869ae3 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:21.890947 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 508/997] 10.222.0.30 () {56 vars in 1249 bytes} [Tue Jul 5 21:09:21 2022] GET /identity/v3/endpoints?service_id=ac03c3512493489f9de8e83fd01643d7&interface=admin®ion_id=RegionOne => generated 193 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:21.896247 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b2ce7-e89a-4e1b-ba3b-c0bf55869ae3 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:21.898124 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e59e590-f683-4e3a-b17a-4903e98ee69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:21.898970 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59e590-f683-4e3a-b17a-4903e98ee69f None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:21.899260 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59e590-f683-4e3a-b17a-4903e98ee69f None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:21.899575 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59e590-f683-4e3a-b17a-4903e98ee69f None admin] PATH_INFO: `/v3/services/image` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:21.900467 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e59e590-f683-4e3a-b17a-4903e98ee69f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:21.901848 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e59e590-f683-4e3a-b17a-4903e98ee69f None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:21.908781 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:21.913658 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-2e59e590-f683-4e3a-b17a-4903e98ee69f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 21:09:21.913658 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:21.913658 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:09:21.913658 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:09:21.913658 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:09:21.913658 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:09:21.913658 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:09:21.913658 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:09:21.913658 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 21:09:21.913658 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:09:21.913658 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:09:21.913658 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:09:21.913658 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:21.913658 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:21.913658 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:21.913658 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:21.913658 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:21.914788 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:21.914788 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:21.914788 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:21.914788 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:21.914788 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:21.914788 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:21.914788 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:09:21.914788 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:09:21.914788 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:09:21.914788 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:09:21.914788 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:21.914788 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:21.914788 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:21.914788 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:21.914788 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:21.914788 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:21.916179 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:21.916179 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:21.916179 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:21.916179 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:21.916179 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:21.916179 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:21.916179 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:21.916179 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:21.916179 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:21.916179 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:21.916179 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:09:21.916179 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:09:21.916179 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 21:09:21.916179 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:09:21.916179 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 490/998] 10.222.0.30 () {56 vars in 1105 bytes} [Tue Jul 5 21:09:21 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:09:21.922300 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e59e590-f683-4e3a-b17a-4903e98ee69f None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:21.951771 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:22.004787 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b2ce7-e89a-4e1b-ba3b-c0bf55869ae3 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:22.032195 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e59e590-f683-4e3a-b17a-4903e98ee69f None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:22.042261 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dca3a0-d3a8-4470-a27e-25162d8ff305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:22.042939 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dca3a0-d3a8-4470-a27e-25162d8ff305 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:22.043374 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dca3a0-d3a8-4470-a27e-25162d8ff305 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:22.043550 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dca3a0-d3a8-4470-a27e-25162d8ff305 None admin] PATH_INFO: `/v3/services` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:22.044190 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dca3a0-d3a8-4470-a27e-25162d8ff305 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:22.045563 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dca3a0-d3a8-4470-a27e-25162d8ff305 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:22.062165 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 509/999] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Jul 5 21:09:21 2022] GET /identity/v3/services => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:09:22.080150 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66101ea8-5b17-40fa-9158-71166f8d09ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:22.080946 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66101ea8-5b17-40fa-9158-71166f8d09ec None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:22.081311 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66101ea8-5b17-40fa-9158-71166f8d09ec None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:22.081668 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66101ea8-5b17-40fa-9158-71166f8d09ec None admin] PATH_INFO: `/v3/services` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:22.082515 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66101ea8-5b17-40fa-9158-71166f8d09ec None admin] RBAC: Adding query filter params (name=image) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:22.082902 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66101ea8-5b17-40fa-9158-71166f8d09ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:22.084422 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66101ea8-5b17-40fa-9158-71166f8d09ec None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:22.091399 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 491/1000] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:09:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:22.097029 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dca3a0-d3a8-4470-a27e-25162d8ff305 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:22.181501 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:22.208525 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dca3a0-d3a8-4470-a27e-25162d8ff305 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:22.248441 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7747703-4053-4e74-bd57-9eb30335e301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:22.249123 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7747703-4053-4e74-bd57-9eb30335e301 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:22.249416 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7747703-4053-4e74-bd57-9eb30335e301 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:22.249703 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7747703-4053-4e74-bd57-9eb30335e301 None admin] PATH_INFO: `/v3/services` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:22.253236 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7747703-4053-4e74-bd57-9eb30335e301 None admin] RBAC: Adding query filter params (type=image) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:22.253236 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7747703-4053-4e74-bd57-9eb30335e301 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:22.253236 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7747703-4053-4e74-bd57-9eb30335e301 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:22.257155 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 510/1001] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:09:22 2022] GET /identity/v3/services?type=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:23.651466 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6e8b2-e7bc-46d9-bd58-3ed595c62205 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:23.651966 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6e8b2-e7bc-46d9-bd58-3ed595c62205 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:23.651966 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6e8b2-e7bc-46d9-bd58-3ed595c62205 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:23.653334 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 492/1002] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:09:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:23.658462 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41ee1d-08bd-4562-8910-c5bb02996aad None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:23.658847 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41ee1d-08bd-4562-8910-c5bb02996aad None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:23.659026 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41ee1d-08bd-4562-8910-c5bb02996aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:23.676208 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-2e41ee1d-08bd-4562-8910-c5bb02996aad None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:23.677390 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-2e41ee1d-08bd-4562-8910-c5bb02996aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:23.745633 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 511/1003] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:23 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:09:23.768456 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6e8b2-e7bc-46d9-bd58-3ed595c62205 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:23.858728 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:23.872602 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6e8b2-e7bc-46d9-bd58-3ed595c62205 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:23.907182 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9310e8-1a39-4921-8d59-d40a04bec7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:23.908087 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9310e8-1a39-4921-8d59-d40a04bec7f3 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:23.908377 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9310e8-1a39-4921-8d59-d40a04bec7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:23.908696 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9310e8-1a39-4921-8d59-d40a04bec7f3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:23.909521 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9310e8-1a39-4921-8d59-d40a04bec7f3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:23.911378 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9310e8-1a39-4921-8d59-d40a04bec7f3 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:23.923293 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-3c9310e8-1a39-4921-8d59-d40a04bec7f3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 21:09:23.923293 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:23.923293 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:09:23.923293 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:09:23.923293 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:09:23.923293 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:09:23.923293 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:09:23.923293 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:09:23.923293 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 21:09:23.923293 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:09:23.923293 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:09:23.923293 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:09:23.923293 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:23.923293 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:23.923293 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:23.923293 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:23.923293 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:23.924298 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:23.924298 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:23.924298 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:23.924298 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:23.924298 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:23.924298 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:23.924298 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:09:23.924298 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:09:23.924298 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:09:23.924298 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:09:23.924298 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:23.924298 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:23.924298 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:23.924298 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:23.924298 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:23.924298 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:23.925187 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:23.925187 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:23.925187 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:23.925187 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:23.925187 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:23.925187 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:23.925187 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:23.925187 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:23.925187 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:23.925187 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:23.925187 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:09:23.925187 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:09:23.925187 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 21:09:23.925187 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:09:23.929314 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 493/1004] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:09:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:23.930367 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41ee1d-08bd-4562-8910-c5bb02996aad None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:23.997232 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:24.031567 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41ee1d-08bd-4562-8910-c5bb02996aad None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:24.066777 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef712a1-920c-4426-8f03-e612ea2b4491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:24.067444 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef712a1-920c-4426-8f03-e612ea2b4491 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:24.067731 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef712a1-920c-4426-8f03-e612ea2b4491 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:24.068009 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef712a1-920c-4426-8f03-e612ea2b4491 None admin] PATH_INFO: `/v3/services` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:24.068712 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef712a1-920c-4426-8f03-e612ea2b4491 None admin] RBAC: Adding query filter params (name=compute) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:24.069020 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef712a1-920c-4426-8f03-e612ea2b4491 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:24.070412 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef712a1-920c-4426-8f03-e612ea2b4491 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:24.076002 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 512/1005] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Jul 5 21:09:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:24.081339 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9310e8-1a39-4921-8d59-d40a04bec7f3 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:24.148093 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5fe3be-e1b2-4068-9665-1ffb6698ce64 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:24.148401 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5fe3be-e1b2-4068-9665-1ffb6698ce64 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:24.148668 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5fe3be-e1b2-4068-9665-1ffb6698ce64 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:24.150390 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 513/1006] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:09:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:24.156148 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdefeb1-3821-483c-baff-6eae271a23b5 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:24.156666 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdefeb1-3821-483c-baff-6eae271a23b5 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:24.158753 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdefeb1-3821-483c-baff-6eae271a23b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:24.174565 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-fbdefeb1-3821-483c-baff-6eae271a23b5 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:24.176059 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-fbdefeb1-3821-483c-baff-6eae271a23b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:24.189061 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9310e8-1a39-4921-8d59-d40a04bec7f3 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:24.227583 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1578065-3dd9-4d9a-8363-27d6947df5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:24.228930 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1578065-3dd9-4d9a-8363-27d6947df5d8 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:24.229218 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1578065-3dd9-4d9a-8363-27d6947df5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:24.229498 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1578065-3dd9-4d9a-8363-27d6947df5d8 None admin] PATH_INFO: `/v3/services` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:24.230231 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1578065-3dd9-4d9a-8363-27d6947df5d8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:24.230547 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1578065-3dd9-4d9a-8363-27d6947df5d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:24.231918 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1578065-3dd9-4d9a-8363-27d6947df5d8 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:24.238458 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 494/1007] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Jul 5 21:09:24 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:24.243686 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1578065-3dd9-4d9a-8363-27d6947df5d8 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:24.248750 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 514/1008] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:24 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:09:24.264762 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:24.272357 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdefeb1-3821-483c-baff-6eae271a23b5 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:24.334848 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:24.350491 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1578065-3dd9-4d9a-8363-27d6947df5d8 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:24.373747 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdefeb1-3821-483c-baff-6eae271a23b5 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:24.383457 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d75d22-c5d9-427d-8f96-f43976aa1864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:24.384637 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d75d22-c5d9-427d-8f96-f43976aa1864 None admin] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:24.384913 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d75d22-c5d9-427d-8f96-f43976aa1864 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:24.385190 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d75d22-c5d9-427d-8f96-f43976aa1864 None admin] PATH_INFO: `/v3/endpoints` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:24.385917 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d75d22-c5d9-427d-8f96-f43976aa1864 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:24.387328 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d75d22-c5d9-427d-8f96-f43976aa1864 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:24.407247 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7e8b4-23b8-43c3-bf89-965c0631b70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:24.408062 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7e8b4-23b8-43c3-bf89-965c0631b70a None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:24.410520 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7e8b4-23b8-43c3-bf89-965c0631b70a None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:24.410520 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7e8b4-23b8-43c3-bf89-965c0631b70a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:24.410520 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec7e8b4-23b8-43c3-bf89-965c0631b70a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:24.410822 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec7e8b4-23b8-43c3-bf89-965c0631b70a None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:24.423127 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-aec7e8b4-23b8-43c3-bf89-965c0631b70a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:09:24.423127 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:24.423127 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:09:24.423127 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:09:24.423127 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:09:24.423127 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:09:24.423127 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:09:24.423127 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:09:24.423127 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:09:24.423127 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:24.423127 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:09:24.423127 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:24.423127 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:24.423127 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:24.423127 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:24.423127 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:24.423127 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:24.424297 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:24.424297 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:24.424297 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:24.424297 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:24.424297 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:24.424297 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:24.424297 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:09:24.424297 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:09:24.424297 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:09:24.424297 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:09:24.424297 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:24.424297 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:24.424297 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:24.424297 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:24.424297 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:24.424297 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:24.425611 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:24.425611 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:24.425611 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:24.425611 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:24.425611 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:24.425611 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:24.425611 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:24.425611 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:24.425611 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:24.425611 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:24.425611 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:09:24.425611 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:09:24.425611 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:09:24.425611 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:24.425611 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 515/1009] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Jul 5 21:09:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:09:24.426497 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbf46a-c031-4339-b0ed-30b7747907c0 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:24.426497 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbf46a-c031-4339-b0ed-30b7747907c0 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:24.426497 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbf46a-c031-4339-b0ed-30b7747907c0 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:24.427300 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 516/1010] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:09:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:24.430120 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bbf46a-c031-4339-b0ed-30b7747907c0 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:24.469355 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 495/1011] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Jul 5 21:09:24 2022] POST /identity/v3/endpoints => generated 334 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:09:24.470786 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b6b76-4273-47fa-bdf9-ffc61423cf8a None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:24.471168 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b6b76-4273-47fa-bdf9-ffc61423cf8a None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:24.471579 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b6b76-4273-47fa-bdf9-ffc61423cf8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:24.489775 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-cd2b6b76-4273-47fa-bdf9-ffc61423cf8a None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:24.491061 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-cd2b6b76-4273-47fa-bdf9-ffc61423cf8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:24.558870 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bbf46a-c031-4339-b0ed-30b7747907c0 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:24.566264 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 496/1012] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:24 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:09:24.584400 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:24.589878 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b6b76-4273-47fa-bdf9-ffc61423cf8a None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:24.592143 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:24.599311 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253da7d-7978-45ce-b9c2-5313b7d3b6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:24.599997 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253da7d-7978-45ce-b9c2-5313b7d3b6da None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:24.600287 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253da7d-7978-45ce-b9c2-5313b7d3b6da None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:24.600558 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253da7d-7978-45ce-b9c2-5313b7d3b6da None admin] PATH_INFO: `/v3/services` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:24.601279 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253da7d-7978-45ce-b9c2-5313b7d3b6da None admin] RBAC: Adding query filter params (name=object-store) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:24.601594 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253da7d-7978-45ce-b9c2-5313b7d3b6da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:24.603626 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253da7d-7978-45ce-b9c2-5313b7d3b6da None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:24.613733 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 517/1013] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Jul 5 21:09:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:24.614718 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253da7d-7978-45ce-b9c2-5313b7d3b6da None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:24.707818 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b6b76-4273-47fa-bdf9-ffc61423cf8a None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:24.733619 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253da7d-7978-45ce-b9c2-5313b7d3b6da None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:24.751168 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df3c0f-3fc5-4121-91e8-4fb78ed4e062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:24.751857 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df3c0f-3fc5-4121-91e8-4fb78ed4e062 None admin] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:24.752147 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df3c0f-3fc5-4121-91e8-4fb78ed4e062 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:24.752421 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df3c0f-3fc5-4121-91e8-4fb78ed4e062 None admin] PATH_INFO: `/v3/services` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:24.753148 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df3c0f-3fc5-4121-91e8-4fb78ed4e062 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:24.754601 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df3c0f-3fc5-4121-91e8-4fb78ed4e062 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:24.774413 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1200e10e-9d01-48b6-bfe8-3b95bd7d0a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:24.776567 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200e10e-9d01-48b6-bfe8-3b95bd7d0a90 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:24.776567 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200e10e-9d01-48b6-bfe8-3b95bd7d0a90 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:24.776567 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200e10e-9d01-48b6-bfe8-3b95bd7d0a90 None admin] PATH_INFO: `/v3/services` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:24.776567 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1200e10e-9d01-48b6-bfe8-3b95bd7d0a90 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:24.776890 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1200e10e-9d01-48b6-bfe8-3b95bd7d0a90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:24.778169 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1200e10e-9d01-48b6-bfe8-3b95bd7d0a90 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:24.784728 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 518/1014] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Jul 5 21:09:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:24.790471 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1200e10e-9d01-48b6-bfe8-3b95bd7d0a90 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:24.819039 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 497/1015] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Jul 5 21:09:24 2022] POST /identity/v3/services => generated 242 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:09:24.845704 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:24.902414 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1200e10e-9d01-48b6-bfe8-3b95bd7d0a90 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:24.946348 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3662a81b-d870-438e-9782-7a277e1fadb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:24.947335 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662a81b-d870-438e-9782-7a277e1fadb9 None admin] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:24.947626 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662a81b-d870-438e-9782-7a277e1fadb9 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:24.947907 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662a81b-d870-438e-9782-7a277e1fadb9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:24.948661 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3662a81b-d870-438e-9782-7a277e1fadb9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:24.950067 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3662a81b-d870-438e-9782-7a277e1fadb9 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:25.024116 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 519/1016] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Jul 5 21:09:24 2022] POST /identity/v3/endpoints => generated 325 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:09:26.601291 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db96e8d-4f57-4f93-a65a-5a75497e06d3 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:26.601784 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db96e8d-4f57-4f93-a65a-5a75497e06d3 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:26.601784 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db96e8d-4f57-4f93-a65a-5a75497e06d3 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:26.603841 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 498/1017] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:09:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:26.608827 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd2445-3086-4d7b-bdcb-908d5879d9fc None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:26.609254 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd2445-3086-4d7b-bdcb-908d5879d9fc None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:26.609434 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd2445-3086-4d7b-bdcb-908d5879d9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:26.626121 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-aabd2445-3086-4d7b-bdcb-908d5879d9fc None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:26.627324 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-aabd2445-3086-4d7b-bdcb-908d5879d9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:26.706273 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 520/1018] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:26 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:09:26.725077 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db96e8d-4f57-4f93-a65a-5a75497e06d3 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:26.788504 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:26.828300 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db96e8d-4f57-4f93-a65a-5a75497e06d3 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:26.864592 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210d4c2-7332-4a41-be29-dd16a00d55c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:26.865693 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210d4c2-7332-4a41-be29-dd16a00d55c4 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:26.866194 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210d4c2-7332-4a41-be29-dd16a00d55c4 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:26.866676 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210d4c2-7332-4a41-be29-dd16a00d55c4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:26.877187 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8210d4c2-7332-4a41-be29-dd16a00d55c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:26.885608 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-8210d4c2-7332-4a41-be29-dd16a00d55c4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 21:09:26.885608 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:26.885608 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:26.885608 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:26.885608 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:26.885608 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:26.885608 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:26.885608 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:26.885608 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:26.885608 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:26.885608 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:26.885608 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:26.885608 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:26.885608 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:26.885608 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:26.885608 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:26.886612 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:26.886612 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:26.886612 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:26.886612 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:26.886612 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:26.886612 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:26.886612 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:26.886612 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:26.886612 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:26.886612 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:26.886612 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:26.886612 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:26.886612 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:26.886612 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:26.886612 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:26.886612 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:26.887475 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:26.887475 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:26.887475 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:26.887475 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:26.887475 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:26.887475 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:26.887475 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:26.887475 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:26.887475 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:26.887475 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:26.887475 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 21:09:26.887475 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:09:26.888128 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 499/1019] 10.222.0.30 () {56 vars in 1120 bytes} [Tue Jul 5 21:09:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:26.893766 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd2445-3086-4d7b-bdcb-908d5879d9fc None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:26.897602 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ae075-8553-4e68-8a65-94db8e4fa6a4 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:26.897899 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ae075-8553-4e68-8a65-94db8e4fa6a4 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:26.898212 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ae075-8553-4e68-8a65-94db8e4fa6a4 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:26.900270 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 500/1020] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:09:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:09:26.905253 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32808f3-e37d-433e-bf72-429eaabbef28 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:26.905553 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32808f3-e37d-433e-bf72-429eaabbef28 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:26.905836 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32808f3-e37d-433e-bf72-429eaabbef28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:26.923177 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-b32808f3-e37d-433e-bf72-429eaabbef28 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:26.924358 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-b32808f3-e37d-433e-bf72-429eaabbef28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:26.930413 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:26.996280 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 501/1021] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:26 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:09:27.003408 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd2445-3086-4d7b-bdcb-908d5879d9fc None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:27.018771 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32808f3-e37d-433e-bf72-429eaabbef28 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:27.041785 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4205c4-834b-419a-9e8b-f9115fb68e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:27.042556 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4205c4-834b-419a-9e8b-f9115fb68e6b None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:27.042792 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4205c4-834b-419a-9e8b-f9115fb68e6b None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:27.043081 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4205c4-834b-419a-9e8b-f9115fb68e6b None admin] PATH_INFO: `/v3/roles` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:27.043885 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4205c4-834b-419a-9e8b-f9115fb68e6b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:27.044201 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4205c4-834b-419a-9e8b-f9115fb68e6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:27.045619 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4205c4-834b-419a-9e8b-f9115fb68e6b None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:27.054857 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 521/1022] 10.222.0.30 () {56 vars in 1115 bytes} [Tue Jul 5 21:09:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:27.056532 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68b76f-256a-4bc3-8a06-bb7c202c28f8 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:27.056824 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68b76f-256a-4bc3-8a06-bb7c202c28f8 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:27.057818 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68b76f-256a-4bc3-8a06-bb7c202c28f8 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:27.058533 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 522/1023] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:09:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:27.060566 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68b76f-256a-4bc3-8a06-bb7c202c28f8 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:27.076681 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:27.125978 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32808f3-e37d-433e-bf72-429eaabbef28 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:27.155003 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:27.161171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14347592-e818-43e6-8c9b-6dff28575de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:27.161974 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14347592-e818-43e6-8c9b-6dff28575de8 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:27.162292 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14347592-e818-43e6-8c9b-6dff28575de8 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:27.162574 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14347592-e818-43e6-8c9b-6dff28575de8 None admin] PATH_INFO: `/v3/services/image` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:27.162693 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68b76f-256a-4bc3-8a06-bb7c202c28f8 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:27.163226 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14347592-e818-43e6-8c9b-6dff28575de8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:27.164631 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14347592-e818-43e6-8c9b-6dff28575de8 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:27.176794 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-14347592-e818-43e6-8c9b-6dff28575de8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 21:09:27.176794 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:27.176794 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:09:27.176794 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:09:27.176794 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:09:27.176794 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:09:27.176794 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:09:27.176794 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:09:27.176794 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 21:09:27.176794 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:09:27.176794 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:09:27.176794 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:09:27.176794 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:27.176794 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:27.176794 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:27.176794 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:27.176794 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:27.184646 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:27.184646 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:27.184646 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:27.184646 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:27.184646 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:27.184646 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:27.184646 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:09:27.184646 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:09:27.184646 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:09:27.184646 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:09:27.184646 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:27.184646 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:27.184646 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:27.184646 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:27.184646 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:27.184646 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:27.185515 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:27.185515 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:27.185515 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:27.185515 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:27.185515 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:27.185515 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:27.185515 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:27.185515 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:27.185515 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:27.185515 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:27.185515 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:09:27.185515 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:09:27.185515 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 21:09:27.185515 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:09:27.185515 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 502/1024] 10.222.0.30 () {56 vars in 1105 bytes} [Tue Jul 5 21:09:27 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:09:27.186436 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b9a7c-5f23-4cd8-9b51-14b2bfbd7d8f None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:27.186436 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b9a7c-5f23-4cd8-9b51-14b2bfbd7d8f None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:27.186436 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b9a7c-5f23-4cd8-9b51-14b2bfbd7d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:27.198173 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de36b2d-df71-4f92-b072-4ec661241357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:27.198813 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-942b9a7c-5f23-4cd8-9b51-14b2bfbd7d8f None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:27.199138 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de36b2d-df71-4f92-b072-4ec661241357 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:27.199817 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de36b2d-df71-4f92-b072-4ec661241357 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:27.200030 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-942b9a7c-5f23-4cd8-9b51-14b2bfbd7d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:27.200142 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de36b2d-df71-4f92-b072-4ec661241357 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:27.210376 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de36b2d-df71-4f92-b072-4ec661241357 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:27.219668 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de36b2d-df71-4f92-b072-4ec661241357 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:27.230332 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-0de36b2d-df71-4f92-b072-4ec661241357 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:27.230332 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:27.230332 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:27.230332 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:27.230332 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:27.230332 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:27.230332 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:27.230332 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:27.230332 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:27.230332 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:27.230332 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:27.230332 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:27.230332 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:09:27.230332 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:09:27.230332 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:09:27.231386 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:09:27.231386 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:27.231386 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:27.231386 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:27.231386 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:27.231386 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:27.231386 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:27.231386 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:27.231386 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:27.231386 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:27.231386 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:27.231386 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:27.231386 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:27.231386 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:27.231386 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:27.231386 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:27.231386 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:27.232307 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:09:27.232307 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:09:27.232307 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:27.232307 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:27.232307 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 523/1025] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:09:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:09:27.232980 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de36b2d-df71-4f92-b072-4ec661241357 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:27.270267 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 503/1026] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:09:27.271183 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b9a7c-5f23-4cd8-9b51-14b2bfbd7d8f None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:27.322080 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:27.337412 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de36b2d-df71-4f92-b072-4ec661241357 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:27.371365 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42f830-5d87-44ae-90af-cd4664fb84e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:27.372034 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42f830-5d87-44ae-90af-cd4664fb84e6 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:27.372325 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42f830-5d87-44ae-90af-cd4664fb84e6 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:27.372608 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42f830-5d87-44ae-90af-cd4664fb84e6 None admin] PATH_INFO: `/v3/services` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:27.373319 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a42f830-5d87-44ae-90af-cd4664fb84e6 None admin] RBAC: Adding query filter params (name=image) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:27.373635 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a42f830-5d87-44ae-90af-cd4664fb84e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:27.374582 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b9a7c-5f23-4cd8-9b51-14b2bfbd7d8f None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:27.375030 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a42f830-5d87-44ae-90af-cd4664fb84e6 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:27.380079 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 524/1027] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:09:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:27.380802 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42f830-5d87-44ae-90af-cd4664fb84e6 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:27.394610 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:27.407966 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377a715-a50e-41b4-ba1f-1e39f8cb3322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:27.408680 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377a715-a50e-41b4-ba1f-1e39f8cb3322 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:27.408967 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377a715-a50e-41b4-ba1f-1e39f8cb3322 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:27.409249 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377a715-a50e-41b4-ba1f-1e39f8cb3322 None admin] PATH_INFO: `/v3/domains` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:27.409960 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4377a715-a50e-41b4-ba1f-1e39f8cb3322 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:27.410300 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4377a715-a50e-41b4-ba1f-1e39f8cb3322 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:27.411670 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4377a715-a50e-41b4-ba1f-1e39f8cb3322 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:27.423599 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 504/1028] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:09:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:27.424396 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377a715-a50e-41b4-ba1f-1e39f8cb3322 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:27.484033 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42f830-5d87-44ae-90af-cd4664fb84e6 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:27.516928 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35b92d-ee0d-4800-8774-b167d8c60e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:27.517728 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35b92d-ee0d-4800-8774-b167d8c60e47 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:27.518018 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35b92d-ee0d-4800-8774-b167d8c60e47 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:27.518329 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35b92d-ee0d-4800-8774-b167d8c60e47 None admin] PATH_INFO: `/v3/domains/default` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:27.519526 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f35b92d-ee0d-4800-8774-b167d8c60e47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:27.520962 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f35b92d-ee0d-4800-8774-b167d8c60e47 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:27.522617 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 525/1029] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:09:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:27.523382 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35b92d-ee0d-4800-8774-b167d8c60e47 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:27.524302 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377a715-a50e-41b4-ba1f-1e39f8cb3322 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:27.533885 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:27.560844 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b0a4d-78ac-4dbb-a6c4-4965fe9c76f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:27.561510 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b0a4d-78ac-4dbb-a6c4-4965fe9c76f3 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:27.561795 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b0a4d-78ac-4dbb-a6c4-4965fe9c76f3 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:27.562074 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b0a4d-78ac-4dbb-a6c4-4965fe9c76f3 None admin] PATH_INFO: `/v3/services` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:27.562849 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b0a4d-78ac-4dbb-a6c4-4965fe9c76f3 None admin] RBAC: Adding query filter params (type=image) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:27.563517 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b0a4d-78ac-4dbb-a6c4-4965fe9c76f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:27.565704 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b0a4d-78ac-4dbb-a6c4-4965fe9c76f3 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:27.575842 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 505/1030] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:09:27 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:27.575842 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b0a4d-78ac-4dbb-a6c4-4965fe9c76f3 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:27.602049 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:27.623568 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35b92d-ee0d-4800-8774-b167d8c60e47 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:27.657018 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f13622-0078-49f9-ad8f-4ccd33719cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:27.657744 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f13622-0078-49f9-ad8f-4ccd33719cb8 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:27.658034 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f13622-0078-49f9-ad8f-4ccd33719cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:27.658345 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f13622-0078-49f9-ad8f-4ccd33719cb8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:27.666594 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f13622-0078-49f9-ad8f-4ccd33719cb8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:27.668042 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f13622-0078-49f9-ad8f-4ccd33719cb8 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:27.674563 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b0a4d-78ac-4dbb-a6c4-4965fe9c76f3 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:27.682213 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-35f13622-0078-49f9-ad8f-4ccd33719cb8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:09:27.682213 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:27.682213 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:27.682213 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:27.682213 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:27.682213 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:27.682213 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:27.682213 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:27.682213 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:27.682213 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:27.682213 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:27.682213 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:27.682213 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:09:27.682213 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:09:27.682213 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:09:27.682213 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:09:27.683305 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:27.683305 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:27.683305 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:09:27.683305 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:09:27.683305 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:09:27.683305 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:09:27.683305 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:27.683305 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:27.683305 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:27.683305 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:27.683305 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:27.683305 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:27.683305 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:27.683305 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:27.683305 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:27.683305 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:27.683305 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:27.683305 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:27.685008 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:27.685008 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:27.685008 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:09:27.685008 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:09:27.685008 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:09:27.685008 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:09:27.685008 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:09:27.685008 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:09:27.685008 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:09:27.685008 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:27.685008 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 526/1031] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Jul 5 21:09:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:27.685008 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f13622-0078-49f9-ad8f-4ccd33719cb8 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:27.710961 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb0cf91-7b7e-4091-8ae8-fb8bb330b8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:27.711638 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0cf91-7b7e-4091-8ae8-fb8bb330b8b1 None admin] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:27.711924 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0cf91-7b7e-4091-8ae8-fb8bb330b8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:27.712720 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0cf91-7b7e-4091-8ae8-fb8bb330b8b1 None admin] PATH_INFO: `/v3/projects` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:27.713427 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb0cf91-7b7e-4091-8ae8-fb8bb330b8b1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:27.714903 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb0cf91-7b7e-4091-8ae8-fb8bb330b8b1 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:27.781859 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f13622-0078-49f9-ad8f-4ccd33719cb8 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:27.794223 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 506/1032] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Jul 5 21:09:27 2022] POST /identity/v3/projects => generated 311 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:09:27.795041 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb0cf91-7b7e-4091-8ae8-fb8bb330b8b1 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:27.821530 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:27.825660 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd70519-e67a-4e00-a1ce-b410240d62f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:27.826482 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd70519-e67a-4e00-a1ce-b410240d62f3 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:27.826774 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd70519-e67a-4e00-a1ce-b410240d62f3 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:27.827052 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd70519-e67a-4e00-a1ce-b410240d62f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:27.827863 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd70519-e67a-4e00-a1ce-b410240d62f3 None admin] RBAC: Adding query filter params (interface=public, service_id=45b50935b49745c9a62ea4bd7f1b3331, region_id=RegionOne) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:27.828180 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd70519-e67a-4e00-a1ce-b410240d62f3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:27.829652 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd70519-e67a-4e00-a1ce-b410240d62f3 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:27.838420 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 527/1033] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Jul 5 21:09:27 2022] GET /identity/v3/endpoints?service_id=45b50935b49745c9a62ea4bd7f1b3331&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:27.842646 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd70519-e67a-4e00-a1ce-b410240d62f3 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:27.846651 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:27.913630 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb0cf91-7b7e-4091-8ae8-fb8bb330b8b1 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:27.955351 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c0fb8b-cd17-440e-981a-78b77d6070ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:27.956091 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0fb8b-cd17-440e-981a-78b77d6070ff None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:27.956379 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0fb8b-cd17-440e-981a-78b77d6070ff None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:27.956714 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0fb8b-cd17-440e-981a-78b77d6070ff None admin] PATH_INFO: `/v3/users` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:27.957559 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c0fb8b-cd17-440e-981a-78b77d6070ff None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:27.957868 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c0fb8b-cd17-440e-981a-78b77d6070ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:27.959373 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c0fb8b-cd17-440e-981a-78b77d6070ff None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:27.963059 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd70519-e67a-4e00-a1ce-b410240d62f3 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:27.979819 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 507/1034] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Jul 5 21:09:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:27.985824 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c0fb8b-cd17-440e-981a-78b77d6070ff None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:28.001087 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48a5c5-b06f-4e02-89c8-02baa1a8ccb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:28.001761 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48a5c5-b06f-4e02-89c8-02baa1a8ccb2 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:28.005510 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48a5c5-b06f-4e02-89c8-02baa1a8ccb2 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:28.005510 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48a5c5-b06f-4e02-89c8-02baa1a8ccb2 None admin] PATH_INFO: `/v3/services` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:28.005510 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed48a5c5-b06f-4e02-89c8-02baa1a8ccb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:28.005510 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed48a5c5-b06f-4e02-89c8-02baa1a8ccb2 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:28.011980 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 528/1035] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Jul 5 21:09:27 2022] GET /identity/v3/services => generated 1957 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:09:28.078247 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:28.099021 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c0fb8b-cd17-440e-981a-78b77d6070ff None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:28.137793 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08492d2f-e0db-495d-8f83-53ccf11d6854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:28.138502 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08492d2f-e0db-495d-8f83-53ccf11d6854 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:28.138793 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08492d2f-e0db-495d-8f83-53ccf11d6854 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:28.139077 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08492d2f-e0db-495d-8f83-53ccf11d6854 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:28.213873 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08492d2f-e0db-495d-8f83-53ccf11d6854 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:28.215374 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08492d2f-e0db-495d-8f83-53ccf11d6854 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:28.296667 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:28.319305 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 508/1036] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:09:27 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 05 21:09:28.325393 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48a5c5-b06f-4e02-89c8-02baa1a8ccb2 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:28.393897 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:28.429685 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48a5c5-b06f-4e02-89c8-02baa1a8ccb2 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:28.464116 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99d52a-5e04-474b-9ae2-2c81a87762f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:28.464846 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99d52a-5e04-474b-9ae2-2c81a87762f5 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:28.465136 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99d52a-5e04-474b-9ae2-2c81a87762f5 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:28.465417 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99d52a-5e04-474b-9ae2-2c81a87762f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:28.476188 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e99d52a-5e04-474b-9ae2-2c81a87762f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:28.477773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e99d52a-5e04-474b-9ae2-2c81a87762f5 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:28.496238 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-4e99d52a-5e04-474b-9ae2-2c81a87762f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:28.496238 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:28.496238 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:28.496238 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:28.496238 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:28.496238 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:28.496238 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:28.496238 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:28.496238 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:28.496238 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:28.496238 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:28.496238 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:28.496238 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:09:28.496238 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:09:28.496238 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:09:28.497224 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:09:28.497224 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:28.497224 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:28.497224 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:28.497224 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:28.497224 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:28.497224 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:28.497224 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:28.497224 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:28.497224 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:28.497224 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:28.497224 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:28.497224 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:28.497224 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:28.497224 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:28.497224 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:28.497224 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:28.502714 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:09:28.502714 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:09:28.502714 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:28.502714 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:28.502714 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 529/1037] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:09:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:28.504757 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08492d2f-e0db-495d-8f83-53ccf11d6854 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:28.606538 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08492d2f-e0db-495d-8f83-53ccf11d6854 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:28.640263 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc33027-c506-4e6e-b477-8df96e1c3977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:28.640930 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc33027-c506-4e6e-b477-8df96e1c3977 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:28.641216 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc33027-c506-4e6e-b477-8df96e1c3977 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:28.641492 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc33027-c506-4e6e-b477-8df96e1c3977 None admin] PATH_INFO: `/v3/domains` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:28.642238 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc33027-c506-4e6e-b477-8df96e1c3977 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:28.642549 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc33027-c506-4e6e-b477-8df96e1c3977 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:28.643907 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc33027-c506-4e6e-b477-8df96e1c3977 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:28.659557 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 509/1038] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:09:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:28.660712 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99d52a-5e04-474b-9ae2-2c81a87762f5 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:28.764295 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99d52a-5e04-474b-9ae2-2c81a87762f5 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:28.780967 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:28.797972 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db5d151-be4b-4587-982e-956f9c01cd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:28.798807 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5d151-be4b-4587-982e-956f9c01cd5a None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:28.799099 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5d151-be4b-4587-982e-956f9c01cd5a None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:28.799383 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5d151-be4b-4587-982e-956f9c01cd5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:28.806433 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db5d151-be4b-4587-982e-956f9c01cd5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:28.807889 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db5d151-be4b-4587-982e-956f9c01cd5a None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:28.822675 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-4db5d151-be4b-4587-982e-956f9c01cd5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:09:28.822675 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:28.822675 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:28.822675 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:28.822675 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:28.822675 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:28.822675 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:28.822675 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:28.822675 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:28.822675 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:28.822675 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:28.822675 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:28.822675 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:09:28.822675 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:09:28.822675 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:09:28.823773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:09:28.823773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:28.823773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:28.823773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:28.823773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:28.823773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:28.823773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:28.823773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:28.823773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:28.823773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:28.823773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:28.823773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:28.823773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:28.823773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:28.823773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:28.823773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:28.823773 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:28.824882 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:09:28.824882 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:09:28.824882 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:09:28.824882 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:09:28.824882 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:09:28.824882 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:09:28.824882 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:09:28.824882 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:28.827559 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 530/1039] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:09:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:09:28.832904 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc33027-c506-4e6e-b477-8df96e1c3977 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:28.876527 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:28.934303 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc33027-c506-4e6e-b477-8df96e1c3977 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:28.968973 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce2988-b7d0-48d1-9ffc-d6958d9514fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:28.969662 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce2988-b7d0-48d1-9ffc-d6958d9514fb None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:28.969949 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce2988-b7d0-48d1-9ffc-d6958d9514fb None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:28.970260 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce2988-b7d0-48d1-9ffc-d6958d9514fb None admin] PATH_INFO: `/v3/projects` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:28.971064 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce2988-b7d0-48d1-9ffc-d6958d9514fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:28.971435 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce2988-b7d0-48d1-9ffc-d6958d9514fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:28.972871 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce2988-b7d0-48d1-9ffc-d6958d9514fb None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:28.986177 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 510/1040] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:09:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:28.992122 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db5d151-be4b-4587-982e-956f9c01cd5a None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:29.093582 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db5d151-be4b-4587-982e-956f9c01cd5a None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:29.128775 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f88b9-2dcb-4340-ba76-e00f4a93fc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:29.129506 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f88b9-2dcb-4340-ba76-e00f4a93fc78 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:29.129790 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f88b9-2dcb-4340-ba76-e00f4a93fc78 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:29.130067 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f88b9-2dcb-4340-ba76-e00f4a93fc78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:29.130943 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9f88b9-2dcb-4340-ba76-e00f4a93fc78 None admin] RBAC: Adding query filter params (role.id=f3bc75c520ed4d52a97c45df41973dd0, scope.project.id=ccd95a48530c4c86a3774301b969d6a9, user.id=be0701b0a7ff479e8b3214afaf618acd) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:29.131260 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9f88b9-2dcb-4340-ba76-e00f4a93fc78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:29.132704 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9f88b9-2dcb-4340-ba76-e00f4a93fc78 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:29.146483 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 531/1041] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:09:28 2022] GET /identity/v3/role_assignments?user.id=be0701b0a7ff479e8b3214afaf618acd&scope.project.id=ccd95a48530c4c86a3774301b969d6a9&role.id=f3bc75c520ed4d52a97c45df41973dd0 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:29.907104 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c825013-5cc9-4b23-92a4-d6535ee11f48 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:29.907629 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c825013-5cc9-4b23-92a4-d6535ee11f48 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:29.907744 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c825013-5cc9-4b23-92a4-d6535ee11f48 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:29.909090 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 511/1042] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:29.914249 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a277e-f1db-4f22-872b-923a3da50760 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:29.914690 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a277e-f1db-4f22-872b-923a3da50760 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:29.914837 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a277e-f1db-4f22-872b-923a3da50760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:29.932101 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-fc4a277e-f1db-4f22-872b-923a3da50760 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:29.933308 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-fc4a277e-f1db-4f22-872b-923a3da50760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:29.971274 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:30.002001 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 532/1043] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:29 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:09:30.026614 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c825013-5cc9-4b23-92a4-d6535ee11f48 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:30.053287 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f0dc2-773a-4098-942e-cbb98e88bc06 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:30.053606 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f0dc2-773a-4098-942e-cbb98e88bc06 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:30.053862 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f0dc2-773a-4098-942e-cbb98e88bc06 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:30.055400 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 533/1044] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:09:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:09:30.060776 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f119dac-a1ee-4837-aff1-11954a4f0dd3 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:30.061270 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f119dac-a1ee-4837-aff1-11954a4f0dd3 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:30.061479 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f119dac-a1ee-4837-aff1-11954a4f0dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:30.078984 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-0f119dac-a1ee-4837-aff1-11954a4f0dd3 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:30.080173 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-0f119dac-a1ee-4837-aff1-11954a4f0dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:30.132226 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:30.137125 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c825013-5cc9-4b23-92a4-d6535ee11f48 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:30.152340 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 534/1045] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:30 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:09:30.175328 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4bdcb8-3828-4a32-901d-dd139572fb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:30.176094 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4bdcb8-3828-4a32-901d-dd139572fb4b None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:30.176485 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f119dac-a1ee-4837-aff1-11954a4f0dd3 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:30.176587 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4bdcb8-3828-4a32-901d-dd139572fb4b None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:30.176680 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4bdcb8-3828-4a32-901d-dd139572fb4b None admin] PATH_INFO: `/v3/domains/default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:30.177885 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4bdcb8-3828-4a32-901d-dd139572fb4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:30.179379 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4bdcb8-3828-4a32-901d-dd139572fb4b None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:30.185978 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 512/1046] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:09:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:30.186886 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4bdcb8-3828-4a32-901d-dd139572fb4b None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:30.283591 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f119dac-a1ee-4837-aff1-11954a4f0dd3 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:30.285628 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:30.301855 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4bdcb8-3828-4a32-901d-dd139572fb4b None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:30.329198 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed8bcb3-6b34-42f2-a0bf-fbf91f54a0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:30.330058 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8bcb3-6b34-42f2-a0bf-fbf91f54a0e8 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:30.330368 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8bcb3-6b34-42f2-a0bf-fbf91f54a0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:30.330646 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8bcb3-6b34-42f2-a0bf-fbf91f54a0e8 None admin] PATH_INFO: `/v3/services/image` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:30.331306 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed8bcb3-6b34-42f2-a0bf-fbf91f54a0e8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:30.332671 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed8bcb3-6b34-42f2-a0bf-fbf91f54a0e8 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:30.344632 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-fed8bcb3-6b34-42f2-a0bf-fbf91f54a0e8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 21:09:30.344632 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:30.344632 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:09:30.344632 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:09:30.344632 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:09:30.344632 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:09:30.344632 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:09:30.344632 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:09:30.344632 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 21:09:30.344632 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:30.344632 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:09:30.344632 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:30.344632 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:30.344632 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:30.344632 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:30.344632 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:30.344632 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:30.345876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:30.345876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:30.345876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:30.345876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:30.345876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:30.345876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:30.345876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:09:30.345876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:09:30.345876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:09:30.345876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:09:30.345876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:30.345876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:30.345876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:30.345876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:30.345876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:30.345876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:30.346817 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:30.346817 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:30.346817 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:30.346817 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:30.346817 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:30.346817 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:30.346817 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:30.346817 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:30.346817 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:30.346817 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:30.346817 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:09:30.346817 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:09:30.346817 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 21:09:30.346817 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:30.346817 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 535/1047] 10.222.0.30 () {56 vars in 1105 bytes} [Tue Jul 5 21:09:30 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:09:30.347636 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9349fa-1f80-4c97-a952-36da7496337e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:30.348078 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9349fa-1f80-4c97-a952-36da7496337e None admin] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:30.348289 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9349fa-1f80-4c97-a952-36da7496337e None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:30.348575 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9349fa-1f80-4c97-a952-36da7496337e None admin] PATH_INFO: `/v3/users` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:30.349350 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9349fa-1f80-4c97-a952-36da7496337e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:30.350876 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9349fa-1f80-4c97-a952-36da7496337e None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:30.351700 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed8bcb3-6b34-42f2-a0bf-fbf91f54a0e8 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:30.432927 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 513/1048] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:09:30 2022] POST /identity/v3/users => generated 285 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:09:30.461430 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed8bcb3-6b34-42f2-a0bf-fbf91f54a0e8 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:30.500161 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d3066f-906c-4492-b2f9-20d427903666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:30.500873 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3066f-906c-4492-b2f9-20d427903666 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:30.501214 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3066f-906c-4492-b2f9-20d427903666 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:30.501498 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3066f-906c-4492-b2f9-20d427903666 None admin] PATH_INFO: `/v3/services` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:30.502254 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d3066f-906c-4492-b2f9-20d427903666 None admin] RBAC: Adding query filter params (name=image) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:30.502573 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d3066f-906c-4492-b2f9-20d427903666 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:30.503987 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d3066f-906c-4492-b2f9-20d427903666 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:30.514892 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 536/1049] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:09:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:30.516344 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9349fa-1f80-4c97-a952-36da7496337e None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:30.544343 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:30.627310 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9349fa-1f80-4c97-a952-36da7496337e None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:30.663574 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db608b64-abae-442a-9268-cdf3122743f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:30.664251 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db608b64-abae-442a-9268-cdf3122743f7 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:30.664541 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db608b64-abae-442a-9268-cdf3122743f7 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:30.664821 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db608b64-abae-442a-9268-cdf3122743f7 None admin] PATH_INFO: `/v3/services` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:30.665727 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db608b64-abae-442a-9268-cdf3122743f7 None admin] RBAC: Adding query filter params (type=image) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:30.666044 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db608b64-abae-442a-9268-cdf3122743f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:30.667459 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db608b64-abae-442a-9268-cdf3122743f7 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:30.672447 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 514/1050] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:09:30 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:30.678279 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d3066f-906c-4492-b2f9-20d427903666 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:30.714288 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:30.783044 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d3066f-906c-4492-b2f9-20d427903666 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:30.816900 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff6abc-92b5-4e06-a95d-f65f49a35057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:30.817563 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff6abc-92b5-4e06-a95d-f65f49a35057 None admin] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:30.817852 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff6abc-92b5-4e06-a95d-f65f49a35057 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:30.818141 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff6abc-92b5-4e06-a95d-f65f49a35057 None admin] PATH_INFO: `/v3/endpoints` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:30.818892 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff6abc-92b5-4e06-a95d-f65f49a35057 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:30.820259 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff6abc-92b5-4e06-a95d-f65f49a35057 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:30.892717 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 537/1051] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Jul 5 21:09:30 2022] POST /identity/v3/endpoints => generated 327 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:09:31.150007 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348293f-e304-4406-8abb-ea4291482bf2 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:31.150609 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348293f-e304-4406-8abb-ea4291482bf2 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:31.150609 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348293f-e304-4406-8abb-ea4291482bf2 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:31.152023 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 515/1052] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:31.157427 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912aecee-11b2-44f2-8b30-99d501ed638c None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:31.157828 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912aecee-11b2-44f2-8b30-99d501ed638c None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:31.158002 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912aecee-11b2-44f2-8b30-99d501ed638c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:31.175290 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-912aecee-11b2-44f2-8b30-99d501ed638c None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:31.176476 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-912aecee-11b2-44f2-8b30-99d501ed638c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:31.251923 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 538/1053] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:09:31.275170 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348293f-e304-4406-8abb-ea4291482bf2 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:31.370896 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:31.383553 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348293f-e304-4406-8abb-ea4291482bf2 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:31.418233 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32265376-2d2e-482b-8f95-561c5e53b240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:31.418999 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32265376-2d2e-482b-8f95-561c5e53b240 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:31.419289 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32265376-2d2e-482b-8f95-561c5e53b240 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:31.419567 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32265376-2d2e-482b-8f95-561c5e53b240 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:31.429618 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32265376-2d2e-482b-8f95-561c5e53b240 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:31.438362 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-32265376-2d2e-482b-8f95-561c5e53b240 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 21:09:31.438362 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:31.438362 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:31.438362 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:31.438362 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:31.438362 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:31.438362 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:31.438362 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:31.438362 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:31.438362 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:31.438362 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:31.438362 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:31.438362 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:31.438362 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:31.438362 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:31.438362 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:31.439295 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:31.439295 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:31.439295 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:31.439295 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:31.439295 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:31.439295 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:31.439295 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:31.439295 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:31.439295 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:31.439295 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:31.439295 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:31.439295 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:31.439295 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:31.439295 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:31.439295 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:31.439295 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:31.440423 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:31.440423 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:31.440423 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:31.440423 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:31.440423 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:31.440423 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:31.440423 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:31.440423 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:31.440423 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:31.440423 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:31.440423 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 21:09:31.440423 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:09:31.442435 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 516/1054] 10.222.0.30 () {56 vars in 1120 bytes} [Tue Jul 5 21:09:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:31.446073 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912aecee-11b2-44f2-8b30-99d501ed638c None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:31.461143 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:31.548513 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912aecee-11b2-44f2-8b30-99d501ed638c None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:31.583653 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e349d7-5b21-47b9-8ac7-d9c1476e26ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:31.584326 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e349d7-5b21-47b9-8ac7-d9c1476e26ef None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:31.584611 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e349d7-5b21-47b9-8ac7-d9c1476e26ef None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:31.584888 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e349d7-5b21-47b9-8ac7-d9c1476e26ef None admin] PATH_INFO: `/v3/roles` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:31.585639 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e349d7-5b21-47b9-8ac7-d9c1476e26ef None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:31.585949 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e349d7-5b21-47b9-8ac7-d9c1476e26ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:31.587392 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e349d7-5b21-47b9-8ac7-d9c1476e26ef None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:31.596033 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 539/1055] 10.222.0.30 () {56 vars in 1115 bytes} [Tue Jul 5 21:09:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:31.601611 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32265376-2d2e-482b-8f95-561c5e53b240 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:31.705256 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32265376-2d2e-482b-8f95-561c5e53b240 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:31.738358 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bcafac-9bda-4a00-9d04-3f006da87038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:31.739164 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bcafac-9bda-4a00-9d04-3f006da87038 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:31.739451 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bcafac-9bda-4a00-9d04-3f006da87038 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:31.739728 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bcafac-9bda-4a00-9d04-3f006da87038 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:31.750274 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bcafac-9bda-4a00-9d04-3f006da87038 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:31.751709 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bcafac-9bda-4a00-9d04-3f006da87038 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:31.760159 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:31.770171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-f7bcafac-9bda-4a00-9d04-3f006da87038 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:31.770171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:31.770171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:31.770171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:31.770171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:31.770171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:31.770171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:31.770171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:31.770171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:31.770171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:31.770171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:31.770171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:31.770171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:09:31.770171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:09:31.770171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:09:31.771082 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:09:31.771082 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:31.771082 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:31.771082 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:31.771082 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:31.771082 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:31.771082 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:31.771082 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:31.771082 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:31.771082 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:31.771082 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:31.771082 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:31.771082 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:31.771082 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:31.771082 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:31.771082 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:31.771082 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:31.772041 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:09:31.772041 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:09:31.772041 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:31.772041 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:09:31.772041 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 517/1056] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:09:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:31.777293 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e349d7-5b21-47b9-8ac7-d9c1476e26ef None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:31.855669 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:31.880295 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e349d7-5b21-47b9-8ac7-d9c1476e26ef None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:31.913561 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a124c8d7-3856-4636-ada0-7d04a28658f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:31.914249 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a124c8d7-3856-4636-ada0-7d04a28658f1 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:31.914537 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a124c8d7-3856-4636-ada0-7d04a28658f1 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:31.914816 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a124c8d7-3856-4636-ada0-7d04a28658f1 None admin] PATH_INFO: `/v3/domains` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:31.916028 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a124c8d7-3856-4636-ada0-7d04a28658f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:31.916339 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a124c8d7-3856-4636-ada0-7d04a28658f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:31.917693 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a124c8d7-3856-4636-ada0-7d04a28658f1 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:31.934676 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 540/1057] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:09:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:31.936200 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bcafac-9bda-4a00-9d04-3f006da87038 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:32.045274 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bcafac-9bda-4a00-9d04-3f006da87038 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:32.079702 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed269415-ff61-4344-9b21-a5cf6f88f3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:32.080565 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed269415-ff61-4344-9b21-a5cf6f88f3f9 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:32.080860 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed269415-ff61-4344-9b21-a5cf6f88f3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:32.081143 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed269415-ff61-4344-9b21-a5cf6f88f3f9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:32.089497 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed269415-ff61-4344-9b21-a5cf6f88f3f9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:32.090972 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed269415-ff61-4344-9b21-a5cf6f88f3f9 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:32.106197 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-ed269415-ff61-4344-9b21-a5cf6f88f3f9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:09:32.106197 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:32.106197 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:32.106197 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:32.106197 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:32.106197 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:32.106197 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:32.106197 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:32.106197 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:32.106197 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:32.106197 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:32.106197 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:32.106197 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:09:32.106197 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:09:32.106197 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:09:32.106197 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:09:32.107218 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:32.107218 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:32.107218 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:09:32.107218 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:09:32.107218 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:09:32.107218 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:09:32.107218 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:32.107218 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:32.107218 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:32.107218 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:32.107218 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:32.107218 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:32.107218 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:32.107218 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:32.107218 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:32.107218 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:32.107218 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:32.107218 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:32.113131 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:32.113131 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:32.113131 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:09:32.113131 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:09:32.113131 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:09:32.113131 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:09:32.113131 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:09:32.113131 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:09:32.113131 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:09:32.113131 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:09:32.113131 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 518/1058] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Jul 5 21:09:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:32.115460 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a124c8d7-3856-4636-ada0-7d04a28658f1 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:32.220179 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a124c8d7-3856-4636-ada0-7d04a28658f1 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:32.254818 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab1174-c2eb-48e9-82a8-898c6d5a06e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:32.255497 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab1174-c2eb-48e9-82a8-898c6d5a06e5 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:32.255790 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab1174-c2eb-48e9-82a8-898c6d5a06e5 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:32.256075 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab1174-c2eb-48e9-82a8-898c6d5a06e5 None admin] PATH_INFO: `/v3/users` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:32.256918 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab1174-c2eb-48e9-82a8-898c6d5a06e5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:32.257234 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab1174-c2eb-48e9-82a8-898c6d5a06e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:32.258907 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab1174-c2eb-48e9-82a8-898c6d5a06e5 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:32.260620 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:32.278163 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 541/1059] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Jul 5 21:09:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:32.283995 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed269415-ff61-4344-9b21-a5cf6f88f3f9 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:32.352791 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:32.395929 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed269415-ff61-4344-9b21-a5cf6f88f3f9 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:32.429954 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515520ef-6c3f-4581-8c9f-2cc638af1b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:32.430903 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515520ef-6c3f-4581-8c9f-2cc638af1b51 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:32.431196 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515520ef-6c3f-4581-8c9f-2cc638af1b51 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:32.431572 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515520ef-6c3f-4581-8c9f-2cc638af1b51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:32.442777 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515520ef-6c3f-4581-8c9f-2cc638af1b51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:32.444234 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515520ef-6c3f-4581-8c9f-2cc638af1b51 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:32.462102 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-515520ef-6c3f-4581-8c9f-2cc638af1b51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:32.462102 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:32.462102 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:32.462102 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:32.462102 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:32.462102 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:32.462102 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:32.462102 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:32.462102 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:32.462102 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:32.462102 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:32.462102 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:32.462102 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:09:32.462102 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:09:32.462102 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:09:32.463062 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:09:32.463062 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:32.463062 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:32.463062 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:32.463062 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:32.463062 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:32.463062 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:32.463062 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:32.463062 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:32.463062 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:32.463062 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:32.463062 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:32.463062 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:32.463062 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:32.463062 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:32.463062 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:32.463062 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:32.464047 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:09:32.464047 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:09:32.464047 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:32.464047 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:09:32.468352 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 519/1060] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:09:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:32.469626 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab1174-c2eb-48e9-82a8-898c6d5a06e5 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:32.573386 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab1174-c2eb-48e9-82a8-898c6d5a06e5 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:32.577799 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72597876-01e7-426f-b054-91f77a89205d None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:32.578092 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72597876-01e7-426f-b054-91f77a89205d None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:32.578404 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72597876-01e7-426f-b054-91f77a89205d None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:32.579768 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 520/1061] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:09:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:09:32.584744 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58837c-0216-4777-8ed1-6d22ee850e0a None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:32.585041 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58837c-0216-4777-8ed1-6d22ee850e0a None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:32.585329 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58837c-0216-4777-8ed1-6d22ee850e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:32.603427 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-9c58837c-0216-4777-8ed1-6d22ee850e0a None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:32.604625 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-9c58837c-0216-4777-8ed1-6d22ee850e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:32.615877 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a450d-b54f-4963-9b09-a929cdfd087b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:32.616550 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a450d-b54f-4963-9b09-a929cdfd087b None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:32.616836 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a450d-b54f-4963-9b09-a929cdfd087b None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:32.617128 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a450d-b54f-4963-9b09-a929cdfd087b None admin] PATH_INFO: `/v3/domains` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:32.617859 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9a450d-b54f-4963-9b09-a929cdfd087b None admin] RBAC: Adding query filter params (name=Default) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:32.618784 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9a450d-b54f-4963-9b09-a929cdfd087b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:32.620175 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9a450d-b54f-4963-9b09-a929cdfd087b None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:32.636766 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 542/1062] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:09:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:32.638786 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a450d-b54f-4963-9b09-a929cdfd087b None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:32.681915 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 521/1063] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:09:32.696048 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:32.705817 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58837c-0216-4777-8ed1-6d22ee850e0a None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:32.747868 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a450d-b54f-4963-9b09-a929cdfd087b None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:32.751790 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:32.784086 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54455286-95ad-4794-920e-507df0b26615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:32.784887 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54455286-95ad-4794-920e-507df0b26615 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:32.785173 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54455286-95ad-4794-920e-507df0b26615 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:32.785451 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54455286-95ad-4794-920e-507df0b26615 None admin] PATH_INFO: `/v3/projects/service` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:32.793058 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54455286-95ad-4794-920e-507df0b26615 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:32.794541 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54455286-95ad-4794-920e-507df0b26615 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:32.809600 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-54455286-95ad-4794-920e-507df0b26615 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:09:32.809600 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:32.809600 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:32.809600 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:32.809600 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:32.809600 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:32.809600 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:32.809600 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:32.809600 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:32.809600 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:32.809600 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:32.809600 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:32.809600 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:09:32.809600 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:09:32.809600 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:09:32.810635 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:09:32.810635 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:32.810635 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:32.810635 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:32.810635 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:32.810635 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:32.810635 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:32.810635 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:32.810635 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:32.810635 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:32.810635 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:32.810635 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:32.810635 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:32.810635 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:32.810635 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:32.810635 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:32.810635 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:32.811559 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:09:32.811559 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:09:32.811559 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:09:32.811559 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:09:32.811559 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:09:32.811559 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:09:32.811559 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:09:32.811559 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:32.813124 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 543/1064] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:09:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:09:32.817001 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54455286-95ad-4794-920e-507df0b26615 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:32.821741 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58837c-0216-4777-8ed1-6d22ee850e0a None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:32.860157 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e8a91-d39a-4312-b329-d96b29fa4ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:32.860884 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e8a91-d39a-4312-b329-d96b29fa4ab9 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:32.861176 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e8a91-d39a-4312-b329-d96b29fa4ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:32.861457 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e8a91-d39a-4312-b329-d96b29fa4ab9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:32.872743 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763e8a91-d39a-4312-b329-d96b29fa4ab9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:32.880960 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-763e8a91-d39a-4312-b329-d96b29fa4ab9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:09:32.880960 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:32.880960 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:32.880960 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:32.880960 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:32.880960 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:32.880960 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:32.880960 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:32.880960 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:32.880960 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:32.880960 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:32.880960 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:32.880960 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:32.880960 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:32.880960 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:32.880960 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:32.881925 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:32.881925 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:32.881925 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:32.881925 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:32.881925 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:32.881925 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:32.881925 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:32.881925 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:32.881925 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:32.881925 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:32.881925 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:32.881925 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:32.881925 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:32.881925 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:32.881925 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:32.881925 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:32.882829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:32.882829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:32.882829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:32.882829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:32.882829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:32.882829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:32.882829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:32.882829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:32.882829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:32.882829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:32.882829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:09:32.882829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:09:32.882829 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 522/1065] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:09:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:09:32.888440 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e8a91-d39a-4312-b329-d96b29fa4ab9 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:32.925568 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54455286-95ad-4794-920e-507df0b26615 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:32.941234 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:32.962613 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c807fcbe-81c0-4571-a78a-c31e3da8ff51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:32.963360 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807fcbe-81c0-4571-a78a-c31e3da8ff51 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:32.963649 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807fcbe-81c0-4571-a78a-c31e3da8ff51 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:32.963930 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807fcbe-81c0-4571-a78a-c31e3da8ff51 None admin] PATH_INFO: `/v3/projects` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:32.964718 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c807fcbe-81c0-4571-a78a-c31e3da8ff51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:32.965035 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c807fcbe-81c0-4571-a78a-c31e3da8ff51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:32.966628 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c807fcbe-81c0-4571-a78a-c31e3da8ff51 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:32.979027 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 544/1066] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:09:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:32.980302 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff092b2-e61c-411a-a50d-cbdc5cedf2d1 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:32.980599 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff092b2-e61c-411a-a50d-cbdc5cedf2d1 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:32.980876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff092b2-e61c-411a-a50d-cbdc5cedf2d1 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:32.982097 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 545/1067] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:09:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:32.987093 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65625ffe-6198-4acc-a900-26a7a9cba63e None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:32.987386 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65625ffe-6198-4acc-a900-26a7a9cba63e None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:32.987667 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65625ffe-6198-4acc-a900-26a7a9cba63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:32.996723 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e8a91-d39a-4312-b329-d96b29fa4ab9 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:32.998314 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:33.003317 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-65625ffe-6198-4acc-a900-26a7a9cba63e None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:33.004499 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-65625ffe-6198-4acc-a900-26a7a9cba63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:33.032091 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641b522-fda2-4ae5-a089-28080e3b552a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:33.032763 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641b522-fda2-4ae5-a089-28080e3b552a None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:33.033050 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641b522-fda2-4ae5-a089-28080e3b552a None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:33.033329 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641b522-fda2-4ae5-a089-28080e3b552a None admin] PATH_INFO: `/v3/roles` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:33.034067 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b641b522-fda2-4ae5-a089-28080e3b552a None admin] RBAC: Adding query filter params (name=admin) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:33.034406 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b641b522-fda2-4ae5-a089-28080e3b552a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:33.035774 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b641b522-fda2-4ae5-a089-28080e3b552a None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:33.045767 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 523/1068] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:09:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:33.046558 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641b522-fda2-4ae5-a089-28080e3b552a None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:33.072127 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 546/1069] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:09:33.079041 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65625ffe-6198-4acc-a900-26a7a9cba63e None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:33.146924 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641b522-fda2-4ae5-a089-28080e3b552a None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:33.178891 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65625ffe-6198-4acc-a900-26a7a9cba63e None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:33.180418 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:33.181246 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a055c-6679-4b3d-b95f-8679d95df83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:33.182153 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a055c-6679-4b3d-b95f-8679d95df83c None admin] REQUEST_METHOD: `PUT` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:33.182496 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a055c-6679-4b3d-b95f-8679d95df83c None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:33.182775 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a055c-6679-4b3d-b95f-8679d95df83c None admin] PATH_INFO: `/v3/projects/ccd95a48530c4c86a3774301b969d6a9/users/be0701b0a7ff479e8b3214afaf618acd/roles/f3bc75c520ed4d52a97c45df41973dd0` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:33.185023 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a055c-6679-4b3d-b95f-8679d95df83c None admin] RBAC: Authorizing `identity:create_grant(project_id=ccd95a48530c4c86a3774301b969d6a9, user_id=be0701b0a7ff479e8b3214afaf618acd, role_id=f3bc75c520ed4d52a97c45df41973dd0)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:33.186492 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a055c-6679-4b3d-b95f-8679d95df83c None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:33.214361 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c6916-4066-49d4-a6ee-e30895a6cf73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:33.215457 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c6916-4066-49d4-a6ee-e30895a6cf73 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:33.215940 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c6916-4066-49d4-a6ee-e30895a6cf73 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:33.216502 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c6916-4066-49d4-a6ee-e30895a6cf73 None admin] PATH_INFO: `/v3/users/8a39dc3f2c6a4ff7bd8fb219b2262f1d` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:33.229777 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c6916-4066-49d4-a6ee-e30895a6cf73 None admin] RBAC: Authorizing `identity:get_user(user_id=8a39dc3f2c6a4ff7bd8fb219b2262f1d)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:33.231335 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c6916-4066-49d4-a6ee-e30895a6cf73 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:33.232974 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 547/1070] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:09:33 2022] GET /identity/v3/users/8a39dc3f2c6a4ff7bd8fb219b2262f1d => generated 285 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:33.233818 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c6916-4066-49d4-a6ee-e30895a6cf73 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:33.290762 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 524/1071] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:09:33 2022] PUT /identity/v3/projects/ccd95a48530c4c86a3774301b969d6a9/users/be0701b0a7ff479e8b3214afaf618acd/roles/f3bc75c520ed4d52a97c45df41973dd0 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:09:33.291722 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a055c-6679-4b3d-b95f-8679d95df83c None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:33.325498 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:33.346504 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c6916-4066-49d4-a6ee-e30895a6cf73 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:33.386037 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69f05b-52c8-4361-9792-dc17bc09d209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:33.386739 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69f05b-52c8-4361-9792-dc17bc09d209 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:33.387027 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69f05b-52c8-4361-9792-dc17bc09d209 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:33.387312 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69f05b-52c8-4361-9792-dc17bc09d209 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:33.411989 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a055c-6679-4b3d-b95f-8679d95df83c None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:33.417634 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:33.459042 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb30c12-4a75-4230-a44b-02824078db15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:33.460080 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb30c12-4a75-4230-a44b-02824078db15 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:33.460371 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb30c12-4a75-4230-a44b-02824078db15 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:33.460878 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb30c12-4a75-4230-a44b-02824078db15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:33.464427 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f69f05b-52c8-4361-9792-dc17bc09d209 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:33.466158 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f69f05b-52c8-4361-9792-dc17bc09d209 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:33.546909 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb30c12-4a75-4230-a44b-02824078db15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:33.548687 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb30c12-4a75-4230-a44b-02824078db15 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:33.574201 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:33.575549 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 548/1072] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:09:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:09:33.580649 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69f05b-52c8-4361-9792-dc17bc09d209 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:33.641564 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:33.658672 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 525/1073] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:09:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:09:33.664478 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb30c12-4a75-4230-a44b-02824078db15 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:33.683804 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69f05b-52c8-4361-9792-dc17bc09d209 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:33.721012 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd7735-da6e-4be0-9a07-a0b125977bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:33.721688 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd7735-da6e-4be0-9a07-a0b125977bcd None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:33.721985 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd7735-da6e-4be0-9a07-a0b125977bcd None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:33.722363 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd7735-da6e-4be0-9a07-a0b125977bcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:33.736068 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd7735-da6e-4be0-9a07-a0b125977bcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:33.737843 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd7735-da6e-4be0-9a07-a0b125977bcd None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:33.755995 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-79bd7735-da6e-4be0-9a07-a0b125977bcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:33.755995 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:33.755995 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:33.755995 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:33.755995 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:33.755995 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:33.755995 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:33.755995 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:33.755995 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:33.755995 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:33.755995 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:33.755995 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:33.755995 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:09:33.755995 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:09:33.755995 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:09:33.756949 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:09:33.756949 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:33.756949 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:33.756949 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:33.756949 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:33.756949 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:33.756949 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:33.756949 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:33.756949 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:33.756949 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:33.756949 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:33.756949 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:33.756949 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:33.756949 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:33.756949 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:33.756949 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:33.756949 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:33.757929 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:09:33.757929 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:09:33.757929 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:33.757929 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:33.757929 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 549/1074] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:09:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:33.763051 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd7735-da6e-4be0-9a07-a0b125977bcd None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:33.779624 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb30c12-4a75-4230-a44b-02824078db15 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:33.806755 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:33.819227 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf0365d-2943-4891-9f1c-e5fdd66e3192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:33.820106 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0365d-2943-4891-9f1c-e5fdd66e3192 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:33.820393 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0365d-2943-4891-9f1c-e5fdd66e3192 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:33.820678 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0365d-2943-4891-9f1c-e5fdd66e3192 None admin] PATH_INFO: `/v3/projects/9cf4b79a3546454f947759f30db2a838` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:33.822881 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf0365d-2943-4891-9f1c-e5fdd66e3192 None admin] RBAC: Authorizing `identity:get_project(project_id=9cf4b79a3546454f947759f30db2a838)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:33.824335 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf0365d-2943-4891-9f1c-e5fdd66e3192 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:33.826162 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 526/1075] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:09:33 2022] GET /identity/v3/projects/9cf4b79a3546454f947759f30db2a838 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:33.832093 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf0365d-2943-4891-9f1c-e5fdd66e3192 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:33.879065 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd7735-da6e-4be0-9a07-a0b125977bcd None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:33.893089 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:33.917853 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3063cf2e-bbec-4515-9454-905c8c270ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:33.919190 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063cf2e-bbec-4515-9454-905c8c270ed7 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:33.920272 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063cf2e-bbec-4515-9454-905c8c270ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:33.921173 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063cf2e-bbec-4515-9454-905c8c270ed7 None admin] PATH_INFO: `/v3/domains` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:33.922158 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3063cf2e-bbec-4515-9454-905c8c270ed7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:33.922464 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3063cf2e-bbec-4515-9454-905c8c270ed7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:33.924351 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3063cf2e-bbec-4515-9454-905c8c270ed7 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:33.946169 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 550/1076] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:09:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:33.950551 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf0365d-2943-4891-9f1c-e5fdd66e3192 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:33.990376 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433788b9-4cb5-4af4-8313-0150b65d2927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:33.991064 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433788b9-4cb5-4af4-8313-0150b65d2927 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:33.991354 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433788b9-4cb5-4af4-8313-0150b65d2927 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:33.991636 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433788b9-4cb5-4af4-8313-0150b65d2927 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:33.992488 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433788b9-4cb5-4af4-8313-0150b65d2927 None admin] RBAC: Adding query filter params (role.id=101b93f94624407f8c812ab86ebec32a, scope.project.id=9cf4b79a3546454f947759f30db2a838, user.id=8a39dc3f2c6a4ff7bd8fb219b2262f1d) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:33.992811 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433788b9-4cb5-4af4-8313-0150b65d2927 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:33.995141 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433788b9-4cb5-4af4-8313-0150b65d2927 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:34.001915 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 527/1077] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:09:33 2022] GET /identity/v3/role_assignments?user.id=8a39dc3f2c6a4ff7bd8fb219b2262f1d&scope.project.id=9cf4b79a3546454f947759f30db2a838&role.id=101b93f94624407f8c812ab86ebec32a => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:35.328971 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888713a3-3b61-46be-ba06-b647fbec655f None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:35.329375 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888713a3-3b61-46be-ba06-b647fbec655f None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:35.329533 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888713a3-3b61-46be-ba06-b647fbec655f None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:35.330937 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 551/1078] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:09:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:35.336031 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a82cc-4eb0-41c4-8799-8c40567bfee7 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:35.336422 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a82cc-4eb0-41c4-8799-8c40567bfee7 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:35.336595 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a82cc-4eb0-41c4-8799-8c40567bfee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:35.354099 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-d02a82cc-4eb0-41c4-8799-8c40567bfee7 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:35.355312 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-d02a82cc-4eb0-41c4-8799-8c40567bfee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:35.402975 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:35.419231 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 528/1079] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:09:35.442575 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888713a3-3b61-46be-ba06-b647fbec655f None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:35.542386 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888713a3-3b61-46be-ba06-b647fbec655f None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:35.575677 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16820164-d2a8-4645-ad86-5f70d161eb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:35.576420 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16820164-d2a8-4645-ad86-5f70d161eb0d None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:35.576707 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16820164-d2a8-4645-ad86-5f70d161eb0d None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:35.576987 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16820164-d2a8-4645-ad86-5f70d161eb0d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:35.587630 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16820164-d2a8-4645-ad86-5f70d161eb0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:35.595849 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-16820164-d2a8-4645-ad86-5f70d161eb0d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 21:09:35.595849 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:35.595849 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:35.595849 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:35.595849 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:35.595849 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:35.595849 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:35.595849 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:35.595849 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:35.595849 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:35.595849 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:35.595849 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:35.595849 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:35.595849 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:35.595849 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:35.595849 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:35.596965 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:35.596965 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:35.596965 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:35.596965 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:35.596965 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:35.596965 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:35.596965 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:35.596965 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:35.596965 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:35.596965 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:35.596965 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:35.596965 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:35.596965 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:35.596965 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:35.596965 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:35.596965 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:35.598019 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:35.598019 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:35.598019 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:35.598019 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:35.598019 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:35.598019 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:35.598019 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:35.598019 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:35.598019 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:35.598019 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:35.598019 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 21:09:35.598019 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:35.602027 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 552/1080] 10.222.0.30 () {56 vars in 1120 bytes} [Tue Jul 5 21:09:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:35.603365 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a82cc-4eb0-41c4-8799-8c40567bfee7 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:35.699098 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a82cc-4eb0-41c4-8799-8c40567bfee7 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:35.745704 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d0458-ec51-4967-b15c-e8d0eb6ec03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:35.746409 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d0458-ec51-4967-b15c-e8d0eb6ec03f None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:35.746694 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d0458-ec51-4967-b15c-e8d0eb6ec03f None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:35.746972 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d0458-ec51-4967-b15c-e8d0eb6ec03f None admin] PATH_INFO: `/v3/roles` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:35.747710 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d0458-ec51-4967-b15c-e8d0eb6ec03f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:35.748020 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d0458-ec51-4967-b15c-e8d0eb6ec03f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:35.749440 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d0458-ec51-4967-b15c-e8d0eb6ec03f None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:35.757314 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 529/1081] 10.222.0.30 () {56 vars in 1115 bytes} [Tue Jul 5 21:09:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:35.763038 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16820164-d2a8-4645-ad86-5f70d161eb0d None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:35.795270 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:35.862213 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16820164-d2a8-4645-ad86-5f70d161eb0d None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:35.896078 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe3444-2b81-4f7b-8f99-0a41b6586176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:35.896879 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe3444-2b81-4f7b-8f99-0a41b6586176 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:35.897172 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe3444-2b81-4f7b-8f99-0a41b6586176 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:35.897458 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe3444-2b81-4f7b-8f99-0a41b6586176 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:35.908495 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbe3444-2b81-4f7b-8f99-0a41b6586176 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:35.909950 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbe3444-2b81-4f7b-8f99-0a41b6586176 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:35.928395 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-0cbe3444-2b81-4f7b-8f99-0a41b6586176 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:35.928395 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:35.928395 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:35.928395 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:35.928395 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:35.928395 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:35.928395 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:35.928395 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:35.928395 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:35.928395 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:35.928395 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:35.928395 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:35.928395 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:09:35.928395 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:09:35.928395 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:09:35.929279 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:09:35.929279 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:35.929279 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:35.929279 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:35.929279 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:35.929279 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:35.929279 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:35.929279 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:35.929279 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:35.929279 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:35.929279 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:35.929279 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:35.929279 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:35.929279 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:35.929279 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:35.929279 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:35.929279 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:35.931150 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:09:35.931150 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:09:35.931150 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:35.931150 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:35.931150 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 553/1082] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:09:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:35.936036 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d0458-ec51-4967-b15c-e8d0eb6ec03f None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:35.986190 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:36.028303 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0919346-9a5d-4d24-ad0b-eb209d3f65c5 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:36.028596 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0919346-9a5d-4d24-ad0b-eb209d3f65c5 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:36.028880 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0919346-9a5d-4d24-ad0b-eb209d3f65c5 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:36.030285 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 554/1083] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:09:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:09:36.035275 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15728389-7f3f-4ec2-bbee-482d56eb241f None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:36.035568 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15728389-7f3f-4ec2-bbee-482d56eb241f None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:36.035851 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15728389-7f3f-4ec2-bbee-482d56eb241f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:36.037876 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d0458-ec51-4967-b15c-e8d0eb6ec03f None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:36.052052 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-15728389-7f3f-4ec2-bbee-482d56eb241f None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:36.053222 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-15728389-7f3f-4ec2-bbee-482d56eb241f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:36.072677 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab0237c-b70a-43b9-bd6a-eae944286fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:36.073351 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0237c-b70a-43b9-bd6a-eae944286fc1 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:36.073644 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0237c-b70a-43b9-bd6a-eae944286fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:36.073961 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0237c-b70a-43b9-bd6a-eae944286fc1 None admin] PATH_INFO: `/v3/domains` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:36.074729 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab0237c-b70a-43b9-bd6a-eae944286fc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:36.075043 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab0237c-b70a-43b9-bd6a-eae944286fc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:36.076423 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab0237c-b70a-43b9-bd6a-eae944286fc1 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:36.088262 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 530/1084] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:09:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:36.093711 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab0237c-b70a-43b9-bd6a-eae944286fc1 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:36.121862 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 555/1085] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:09:36.144679 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15728389-7f3f-4ec2-bbee-482d56eb241f None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:36.159393 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:36.194763 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab0237c-b70a-43b9-bd6a-eae944286fc1 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:36.204285 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:36.230104 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3ea3f-32de-4004-b267-ef987f2bed12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:36.231381 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3ea3f-32de-4004-b267-ef987f2bed12 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:36.231671 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3ea3f-32de-4004-b267-ef987f2bed12 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:36.231956 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3ea3f-32de-4004-b267-ef987f2bed12 None admin] PATH_INFO: `/v3/users/nova` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:36.239365 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace3ea3f-32de-4004-b267-ef987f2bed12 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:36.240808 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace3ea3f-32de-4004-b267-ef987f2bed12 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:36.244509 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15728389-7f3f-4ec2-bbee-482d56eb241f None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:36.256083 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-ace3ea3f-32de-4004-b267-ef987f2bed12 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:09:36.256083 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:36.256083 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:36.256083 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:36.256083 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:36.256083 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:36.256083 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:36.256083 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:36.256083 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:36.256083 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:36.256083 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:36.256083 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:36.256083 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:09:36.256083 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:09:36.256083 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:09:36.256083 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:09:36.257027 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:36.257027 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:36.257027 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:09:36.257027 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:09:36.257027 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:09:36.257027 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:09:36.257027 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:36.257027 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:36.257027 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:36.257027 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:36.257027 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:36.257027 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:36.257027 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:36.257027 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:36.257027 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:36.257027 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:36.257027 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:36.257027 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:36.258243 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:36.258243 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:36.258243 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:09:36.258243 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:09:36.258243 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:09:36.258243 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:09:36.258243 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:09:36.258243 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:09:36.258243 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:09:36.258243 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:09:36.258243 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 531/1086] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Jul 5 21:09:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:09:36.263021 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3ea3f-32de-4004-b267-ef987f2bed12 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:36.281476 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d61a2-a5ee-4459-9048-2aa58495a659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:36.282326 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d61a2-a5ee-4459-9048-2aa58495a659 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:36.282649 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d61a2-a5ee-4459-9048-2aa58495a659 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:36.282954 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d61a2-a5ee-4459-9048-2aa58495a659 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:36.293313 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d61a2-a5ee-4459-9048-2aa58495a659 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:36.302673 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-b01d61a2-a5ee-4459-9048-2aa58495a659 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:09:36.302673 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:36.302673 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:36.302673 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:36.302673 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:36.302673 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:36.302673 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:36.302673 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:36.302673 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:36.302673 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:36.302673 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:36.302673 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:36.302673 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:36.302673 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:36.302673 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:36.302673 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:36.303707 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:36.303707 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:36.303707 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:36.303707 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:36.303707 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:36.303707 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:36.303707 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:36.303707 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:36.303707 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:36.303707 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:36.303707 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:36.303707 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:36.303707 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:36.303707 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:36.303707 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:36.303707 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:36.304680 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:36.304680 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:36.304680 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:36.304680 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:36.304680 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:36.304680 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:36.304680 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:36.304680 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:36.304680 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:36.304680 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:36.304680 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:09:36.304680 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:36.304680 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 556/1087] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:09:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:09:36.309686 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d61a2-a5ee-4459-9048-2aa58495a659 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:36.369672 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3ea3f-32de-4004-b267-ef987f2bed12 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:36.385825 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:36.403985 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a9f29-59ba-49a6-9100-dc38ae4d147d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:36.404625 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a9f29-59ba-49a6-9100-dc38ae4d147d None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:36.404915 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a9f29-59ba-49a6-9100-dc38ae4d147d None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:36.405200 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a9f29-59ba-49a6-9100-dc38ae4d147d None admin] PATH_INFO: `/v3/users` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:36.406033 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2a9f29-59ba-49a6-9100-dc38ae4d147d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:36.406384 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2a9f29-59ba-49a6-9100-dc38ae4d147d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:36.407942 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2a9f29-59ba-49a6-9100-dc38ae4d147d None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:36.409573 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d61a2-a5ee-4459-9048-2aa58495a659 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:36.426359 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 532/1088] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Jul 5 21:09:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:36.432577 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a9f29-59ba-49a6-9100-dc38ae4d147d None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:36.445234 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90b716-8a3d-407c-a569-ce3b6c9520c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:36.445909 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90b716-8a3d-407c-a569-ce3b6c9520c9 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:36.446280 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90b716-8a3d-407c-a569-ce3b6c9520c9 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:36.446751 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90b716-8a3d-407c-a569-ce3b6c9520c9 None admin] PATH_INFO: `/v3/roles` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:36.447593 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d90b716-8a3d-407c-a569-ce3b6c9520c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:36.447911 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d90b716-8a3d-407c-a569-ce3b6c9520c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:36.449307 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d90b716-8a3d-407c-a569-ce3b6c9520c9 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:36.457454 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 557/1089] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:09:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:36.458776 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:36.463134 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90b716-8a3d-407c-a569-ce3b6c9520c9 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:36.531973 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a9f29-59ba-49a6-9100-dc38ae4d147d None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:36.561025 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90b716-8a3d-407c-a569-ce3b6c9520c9 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:36.565976 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e744a8e-ff7c-4f78-9ef6-72f8e97a1f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:36.566658 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e744a8e-ff7c-4f78-9ef6-72f8e97a1f78 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:36.566948 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e744a8e-ff7c-4f78-9ef6-72f8e97a1f78 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:36.567231 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e744a8e-ff7c-4f78-9ef6-72f8e97a1f78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:36.593610 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f17821-cbb9-49de-917a-060cb04cf439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:36.594514 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f17821-cbb9-49de-917a-060cb04cf439 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:36.594801 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f17821-cbb9-49de-917a-060cb04cf439 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:36.595082 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f17821-cbb9-49de-917a-060cb04cf439 None admin] PATH_INFO: `/v3/users/8a39dc3f2c6a4ff7bd8fb219b2262f1d` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:36.596271 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f17821-cbb9-49de-917a-060cb04cf439 None admin] RBAC: Authorizing `identity:get_user(user_id=8a39dc3f2c6a4ff7bd8fb219b2262f1d)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:36.597690 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f17821-cbb9-49de-917a-060cb04cf439 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:36.599336 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 558/1090] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:09:36 2022] GET /identity/v3/users/8a39dc3f2c6a4ff7bd8fb219b2262f1d => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:36.605578 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f17821-cbb9-49de-917a-060cb04cf439 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:36.609429 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:36.634478 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e744a8e-ff7c-4f78-9ef6-72f8e97a1f78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:36.636006 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e744a8e-ff7c-4f78-9ef6-72f8e97a1f78 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:36.662110 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:36.703615 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f17821-cbb9-49de-917a-060cb04cf439 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:36.733961 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 533/1091] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:09:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 05 21:09:36.736813 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc28a3a7-4fe2-4a58-b8dd-529bb61342e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:36.737678 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28a3a7-4fe2-4a58-b8dd-529bb61342e7 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:36.737964 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28a3a7-4fe2-4a58-b8dd-529bb61342e7 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:36.738276 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28a3a7-4fe2-4a58-b8dd-529bb61342e7 None admin] PATH_INFO: `/v3/projects/9cf4b79a3546454f947759f30db2a838` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:36.739454 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc28a3a7-4fe2-4a58-b8dd-529bb61342e7 None admin] RBAC: Authorizing `identity:get_project(project_id=9cf4b79a3546454f947759f30db2a838)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:36.739565 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e744a8e-ff7c-4f78-9ef6-72f8e97a1f78 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:36.740912 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc28a3a7-4fe2-4a58-b8dd-529bb61342e7 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:36.744203 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 559/1092] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:09:36 2022] GET /identity/v3/projects/9cf4b79a3546454f947759f30db2a838 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:36.749177 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc28a3a7-4fe2-4a58-b8dd-529bb61342e7 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:36.816872 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:36.838213 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e744a8e-ff7c-4f78-9ef6-72f8e97a1f78 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:36.845556 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc28a3a7-4fe2-4a58-b8dd-529bb61342e7 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:36.863413 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:36.872570 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa308f0-8908-4988-a8ed-0b25ffb06760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:36.873440 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa308f0-8908-4988-a8ed-0b25ffb06760 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:36.873727 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa308f0-8908-4988-a8ed-0b25ffb06760 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:36.875388 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa308f0-8908-4988-a8ed-0b25ffb06760 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:36.878596 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e66a44-f659-443b-a4d9-9bc5c32509b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:36.879477 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e66a44-f659-443b-a4d9-9bc5c32509b4 None admin] REQUEST_METHOD: `PUT` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:36.879764 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e66a44-f659-443b-a4d9-9bc5c32509b4 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:36.880046 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e66a44-f659-443b-a4d9-9bc5c32509b4 None admin] PATH_INFO: `/v3/projects/9cf4b79a3546454f947759f30db2a838/users/8a39dc3f2c6a4ff7bd8fb219b2262f1d/roles/101b93f94624407f8c812ab86ebec32a` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:36.881998 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e66a44-f659-443b-a4d9-9bc5c32509b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=9cf4b79a3546454f947759f30db2a838, user_id=8a39dc3f2c6a4ff7bd8fb219b2262f1d, role_id=101b93f94624407f8c812ab86ebec32a)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:36.883490 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e66a44-f659-443b-a4d9-9bc5c32509b4 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:36.884630 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa308f0-8908-4988-a8ed-0b25ffb06760 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:36.886120 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa308f0-8908-4988-a8ed-0b25ffb06760 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:36.904004 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-afa308f0-8908-4988-a8ed-0b25ffb06760 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:36.904004 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:36.904004 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:36.904004 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:36.904004 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:36.904004 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:36.904004 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:36.904004 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:36.904004 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:36.904004 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:36.904004 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:36.904004 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:36.904004 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:09:36.904004 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:09:36.904004 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:09:36.905109 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:09:36.905109 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:36.905109 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:36.905109 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:36.905109 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:36.905109 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:36.905109 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:36.905109 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:36.905109 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:36.905109 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:36.905109 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:36.905109 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:36.905109 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:36.905109 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:36.905109 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:36.905109 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:36.905109 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:36.906443 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:09:36.906443 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:09:36.906443 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:09:36.906443 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:09:36.906443 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 534/1093] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:09:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:09:36.910736 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa308f0-8908-4988-a8ed-0b25ffb06760 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:36.966535 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 560/1094] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:09:36 2022] PUT /identity/v3/projects/9cf4b79a3546454f947759f30db2a838/users/8a39dc3f2c6a4ff7bd8fb219b2262f1d/roles/101b93f94624407f8c812ab86ebec32a => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:09:37.013412 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa308f0-8908-4988-a8ed-0b25ffb06760 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:37.050962 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a468ae-faf2-4679-9127-e9968b91d997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:37.051652 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a468ae-faf2-4679-9127-e9968b91d997 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:37.051941 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a468ae-faf2-4679-9127-e9968b91d997 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:37.052222 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a468ae-faf2-4679-9127-e9968b91d997 None admin] PATH_INFO: `/v3/domains` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:37.052957 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a468ae-faf2-4679-9127-e9968b91d997 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:37.053298 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a468ae-faf2-4679-9127-e9968b91d997 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:37.054746 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a468ae-faf2-4679-9127-e9968b91d997 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:37.068122 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 535/1095] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:09:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:09:37.074003 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e66a44-f659-443b-a4d9-9bc5c32509b4 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:37.178596 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e66a44-f659-443b-a4d9-9bc5c32509b4 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:37.208308 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:37.213304 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa91dcc-91d8-423b-a11d-80574f4908d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:37.214103 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa91dcc-91d8-423b-a11d-80574f4908d2 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:37.214419 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa91dcc-91d8-423b-a11d-80574f4908d2 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:37.214699 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa91dcc-91d8-423b-a11d-80574f4908d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:37.221455 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa91dcc-91d8-423b-a11d-80574f4908d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:37.222919 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa91dcc-91d8-423b-a11d-80574f4908d2 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:37.237559 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-8fa91dcc-91d8-423b-a11d-80574f4908d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:09:37.237559 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:37.237559 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:37.237559 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:37.237559 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:37.237559 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:37.237559 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:37.237559 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:37.237559 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:37.237559 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:37.237559 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:37.237559 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:37.237559 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:09:37.237559 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:09:37.237559 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:09:37.238668 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:09:37.238668 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:37.238668 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:37.238668 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:37.238668 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:37.238668 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:37.238668 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:37.238668 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:37.238668 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:37.238668 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:37.238668 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:37.238668 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:37.238668 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:37.238668 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:37.238668 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:37.238668 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:37.238668 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:37.239593 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:09:37.239593 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:09:37.239593 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:09:37.239593 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:09:37.239593 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:09:37.239593 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:09:37.239593 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:09:37.239593 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:09:37.239593 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 561/1096] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:09:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:09:37.245391 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a468ae-faf2-4679-9127-e9968b91d997 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:37.285313 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:37.349403 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a468ae-faf2-4679-9127-e9968b91d997 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:37.383340 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a52033-56b3-43f7-b593-00182f56c58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:37.384078 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a52033-56b3-43f7-b593-00182f56c58d None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:37.384374 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a52033-56b3-43f7-b593-00182f56c58d None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:37.384662 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a52033-56b3-43f7-b593-00182f56c58d None admin] PATH_INFO: `/v3/projects` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:37.385458 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a52033-56b3-43f7-b593-00182f56c58d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:37.385777 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a52033-56b3-43f7-b593-00182f56c58d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:37.387263 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a52033-56b3-43f7-b593-00182f56c58d None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:37.404744 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 536/1097] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:09:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:37.405890 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa91dcc-91d8-423b-a11d-80574f4908d2 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:37.502910 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa91dcc-91d8-423b-a11d-80574f4908d2 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:37.535385 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e760cd-543a-42ba-9f48-c439ec0f6d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:37.536033 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e760cd-543a-42ba-9f48-c439ec0f6d3b None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:37.536318 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e760cd-543a-42ba-9f48-c439ec0f6d3b None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:37.536595 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e760cd-543a-42ba-9f48-c439ec0f6d3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:37.537411 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e760cd-543a-42ba-9f48-c439ec0f6d3b None admin] RBAC: Adding query filter params (role.id=f3bc75c520ed4d52a97c45df41973dd0, scope.project.id=ccd95a48530c4c86a3774301b969d6a9, user.id=be0701b0a7ff479e8b3214afaf618acd) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:37.537722 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e760cd-543a-42ba-9f48-c439ec0f6d3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:37.539175 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e760cd-543a-42ba-9f48-c439ec0f6d3b None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:37.545396 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 562/1098] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:09:37 2022] GET /identity/v3/role_assignments?user.id=be0701b0a7ff479e8b3214afaf618acd&scope.project.id=ccd95a48530c4c86a3774301b969d6a9&role.id=f3bc75c520ed4d52a97c45df41973dd0 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:38.972295 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6bf73-b628-420e-8b1d-4114c3298c3b None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:38.973071 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6bf73-b628-420e-8b1d-4114c3298c3b None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:38.973071 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6bf73-b628-420e-8b1d-4114c3298c3b None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:38.974254 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 537/1099] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:09:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:38.979685 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9a2ad-9a62-4285-9c55-41b01b62ce4c None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:38.980081 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9a2ad-9a62-4285-9c55-41b01b62ce4c None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:38.980242 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9a2ad-9a62-4285-9c55-41b01b62ce4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:38.997051 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-48d9a2ad-9a62-4285-9c55-41b01b62ce4c None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:38.998281 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-48d9a2ad-9a62-4285-9c55-41b01b62ce4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:39.046711 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:39.063067 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 563/1100] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:09:39.087291 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc6bf73-b628-420e-8b1d-4114c3298c3b None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:39.183435 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:39.188063 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc6bf73-b628-420e-8b1d-4114c3298c3b None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:39.221465 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836b574-c957-461a-8040-20f753a8d363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:39.222282 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836b574-c957-461a-8040-20f753a8d363 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:39.222614 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836b574-c957-461a-8040-20f753a8d363 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:39.222845 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836b574-c957-461a-8040-20f753a8d363 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:39.233323 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4836b574-c957-461a-8040-20f753a8d363 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:39.241040 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-4836b574-c957-461a-8040-20f753a8d363 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:09:39.241040 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:39.241040 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:39.241040 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:39.241040 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:39.241040 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:39.241040 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:39.241040 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:39.241040 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:39.241040 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:39.241040 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:39.241040 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:39.241040 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:39.241040 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:39.241040 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:39.241040 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:39.242192 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:39.242192 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:39.242192 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:39.242192 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:39.242192 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:39.242192 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:39.242192 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:39.242192 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:39.242192 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:39.242192 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:39.242192 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:39.242192 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:39.242192 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:39.242192 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:39.242192 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:39.242192 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:39.244086 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:39.244086 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:39.244086 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:39.244086 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:39.244086 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:39.244086 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:39.244086 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:39.244086 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:39.244086 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:39.244086 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:39.244086 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:09:39.244086 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:09:39.244086 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 538/1101] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:09:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:39.248814 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9a2ad-9a62-4285-9c55-41b01b62ce4c None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:39.344590 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9a2ad-9a62-4285-9c55-41b01b62ce4c None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:39.377890 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4787ca-3cc0-4edb-b49c-eec5cad9ad0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:39.378576 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4787ca-3cc0-4edb-b49c-eec5cad9ad0b None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:39.378865 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4787ca-3cc0-4edb-b49c-eec5cad9ad0b None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:39.379144 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4787ca-3cc0-4edb-b49c-eec5cad9ad0b None admin] PATH_INFO: `/v3/roles` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:39.379884 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4787ca-3cc0-4edb-b49c-eec5cad9ad0b None admin] RBAC: Adding query filter params (name=admin) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:39.380193 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4787ca-3cc0-4edb-b49c-eec5cad9ad0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:39.381554 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4787ca-3cc0-4edb-b49c-eec5cad9ad0b None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:39.389353 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 564/1102] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:09:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:39.395225 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836b574-c957-461a-8040-20f753a8d363 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:39.494150 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836b574-c957-461a-8040-20f753a8d363 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:39.526692 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f1cdde-bd76-42e3-b7b3-2bed4947dca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:39.527558 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1cdde-bd76-42e3-b7b3-2bed4947dca5 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:39.527850 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1cdde-bd76-42e3-b7b3-2bed4947dca5 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:39.528132 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1cdde-bd76-42e3-b7b3-2bed4947dca5 None admin] PATH_INFO: `/v3/users/8a39dc3f2c6a4ff7bd8fb219b2262f1d` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:39.529327 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f1cdde-bd76-42e3-b7b3-2bed4947dca5 None admin] RBAC: Authorizing `identity:get_user(user_id=8a39dc3f2c6a4ff7bd8fb219b2262f1d)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:39.530804 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f1cdde-bd76-42e3-b7b3-2bed4947dca5 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:39.532407 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 539/1103] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:09:39 2022] GET /identity/v3/users/8a39dc3f2c6a4ff7bd8fb219b2262f1d => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:39.538114 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4787ca-3cc0-4edb-b49c-eec5cad9ad0b None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:39.585303 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:39.636517 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4787ca-3cc0-4edb-b49c-eec5cad9ad0b None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:39.672717 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6100c9-9938-4ede-8029-edef86dc3071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:39.673372 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6100c9-9938-4ede-8029-edef86dc3071 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:39.673664 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6100c9-9938-4ede-8029-edef86dc3071 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:39.673947 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6100c9-9938-4ede-8029-edef86dc3071 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:39.738004 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6100c9-9938-4ede-8029-edef86dc3071 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:39.739479 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6100c9-9938-4ede-8029-edef86dc3071 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:39.784175 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:39.834028 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 565/1104] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:09:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:09:39.840940 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f1cdde-bd76-42e3-b7b3-2bed4947dca5 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:39.868954 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:39.939722 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f1cdde-bd76-42e3-b7b3-2bed4947dca5 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:39.974297 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af162a3-87c2-4643-9446-55c130c69013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:39.975167 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af162a3-87c2-4643-9446-55c130c69013 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:39.975457 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af162a3-87c2-4643-9446-55c130c69013 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:39.975737 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af162a3-87c2-4643-9446-55c130c69013 None admin] PATH_INFO: `/v3/projects/9cf4b79a3546454f947759f30db2a838` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:39.976923 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af162a3-87c2-4643-9446-55c130c69013 None admin] RBAC: Authorizing `identity:get_project(project_id=9cf4b79a3546454f947759f30db2a838)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:39.978539 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af162a3-87c2-4643-9446-55c130c69013 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:39.980230 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 540/1105] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:09:39 2022] GET /identity/v3/projects/9cf4b79a3546454f947759f30db2a838 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:39.986300 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6100c9-9938-4ede-8029-edef86dc3071 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:40.082431 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6100c9-9938-4ede-8029-edef86dc3071 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:40.115242 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b70e7-84a3-4c42-8e02-ef3ace1de57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:40.115895 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b70e7-84a3-4c42-8e02-ef3ace1de57c None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:40.116184 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b70e7-84a3-4c42-8e02-ef3ace1de57c None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:40.116466 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b70e7-84a3-4c42-8e02-ef3ace1de57c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:40.117288 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747b70e7-84a3-4c42-8e02-ef3ace1de57c None admin] RBAC: Adding query filter params (role.id=101b93f94624407f8c812ab86ebec32a, scope.project.id=9cf4b79a3546454f947759f30db2a838, user.id=8a39dc3f2c6a4ff7bd8fb219b2262f1d) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:40.117606 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747b70e7-84a3-4c42-8e02-ef3ace1de57c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:40.119320 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747b70e7-84a3-4c42-8e02-ef3ace1de57c None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:40.124994 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 566/1106] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:09:39 2022] GET /identity/v3/role_assignments?user.id=8a39dc3f2c6a4ff7bd8fb219b2262f1d&scope.project.id=9cf4b79a3546454f947759f30db2a838&role.id=101b93f94624407f8c812ab86ebec32a => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:42.216706 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea36ea3-a013-410d-9e18-bd889c06bac0 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:42.217788 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea36ea3-a013-410d-9e18-bd889c06bac0 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:42.217788 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea36ea3-a013-410d-9e18-bd889c06bac0 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:42.218674 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 541/1107] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:09:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:42.223922 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117e61b-88e0-4d73-ac3f-18ed6ad84381 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:42.224324 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117e61b-88e0-4d73-ac3f-18ed6ad84381 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:42.224496 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117e61b-88e0-4d73-ac3f-18ed6ad84381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:42.241725 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-c117e61b-88e0-4d73-ac3f-18ed6ad84381 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:42.242969 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-c117e61b-88e0-4d73-ac3f-18ed6ad84381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:42.250726 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:42.310789 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 567/1108] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:09:42.335961 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea36ea3-a013-410d-9e18-bd889c06bac0 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:42.436935 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:42.448482 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea36ea3-a013-410d-9e18-bd889c06bac0 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:42.485135 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb70cb-1757-4ae7-b6bf-472d950b3042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:42.486184 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb70cb-1757-4ae7-b6bf-472d950b3042 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:42.486511 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb70cb-1757-4ae7-b6bf-472d950b3042 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:42.486828 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb70cb-1757-4ae7-b6bf-472d950b3042 None admin] PATH_INFO: `/v3/domains/default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:42.488013 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eb70cb-1757-4ae7-b6bf-472d950b3042 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:42.489453 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eb70cb-1757-4ae7-b6bf-472d950b3042 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:42.491108 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 542/1109] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:09:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:42.497654 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c117e61b-88e0-4d73-ac3f-18ed6ad84381 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:42.596861 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c117e61b-88e0-4d73-ac3f-18ed6ad84381 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:42.629684 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396ed01-cc17-4d43-b414-cd92f045f70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:42.630391 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396ed01-cc17-4d43-b414-cd92f045f70e None admin] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:42.630681 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396ed01-cc17-4d43-b414-cd92f045f70e None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:42.630964 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396ed01-cc17-4d43-b414-cd92f045f70e None admin] PATH_INFO: `/v3/users` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:42.631674 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c396ed01-cc17-4d43-b414-cd92f045f70e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:42.633106 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c396ed01-cc17-4d43-b414-cd92f045f70e None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:42.737015 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:42.742631 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 568/1110] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:09:42 2022] POST /identity/v3/users => generated 286 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:09:44.830033 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1093cf0-34d2-4c26-bc38-5830efb7be31 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:44.830639 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1093cf0-34d2-4c26-bc38-5830efb7be31 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:44.830639 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1093cf0-34d2-4c26-bc38-5830efb7be31 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:44.832010 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 543/1111] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:44.837557 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8005d-2512-4f23-87d0-6b4d7273f165 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:44.838008 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8005d-2512-4f23-87d0-6b4d7273f165 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:44.838307 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8005d-2512-4f23-87d0-6b4d7273f165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:44.855253 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-42a8005d-2512-4f23-87d0-6b4d7273f165 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:44.856443 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-42a8005d-2512-4f23-87d0-6b4d7273f165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:44.920701 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 569/1112] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:09:44.944184 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1093cf0-34d2-4c26-bc38-5830efb7be31 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:45.043533 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1093cf0-34d2-4c26-bc38-5830efb7be31 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:45.077031 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29248fb5-6d24-431d-a560-10e7dee3d890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:45.077884 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29248fb5-6d24-431d-a560-10e7dee3d890 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:45.078200 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29248fb5-6d24-431d-a560-10e7dee3d890 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:45.078489 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29248fb5-6d24-431d-a560-10e7dee3d890 None admin] PATH_INFO: `/v3/roles/49943dd485174ef39fdd0368de241417` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:45.079958 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29248fb5-6d24-431d-a560-10e7dee3d890 None admin] RBAC: Authorizing `identity:get_role(role_id=49943dd485174ef39fdd0368de241417)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:45.081385 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29248fb5-6d24-431d-a560-10e7dee3d890 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:45.082711 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 544/1113] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:09:44 2022] GET /identity/v3/roles/49943dd485174ef39fdd0368de241417 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:45.089158 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8005d-2512-4f23-87d0-6b4d7273f165 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:45.184883 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8005d-2512-4f23-87d0-6b4d7273f165 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:45.210482 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:45.218487 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f9c5d-dc73-4081-8f0a-d894857e3a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:45.219361 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f9c5d-dc73-4081-8f0a-d894857e3a95 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:45.219655 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f9c5d-dc73-4081-8f0a-d894857e3a95 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:45.219932 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f9c5d-dc73-4081-8f0a-d894857e3a95 None admin] PATH_INFO: `/v3/users/238c68ea4a224f73b5e3138e641a5ac6` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:45.232573 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305f9c5d-dc73-4081-8f0a-d894857e3a95 None admin] RBAC: Authorizing `identity:get_user(user_id=238c68ea4a224f73b5e3138e641a5ac6)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:45.234013 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305f9c5d-dc73-4081-8f0a-d894857e3a95 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:45.235713 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 570/1114] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:09:45 2022] GET /identity/v3/users/238c68ea4a224f73b5e3138e641a5ac6 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:45.241437 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29248fb5-6d24-431d-a560-10e7dee3d890 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:45.271167 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:45.340621 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29248fb5-6d24-431d-a560-10e7dee3d890 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:45.373691 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49741d-ac3b-4925-93fb-8b97ab17f65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:45.374365 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49741d-ac3b-4925-93fb-8b97ab17f65a None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:45.374657 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49741d-ac3b-4925-93fb-8b97ab17f65a None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:45.374936 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49741d-ac3b-4925-93fb-8b97ab17f65a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:45.438276 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb49741d-ac3b-4925-93fb-8b97ab17f65a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:45.439718 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb49741d-ac3b-4925-93fb-8b97ab17f65a None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:45.468906 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:45.536633 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 545/1115] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:09:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:09:45.543083 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f9c5d-dc73-4081-8f0a-d894857e3a95 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:45.638740 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f9c5d-dc73-4081-8f0a-d894857e3a95 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:45.671275 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8e6e3-1cac-4976-9a09-ebcf6972ae69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:45.672123 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8e6e3-1cac-4976-9a09-ebcf6972ae69 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:45.672405 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8e6e3-1cac-4976-9a09-ebcf6972ae69 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:45.672677 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8e6e3-1cac-4976-9a09-ebcf6972ae69 None admin] PATH_INFO: `/v3/projects/9cf4b79a3546454f947759f30db2a838` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:45.673839 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8e6e3-1cac-4976-9a09-ebcf6972ae69 None admin] RBAC: Authorizing `identity:get_project(project_id=9cf4b79a3546454f947759f30db2a838)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:45.675293 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8e6e3-1cac-4976-9a09-ebcf6972ae69 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:45.676949 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 571/1116] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:09:45 2022] GET /identity/v3/projects/9cf4b79a3546454f947759f30db2a838 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:45.683122 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49741d-ac3b-4925-93fb-8b97ab17f65a None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:45.779144 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49741d-ac3b-4925-93fb-8b97ab17f65a None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:45.806404 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:45.811993 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da0b054-186a-47b2-88ba-8c83a0ddd0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:45.826302 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0b054-186a-47b2-88ba-8c83a0ddd0f7 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:45.826302 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0b054-186a-47b2-88ba-8c83a0ddd0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:45.826302 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0b054-186a-47b2-88ba-8c83a0ddd0f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:45.826302 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da0b054-186a-47b2-88ba-8c83a0ddd0f7 None admin] RBAC: Adding query filter params (role.id=49943dd485174ef39fdd0368de241417, scope.project.id=9cf4b79a3546454f947759f30db2a838, user.id=238c68ea4a224f73b5e3138e641a5ac6) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:45.826302 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da0b054-186a-47b2-88ba-8c83a0ddd0f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:45.826842 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da0b054-186a-47b2-88ba-8c83a0ddd0f7 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:45.826842 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 546/1117] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:09:45 2022] GET /identity/v3/role_assignments?user.id=238c68ea4a224f73b5e3138e641a5ac6&scope.project.id=9cf4b79a3546454f947759f30db2a838&role.id=49943dd485174ef39fdd0368de241417 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:47.787123 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166f26d-2569-4621-b725-b1fdd49c3a44 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:47.787667 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166f26d-2569-4621-b725-b1fdd49c3a44 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:47.787667 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166f26d-2569-4621-b725-b1fdd49c3a44 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:47.789049 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 572/1118] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:09:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:47.794919 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92192a5c-132c-4719-a9a5-b64d48c253ce None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:47.795346 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92192a5c-132c-4719-a9a5-b64d48c253ce None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:47.795484 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92192a5c-132c-4719-a9a5-b64d48c253ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:47.811731 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-92192a5c-132c-4719-a9a5-b64d48c253ce None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:47.812908 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-92192a5c-132c-4719-a9a5-b64d48c253ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:47.877227 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 547/1119] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:09:47.899820 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166f26d-2569-4621-b725-b1fdd49c3a44 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:47.954384 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:47.998832 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166f26d-2569-4621-b725-b1fdd49c3a44 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:48.031268 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ce13b-8b31-4881-8a5d-8478752f56a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:48.032117 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ce13b-8b31-4881-8a5d-8478752f56a7 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:48.032403 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ce13b-8b31-4881-8a5d-8478752f56a7 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:48.032685 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ce13b-8b31-4881-8a5d-8478752f56a7 None admin] PATH_INFO: `/v3/roles/49943dd485174ef39fdd0368de241417` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:48.034181 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ce13b-8b31-4881-8a5d-8478752f56a7 None admin] RBAC: Authorizing `identity:get_role(role_id=49943dd485174ef39fdd0368de241417)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:48.035548 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ce13b-8b31-4881-8a5d-8478752f56a7 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:48.036908 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 573/1120] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:09:47 2022] GET /identity/v3/roles/49943dd485174ef39fdd0368de241417 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:48.043184 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92192a5c-132c-4719-a9a5-b64d48c253ce None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:48.140273 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92192a5c-132c-4719-a9a5-b64d48c253ce None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:48.163200 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:48.173602 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3ad33-ce19-445b-93f2-be9963e50d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:48.174510 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3ad33-ce19-445b-93f2-be9963e50d0a None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:48.174800 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3ad33-ce19-445b-93f2-be9963e50d0a None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:48.175084 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3ad33-ce19-445b-93f2-be9963e50d0a None admin] PATH_INFO: `/v3/users/238c68ea4a224f73b5e3138e641a5ac6` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:48.176280 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d3ad33-ce19-445b-93f2-be9963e50d0a None admin] RBAC: Authorizing `identity:get_user(user_id=238c68ea4a224f73b5e3138e641a5ac6)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:48.177712 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d3ad33-ce19-445b-93f2-be9963e50d0a None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:48.179354 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 548/1121] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:09:48 2022] GET /identity/v3/users/238c68ea4a224f73b5e3138e641a5ac6 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:48.185317 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ce13b-8b31-4881-8a5d-8478752f56a7 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:48.282277 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ce13b-8b31-4881-8a5d-8478752f56a7 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:48.303230 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:48.315640 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a61fc-52dc-4a70-80f8-db627aefc7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:48.316767 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a61fc-52dc-4a70-80f8-db627aefc7df None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:48.316767 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a61fc-52dc-4a70-80f8-db627aefc7df None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:48.317020 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a61fc-52dc-4a70-80f8-db627aefc7df None admin] PATH_INFO: `/v3/projects/9cf4b79a3546454f947759f30db2a838` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:48.318219 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a61fc-52dc-4a70-80f8-db627aefc7df None admin] RBAC: Authorizing `identity:get_project(project_id=9cf4b79a3546454f947759f30db2a838)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:48.319649 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a61fc-52dc-4a70-80f8-db627aefc7df None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:48.321879 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 574/1122] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:09:48 2022] GET /identity/v3/projects/9cf4b79a3546454f947759f30db2a838 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:48.328071 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3ad33-ce19-445b-93f2-be9963e50d0a None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:48.425297 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3ad33-ce19-445b-93f2-be9963e50d0a None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:48.458386 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964bf09-7ea3-41ad-9a68-74bfa50c2ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:48.459271 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964bf09-7ea3-41ad-9a68-74bfa50c2ac7 None admin] REQUEST_METHOD: `PUT` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:48.459562 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964bf09-7ea3-41ad-9a68-74bfa50c2ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:48.459846 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964bf09-7ea3-41ad-9a68-74bfa50c2ac7 None admin] PATH_INFO: `/v3/projects/9cf4b79a3546454f947759f30db2a838/users/238c68ea4a224f73b5e3138e641a5ac6/roles/49943dd485174ef39fdd0368de241417` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:48.462866 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964bf09-7ea3-41ad-9a68-74bfa50c2ac7 None admin] RBAC: Authorizing `identity:create_grant(project_id=9cf4b79a3546454f947759f30db2a838, user_id=238c68ea4a224f73b5e3138e641a5ac6, role_id=49943dd485174ef39fdd0368de241417)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:48.464308 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964bf09-7ea3-41ad-9a68-74bfa50c2ac7 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:48.551676 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 549/1123] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:09:48 2022] PUT /identity/v3/projects/9cf4b79a3546454f947759f30db2a838/users/238c68ea4a224f73b5e3138e641a5ac6/roles/49943dd485174ef39fdd0368de241417 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:09:50.549153 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2c25e-f3c7-435d-b51f-19b5f8769f96 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:50.549675 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2c25e-f3c7-435d-b51f-19b5f8769f96 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:50.549762 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2c25e-f3c7-435d-b51f-19b5f8769f96 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:50.551141 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 575/1124] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:09:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:50.556939 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434fffe-549b-436a-9bcf-46264d46abcd None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:50.557336 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434fffe-549b-436a-9bcf-46264d46abcd None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:50.557508 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434fffe-549b-436a-9bcf-46264d46abcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:50.574089 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-9434fffe-549b-436a-9bcf-46264d46abcd None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:50.575245 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-9434fffe-549b-436a-9bcf-46264d46abcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:50.621380 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:50.640063 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 550/1125] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:09:50.662870 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2c25e-f3c7-435d-b51f-19b5f8769f96 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:50.762518 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2c25e-f3c7-435d-b51f-19b5f8769f96 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:50.798776 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12083d-02ce-4504-bb23-abce212e579f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:50.799637 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12083d-02ce-4504-bb23-abce212e579f None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:50.799927 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12083d-02ce-4504-bb23-abce212e579f None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:50.800209 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12083d-02ce-4504-bb23-abce212e579f None admin] PATH_INFO: `/v3/roles/49943dd485174ef39fdd0368de241417` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:50.801673 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd12083d-02ce-4504-bb23-abce212e579f None admin] RBAC: Authorizing `identity:get_role(role_id=49943dd485174ef39fdd0368de241417)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:50.803074 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd12083d-02ce-4504-bb23-abce212e579f None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:50.804448 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 576/1126] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:09:50 2022] GET /identity/v3/roles/49943dd485174ef39fdd0368de241417 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:50.810123 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9434fffe-549b-436a-9bcf-46264d46abcd None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:50.905000 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9434fffe-549b-436a-9bcf-46264d46abcd None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:50.937241 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ee412-028e-4b08-b9d4-fcd55b738fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:50.938104 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ee412-028e-4b08-b9d4-fcd55b738fa1 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:50.938420 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ee412-028e-4b08-b9d4-fcd55b738fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:50.938699 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ee412-028e-4b08-b9d4-fcd55b738fa1 None admin] PATH_INFO: `/v3/users/238c68ea4a224f73b5e3138e641a5ac6` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:50.939866 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21ee412-028e-4b08-b9d4-fcd55b738fa1 None admin] RBAC: Authorizing `identity:get_user(user_id=238c68ea4a224f73b5e3138e641a5ac6)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:50.941561 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21ee412-028e-4b08-b9d4-fcd55b738fa1 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:50.943167 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 551/1127] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:09:50 2022] GET /identity/v3/users/238c68ea4a224f73b5e3138e641a5ac6 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:50.948986 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12083d-02ce-4504-bb23-abce212e579f None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:51.005688 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:51.045052 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12083d-02ce-4504-bb23-abce212e579f None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:51.077889 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3b2b3-6de2-4d97-b038-4b4a0c4202c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:51.078560 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3b2b3-6de2-4d97-b038-4b4a0c4202c7 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:51.078852 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3b2b3-6de2-4d97-b038-4b4a0c4202c7 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:51.079133 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3b2b3-6de2-4d97-b038-4b4a0c4202c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:51.143811 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab3b2b3-6de2-4d97-b038-4b4a0c4202c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:51.145264 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab3b2b3-6de2-4d97-b038-4b4a0c4202c7 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:51.200308 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:51.241144 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 577/1128] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:09:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:09:51.247145 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ee412-028e-4b08-b9d4-fcd55b738fa1 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:51.295979 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:51.345586 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ee412-028e-4b08-b9d4-fcd55b738fa1 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:51.378972 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c6b8b7-67b3-4caa-bc90-e2a4eb52d73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:51.379832 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6b8b7-67b3-4caa-bc90-e2a4eb52d73b None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:51.380119 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6b8b7-67b3-4caa-bc90-e2a4eb52d73b None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:51.380398 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6b8b7-67b3-4caa-bc90-e2a4eb52d73b None admin] PATH_INFO: `/v3/projects/9cf4b79a3546454f947759f30db2a838` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:51.381568 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c6b8b7-67b3-4caa-bc90-e2a4eb52d73b None admin] RBAC: Authorizing `identity:get_project(project_id=9cf4b79a3546454f947759f30db2a838)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:51.383039 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c6b8b7-67b3-4caa-bc90-e2a4eb52d73b None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:51.384754 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 552/1129] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:09:51 2022] GET /identity/v3/projects/9cf4b79a3546454f947759f30db2a838 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:51.390874 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3b2b3-6de2-4d97-b038-4b4a0c4202c7 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:51.485851 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3b2b3-6de2-4d97-b038-4b4a0c4202c7 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:51.518521 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f90c16-e8f9-4865-8aab-3473189fb2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:51.519162 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f90c16-e8f9-4865-8aab-3473189fb2e5 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:51.519447 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f90c16-e8f9-4865-8aab-3473189fb2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:51.519724 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f90c16-e8f9-4865-8aab-3473189fb2e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:51.520540 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f90c16-e8f9-4865-8aab-3473189fb2e5 None admin] RBAC: Adding query filter params (role.id=49943dd485174ef39fdd0368de241417, scope.project.id=9cf4b79a3546454f947759f30db2a838, user.id=238c68ea4a224f73b5e3138e641a5ac6) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:51.520850 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f90c16-e8f9-4865-8aab-3473189fb2e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:51.522298 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f90c16-e8f9-4865-8aab-3473189fb2e5 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:51.528916 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 578/1130] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:09:51 2022] GET /identity/v3/role_assignments?user.id=238c68ea4a224f73b5e3138e641a5ac6&scope.project.id=9cf4b79a3546454f947759f30db2a838&role.id=49943dd485174ef39fdd0368de241417 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:53.540300 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d3554f-a5ae-4f0e-9d14-ba85f6871f5a None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:53.540846 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d3554f-a5ae-4f0e-9d14-ba85f6871f5a None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:53.541071 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d3554f-a5ae-4f0e-9d14-ba85f6871f5a None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:53.542468 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 553/1131] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:09:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:53.547521 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c73dc-124f-4b58-b089-af2b67576106 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:53.547912 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c73dc-124f-4b58-b089-af2b67576106 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:53.548095 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c73dc-124f-4b58-b089-af2b67576106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:53.565048 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-8f7c73dc-124f-4b58-b089-af2b67576106 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:53.566482 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-8f7c73dc-124f-4b58-b089-af2b67576106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:53.582384 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:53.631180 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 579/1132] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:09:53.654181 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d3554f-a5ae-4f0e-9d14-ba85f6871f5a None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:53.754359 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d3554f-a5ae-4f0e-9d14-ba85f6871f5a None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:53.770820 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:53.787728 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790cea61-0875-4950-ae08-7e0fada2ccf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:53.788514 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cea61-0875-4950-ae08-7e0fada2ccf3 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:53.788802 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cea61-0875-4950-ae08-7e0fada2ccf3 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:53.789087 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cea61-0875-4950-ae08-7e0fada2ccf3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:53.790426 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790cea61-0875-4950-ae08-7e0fada2ccf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:53.791919 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790cea61-0875-4950-ae08-7e0fada2ccf3 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:53.793514 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 554/1133] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:09:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:53.799214 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c73dc-124f-4b58-b089-af2b67576106 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:53.894195 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c73dc-124f-4b58-b089-af2b67576106 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:53.926033 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab77034-e3ea-439a-b8ce-b1f9897766e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:53.926719 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab77034-e3ea-439a-b8ce-b1f9897766e3 None admin] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:53.927011 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab77034-e3ea-439a-b8ce-b1f9897766e3 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:53.927294 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab77034-e3ea-439a-b8ce-b1f9897766e3 None admin] PATH_INFO: `/v3/projects` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:53.928011 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab77034-e3ea-439a-b8ce-b1f9897766e3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:53.929442 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab77034-e3ea-439a-b8ce-b1f9897766e3 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:54.012303 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 580/1134] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Jul 5 21:09:53 2022] POST /identity/v3/projects => generated 311 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:09:56.077363 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ecc4f-5dee-492d-81f6-cc8230bd401b None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:56.077932 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ecc4f-5dee-492d-81f6-cc8230bd401b None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:56.077932 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ecc4f-5dee-492d-81f6-cc8230bd401b None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:56.079317 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 555/1135] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:09:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:56.084528 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4cf49-76c4-46e3-8d6a-0cff2b54817a None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:56.084939 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4cf49-76c4-46e3-8d6a-0cff2b54817a None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:56.085110 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4cf49-76c4-46e3-8d6a-0cff2b54817a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:56.091722 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:56.102204 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-b0d4cf49-76c4-46e3-8d6a-0cff2b54817a None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:56.104056 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-b0d4cf49-76c4-46e3-8d6a-0cff2b54817a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:56.169911 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 581/1136] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:09:56.194509 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ecc4f-5dee-492d-81f6-cc8230bd401b None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:56.300461 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ecc4f-5dee-492d-81f6-cc8230bd401b None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:56.334855 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40879e0d-8817-42ea-acbe-e512502a87fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:56.335589 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40879e0d-8817-42ea-acbe-e512502a87fb None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:56.335876 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40879e0d-8817-42ea-acbe-e512502a87fb None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:56.336157 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40879e0d-8817-42ea-acbe-e512502a87fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:56.337826 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40879e0d-8817-42ea-acbe-e512502a87fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:56.339278 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40879e0d-8817-42ea-acbe-e512502a87fb None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:56.340912 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 556/1137] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:09:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:56.346724 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4cf49-76c4-46e3-8d6a-0cff2b54817a None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:56.442549 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4cf49-76c4-46e3-8d6a-0cff2b54817a None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:56.475820 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873795f8-8110-4906-af11-0da71564d968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:56.476495 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873795f8-8110-4906-af11-0da71564d968 None admin] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:56.476789 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873795f8-8110-4906-af11-0da71564d968 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:56.477075 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873795f8-8110-4906-af11-0da71564d968 None admin] PATH_INFO: `/v3/users` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:56.478088 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873795f8-8110-4906-af11-0da71564d968 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:56.479566 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873795f8-8110-4906-af11-0da71564d968 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:56.486038 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:56.559314 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 582/1138] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:09:56 2022] POST /identity/v3/users => generated 286 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:09:58.588873 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d7e75-1fcc-4db1-a9cc-056b33809195 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:58.589386 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d7e75-1fcc-4db1-a9cc-056b33809195 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:58.589386 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d7e75-1fcc-4db1-a9cc-056b33809195 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:58.590767 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 557/1139] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:09:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:09:58.596024 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbd5de-8fcc-49ca-bb0b-c8af4554523f None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:58.596455 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbd5de-8fcc-49ca-bb0b-c8af4554523f None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:58.596581 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbd5de-8fcc-49ca-bb0b-c8af4554523f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:58.614060 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-fdfbd5de-8fcc-49ca-bb0b-c8af4554523f None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:09:58.615265 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-fdfbd5de-8fcc-49ca-bb0b-c8af4554523f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:58.678080 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 583/1140] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:09:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:09:58.701630 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d7e75-1fcc-4db1-a9cc-056b33809195 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:58.757336 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:58.802118 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d7e75-1fcc-4db1-a9cc-056b33809195 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:58.835186 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c90d0d-779a-4ce4-84f3-02054515917f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:58.835976 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c90d0d-779a-4ce4-84f3-02054515917f None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:58.836268 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c90d0d-779a-4ce4-84f3-02054515917f None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:58.836715 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c90d0d-779a-4ce4-84f3-02054515917f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:58.846639 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c90d0d-779a-4ce4-84f3-02054515917f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:09:58.854777 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-a7c90d0d-779a-4ce4-84f3-02054515917f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:09:58.854777 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:09:58.854777 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:09:58.854777 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:09:58.854777 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:09:58.854777 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:09:58.854777 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:09:58.854777 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:09:58.854777 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:09:58.854777 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:09:58.854777 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:09:58.854777 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:09:58.854777 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:09:58.854777 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:09:58.854777 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:09:58.854777 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:09:58.855972 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:09:58.855972 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:09:58.855972 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:09:58.855972 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:09:58.855972 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:09:58.855972 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:09:58.855972 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:09:58.855972 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:09:58.855972 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:09:58.855972 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:09:58.855972 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:09:58.855972 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:09:58.855972 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:09:58.855972 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:09:58.855972 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:09:58.855972 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:09:58.857235 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:09:58.857235 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:09:58.857235 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:09:58.857235 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:09:58.857235 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:09:58.857235 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:09:58.857235 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:09:58.857235 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:09:58.857235 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:09:58.857235 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:09:58.857235 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:09:58.857235 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:09:58.857235 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 558/1141] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:09:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:09:58.861883 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbd5de-8fcc-49ca-bb0b-c8af4554523f None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:58.956949 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbd5de-8fcc-49ca-bb0b-c8af4554523f None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:58.976208 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:58.990454 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f976e33a-bd65-40b4-a607-129be08f9614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:58.991131 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976e33a-bd65-40b4-a607-129be08f9614 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:58.991420 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976e33a-bd65-40b4-a607-129be08f9614 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:58.991702 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976e33a-bd65-40b4-a607-129be08f9614 None admin] PATH_INFO: `/v3/roles` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:58.992508 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f976e33a-bd65-40b4-a607-129be08f9614 None admin] RBAC: Adding query filter params (name=admin) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:58.993480 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f976e33a-bd65-40b4-a607-129be08f9614 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:58.994902 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f976e33a-bd65-40b4-a607-129be08f9614 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:59.002914 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 584/1142] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:09:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:59.008671 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c90d0d-779a-4ce4-84f3-02054515917f None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:59.106117 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c90d0d-779a-4ce4-84f3-02054515917f None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:59.119210 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:59.138367 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b21a47-2f5e-4069-9c1c-c5f75b2b4321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:59.139235 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b21a47-2f5e-4069-9c1c-c5f75b2b4321 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:59.139521 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b21a47-2f5e-4069-9c1c-c5f75b2b4321 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:59.139798 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b21a47-2f5e-4069-9c1c-c5f75b2b4321 None admin] PATH_INFO: `/v3/users/0e119ad942b8457e908b810fdfb814dd` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:59.153401 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b21a47-2f5e-4069-9c1c-c5f75b2b4321 None admin] RBAC: Authorizing `identity:get_user(user_id=0e119ad942b8457e908b810fdfb814dd)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:59.154862 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b21a47-2f5e-4069-9c1c-c5f75b2b4321 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:59.156492 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 559/1143] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:09:59 2022] GET /identity/v3/users/0e119ad942b8457e908b810fdfb814dd => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:59.162681 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f976e33a-bd65-40b4-a607-129be08f9614 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:59.320157 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f976e33a-bd65-40b4-a607-129be08f9614 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:59.353597 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb4512b-9a7a-40a4-8bab-dceaacb35a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:59.354285 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4512b-9a7a-40a4-8bab-dceaacb35a5a None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:59.354578 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4512b-9a7a-40a4-8bab-dceaacb35a5a None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:59.354861 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4512b-9a7a-40a4-8bab-dceaacb35a5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:59.403133 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:59.421208 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb4512b-9a7a-40a4-8bab-dceaacb35a5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:59.422698 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb4512b-9a7a-40a4-8bab-dceaacb35a5a None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:59.518002 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 585/1144] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:09:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:09:59.524588 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b21a47-2f5e-4069-9c1c-c5f75b2b4321 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:59.620793 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b21a47-2f5e-4069-9c1c-c5f75b2b4321 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:59.653704 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c1ba4-3924-4847-9203-51c11dbb5e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:59.654523 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c1ba4-3924-4847-9203-51c11dbb5e7c None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:59.654808 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c1ba4-3924-4847-9203-51c11dbb5e7c None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:59.655085 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c1ba4-3924-4847-9203-51c11dbb5e7c None admin] PATH_INFO: `/v3/projects/46df4ebb349c4739867e16ac062b7465` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:59.656246 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c1ba4-3924-4847-9203-51c11dbb5e7c None admin] RBAC: Authorizing `identity:get_project(project_id=46df4ebb349c4739867e16ac062b7465)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:59.657672 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c1ba4-3924-4847-9203-51c11dbb5e7c None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:59.659344 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 560/1145] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:09:59 2022] GET /identity/v3/projects/46df4ebb349c4739867e16ac062b7465 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:09:59.665423 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb4512b-9a7a-40a4-8bab-dceaacb35a5a None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:59.743634 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:59.760730 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb4512b-9a7a-40a4-8bab-dceaacb35a5a None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:59.794567 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb8a6b-dfcf-4749-9c74-9779468d5fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:59.795216 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb8a6b-dfcf-4749-9c74-9779468d5fff None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:59.795511 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb8a6b-dfcf-4749-9c74-9779468d5fff None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:59.795783 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb8a6b-dfcf-4749-9c74-9779468d5fff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:59.796610 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb8a6b-dfcf-4749-9c74-9779468d5fff None admin] RBAC: Adding query filter params (role.id=101b93f94624407f8c812ab86ebec32a, scope.project.id=46df4ebb349c4739867e16ac062b7465, user.id=0e119ad942b8457e908b810fdfb814dd) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:09:59.796929 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb8a6b-dfcf-4749-9c74-9779468d5fff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:59.798392 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb8a6b-dfcf-4749-9c74-9779468d5fff None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:59.803642 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 586/1146] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:09:59 2022] GET /identity/v3/role_assignments?user.id=0e119ad942b8457e908b810fdfb814dd&scope.project.id=46df4ebb349c4739867e16ac062b7465&role.id=101b93f94624407f8c812ab86ebec32a => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:01.785936 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59010043-e98d-4fff-adae-8ed92bd49f7b None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:01.786510 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59010043-e98d-4fff-adae-8ed92bd49f7b None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:01.786510 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59010043-e98d-4fff-adae-8ed92bd49f7b None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:01.787880 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 561/1147] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:10:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:01.793667 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472fee1-bc20-418e-ac42-4cff9cbd6e8a None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:01.794089 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472fee1-bc20-418e-ac42-4cff9cbd6e8a None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:01.794268 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472fee1-bc20-418e-ac42-4cff9cbd6e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:01.811122 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-9472fee1-bc20-418e-ac42-4cff9cbd6e8a None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:01.812308 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-9472fee1-bc20-418e-ac42-4cff9cbd6e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:01.876524 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 587/1148] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:10:01.899869 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59010043-e98d-4fff-adae-8ed92bd49f7b None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:01.942142 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:01.998625 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59010043-e98d-4fff-adae-8ed92bd49f7b None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:02.031087 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816710d3-4c66-4913-9f0c-5d0ef62e6aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:02.031871 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816710d3-4c66-4913-9f0c-5d0ef62e6aa3 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:02.032156 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816710d3-4c66-4913-9f0c-5d0ef62e6aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:02.032432 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816710d3-4c66-4913-9f0c-5d0ef62e6aa3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:02.042299 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816710d3-4c66-4913-9f0c-5d0ef62e6aa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:10:02.049831 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-816710d3-4c66-4913-9f0c-5d0ef62e6aa3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:10:02.049831 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:02.049831 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:02.049831 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:02.049831 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:02.049831 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:02.049831 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:02.049831 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:02.049831 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:02.049831 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:02.049831 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:02.049831 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:02.049831 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:10:02.049831 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:10:02.049831 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:10:02.049831 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:10:02.050947 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:10:02.050947 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:10:02.050947 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:10:02.050947 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:10:02.050947 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:02.050947 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:02.050947 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:02.050947 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:02.050947 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:02.050947 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:02.050947 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:02.050947 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:02.050947 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:02.050947 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:02.050947 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:02.050947 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:02.052175 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:02.052175 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:02.052175 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:02.052175 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:02.052175 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:10:02.052175 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:10:02.052175 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:10:02.052175 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:10:02.052175 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:10:02.052175 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:10:02.052175 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:10:02.052175 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:10:02.052175 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 562/1149] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:10:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:02.057712 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472fee1-bc20-418e-ac42-4cff9cbd6e8a None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:02.131717 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:02.154401 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472fee1-bc20-418e-ac42-4cff9cbd6e8a None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:02.187768 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2652101-d9f9-4479-a74f-5758f00c7eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:02.188429 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2652101-d9f9-4479-a74f-5758f00c7eb2 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:02.188716 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2652101-d9f9-4479-a74f-5758f00c7eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:02.188998 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2652101-d9f9-4479-a74f-5758f00c7eb2 None admin] PATH_INFO: `/v3/roles` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:02.189737 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2652101-d9f9-4479-a74f-5758f00c7eb2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:02.190050 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2652101-d9f9-4479-a74f-5758f00c7eb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:02.191699 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2652101-d9f9-4479-a74f-5758f00c7eb2 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:02.200613 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 588/1150] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:10:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:02.206370 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816710d3-4c66-4913-9f0c-5d0ef62e6aa3 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:02.300151 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:02.303029 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816710d3-4c66-4913-9f0c-5d0ef62e6aa3 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:02.338282 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6e5ec-b128-45e6-b8e8-9b4ad88588a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:02.339190 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6e5ec-b128-45e6-b8e8-9b4ad88588a1 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:02.339483 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6e5ec-b128-45e6-b8e8-9b4ad88588a1 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:02.339773 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6e5ec-b128-45e6-b8e8-9b4ad88588a1 None admin] PATH_INFO: `/v3/users/0e119ad942b8457e908b810fdfb814dd` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:02.340966 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b6e5ec-b128-45e6-b8e8-9b4ad88588a1 None admin] RBAC: Authorizing `identity:get_user(user_id=0e119ad942b8457e908b810fdfb814dd)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:02.342434 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b6e5ec-b128-45e6-b8e8-9b4ad88588a1 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:02.344060 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 563/1151] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:10:02 2022] GET /identity/v3/users/0e119ad942b8457e908b810fdfb814dd => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:02.349942 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2652101-d9f9-4479-a74f-5758f00c7eb2 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:02.446332 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2652101-d9f9-4479-a74f-5758f00c7eb2 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:02.478412 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e46357-898a-44d4-9307-006589de7de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:02.479262 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e46357-898a-44d4-9307-006589de7de3 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:02.479545 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e46357-898a-44d4-9307-006589de7de3 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:02.479817 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e46357-898a-44d4-9307-006589de7de3 None admin] PATH_INFO: `/v3/projects/46df4ebb349c4739867e16ac062b7465` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:02.480974 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e46357-898a-44d4-9307-006589de7de3 None admin] RBAC: Authorizing `identity:get_project(project_id=46df4ebb349c4739867e16ac062b7465)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:02.482485 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e46357-898a-44d4-9307-006589de7de3 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:02.484142 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 589/1152] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:10:02 2022] GET /identity/v3/projects/46df4ebb349c4739867e16ac062b7465 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:02.489873 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6e5ec-b128-45e6-b8e8-9b4ad88588a1 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:02.588084 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6e5ec-b128-45e6-b8e8-9b4ad88588a1 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:02.620260 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc985ba1-a37d-4384-b096-9db019c13d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:02.621123 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc985ba1-a37d-4384-b096-9db019c13d0d None admin] REQUEST_METHOD: `PUT` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:02.621413 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc985ba1-a37d-4384-b096-9db019c13d0d None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:02.621697 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc985ba1-a37d-4384-b096-9db019c13d0d None admin] PATH_INFO: `/v3/projects/46df4ebb349c4739867e16ac062b7465/users/0e119ad942b8457e908b810fdfb814dd/roles/101b93f94624407f8c812ab86ebec32a` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:02.623668 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc985ba1-a37d-4384-b096-9db019c13d0d None admin] RBAC: Authorizing `identity:create_grant(project_id=46df4ebb349c4739867e16ac062b7465, user_id=0e119ad942b8457e908b810fdfb814dd, role_id=101b93f94624407f8c812ab86ebec32a)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:02.625104 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc985ba1-a37d-4384-b096-9db019c13d0d None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:02.702599 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 564/1153] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:10:02 2022] PUT /identity/v3/projects/46df4ebb349c4739867e16ac062b7465/users/0e119ad942b8457e908b810fdfb814dd/roles/101b93f94624407f8c812ab86ebec32a => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:10:04.683886 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61f5bb-ccd2-401e-aacb-911c561c802e None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:04.684411 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61f5bb-ccd2-401e-aacb-911c561c802e None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:04.684411 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61f5bb-ccd2-401e-aacb-911c561c802e None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:04.685735 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 590/1154] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:04.691097 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d564494-ff15-444d-ab14-08e89b12c82f None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:04.691517 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d564494-ff15-444d-ab14-08e89b12c82f None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:04.691764 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d564494-ff15-444d-ab14-08e89b12c82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:04.708610 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-0d564494-ff15-444d-ab14-08e89b12c82f None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:04.709789 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-0d564494-ff15-444d-ab14-08e89b12c82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:04.732827 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:04.775917 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 565/1155] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:10:04.800242 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61f5bb-ccd2-401e-aacb-911c561c802e None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:04.810222 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:04.900636 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61f5bb-ccd2-401e-aacb-911c561c802e None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:04.934926 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a5f67-618d-42f4-81e9-246b98cce038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:04.935650 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a5f67-618d-42f4-81e9-246b98cce038 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:04.935938 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a5f67-618d-42f4-81e9-246b98cce038 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:04.936218 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a5f67-618d-42f4-81e9-246b98cce038 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:04.946425 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597a5f67-618d-42f4-81e9-246b98cce038 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:10:04.954102 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-597a5f67-618d-42f4-81e9-246b98cce038 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:10:04.954102 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:04.954102 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:04.954102 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:04.954102 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:04.954102 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:04.954102 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:04.954102 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:04.954102 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:04.954102 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:04.954102 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:04.954102 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:04.954102 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:10:04.954102 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:10:04.954102 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:10:04.954102 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:10:04.955256 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:10:04.955256 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:10:04.955256 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:10:04.955256 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:10:04.955256 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:04.955256 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:04.955256 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:04.955256 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:04.955256 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:04.955256 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:04.955256 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:04.955256 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:04.955256 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:04.955256 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:04.955256 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:04.955256 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:04.956312 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:04.956312 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:04.956312 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:04.956312 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:04.956312 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:10:04.956312 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:10:04.956312 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:10:04.956312 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:10:04.956312 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:10:04.956312 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:10:04.956312 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:10:04.956312 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:10:04.956312 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 591/1156] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:10:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:04.961238 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d564494-ff15-444d-ab14-08e89b12c82f None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:05.057606 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d564494-ff15-444d-ab14-08e89b12c82f None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:05.090637 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d95f2a-6e21-471f-86fd-3b649446aa4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:05.091304 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d95f2a-6e21-471f-86fd-3b649446aa4a None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:05.091599 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d95f2a-6e21-471f-86fd-3b649446aa4a None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:05.091881 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d95f2a-6e21-471f-86fd-3b649446aa4a None admin] PATH_INFO: `/v3/roles` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:05.092619 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d95f2a-6e21-471f-86fd-3b649446aa4a None admin] RBAC: Adding query filter params (name=admin) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:05.092931 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d95f2a-6e21-471f-86fd-3b649446aa4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:05.094322 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d95f2a-6e21-471f-86fd-3b649446aa4a None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:05.102787 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 566/1157] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:10:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:05.108639 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a5f67-618d-42f4-81e9-246b98cce038 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:05.173233 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:05.205701 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a5f67-618d-42f4-81e9-246b98cce038 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:05.238238 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cec337-5742-4710-a80e-e76b41d1669c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:05.239097 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cec337-5742-4710-a80e-e76b41d1669c None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:05.239383 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cec337-5742-4710-a80e-e76b41d1669c None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:05.239661 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cec337-5742-4710-a80e-e76b41d1669c None admin] PATH_INFO: `/v3/users/0e119ad942b8457e908b810fdfb814dd` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:05.240922 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cec337-5742-4710-a80e-e76b41d1669c None admin] RBAC: Authorizing `identity:get_user(user_id=0e119ad942b8457e908b810fdfb814dd)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:05.242398 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cec337-5742-4710-a80e-e76b41d1669c None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:05.244034 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 592/1158] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:10:05 2022] GET /identity/v3/users/0e119ad942b8457e908b810fdfb814dd => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:05.249916 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d95f2a-6e21-471f-86fd-3b649446aa4a None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:05.271774 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:05.349063 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d95f2a-6e21-471f-86fd-3b649446aa4a None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:05.381580 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b632a-cd39-4328-8e1f-cd50a233e8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:05.382253 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b632a-cd39-4328-8e1f-cd50a233e8a3 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:05.382548 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b632a-cd39-4328-8e1f-cd50a233e8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:05.382833 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b632a-cd39-4328-8e1f-cd50a233e8a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:05.448919 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b632a-cd39-4328-8e1f-cd50a233e8a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:05.450392 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b632a-cd39-4328-8e1f-cd50a233e8a3 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:05.470441 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:05.545666 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 567/1159] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:10:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:10:05.551609 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cec337-5742-4710-a80e-e76b41d1669c None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:05.649917 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cec337-5742-4710-a80e-e76b41d1669c None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:05.682156 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a4e0e-4fd9-445e-be5c-d63bc26baa86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:05.683029 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a4e0e-4fd9-445e-be5c-d63bc26baa86 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:05.683319 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a4e0e-4fd9-445e-be5c-d63bc26baa86 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:05.683604 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a4e0e-4fd9-445e-be5c-d63bc26baa86 None admin] PATH_INFO: `/v3/projects/46df4ebb349c4739867e16ac062b7465` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:05.684782 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a4e0e-4fd9-445e-be5c-d63bc26baa86 None admin] RBAC: Authorizing `identity:get_project(project_id=46df4ebb349c4739867e16ac062b7465)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:05.686250 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a4e0e-4fd9-445e-be5c-d63bc26baa86 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:05.687938 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 593/1160] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:10:05 2022] GET /identity/v3/projects/46df4ebb349c4739867e16ac062b7465 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:05.694201 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b632a-cd39-4328-8e1f-cd50a233e8a3 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:05.790740 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b632a-cd39-4328-8e1f-cd50a233e8a3 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:05.810191 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:05.823977 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d14b23-f0b6-47a3-9c18-52f7f9175209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:05.830242 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d14b23-f0b6-47a3-9c18-52f7f9175209 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:05.830242 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d14b23-f0b6-47a3-9c18-52f7f9175209 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:05.830242 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d14b23-f0b6-47a3-9c18-52f7f9175209 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:05.830242 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d14b23-f0b6-47a3-9c18-52f7f9175209 None admin] RBAC: Adding query filter params (role.id=101b93f94624407f8c812ab86ebec32a, scope.project.id=46df4ebb349c4739867e16ac062b7465, user.id=0e119ad942b8457e908b810fdfb814dd) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:05.830242 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d14b23-f0b6-47a3-9c18-52f7f9175209 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:05.830719 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d14b23-f0b6-47a3-9c18-52f7f9175209 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:05.833543 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 568/1161] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:10:05 2022] GET /identity/v3/role_assignments?user.id=0e119ad942b8457e908b810fdfb814dd&scope.project.id=46df4ebb349c4739867e16ac062b7465&role.id=101b93f94624407f8c812ab86ebec32a => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:07.856500 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2cd32-bc3e-4911-9ed2-98b303560df2 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:07.857039 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2cd32-bc3e-4911-9ed2-98b303560df2 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:07.857134 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2cd32-bc3e-4911-9ed2-98b303560df2 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:07.858477 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 594/1162] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:10:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:07.863568 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28758b4e-a951-4dc1-8846-f58725102a43 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:07.863954 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28758b4e-a951-4dc1-8846-f58725102a43 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:07.864131 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28758b4e-a951-4dc1-8846-f58725102a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:07.881799 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-28758b4e-a951-4dc1-8846-f58725102a43 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:07.883001 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-28758b4e-a951-4dc1-8846-f58725102a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:07.947269 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 569/1163] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:10:07.969295 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2cd32-bc3e-4911-9ed2-98b303560df2 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:07.972181 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:08.069307 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2cd32-bc3e-4911-9ed2-98b303560df2 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:08.102728 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d523e4-ea1e-4dbd-856e-b28e803198d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:08.103370 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d523e4-ea1e-4dbd-856e-b28e803198d5 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:08.103655 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d523e4-ea1e-4dbd-856e-b28e803198d5 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:08.103933 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d523e4-ea1e-4dbd-856e-b28e803198d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:08.168007 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d523e4-ea1e-4dbd-856e-b28e803198d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:08.169381 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d523e4-ea1e-4dbd-856e-b28e803198d5 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:08.171154 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:08.263503 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 595/1164] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:10:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:10:08.269475 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28758b4e-a951-4dc1-8846-f58725102a43 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:08.366426 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28758b4e-a951-4dc1-8846-f58725102a43 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:08.380121 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:08.400460 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d2fed7-6838-430b-8168-e114d7d91587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:08.401260 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2fed7-6838-430b-8168-e114d7d91587 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:08.401549 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2fed7-6838-430b-8168-e114d7d91587 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:08.401828 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2fed7-6838-430b-8168-e114d7d91587 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:08.408722 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d2fed7-6838-430b-8168-e114d7d91587 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:08.410188 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d2fed7-6838-430b-8168-e114d7d91587 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:08.424225 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-47d2fed7-6838-430b-8168-e114d7d91587 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 05 21:10:08.424225 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:08.424225 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 05 21:10:08.424225 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 05 21:10:08.424225 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:10:08.424225 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:10:08.424225 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:10:08.424225 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:10:08.424225 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 05 21:10:08.424225 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:10:08.424225 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:10:08.424225 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:10:08.424225 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:08.424225 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:08.424225 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:08.424225 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:08.424225 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:08.425412 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:08.425412 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:08.425412 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:08.425412 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:08.425412 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:08.425412 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:08.425412 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:10:08.425412 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:10:08.425412 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:10:08.425412 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:10:08.425412 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:08.425412 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:08.425412 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:08.425412 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:08.425412 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:08.425412 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:08.426717 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:08.426717 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:08.426717 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:08.426717 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:08.426717 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:08.426717 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:08.426717 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:08.426717 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:08.426717 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:08.426717 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:08.426717 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 05 21:10:08.426717 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:10:08.426717 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 05 21:10:08.426717 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:10:08.426717 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 570/1165] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Jul 5 21:10:08 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:08.431382 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d523e4-ea1e-4dbd-856e-b28e803198d5 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:08.527886 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d523e4-ea1e-4dbd-856e-b28e803198d5 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:08.529374 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:08.561197 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27e9bb-bdd2-46f3-94cd-d7515ec92821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:08.561846 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27e9bb-bdd2-46f3-94cd-d7515ec92821 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:08.562161 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27e9bb-bdd2-46f3-94cd-d7515ec92821 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:08.562437 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27e9bb-bdd2-46f3-94cd-d7515ec92821 None admin] PATH_INFO: `/v3/domains` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:08.563147 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f27e9bb-bdd2-46f3-94cd-d7515ec92821 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:08.563457 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f27e9bb-bdd2-46f3-94cd-d7515ec92821 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:08.564810 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f27e9bb-bdd2-46f3-94cd-d7515ec92821 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:08.572677 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 596/1166] 10.222.0.30 () {56 vars in 1115 bytes} [Tue Jul 5 21:10:08 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:10.568084 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f0f66-b8fc-4951-8438-48016a14bd6f None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:10.568604 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f0f66-b8fc-4951-8438-48016a14bd6f None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:10.568604 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f0f66-b8fc-4951-8438-48016a14bd6f None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:10.569925 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 571/1167] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:10:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:10.575102 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde4ba9-688d-4848-b3fd-e23ed79976e6 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:10.575488 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde4ba9-688d-4848-b3fd-e23ed79976e6 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:10.575674 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde4ba9-688d-4848-b3fd-e23ed79976e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:10.592474 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-fcde4ba9-688d-4848-b3fd-e23ed79976e6 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:10.593660 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-fcde4ba9-688d-4848-b3fd-e23ed79976e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:10.658534 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 597/1168] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:10:10.681504 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f0f66-b8fc-4951-8438-48016a14bd6f None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:10.783411 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f0f66-b8fc-4951-8438-48016a14bd6f None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:10.817035 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4fa24b-6ab4-4860-957c-cee57a530e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:10.817718 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4fa24b-6ab4-4860-957c-cee57a530e3e None admin] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:10.818015 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4fa24b-6ab4-4860-957c-cee57a530e3e None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:10.818392 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4fa24b-6ab4-4860-957c-cee57a530e3e None admin] PATH_INFO: `/v3/domains` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:10.819094 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4fa24b-6ab4-4860-957c-cee57a530e3e None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:10.820474 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4fa24b-6ab4-4860-957c-cee57a530e3e None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:10.909795 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 572/1169] 10.222.0.30 () {60 vars in 1138 bytes} [Tue Jul 5 21:10:10 2022] POST /identity/v3/domains => generated 267 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:10:12.927284 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f63cf-4fc8-44f0-addb-5ca0122ff32a None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:12.927842 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f63cf-4fc8-44f0-addb-5ca0122ff32a None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:12.927842 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f63cf-4fc8-44f0-addb-5ca0122ff32a None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:12.929203 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 598/1170] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:10:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:12.934652 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c8860-f179-4da5-9a3c-ec2aa59e64f1 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:12.935038 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c8860-f179-4da5-9a3c-ec2aa59e64f1 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:12.935228 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c8860-f179-4da5-9a3c-ec2aa59e64f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:12.952449 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-319c8860-f179-4da5-9a3c-ec2aa59e64f1 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:12.953648 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-319c8860-f179-4da5-9a3c-ec2aa59e64f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:12.979894 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:13.019018 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 573/1171] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:10:13.043056 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f63cf-4fc8-44f0-addb-5ca0122ff32a None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:13.134464 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:13.140848 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f63cf-4fc8-44f0-addb-5ca0122ff32a None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:13.173562 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da21ba71-83a3-4d59-814d-7d3ab2728409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:13.174439 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21ba71-83a3-4d59-814d-7d3ab2728409 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:13.174724 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21ba71-83a3-4d59-814d-7d3ab2728409 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:13.174996 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21ba71-83a3-4d59-814d-7d3ab2728409 None admin] PATH_INFO: `/v3/domains/70908d0ae1874451ad036cc66043d6d5` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:13.185622 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da21ba71-83a3-4d59-814d-7d3ab2728409 None admin] RBAC: Authorizing `identity:get_domain(domain_id=70908d0ae1874451ad036cc66043d6d5)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:13.187036 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da21ba71-83a3-4d59-814d-7d3ab2728409 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:13.188640 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 599/1172] 10.222.0.30 () {56 vars in 1183 bytes} [Tue Jul 5 21:10:13 2022] GET /identity/v3/domains/70908d0ae1874451ad036cc66043d6d5 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:13.194658 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c8860-f179-4da5-9a3c-ec2aa59e64f1 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:13.293920 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c8860-f179-4da5-9a3c-ec2aa59e64f1 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:13.327158 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e09c1-0650-4076-8226-56267baa2496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:13.327819 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e09c1-0650-4076-8226-56267baa2496 None admin] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:13.328104 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e09c1-0650-4076-8226-56267baa2496 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:13.328380 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e09c1-0650-4076-8226-56267baa2496 None admin] PATH_INFO: `/v3/projects` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:13.329076 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601e09c1-0650-4076-8226-56267baa2496 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:13.330645 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601e09c1-0650-4076-8226-56267baa2496 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:13.404375 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 574/1173] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Jul 5 21:10:13 2022] POST /identity/v3/projects => generated 361 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:10:15.446788 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c94b9-e40a-48d0-b20c-9938cfa59c21 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:15.447351 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c94b9-e40a-48d0-b20c-9938cfa59c21 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:15.447351 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c94b9-e40a-48d0-b20c-9938cfa59c21 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:15.448790 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 600/1174] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:10:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:15.454058 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce0a68-6721-482b-8863-e32d71c02f83 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:15.454511 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce0a68-6721-482b-8863-e32d71c02f83 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:15.454658 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce0a68-6721-482b-8863-e32d71c02f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:15.471989 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-05ce0a68-6721-482b-8863-e32d71c02f83 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:15.473186 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-05ce0a68-6721-482b-8863-e32d71c02f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:15.483593 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:15.538669 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 575/1175] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:10:15.563889 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c94b9-e40a-48d0-b20c-9938cfa59c21 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:15.662490 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c94b9-e40a-48d0-b20c-9938cfa59c21 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:15.695237 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc6f3c-8801-4944-9697-f296c4f0f0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:15.696163 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc6f3c-8801-4944-9697-f296c4f0f0f3 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:15.696447 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc6f3c-8801-4944-9697-f296c4f0f0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:15.696726 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc6f3c-8801-4944-9697-f296c4f0f0f3 None admin] PATH_INFO: `/v3/domains/70908d0ae1874451ad036cc66043d6d5` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:15.697893 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc6f3c-8801-4944-9697-f296c4f0f0f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=70908d0ae1874451ad036cc66043d6d5)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:15.699356 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc6f3c-8801-4944-9697-f296c4f0f0f3 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:15.700944 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 601/1176] 10.222.0.30 () {56 vars in 1183 bytes} [Tue Jul 5 21:10:15 2022] GET /identity/v3/domains/70908d0ae1874451ad036cc66043d6d5 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:15.706566 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce0a68-6721-482b-8863-e32d71c02f83 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:15.802574 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce0a68-6721-482b-8863-e32d71c02f83 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:15.834639 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6dd972-f074-4905-90e6-224d827dc093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:15.835243 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6dd972-f074-4905-90e6-224d827dc093 None admin] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:15.835525 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6dd972-f074-4905-90e6-224d827dc093 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:15.835803 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6dd972-f074-4905-90e6-224d827dc093 None admin] PATH_INFO: `/v3/users` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:15.837087 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6dd972-f074-4905-90e6-224d827dc093 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:15.838534 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6dd972-f074-4905-90e6-224d827dc093 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:15.907577 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 576/1177] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:10:15 2022] POST /identity/v3/users => generated 311 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:10:18.021178 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb13af-6020-4c06-94ad-943e014b126b None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:18.021756 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb13af-6020-4c06-94ad-943e014b126b None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:18.021756 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb13af-6020-4c06-94ad-943e014b126b None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:18.023151 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 602/1178] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:10:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:18.028754 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfeb8f-4eb7-4fac-b697-16f7343deab6 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:18.029183 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfeb8f-4eb7-4fac-b697-16f7343deab6 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:18.029327 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfeb8f-4eb7-4fac-b697-16f7343deab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:18.034413 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:18.046118 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-b1bfeb8f-4eb7-4fac-b697-16f7343deab6 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:18.047332 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-b1bfeb8f-4eb7-4fac-b697-16f7343deab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:18.111969 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 577/1179] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:10:18.136145 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb13af-6020-4c06-94ad-943e014b126b None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:18.160545 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:18.234635 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb13af-6020-4c06-94ad-943e014b126b None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:18.267473 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04db81-7db5-48d6-ae67-7b8b75e5378a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:18.268252 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04db81-7db5-48d6-ae67-7b8b75e5378a None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:18.268536 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04db81-7db5-48d6-ae67-7b8b75e5378a None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:18.268811 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04db81-7db5-48d6-ae67-7b8b75e5378a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:18.278639 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd04db81-7db5-48d6-ae67-7b8b75e5378a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:10:18.286245 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-fd04db81-7db5-48d6-ae67-7b8b75e5378a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:10:18.286245 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:18.286245 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:18.286245 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:18.286245 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:18.286245 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:18.286245 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:18.286245 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:18.286245 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:18.286245 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:18.286245 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:18.286245 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:18.286245 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:10:18.286245 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:10:18.286245 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:10:18.286245 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:10:18.287486 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:10:18.287486 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:10:18.287486 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:10:18.287486 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:10:18.287486 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:18.287486 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:18.287486 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:18.287486 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:18.287486 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:18.287486 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:18.287486 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:18.287486 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:18.287486 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:18.287486 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:18.287486 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:18.287486 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:18.288633 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:18.288633 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:18.288633 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:18.288633 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:18.288633 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:10:18.288633 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:10:18.288633 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:10:18.288633 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:10:18.288633 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:10:18.288633 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:10:18.288633 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:10:18.288633 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:10:18.288633 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 603/1180] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:10:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:18.293958 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfeb8f-4eb7-4fac-b697-16f7343deab6 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:18.391112 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfeb8f-4eb7-4fac-b697-16f7343deab6 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:18.419604 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:18.424400 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730bb0d-05e7-43b0-b33a-05e8b8fe51ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:18.428869 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730bb0d-05e7-43b0-b33a-05e8b8fe51ab None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:18.428869 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730bb0d-05e7-43b0-b33a-05e8b8fe51ab None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:18.428869 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730bb0d-05e7-43b0-b33a-05e8b8fe51ab None admin] PATH_INFO: `/v3/roles` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:18.428869 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9730bb0d-05e7-43b0-b33a-05e8b8fe51ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:18.428869 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9730bb0d-05e7-43b0-b33a-05e8b8fe51ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:18.428869 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9730bb0d-05e7-43b0-b33a-05e8b8fe51ab None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:18.436752 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 578/1181] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:10:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:18.442771 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04db81-7db5-48d6-ae67-7b8b75e5378a None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:18.523481 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:18.539063 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04db81-7db5-48d6-ae67-7b8b75e5378a None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:18.572298 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abfe1ae-73b3-4c50-96a8-78e4d5e22138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:18.573151 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfe1ae-73b3-4c50-96a8-78e4d5e22138 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:18.573434 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfe1ae-73b3-4c50-96a8-78e4d5e22138 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:18.573708 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfe1ae-73b3-4c50-96a8-78e4d5e22138 None admin] PATH_INFO: `/v3/users/20b91fb533804343b720bf18963eaed2` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:18.586066 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abfe1ae-73b3-4c50-96a8-78e4d5e22138 None admin] RBAC: Authorizing `identity:get_user(user_id=20b91fb533804343b720bf18963eaed2)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:18.588025 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abfe1ae-73b3-4c50-96a8-78e4d5e22138 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:18.589642 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 604/1182] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:10:18 2022] GET /identity/v3/users/20b91fb533804343b720bf18963eaed2 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:10:18.595261 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730bb0d-05e7-43b0-b33a-05e8b8fe51ab None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:18.693485 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730bb0d-05e7-43b0-b33a-05e8b8fe51ab None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:18.725444 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8394f2a-c808-49fe-8e08-74d3869ba994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:18.726076 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8394f2a-c808-49fe-8e08-74d3869ba994 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:18.726388 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8394f2a-c808-49fe-8e08-74d3869ba994 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:18.726666 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8394f2a-c808-49fe-8e08-74d3869ba994 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:18.784554 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:18.791778 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8394f2a-c808-49fe-8e08-74d3869ba994 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:18.793154 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8394f2a-c808-49fe-8e08-74d3869ba994 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:18.888413 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 579/1183] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:10:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:10:18.894225 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abfe1ae-73b3-4c50-96a8-78e4d5e22138 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:18.990179 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abfe1ae-73b3-4c50-96a8-78e4d5e22138 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:19.022647 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b78e73-6699-42f2-a9b5-368cd81bca75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:19.023504 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b78e73-6699-42f2-a9b5-368cd81bca75 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:19.023831 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b78e73-6699-42f2-a9b5-368cd81bca75 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:19.024113 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b78e73-6699-42f2-a9b5-368cd81bca75 None admin] PATH_INFO: `/v3/projects/4e699227072348fab4fef3c606e11221` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:19.025300 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b78e73-6699-42f2-a9b5-368cd81bca75 None admin] RBAC: Authorizing `identity:get_project(project_id=4e699227072348fab4fef3c606e11221)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:19.026780 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b78e73-6699-42f2-a9b5-368cd81bca75 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:19.028449 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 605/1184] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:10:18 2022] GET /identity/v3/projects/4e699227072348fab4fef3c606e11221 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:19.034347 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8394f2a-c808-49fe-8e08-74d3869ba994 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:19.125052 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:19.131452 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8394f2a-c808-49fe-8e08-74d3869ba994 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:19.165398 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e2a2a-4cbb-41d1-8966-835b904c9a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:19.166039 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e2a2a-4cbb-41d1-8966-835b904c9a03 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:19.166347 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e2a2a-4cbb-41d1-8966-835b904c9a03 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:19.166625 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e2a2a-4cbb-41d1-8966-835b904c9a03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:19.167440 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027e2a2a-4cbb-41d1-8966-835b904c9a03 None admin] RBAC: Adding query filter params (role.id=101b93f94624407f8c812ab86ebec32a, scope.project.id=4e699227072348fab4fef3c606e11221, user.id=20b91fb533804343b720bf18963eaed2) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:19.167752 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027e2a2a-4cbb-41d1-8966-835b904c9a03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:19.169168 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027e2a2a-4cbb-41d1-8966-835b904c9a03 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:19.174457 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 580/1185] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:10:19 2022] GET /identity/v3/role_assignments?user.id=20b91fb533804343b720bf18963eaed2&scope.project.id=4e699227072348fab4fef3c606e11221&role.id=101b93f94624407f8c812ab86ebec32a => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:21.144247 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9b2dd-c335-49f9-bbf4-93bc9de627c9 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:21.144826 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9b2dd-c335-49f9-bbf4-93bc9de627c9 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:21.144826 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9b2dd-c335-49f9-bbf4-93bc9de627c9 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:21.146243 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 606/1186] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:10:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:21.152276 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c53a7-3a71-416b-85e6-094d9b68c3fd None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:21.152702 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c53a7-3a71-416b-85e6-094d9b68c3fd None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:21.152838 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c53a7-3a71-416b-85e6-094d9b68c3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:21.168517 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-793c53a7-3a71-416b-85e6-094d9b68c3fd None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:21.169688 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-793c53a7-3a71-416b-85e6-094d9b68c3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:21.233749 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 581/1187] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:10:21.256427 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9b2dd-c335-49f9-bbf4-93bc9de627c9 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:21.268939 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:21.357190 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9b2dd-c335-49f9-bbf4-93bc9de627c9 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:21.390848 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24711582-48c5-462f-a409-40d9d3b58968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:21.391629 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24711582-48c5-462f-a409-40d9d3b58968 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:21.391916 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24711582-48c5-462f-a409-40d9d3b58968 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:21.392193 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24711582-48c5-462f-a409-40d9d3b58968 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:21.402907 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24711582-48c5-462f-a409-40d9d3b58968 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:10:21.410478 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-24711582-48c5-462f-a409-40d9d3b58968 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:10:21.410478 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:21.410478 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:21.410478 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:21.410478 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:21.410478 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:21.410478 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:21.410478 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:21.410478 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:21.410478 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:21.410478 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:21.410478 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:21.410478 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:10:21.410478 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:10:21.410478 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:10:21.410478 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:10:21.411570 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:10:21.411570 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:10:21.411570 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:10:21.411570 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:10:21.411570 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:21.411570 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:21.411570 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:21.411570 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:21.411570 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:21.411570 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:21.411570 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:21.411570 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:21.411570 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:21.411570 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:21.411570 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:21.411570 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:21.412803 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:21.412803 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:21.412803 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:21.412803 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:21.412803 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:10:21.412803 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:10:21.412803 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:10:21.412803 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:10:21.412803 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:10:21.412803 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:10:21.412803 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:10:21.412803 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:10:21.412803 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 607/1188] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:10:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:21.417776 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c53a7-3a71-416b-85e6-094d9b68c3fd None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:21.500775 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:21.513324 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c53a7-3a71-416b-85e6-094d9b68c3fd None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:21.545926 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52990679-9121-44cf-91b8-919653d4d339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:21.546621 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52990679-9121-44cf-91b8-919653d4d339 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:21.546906 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52990679-9121-44cf-91b8-919653d4d339 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:21.547187 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52990679-9121-44cf-91b8-919653d4d339 None admin] PATH_INFO: `/v3/roles` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:21.547926 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52990679-9121-44cf-91b8-919653d4d339 None admin] RBAC: Adding query filter params (name=admin) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:21.548238 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52990679-9121-44cf-91b8-919653d4d339 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:21.549601 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52990679-9121-44cf-91b8-919653d4d339 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:21.557920 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 582/1189] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:10:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:21.563556 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24711582-48c5-462f-a409-40d9d3b58968 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:21.630812 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:21.660095 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24711582-48c5-462f-a409-40d9d3b58968 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:21.692509 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb07dc-aa4b-4ab9-8ca3-f78ec6dd6614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:21.693370 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb07dc-aa4b-4ab9-8ca3-f78ec6dd6614 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:21.693656 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb07dc-aa4b-4ab9-8ca3-f78ec6dd6614 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:21.693933 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb07dc-aa4b-4ab9-8ca3-f78ec6dd6614 None admin] PATH_INFO: `/v3/users/20b91fb533804343b720bf18963eaed2` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:21.695135 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bb07dc-aa4b-4ab9-8ca3-f78ec6dd6614 None admin] RBAC: Authorizing `identity:get_user(user_id=20b91fb533804343b720bf18963eaed2)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:21.697240 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bb07dc-aa4b-4ab9-8ca3-f78ec6dd6614 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:21.698874 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 608/1190] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:10:21 2022] GET /identity/v3/users/20b91fb533804343b720bf18963eaed2 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:21.704645 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52990679-9121-44cf-91b8-919653d4d339 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:21.801698 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52990679-9121-44cf-91b8-919653d4d339 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:21.834799 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0277e76-60b8-4012-a0b8-421bb7a9a6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:21.835659 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0277e76-60b8-4012-a0b8-421bb7a9a6d3 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:21.835952 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0277e76-60b8-4012-a0b8-421bb7a9a6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:21.836766 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0277e76-60b8-4012-a0b8-421bb7a9a6d3 None admin] PATH_INFO: `/v3/projects/4e699227072348fab4fef3c606e11221` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:21.838030 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0277e76-60b8-4012-a0b8-421bb7a9a6d3 None admin] RBAC: Authorizing `identity:get_project(project_id=4e699227072348fab4fef3c606e11221)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:21.839496 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0277e76-60b8-4012-a0b8-421bb7a9a6d3 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:21.841166 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 583/1191] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:10:21 2022] GET /identity/v3/projects/4e699227072348fab4fef3c606e11221 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:21.847007 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb07dc-aa4b-4ab9-8ca3-f78ec6dd6614 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:21.942216 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb07dc-aa4b-4ab9-8ca3-f78ec6dd6614 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:21.976723 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2d9ff-148e-488a-a4ec-30bce7ed350d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:21.977712 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2d9ff-148e-488a-a4ec-30bce7ed350d None admin] REQUEST_METHOD: `PUT` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:21.977998 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2d9ff-148e-488a-a4ec-30bce7ed350d None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:21.978311 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2d9ff-148e-488a-a4ec-30bce7ed350d None admin] PATH_INFO: `/v3/projects/4e699227072348fab4fef3c606e11221/users/20b91fb533804343b720bf18963eaed2/roles/101b93f94624407f8c812ab86ebec32a` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:21.980275 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a2d9ff-148e-488a-a4ec-30bce7ed350d None admin] RBAC: Authorizing `identity:create_grant(project_id=4e699227072348fab4fef3c606e11221, user_id=20b91fb533804343b720bf18963eaed2, role_id=101b93f94624407f8c812ab86ebec32a)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:21.981699 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a2d9ff-148e-488a-a4ec-30bce7ed350d None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:22.083302 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:22.089212 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 609/1192] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:10:21 2022] PUT /identity/v3/projects/4e699227072348fab4fef3c606e11221/users/20b91fb533804343b720bf18963eaed2/roles/101b93f94624407f8c812ab86ebec32a => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:10:24.056858 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99984d2f-3970-4775-aade-75c7f46fd65f None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:24.057462 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99984d2f-3970-4775-aade-75c7f46fd65f None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:24.057462 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99984d2f-3970-4775-aade-75c7f46fd65f None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:24.058812 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 584/1193] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:10:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:10:24.063834 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21d9f0-a4e1-4b2a-9e03-b28f7ad5796d None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:24.064248 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21d9f0-a4e1-4b2a-9e03-b28f7ad5796d None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:24.064399 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21d9f0-a4e1-4b2a-9e03-b28f7ad5796d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:24.081565 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-eb21d9f0-a4e1-4b2a-9e03-b28f7ad5796d None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:24.082784 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-eb21d9f0-a4e1-4b2a-9e03-b28f7ad5796d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:24.147475 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 610/1194] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:10:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:10:24.170864 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99984d2f-3970-4775-aade-75c7f46fd65f None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:24.189956 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:24.271580 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99984d2f-3970-4775-aade-75c7f46fd65f None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:24.304631 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe436267-3838-49ed-b221-6dd807158eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:24.305521 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe436267-3838-49ed-b221-6dd807158eaa None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:24.305816 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe436267-3838-49ed-b221-6dd807158eaa None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:24.306101 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe436267-3838-49ed-b221-6dd807158eaa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:24.317087 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe436267-3838-49ed-b221-6dd807158eaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:10:24.325432 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-fe436267-3838-49ed-b221-6dd807158eaa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:10:24.325432 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:10:24.325432 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:10:24.325432 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:10:24.325432 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:10:24.325432 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:10:24.325432 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:10:24.325432 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:10:24.325432 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:10:24.325432 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:10:24.325432 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:10:24.325432 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:10:24.325432 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:10:24.325432 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:10:24.325432 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:10:24.325432 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:10:24.326560 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:10:24.326560 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:10:24.326560 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:10:24.326560 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:10:24.326560 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:10:24.326560 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:10:24.326560 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:10:24.326560 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:10:24.326560 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:10:24.326560 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:10:24.326560 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:10:24.326560 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:10:24.326560 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:10:24.326560 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:10:24.326560 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:10:24.326560 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:10:24.327610 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:10:24.327610 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:10:24.327610 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:10:24.327610 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:10:24.327610 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:10:24.327610 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:10:24.327610 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:10:24.327610 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:10:24.327610 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:10:24.327610 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:10:24.327610 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:10:24.327610 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:10:24.327610 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 585/1195] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:10:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:10:24.332591 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21d9f0-a4e1-4b2a-9e03-b28f7ad5796d None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:24.426744 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21d9f0-a4e1-4b2a-9e03-b28f7ad5796d None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:24.452296 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:24.459643 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2baf31-3e1a-4e41-bc68-c0367fd9dd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:24.463506 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2baf31-3e1a-4e41-bc68-c0367fd9dd49 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:24.463506 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2baf31-3e1a-4e41-bc68-c0367fd9dd49 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:24.463506 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2baf31-3e1a-4e41-bc68-c0367fd9dd49 None admin] PATH_INFO: `/v3/roles` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:24.463506 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2baf31-3e1a-4e41-bc68-c0367fd9dd49 None admin] RBAC: Adding query filter params (name=admin) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:24.463506 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2baf31-3e1a-4e41-bc68-c0367fd9dd49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:24.463959 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2baf31-3e1a-4e41-bc68-c0367fd9dd49 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:24.471722 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 611/1196] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:10:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:24.477616 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe436267-3838-49ed-b221-6dd807158eaa None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:24.553311 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:24.575095 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe436267-3838-49ed-b221-6dd807158eaa None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:24.607820 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfddbba4-8a6c-468e-bc4c-c37f85e9c163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:24.608680 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfddbba4-8a6c-468e-bc4c-c37f85e9c163 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:24.608969 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfddbba4-8a6c-468e-bc4c-c37f85e9c163 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:24.609253 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfddbba4-8a6c-468e-bc4c-c37f85e9c163 None admin] PATH_INFO: `/v3/users/20b91fb533804343b720bf18963eaed2` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:24.610462 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfddbba4-8a6c-468e-bc4c-c37f85e9c163 None admin] RBAC: Authorizing `identity:get_user(user_id=20b91fb533804343b720bf18963eaed2)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:24.611890 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfddbba4-8a6c-468e-bc4c-c37f85e9c163 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:24.613487 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 586/1197] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:10:24 2022] GET /identity/v3/users/20b91fb533804343b720bf18963eaed2 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:24.619622 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2baf31-3e1a-4e41-bc68-c0367fd9dd49 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:24.714938 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2baf31-3e1a-4e41-bc68-c0367fd9dd49 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:24.747014 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc51bc-7b46-43df-8a68-2aab0acfbfa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:24.747652 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc51bc-7b46-43df-8a68-2aab0acfbfa3 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:24.747936 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc51bc-7b46-43df-8a68-2aab0acfbfa3 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:24.748214 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc51bc-7b46-43df-8a68-2aab0acfbfa3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:24.802241 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:24.812366 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bc51bc-7b46-43df-8a68-2aab0acfbfa3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:24.813811 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bc51bc-7b46-43df-8a68-2aab0acfbfa3 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:24.908153 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 612/1198] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:10:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:10:24.914032 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfddbba4-8a6c-468e-bc4c-c37f85e9c163 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:25.012155 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfddbba4-8a6c-468e-bc4c-c37f85e9c163 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:25.044700 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708931b-925c-4694-989a-aa024ec3c3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:25.045545 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708931b-925c-4694-989a-aa024ec3c3d5 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:25.045834 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708931b-925c-4694-989a-aa024ec3c3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:25.046114 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708931b-925c-4694-989a-aa024ec3c3d5 None admin] PATH_INFO: `/v3/projects/4e699227072348fab4fef3c606e11221` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:25.047307 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9708931b-925c-4694-989a-aa024ec3c3d5 None admin] RBAC: Authorizing `identity:get_project(project_id=4e699227072348fab4fef3c606e11221)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:25.048726 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9708931b-925c-4694-989a-aa024ec3c3d5 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:25.050420 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 587/1199] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:10:24 2022] GET /identity/v3/projects/4e699227072348fab4fef3c606e11221 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:25.056350 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc51bc-7b46-43df-8a68-2aab0acfbfa3 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:25.141441 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:25.151148 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc51bc-7b46-43df-8a68-2aab0acfbfa3 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:25.183471 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a7555-2f5d-44bc-841d-5df2ed79183e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:25.184057 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a7555-2f5d-44bc-841d-5df2ed79183e None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:25.184343 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a7555-2f5d-44bc-841d-5df2ed79183e None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:25.184620 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a7555-2f5d-44bc-841d-5df2ed79183e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:25.185440 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a7555-2f5d-44bc-841d-5df2ed79183e None admin] RBAC: Adding query filter params (role.id=101b93f94624407f8c812ab86ebec32a, scope.project.id=4e699227072348fab4fef3c606e11221, user.id=20b91fb533804343b720bf18963eaed2) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:10:25.185753 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a7555-2f5d-44bc-841d-5df2ed79183e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:25.187202 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a7555-2f5d-44bc-841d-5df2ed79183e None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:25.193058 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 613/1200] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:10:25 2022] GET /identity/v3/role_assignments?user.id=20b91fb533804343b720bf18963eaed2&scope.project.id=4e699227072348fab4fef3c606e11221&role.id=101b93f94624407f8c812ab86ebec32a => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:10:35.040675 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=93 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:35.190298 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=23 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:35.013335 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62a7d0-3bc5-4681-b37f-bafcbcb8a838 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:35.013950 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62a7d0-3bc5-4681-b37f-bafcbcb8a838 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:35.013950 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62a7d0-3bc5-4681-b37f-bafcbcb8a838 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:35.015318 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 588/1201] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:11:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:11:35.020396 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f26dd8-c32b-4846-a1d5-2f66aecb0445 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:35.020868 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f26dd8-c32b-4846-a1d5-2f66aecb0445 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:35.020976 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f26dd8-c32b-4846-a1d5-2f66aecb0445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:35.037563 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-50f26dd8-c32b-4846-a1d5-2f66aecb0445 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:11:35.038772 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-50f26dd8-c32b-4846-a1d5-2f66aecb0445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:11:35.107518 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 614/1202] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:11:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:11:35.132390 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f62a7d0-3bc5-4681-b37f-bafcbcb8a838 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:35.237621 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f62a7d0-3bc5-4681-b37f-bafcbcb8a838 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:35.272432 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7447fc-2613-47f9-a380-936381e57f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:35.273294 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7447fc-2613-47f9-a380-936381e57f3d None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:35.273581 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7447fc-2613-47f9-a380-936381e57f3d None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:35.273858 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7447fc-2613-47f9-a380-936381e57f3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:35.283810 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7447fc-2613-47f9-a380-936381e57f3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:35.285239 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7447fc-2613-47f9-a380-936381e57f3d None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:35.302804 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-aa7447fc-2613-47f9-a380-936381e57f3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:11:35.302804 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:11:35.302804 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:11:35.302804 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:11:35.302804 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:11:35.302804 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:11:35.302804 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:11:35.302804 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:11:35.302804 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:11:35.302804 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:11:35.302804 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:11:35.302804 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:11:35.302804 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:11:35.302804 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:11:35.302804 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:11:35.303853 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:11:35.303853 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:11:35.303853 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:11:35.303853 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:11:35.303853 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:11:35.303853 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:11:35.303853 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:11:35.303853 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:11:35.303853 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:11:35.303853 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:11:35.303853 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:11:35.303853 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:11:35.303853 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:11:35.303853 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:11:35.303853 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:11:35.303853 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:11:35.303853 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:11:35.304825 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:11:35.304825 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:11:35.304825 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:11:35.304825 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:11:35.304825 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 589/1203] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:11:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:11:35.310632 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f26dd8-c32b-4846-a1d5-2f66aecb0445 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:35.409970 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f26dd8-c32b-4846-a1d5-2f66aecb0445 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:35.438074 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:35.444125 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be8f4d-95a5-4553-a1f2-79f51e8268b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:35.444787 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be8f4d-95a5-4553-a1f2-79f51e8268b0 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:35.445081 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be8f4d-95a5-4553-a1f2-79f51e8268b0 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:35.445363 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be8f4d-95a5-4553-a1f2-79f51e8268b0 None admin] PATH_INFO: `/v3/domains` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:35.446088 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be8f4d-95a5-4553-a1f2-79f51e8268b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:35.446948 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be8f4d-95a5-4553-a1f2-79f51e8268b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:35.448326 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be8f4d-95a5-4553-a1f2-79f51e8268b0 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:35.459436 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 615/1204] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:35.465867 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7447fc-2613-47f9-a380-936381e57f3d None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:35.518388 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:35.566567 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7447fc-2613-47f9-a380-936381e57f3d None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:35.600008 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2004348-d222-43f5-84f3-17d5f1669c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:35.600681 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2004348-d222-43f5-84f3-17d5f1669c1f None admin] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:35.600969 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2004348-d222-43f5-84f3-17d5f1669c1f None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:35.601251 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2004348-d222-43f5-84f3-17d5f1669c1f None admin] PATH_INFO: `/v3/users` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:35.601949 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2004348-d222-43f5-84f3-17d5f1669c1f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:35.604025 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2004348-d222-43f5-84f3-17d5f1669c1f None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:35.685032 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 590/1205] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:11:35 2022] POST /identity/v3/users => generated 251 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:11:37.722257 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce4b0b-654a-4ae2-aeef-009b7a75fb72 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:37.722802 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce4b0b-654a-4ae2-aeef-009b7a75fb72 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:37.722802 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce4b0b-654a-4ae2-aeef-009b7a75fb72 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:37.724225 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 616/1206] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:11:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:11:37.729768 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4eaa7-d126-49fd-acc4-7f4aa45f64b6 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:37.731923 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4eaa7-d126-49fd-acc4-7f4aa45f64b6 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:37.731923 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4eaa7-d126-49fd-acc4-7f4aa45f64b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:37.747329 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-8ce4eaa7-d126-49fd-acc4-7f4aa45f64b6 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:11:37.748613 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-8ce4eaa7-d126-49fd-acc4-7f4aa45f64b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:11:37.814810 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 591/1207] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:11:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:11:37.838513 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce4b0b-654a-4ae2-aeef-009b7a75fb72 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:37.938876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce4b0b-654a-4ae2-aeef-009b7a75fb72 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:37.972409 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa2a2f-50a2-4b69-9404-f768bb4ea59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:37.973139 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa2a2f-50a2-4b69-9404-f768bb4ea59d None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:37.973424 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa2a2f-50a2-4b69-9404-f768bb4ea59d None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:37.973700 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa2a2f-50a2-4b69-9404-f768bb4ea59d None admin] PATH_INFO: `/v3/roles/service` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:37.984168 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa2a2f-50a2-4b69-9404-f768bb4ea59d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:11:37.991975 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-dffa2a2f-50a2-4b69-9404-f768bb4ea59d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:11:37.991975 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:11:37.991975 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:11:37.991975 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:11:37.991975 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:11:37.991975 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:11:37.991975 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:11:37.991975 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:11:37.991975 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:11:37.991975 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:11:37.991975 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:11:37.991975 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:11:37.991975 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:11:37.991975 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:11:37.991975 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:11:37.991975 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:11:37.997459 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:11:37.997459 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:11:37.997459 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:11:37.997459 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:11:37.997459 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:11:37.997459 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:11:37.997459 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:11:37.997459 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:11:37.997459 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:11:37.997459 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:11:37.997459 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:11:37.997459 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:11:37.997459 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:11:37.997459 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:11:37.997459 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:11:37.997459 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:11:37.998456 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:11:37.998456 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:11:37.998456 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:11:37.998456 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:11:37.998456 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:11:37.998456 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:11:37.998456 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:11:37.998456 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:11:37.998456 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:11:37.998456 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:11:37.998456 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:11:37.998456 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:11:37.998456 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 617/1208] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:11:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:11:37.999197 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce4eaa7-d126-49fd-acc4-7f4aa45f64b6 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:38.038743 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:38.097917 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce4eaa7-d126-49fd-acc4-7f4aa45f64b6 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:38.131907 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8076e-afbd-4dc9-a6fd-091eea6672e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:38.132579 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8076e-afbd-4dc9-a6fd-091eea6672e7 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:38.132869 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8076e-afbd-4dc9-a6fd-091eea6672e7 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:38.133152 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8076e-afbd-4dc9-a6fd-091eea6672e7 None admin] PATH_INFO: `/v3/roles` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:38.133954 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8076e-afbd-4dc9-a6fd-091eea6672e7 None admin] RBAC: Adding query filter params (name=service) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:38.134464 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8076e-afbd-4dc9-a6fd-091eea6672e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:38.135840 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8076e-afbd-4dc9-a6fd-091eea6672e7 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:38.143579 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 592/1209] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:11:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:38.149270 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa2a2f-50a2-4b69-9404-f768bb4ea59d None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:38.200459 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:38.248700 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa2a2f-50a2-4b69-9404-f768bb4ea59d None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:38.282414 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d58d2-9b41-4868-8242-64db86ef0f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:38.283203 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d58d2-9b41-4868-8242-64db86ef0f2b None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:38.283529 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d58d2-9b41-4868-8242-64db86ef0f2b None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:38.283835 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d58d2-9b41-4868-8242-64db86ef0f2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:38.294406 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9d58d2-9b41-4868-8242-64db86ef0f2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:38.295859 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9d58d2-9b41-4868-8242-64db86ef0f2b None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:38.315698 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-ab9d58d2-9b41-4868-8242-64db86ef0f2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:11:38.315698 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:11:38.315698 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:11:38.315698 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:11:38.315698 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:11:38.315698 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:11:38.315698 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:11:38.315698 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:11:38.315698 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:11:38.315698 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:11:38.315698 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:11:38.315698 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:11:38.315698 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:11:38.315698 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:11:38.315698 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:11:38.317030 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:11:38.317030 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:11:38.317030 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:11:38.317030 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:11:38.317030 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:11:38.317030 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:11:38.317030 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:11:38.317030 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:11:38.317030 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:11:38.317030 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:11:38.317030 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:11:38.317030 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:11:38.317030 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:11:38.317030 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:11:38.317030 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:11:38.317030 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:11:38.317030 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:11:38.318084 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:11:38.318084 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:11:38.318084 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:11:38.318084 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:11:38.318084 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 618/1210] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:11:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:11:38.323484 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8076e-afbd-4dc9-a6fd-091eea6672e7 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:38.419852 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:38.422819 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8076e-afbd-4dc9-a6fd-091eea6672e7 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:38.455395 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9190444b-ad41-4123-8c3b-004a5817a18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:38.456054 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190444b-ad41-4123-8c3b-004a5817a18c None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:38.456338 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190444b-ad41-4123-8c3b-004a5817a18c None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:38.456616 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190444b-ad41-4123-8c3b-004a5817a18c None admin] PATH_INFO: `/v3/domains` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:38.457335 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9190444b-ad41-4123-8c3b-004a5817a18c None admin] RBAC: Adding query filter params (name=Default) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:38.457689 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9190444b-ad41-4123-8c3b-004a5817a18c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:38.459082 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9190444b-ad41-4123-8c3b-004a5817a18c None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:38.471038 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 593/1211] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:38.476682 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d58d2-9b41-4868-8242-64db86ef0f2b None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:38.575554 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d58d2-9b41-4868-8242-64db86ef0f2b None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:38.576992 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:38.610021 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1f062-350f-4f36-82b8-cf39b625d81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:38.610863 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1f062-350f-4f36-82b8-cf39b625d81d None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:38.611153 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1f062-350f-4f36-82b8-cf39b625d81d None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:38.611442 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1f062-350f-4f36-82b8-cf39b625d81d None admin] PATH_INFO: `/v3/users/placement` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:38.619336 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b1f062-350f-4f36-82b8-cf39b625d81d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:38.623991 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b1f062-350f-4f36-82b8-cf39b625d81d None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:38.636008 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-38b1f062-350f-4f36-82b8-cf39b625d81d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 21:11:38.636008 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:11:38.636008 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:11:38.636008 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:11:38.636008 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:11:38.636008 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:11:38.636008 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:11:38.636008 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:11:38.636008 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:11:38.636008 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:11:38.636008 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:11:38.636008 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:11:38.636008 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:11:38.636008 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:11:38.636008 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:11:38.636008 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:11:38.637149 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:11:38.637149 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:11:38.637149 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:11:38.637149 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:11:38.637149 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:11:38.637149 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:11:38.637149 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:11:38.637149 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:11:38.637149 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:11:38.637149 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:11:38.637149 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:11:38.637149 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:11:38.637149 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:11:38.637149 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:11:38.637149 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:11:38.637149 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:11:38.637149 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:11:38.637149 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:11:38.638658 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:11:38.638658 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:11:38.638658 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:11:38.638658 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:11:38.638658 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:11:38.638658 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:11:38.638658 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:11:38.638658 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:11:38.638658 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 21:11:38.638658 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:11:38.638658 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 619/1212] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:11:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:11:38.642995 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9190444b-ad41-4123-8c3b-004a5817a18c None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:38.741068 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9190444b-ad41-4123-8c3b-004a5817a18c None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:38.775888 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbcaf33-0d61-4a1d-b023-c5503bf7dd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:38.776557 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbcaf33-0d61-4a1d-b023-c5503bf7dd94 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:38.776871 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbcaf33-0d61-4a1d-b023-c5503bf7dd94 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:38.777150 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbcaf33-0d61-4a1d-b023-c5503bf7dd94 None admin] PATH_INFO: `/v3/users` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:38.777979 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbcaf33-0d61-4a1d-b023-c5503bf7dd94 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:38.778322 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbcaf33-0d61-4a1d-b023-c5503bf7dd94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:38.779754 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbcaf33-0d61-4a1d-b023-c5503bf7dd94 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:38.796423 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 594/1213] 10.222.0.30 () {56 vars in 1143 bytes} [Tue Jul 5 21:11:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:11:38.802109 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1f062-350f-4f36-82b8-cf39b625d81d None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:38.902208 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1f062-350f-4f36-82b8-cf39b625d81d None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:38.935564 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09998345-9e55-40b1-a84b-5d58033aca29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:38.936219 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09998345-9e55-40b1-a84b-5d58033aca29 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:38.936508 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09998345-9e55-40b1-a84b-5d58033aca29 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:38.936789 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09998345-9e55-40b1-a84b-5d58033aca29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:38.967207 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:39.003916 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09998345-9e55-40b1-a84b-5d58033aca29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:39.005367 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09998345-9e55-40b1-a84b-5d58033aca29 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:39.101547 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 620/1214] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:11:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:11:39.108184 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbcaf33-0d61-4a1d-b023-c5503bf7dd94 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:39.127859 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:39.208367 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbcaf33-0d61-4a1d-b023-c5503bf7dd94 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:39.242368 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9d19c-d769-495f-90b2-3f63496f73ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:39.243734 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9d19c-d769-495f-90b2-3f63496f73ea None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:39.244058 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9d19c-d769-495f-90b2-3f63496f73ea None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:39.244289 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9d19c-d769-495f-90b2-3f63496f73ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:39.254414 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee9d19c-d769-495f-90b2-3f63496f73ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:39.255861 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee9d19c-d769-495f-90b2-3f63496f73ea None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:39.273331 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-eee9d19c-d769-495f-90b2-3f63496f73ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:11:39.273331 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:11:39.273331 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:11:39.273331 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:11:39.273331 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:11:39.273331 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:11:39.273331 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:11:39.273331 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:11:39.273331 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:11:39.273331 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:11:39.273331 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:11:39.273331 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:11:39.273331 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:11:39.273331 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:11:39.273331 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:11:39.274520 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:11:39.274520 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:11:39.274520 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:11:39.274520 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:11:39.274520 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:11:39.274520 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:11:39.274520 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:11:39.274520 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:11:39.274520 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:11:39.274520 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:11:39.274520 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:11:39.274520 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:11:39.274520 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:11:39.274520 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:11:39.274520 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:11:39.274520 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:11:39.274520 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:11:39.275748 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:11:39.275748 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:11:39.275748 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:11:39.275748 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:11:39.275748 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 595/1215] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:11:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:11:39.280619 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09998345-9e55-40b1-a84b-5d58033aca29 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:39.341314 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:39.380255 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09998345-9e55-40b1-a84b-5d58033aca29 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:39.413102 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e8e12-ea6f-432c-b94e-540231033a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:39.413770 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e8e12-ea6f-432c-b94e-540231033a9b None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:39.414063 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e8e12-ea6f-432c-b94e-540231033a9b None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:39.414375 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e8e12-ea6f-432c-b94e-540231033a9b None admin] PATH_INFO: `/v3/domains` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:39.415612 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903e8e12-ea6f-432c-b94e-540231033a9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:39.416535 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903e8e12-ea6f-432c-b94e-540231033a9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:39.418506 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903e8e12-ea6f-432c-b94e-540231033a9b None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:39.430075 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 621/1216] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:39.436280 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9d19c-d769-495f-90b2-3f63496f73ea None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:39.505400 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:39.535868 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9d19c-d769-495f-90b2-3f63496f73ea None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:39.569756 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ba8b6-914b-4dd5-955a-15a9bd2902da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:39.570545 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ba8b6-914b-4dd5-955a-15a9bd2902da None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:39.575521 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ba8b6-914b-4dd5-955a-15a9bd2902da None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:39.575521 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ba8b6-914b-4dd5-955a-15a9bd2902da None admin] PATH_INFO: `/v3/projects/service` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:39.577746 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43ba8b6-914b-4dd5-955a-15a9bd2902da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:39.579215 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43ba8b6-914b-4dd5-955a-15a9bd2902da None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:39.593249 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-c43ba8b6-914b-4dd5-955a-15a9bd2902da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:11:39.593249 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:11:39.593249 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:11:39.593249 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:11:39.593249 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:11:39.593249 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:11:39.593249 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:11:39.593249 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:11:39.593249 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:11:39.593249 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:11:39.593249 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:11:39.593249 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:11:39.593249 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:11:39.593249 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:11:39.593249 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:11:39.594468 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:11:39.594468 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:11:39.594468 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:11:39.594468 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:11:39.594468 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:11:39.594468 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:11:39.594468 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:11:39.594468 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:11:39.594468 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:11:39.594468 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:11:39.594468 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:11:39.594468 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:11:39.594468 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:11:39.594468 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:11:39.594468 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:11:39.594468 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:11:39.594468 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:11:39.595389 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:11:39.595389 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:11:39.595389 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:11:39.595389 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:11:39.595389 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:11:39.595389 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:11:39.595389 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:11:39.595389 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:11:39.595389 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 596/1217] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:11:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:11:39.600530 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e8e12-ea6f-432c-b94e-540231033a9b None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:39.697854 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e8e12-ea6f-432c-b94e-540231033a9b None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:39.720063 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:39.731787 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b4ff6-67e4-4cb9-b0ea-f1566c678b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:39.732447 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b4ff6-67e4-4cb9-b0ea-f1566c678b95 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:39.732736 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b4ff6-67e4-4cb9-b0ea-f1566c678b95 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:39.733018 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b4ff6-67e4-4cb9-b0ea-f1566c678b95 None admin] PATH_INFO: `/v3/projects` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:39.734789 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b4ff6-67e4-4cb9-b0ea-f1566c678b95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:39.734789 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b4ff6-67e4-4cb9-b0ea-f1566c678b95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:39.735677 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b4ff6-67e4-4cb9-b0ea-f1566c678b95 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:39.746860 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 622/1218] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:11:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:39.753010 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ba8b6-914b-4dd5-955a-15a9bd2902da None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:39.851763 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ba8b6-914b-4dd5-955a-15a9bd2902da None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:39.879005 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:39.885488 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b57bd-d95e-453c-a412-2422a87f0e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:39.886171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b57bd-d95e-453c-a412-2422a87f0e13 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:39.889693 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b57bd-d95e-453c-a412-2422a87f0e13 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:39.889693 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b57bd-d95e-453c-a412-2422a87f0e13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:39.889693 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b57bd-d95e-453c-a412-2422a87f0e13 None admin] RBAC: Adding query filter params (role.id=601a166d56f647bda8256e971450cfdf, scope.project.id=ccd95a48530c4c86a3774301b969d6a9, user.id=a027185c09a8465fa88aadbe511a07f9) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:39.889693 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b57bd-d95e-453c-a412-2422a87f0e13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:39.889693 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b57bd-d95e-453c-a412-2422a87f0e13 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:39.894857 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 597/1219] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:11:39 2022] GET /identity/v3/role_assignments?user.id=a027185c09a8465fa88aadbe511a07f9&scope.project.id=ccd95a48530c4c86a3774301b969d6a9&role.id=601a166d56f647bda8256e971450cfdf => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:41.878749 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264ed25-0252-4863-b3c9-7e6bb55eef8c None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:41.879303 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264ed25-0252-4863-b3c9-7e6bb55eef8c None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:41.879403 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264ed25-0252-4863-b3c9-7e6bb55eef8c None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:41.880750 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 623/1220] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:11:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:11:41.886692 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5199d-d36f-44bb-8d73-36d453e4c228 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:41.887119 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5199d-d36f-44bb-8d73-36d453e4c228 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:41.887257 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5199d-d36f-44bb-8d73-36d453e4c228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:41.904635 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-88b5199d-d36f-44bb-8d73-36d453e4c228 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:11:41.905861 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-88b5199d-d36f-44bb-8d73-36d453e4c228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:11:41.973251 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 598/1221] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:11:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:11:41.995893 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9264ed25-0252-4863-b3c9-7e6bb55eef8c None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:42.095926 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9264ed25-0252-4863-b3c9-7e6bb55eef8c None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:42.130123 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfac63a-f662-4a89-a3e9-95ab4d2a4693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:42.130878 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfac63a-f662-4a89-a3e9-95ab4d2a4693 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:42.131164 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfac63a-f662-4a89-a3e9-95ab4d2a4693 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:42.131440 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfac63a-f662-4a89-a3e9-95ab4d2a4693 None admin] PATH_INFO: `/v3/roles/service` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:42.141591 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfac63a-f662-4a89-a3e9-95ab4d2a4693 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:11:42.149330 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-0bfac63a-f662-4a89-a3e9-95ab4d2a4693 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:11:42.149330 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:11:42.149330 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:11:42.149330 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:11:42.149330 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:11:42.149330 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:11:42.149330 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:11:42.149330 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:11:42.149330 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:11:42.149330 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:11:42.149330 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:11:42.149330 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:11:42.149330 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:11:42.149330 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:11:42.149330 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:11:42.149330 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:11:42.151899 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:11:42.151899 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:11:42.151899 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:11:42.151899 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:11:42.151899 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:11:42.151899 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:11:42.151899 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:11:42.151899 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:11:42.151899 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:11:42.151899 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:11:42.151899 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:11:42.151899 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:11:42.151899 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:11:42.151899 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:11:42.151899 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:11:42.151899 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:11:42.152881 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:11:42.152881 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:11:42.152881 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:11:42.152881 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:11:42.152881 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:11:42.152881 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:11:42.152881 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:11:42.152881 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:11:42.152881 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:11:42.152881 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:11:42.152881 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:11:42.152881 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:11:42.152881 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 624/1222] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:11:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:11:42.156759 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5199d-d36f-44bb-8d73-36d453e4c228 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:42.253900 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5199d-d36f-44bb-8d73-36d453e4c228 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:42.276574 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:42.286967 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6315d88-b3a1-43ab-a892-7d329770e569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:42.287642 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6315d88-b3a1-43ab-a892-7d329770e569 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:42.287931 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6315d88-b3a1-43ab-a892-7d329770e569 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:42.288212 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6315d88-b3a1-43ab-a892-7d329770e569 None admin] PATH_INFO: `/v3/roles` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:42.288961 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6315d88-b3a1-43ab-a892-7d329770e569 None admin] RBAC: Adding query filter params (name=service) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:42.289274 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6315d88-b3a1-43ab-a892-7d329770e569 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:42.291308 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6315d88-b3a1-43ab-a892-7d329770e569 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:42.299018 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 599/1223] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:11:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:42.304706 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfac63a-f662-4a89-a3e9-95ab4d2a4693 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:42.348413 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:42.404936 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfac63a-f662-4a89-a3e9-95ab4d2a4693 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:42.438714 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd64694-b586-4627-abce-35476d9491b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:42.439508 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd64694-b586-4627-abce-35476d9491b7 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:42.439801 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd64694-b586-4627-abce-35476d9491b7 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:42.440087 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd64694-b586-4627-abce-35476d9491b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:42.451190 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd64694-b586-4627-abce-35476d9491b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:42.452744 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd64694-b586-4627-abce-35476d9491b7 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:42.472047 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-cfd64694-b586-4627-abce-35476d9491b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:11:42.472047 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:11:42.472047 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:11:42.472047 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:11:42.472047 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:11:42.472047 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:11:42.472047 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:11:42.472047 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:11:42.472047 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:11:42.472047 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:11:42.472047 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:11:42.472047 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:11:42.472047 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:11:42.472047 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:11:42.472047 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:11:42.473135 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:11:42.473135 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:11:42.473135 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:11:42.473135 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:11:42.473135 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:11:42.473135 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:11:42.473135 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:11:42.473135 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:11:42.473135 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:11:42.473135 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:11:42.473135 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:11:42.473135 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:11:42.473135 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:11:42.473135 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:11:42.473135 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:11:42.473135 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:11:42.473135 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:11:42.474463 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:11:42.474463 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:11:42.474463 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:11:42.474463 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:11:42.474463 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 625/1224] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:11:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:11:42.479715 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6315d88-b3a1-43ab-a892-7d329770e569 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:42.581817 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6315d88-b3a1-43ab-a892-7d329770e569 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:42.615549 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ecc940-13a8-499d-9703-c95e35293b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:42.616256 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecc940-13a8-499d-9703-c95e35293b64 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:42.616687 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecc940-13a8-499d-9703-c95e35293b64 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:42.616974 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecc940-13a8-499d-9703-c95e35293b64 None admin] PATH_INFO: `/v3/domains` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:42.617693 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ecc940-13a8-499d-9703-c95e35293b64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:42.618004 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ecc940-13a8-499d-9703-c95e35293b64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:42.619905 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ecc940-13a8-499d-9703-c95e35293b64 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:42.631536 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 600/1225] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:11:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:42.637435 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd64694-b586-4627-abce-35476d9491b7 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:42.731746 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:42.738120 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd64694-b586-4627-abce-35476d9491b7 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:42.771488 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21563af3-b9c9-4610-89bd-55e79f1ea3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:42.772286 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21563af3-b9c9-4610-89bd-55e79f1ea3de None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:42.772579 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21563af3-b9c9-4610-89bd-55e79f1ea3de None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:42.772863 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21563af3-b9c9-4610-89bd-55e79f1ea3de None admin] PATH_INFO: `/v3/users/placement` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:42.780387 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21563af3-b9c9-4610-89bd-55e79f1ea3de None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:42.781829 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21563af3-b9c9-4610-89bd-55e79f1ea3de None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:42.796877 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-21563af3-b9c9-4610-89bd-55e79f1ea3de None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 21:11:42.796877 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:11:42.796877 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:11:42.796877 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:11:42.796877 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:11:42.796877 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:11:42.796877 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:11:42.796877 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:11:42.796877 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:11:42.796877 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:11:42.796877 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:11:42.796877 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:11:42.796877 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:11:42.796877 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:11:42.796877 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:11:42.796877 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:11:42.798009 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:11:42.798009 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:11:42.798009 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:11:42.798009 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:11:42.798009 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:11:42.798009 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:11:42.798009 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:11:42.798009 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:11:42.798009 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:11:42.798009 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:11:42.798009 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:11:42.798009 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:11:42.798009 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:11:42.798009 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:11:42.798009 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:11:42.798009 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:11:42.798009 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:11:42.798009 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:11:42.799257 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:11:42.799257 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:11:42.799257 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:11:42.799257 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:11:42.799257 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:11:42.799257 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:11:42.799257 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:11:42.799257 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:11:42.799257 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 21:11:42.799257 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:11:42.799257 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 626/1226] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:11:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:11:42.803842 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ecc940-13a8-499d-9703-c95e35293b64 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:42.851466 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:42.903958 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ecc940-13a8-499d-9703-c95e35293b64 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:42.936228 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ab53c-6872-42fc-bb4b-2adc6d518572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:42.936892 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ab53c-6872-42fc-bb4b-2adc6d518572 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:42.937238 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ab53c-6872-42fc-bb4b-2adc6d518572 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:42.937561 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ab53c-6872-42fc-bb4b-2adc6d518572 None admin] PATH_INFO: `/v3/users` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:42.938414 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2ab53c-6872-42fc-bb4b-2adc6d518572 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:42.938727 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2ab53c-6872-42fc-bb4b-2adc6d518572 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:42.940153 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2ab53c-6872-42fc-bb4b-2adc6d518572 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:42.957404 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 601/1227] 10.222.0.30 () {56 vars in 1143 bytes} [Tue Jul 5 21:11:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:42.963567 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21563af3-b9c9-4610-89bd-55e79f1ea3de None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:43.060731 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21563af3-b9c9-4610-89bd-55e79f1ea3de None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:43.094803 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1eed6d-bb5f-4424-ad17-49e4d5add559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:43.095597 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1eed6d-bb5f-4424-ad17-49e4d5add559 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:43.095884 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1eed6d-bb5f-4424-ad17-49e4d5add559 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:43.096164 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1eed6d-bb5f-4424-ad17-49e4d5add559 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:43.106142 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1eed6d-bb5f-4424-ad17-49e4d5add559 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:43.107585 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1eed6d-bb5f-4424-ad17-49e4d5add559 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:43.124995 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-af1eed6d-bb5f-4424-ad17-49e4d5add559 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:11:43.124995 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:11:43.124995 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:11:43.124995 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:11:43.124995 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:11:43.124995 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:11:43.124995 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:11:43.124995 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:11:43.124995 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:11:43.124995 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:11:43.124995 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:11:43.124995 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:11:43.124995 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:11:43.124995 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:11:43.124995 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:11:43.126194 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:11:43.126194 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:11:43.126194 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:11:43.126194 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:11:43.126194 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:11:43.126194 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:11:43.126194 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:11:43.126194 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:11:43.126194 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:11:43.126194 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:11:43.126194 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:11:43.126194 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:11:43.126194 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:11:43.126194 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:11:43.126194 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:11:43.126194 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:11:43.126194 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:11:43.127201 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:11:43.127201 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:11:43.127201 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:11:43.127201 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:11:43.127201 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 627/1228] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:11:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:11:43.132010 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ab53c-6872-42fc-bb4b-2adc6d518572 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:43.231837 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ab53c-6872-42fc-bb4b-2adc6d518572 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:43.234142 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:43.265970 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2882b-ef81-463f-9395-333f88ba9fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:43.266740 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2882b-ef81-463f-9395-333f88ba9fc5 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:43.267026 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2882b-ef81-463f-9395-333f88ba9fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:43.267303 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2882b-ef81-463f-9395-333f88ba9fc5 None admin] PATH_INFO: `/v3/domains` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:43.268017 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde2882b-ef81-463f-9395-333f88ba9fc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:43.268332 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde2882b-ef81-463f-9395-333f88ba9fc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:43.269690 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde2882b-ef81-463f-9395-333f88ba9fc5 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:43.281111 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 602/1229] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:43.286827 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1eed6d-bb5f-4424-ad17-49e4d5add559 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:43.296171 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:43.388352 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1eed6d-bb5f-4424-ad17-49e4d5add559 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:43.421787 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47691b7e-46a6-47cc-bc07-57f23d466683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:43.422610 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47691b7e-46a6-47cc-bc07-57f23d466683 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:43.422901 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47691b7e-46a6-47cc-bc07-57f23d466683 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:43.423176 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47691b7e-46a6-47cc-bc07-57f23d466683 None admin] PATH_INFO: `/v3/projects/service` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:43.429806 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47691b7e-46a6-47cc-bc07-57f23d466683 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:43.431948 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47691b7e-46a6-47cc-bc07-57f23d466683 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:43.447407 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-47691b7e-46a6-47cc-bc07-57f23d466683 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:11:43.447407 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:11:43.447407 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:11:43.447407 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:11:43.447407 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:11:43.447407 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:11:43.447407 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:11:43.447407 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:11:43.447407 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:11:43.447407 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:11:43.447407 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:11:43.447407 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:11:43.447407 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:11:43.447407 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:11:43.447407 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:11:43.448533 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:11:43.448533 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:11:43.448533 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:11:43.448533 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:11:43.448533 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:11:43.448533 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:11:43.448533 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:11:43.448533 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:11:43.448533 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:11:43.448533 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:11:43.448533 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:11:43.448533 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:11:43.448533 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:11:43.448533 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:11:43.448533 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:11:43.448533 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:11:43.448533 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:11:43.449496 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:11:43.449496 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:11:43.449496 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:11:43.449496 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:11:43.449496 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:11:43.449496 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:11:43.449496 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:11:43.449496 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:11:43.449496 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 628/1230] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:11:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:11:43.454568 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2882b-ef81-463f-9395-333f88ba9fc5 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:43.553284 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2882b-ef81-463f-9395-333f88ba9fc5 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:43.591005 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42798346-7023-42d0-9380-d54d44696662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:43.592144 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42798346-7023-42d0-9380-d54d44696662 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:43.592666 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42798346-7023-42d0-9380-d54d44696662 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:43.593186 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42798346-7023-42d0-9380-d54d44696662 None admin] PATH_INFO: `/v3/projects` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:43.594759 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42798346-7023-42d0-9380-d54d44696662 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:43.595334 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42798346-7023-42d0-9380-d54d44696662 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:43.598061 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42798346-7023-42d0-9380-d54d44696662 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:43.617440 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 603/1231] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:11:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:43.625364 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47691b7e-46a6-47cc-bc07-57f23d466683 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:43.693741 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:43.729725 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47691b7e-46a6-47cc-bc07-57f23d466683 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:43.763514 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6189a1a-3620-4e7e-8bbd-5fa01cec5462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:43.764399 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6189a1a-3620-4e7e-8bbd-5fa01cec5462 None admin] REQUEST_METHOD: `PUT` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:43.764686 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6189a1a-3620-4e7e-8bbd-5fa01cec5462 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:43.764965 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6189a1a-3620-4e7e-8bbd-5fa01cec5462 None admin] PATH_INFO: `/v3/projects/ccd95a48530c4c86a3774301b969d6a9/users/a027185c09a8465fa88aadbe511a07f9/roles/601a166d56f647bda8256e971450cfdf` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:43.779776 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6189a1a-3620-4e7e-8bbd-5fa01cec5462 None admin] RBAC: Authorizing `identity:create_grant(project_id=ccd95a48530c4c86a3774301b969d6a9, user_id=a027185c09a8465fa88aadbe511a07f9, role_id=601a166d56f647bda8256e971450cfdf)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:43.781230 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6189a1a-3620-4e7e-8bbd-5fa01cec5462 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:43.847480 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 629/1232] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:11:43 2022] PUT /identity/v3/projects/ccd95a48530c4c86a3774301b969d6a9/users/a027185c09a8465fa88aadbe511a07f9/roles/601a166d56f647bda8256e971450cfdf => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:11:45.937661 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f9d47-9124-49d9-8201-aaa27f52b97d None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:45.938223 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f9d47-9124-49d9-8201-aaa27f52b97d None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:45.938318 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f9d47-9124-49d9-8201-aaa27f52b97d None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:45.939633 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 604/1233] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:11:45.945607 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7b502-deae-4966-9400-fafb88885edf None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:45.946094 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7b502-deae-4966-9400-fafb88885edf None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:45.946270 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7b502-deae-4966-9400-fafb88885edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:45.972740 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-6cb7b502-deae-4966-9400-fafb88885edf None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:11:45.974147 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-6cb7b502-deae-4966-9400-fafb88885edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:11:46.058951 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 630/1234] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:11:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:11:46.083127 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f9d47-9124-49d9-8201-aaa27f52b97d None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:46.109620 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:46.184501 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f9d47-9124-49d9-8201-aaa27f52b97d None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:46.219089 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fecdadf-5626-4d7d-ae87-785fe61ae16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:46.219894 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fecdadf-5626-4d7d-ae87-785fe61ae16f None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:46.220187 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fecdadf-5626-4d7d-ae87-785fe61ae16f None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:46.220469 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fecdadf-5626-4d7d-ae87-785fe61ae16f None admin] PATH_INFO: `/v3/roles/service` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:46.231289 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fecdadf-5626-4d7d-ae87-785fe61ae16f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:11:46.239337 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-9fecdadf-5626-4d7d-ae87-785fe61ae16f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:11:46.239337 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:11:46.239337 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:11:46.239337 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:11:46.239337 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:11:46.239337 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:11:46.239337 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:11:46.239337 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:11:46.239337 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:11:46.239337 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:11:46.239337 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:11:46.239337 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:11:46.239337 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:11:46.239337 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:11:46.239337 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:11:46.239337 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:11:46.240464 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:11:46.240464 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:11:46.240464 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:11:46.240464 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:11:46.240464 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:11:46.240464 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:11:46.240464 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:11:46.240464 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:11:46.240464 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:11:46.240464 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:11:46.240464 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:11:46.240464 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:11:46.240464 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:11:46.240464 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:11:46.240464 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:11:46.240464 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:11:46.241532 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:11:46.241532 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:11:46.241532 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:11:46.241532 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:11:46.241532 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:11:46.241532 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:11:46.241532 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:11:46.241532 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:11:46.241532 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:11:46.241532 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:11:46.241532 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:11:46.241532 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:11:46.241532 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 605/1235] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:11:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:11:46.246946 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7b502-deae-4966-9400-fafb88885edf None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:46.295101 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:46.352296 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7b502-deae-4966-9400-fafb88885edf None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:46.386055 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1322d-91de-40f5-8a17-3160eaf07ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:46.386749 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1322d-91de-40f5-8a17-3160eaf07ab6 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:46.387034 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1322d-91de-40f5-8a17-3160eaf07ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:46.387310 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1322d-91de-40f5-8a17-3160eaf07ab6 None admin] PATH_INFO: `/v3/roles` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:46.388052 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb1322d-91de-40f5-8a17-3160eaf07ab6 None admin] RBAC: Adding query filter params (name=service) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:46.388362 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb1322d-91de-40f5-8a17-3160eaf07ab6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:46.389862 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb1322d-91de-40f5-8a17-3160eaf07ab6 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:46.398103 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 631/1236] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:11:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:46.404909 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fecdadf-5626-4d7d-ae87-785fe61ae16f None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:46.491518 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:46.507422 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fecdadf-5626-4d7d-ae87-785fe61ae16f None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:46.551050 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376de59-dbce-4b4e-8788-dc6baf68ab8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:46.551961 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376de59-dbce-4b4e-8788-dc6baf68ab8a None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:46.552256 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376de59-dbce-4b4e-8788-dc6baf68ab8a None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:46.552542 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376de59-dbce-4b4e-8788-dc6baf68ab8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:46.564544 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a376de59-dbce-4b4e-8788-dc6baf68ab8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:46.566306 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a376de59-dbce-4b4e-8788-dc6baf68ab8a None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:46.589983 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-a376de59-dbce-4b4e-8788-dc6baf68ab8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:11:46.589983 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:11:46.589983 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:11:46.589983 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:11:46.589983 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:11:46.589983 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:11:46.589983 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:11:46.589983 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:11:46.589983 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:11:46.589983 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:11:46.589983 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:11:46.589983 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:11:46.589983 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:11:46.589983 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:11:46.589983 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:11:46.593718 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:11:46.593718 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:11:46.593718 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:11:46.593718 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:11:46.593718 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:11:46.593718 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:11:46.593718 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:11:46.593718 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:11:46.593718 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:11:46.593718 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:11:46.593718 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:11:46.593718 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:11:46.593718 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:11:46.593718 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:11:46.593718 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:11:46.593718 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:11:46.593718 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:11:46.594986 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:11:46.594986 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:11:46.594986 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:11:46.594986 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:11:46.594986 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 606/1237] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:11:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:11:46.597163 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1322d-91de-40f5-8a17-3160eaf07ab6 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:46.699383 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1322d-91de-40f5-8a17-3160eaf07ab6 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:46.708028 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:46.732521 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db93be-244f-45f1-b7ce-8a0690acadd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:46.737297 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db93be-244f-45f1-b7ce-8a0690acadd1 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:46.737297 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db93be-244f-45f1-b7ce-8a0690acadd1 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:46.737297 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db93be-244f-45f1-b7ce-8a0690acadd1 None admin] PATH_INFO: `/v3/domains` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:46.737297 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db93be-244f-45f1-b7ce-8a0690acadd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:46.737297 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db93be-244f-45f1-b7ce-8a0690acadd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:46.737297 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db93be-244f-45f1-b7ce-8a0690acadd1 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:46.748441 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 632/1238] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:11:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:46.754059 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376de59-dbce-4b4e-8788-dc6baf68ab8a None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:46.856894 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376de59-dbce-4b4e-8788-dc6baf68ab8a None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:46.890385 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d020b-4344-4b2b-8e0f-f4bb2a41137b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:46.891183 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d020b-4344-4b2b-8e0f-f4bb2a41137b None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:46.891473 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d020b-4344-4b2b-8e0f-f4bb2a41137b None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:46.891758 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d020b-4344-4b2b-8e0f-f4bb2a41137b None admin] PATH_INFO: `/v3/users/placement` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:46.894500 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:46.900044 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d020b-4344-4b2b-8e0f-f4bb2a41137b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:46.903622 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d020b-4344-4b2b-8e0f-f4bb2a41137b None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:46.916145 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-c88d020b-4344-4b2b-8e0f-f4bb2a41137b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 21:11:46.916145 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:11:46.916145 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:11:46.916145 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:11:46.916145 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:11:46.916145 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:11:46.916145 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:11:46.916145 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:11:46.916145 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:11:46.916145 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:11:46.916145 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:11:46.916145 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:11:46.916145 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:11:46.916145 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:11:46.916145 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:11:46.916145 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:11:46.917366 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:11:46.917366 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:11:46.917366 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:11:46.917366 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:11:46.917366 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:11:46.917366 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:11:46.917366 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:11:46.917366 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:11:46.917366 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:11:46.917366 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:11:46.917366 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:11:46.917366 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:11:46.917366 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:11:46.917366 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:11:46.917366 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:11:46.917366 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:11:46.917366 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:11:46.917366 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:11:46.918638 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:11:46.918638 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:11:46.918638 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:11:46.918638 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:11:46.918638 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:11:46.918638 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:11:46.918638 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:11:46.918638 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:11:46.918638 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 21:11:46.918638 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:11:46.918638 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 607/1239] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:11:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:11:46.923166 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db93be-244f-45f1-b7ce-8a0690acadd1 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:47.024569 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db93be-244f-45f1-b7ce-8a0690acadd1 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:47.058844 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d1404-7433-4462-a624-a7a8745fd55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:47.059546 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d1404-7433-4462-a624-a7a8745fd55e None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:47.059839 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d1404-7433-4462-a624-a7a8745fd55e None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:47.060121 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d1404-7433-4462-a624-a7a8745fd55e None admin] PATH_INFO: `/v3/users` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:47.060956 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d1404-7433-4462-a624-a7a8745fd55e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:47.061270 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d1404-7433-4462-a624-a7a8745fd55e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:47.062747 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d1404-7433-4462-a624-a7a8745fd55e None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:47.080689 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 633/1240] 10.222.0.30 () {56 vars in 1143 bytes} [Tue Jul 5 21:11:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:47.086597 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d020b-4344-4b2b-8e0f-f4bb2a41137b None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:47.190526 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d020b-4344-4b2b-8e0f-f4bb2a41137b None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:47.225373 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f77aad5-72ed-4172-ab93-10187dde6f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:47.226030 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77aad5-72ed-4172-ab93-10187dde6f08 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:47.226354 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77aad5-72ed-4172-ab93-10187dde6f08 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:47.226643 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77aad5-72ed-4172-ab93-10187dde6f08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:47.290309 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:47.296988 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f77aad5-72ed-4172-ab93-10187dde6f08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:47.298488 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f77aad5-72ed-4172-ab93-10187dde6f08 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:47.402373 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 608/1241] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:11:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:11:47.408620 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d1404-7433-4462-a624-a7a8745fd55e None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:47.440861 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:47.512121 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d1404-7433-4462-a624-a7a8745fd55e None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:47.545808 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700be620-5751-4078-b3e0-f9b990a5879e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:47.546579 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700be620-5751-4078-b3e0-f9b990a5879e None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:47.546870 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700be620-5751-4078-b3e0-f9b990a5879e None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:47.547153 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700be620-5751-4078-b3e0-f9b990a5879e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:47.557707 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700be620-5751-4078-b3e0-f9b990a5879e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:47.559223 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700be620-5751-4078-b3e0-f9b990a5879e None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:47.578204 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-700be620-5751-4078-b3e0-f9b990a5879e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:11:47.578204 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:11:47.578204 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:11:47.578204 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:11:47.578204 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:11:47.578204 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:11:47.578204 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:11:47.578204 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:11:47.578204 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:11:47.578204 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:11:47.578204 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:11:47.578204 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:11:47.578204 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:11:47.578204 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:11:47.578204 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:11:47.579285 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:11:47.579285 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:11:47.579285 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:11:47.579285 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:11:47.579285 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:11:47.579285 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:11:47.579285 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:11:47.579285 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:11:47.579285 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:11:47.579285 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:11:47.579285 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:11:47.579285 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:11:47.579285 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:11:47.579285 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:11:47.579285 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:11:47.579285 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:11:47.579285 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:11:47.580422 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:11:47.580422 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:11:47.580422 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:11:47.580422 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:11:47.580422 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 634/1242] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:11:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:11:47.585082 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f77aad5-72ed-4172-ab93-10187dde6f08 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:47.677742 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:47.683947 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f77aad5-72ed-4172-ab93-10187dde6f08 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:47.717017 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc587d-2f2f-4992-90cf-e9a9bbe71bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:47.717687 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc587d-2f2f-4992-90cf-e9a9bbe71bac None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:47.717977 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc587d-2f2f-4992-90cf-e9a9bbe71bac None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:47.718298 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc587d-2f2f-4992-90cf-e9a9bbe71bac None admin] PATH_INFO: `/v3/domains` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:47.719021 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc587d-2f2f-4992-90cf-e9a9bbe71bac None admin] RBAC: Adding query filter params (name=Default) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:47.719337 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc587d-2f2f-4992-90cf-e9a9bbe71bac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:47.720713 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc587d-2f2f-4992-90cf-e9a9bbe71bac None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:47.732930 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 609/1243] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:11:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:47.738595 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700be620-5751-4078-b3e0-f9b990a5879e None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:47.815068 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:47.836013 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700be620-5751-4078-b3e0-f9b990a5879e None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:47.870411 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486cb510-c692-465a-b197-23945e0bdb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:47.871240 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486cb510-c692-465a-b197-23945e0bdb7b None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:47.871533 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486cb510-c692-465a-b197-23945e0bdb7b None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:47.871818 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486cb510-c692-465a-b197-23945e0bdb7b None admin] PATH_INFO: `/v3/projects/service` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:47.878530 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486cb510-c692-465a-b197-23945e0bdb7b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:47.879977 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486cb510-c692-465a-b197-23945e0bdb7b None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:47.894290 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-486cb510-c692-465a-b197-23945e0bdb7b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:11:47.894290 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:11:47.894290 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:11:47.894290 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:11:47.894290 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:11:47.894290 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:11:47.894290 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:11:47.894290 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:11:47.894290 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:11:47.894290 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:11:47.894290 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:11:47.894290 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:11:47.894290 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:11:47.894290 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:11:47.894290 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:11:47.895280 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:11:47.895280 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:11:47.895280 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:11:47.895280 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:11:47.895280 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:11:47.895280 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:11:47.895280 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:11:47.895280 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:11:47.895280 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:11:47.895280 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:11:47.895280 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:11:47.895280 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:11:47.895280 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:11:47.895280 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:11:47.895280 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:11:47.895280 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:11:47.895280 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:11:47.896227 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:11:47.896227 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:11:47.896227 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:11:47.896227 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:11:47.896227 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:11:47.896227 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:11:47.896227 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:11:47.896227 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:11:47.896227 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 635/1244] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:11:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:11:47.902116 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc587d-2f2f-4992-90cf-e9a9bbe71bac None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:48.002506 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc587d-2f2f-4992-90cf-e9a9bbe71bac None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:48.036574 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a82a39-286e-4541-b630-745ef2286189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:48.037246 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a82a39-286e-4541-b630-745ef2286189 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:48.037537 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a82a39-286e-4541-b630-745ef2286189 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:48.037818 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a82a39-286e-4541-b630-745ef2286189 None admin] PATH_INFO: `/v3/projects` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:48.038634 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a82a39-286e-4541-b630-745ef2286189 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:48.038953 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a82a39-286e-4541-b630-745ef2286189 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:48.040462 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a82a39-286e-4541-b630-745ef2286189 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:48.052446 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 610/1245] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:11:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:11:48.059129 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486cb510-c692-465a-b197-23945e0bdb7b None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:48.157695 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486cb510-c692-465a-b197-23945e0bdb7b None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:48.190856 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41fef4-e852-47b3-b0d2-a5c608a8b5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:48.191562 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41fef4-e852-47b3-b0d2-a5c608a8b5c5 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:48.191849 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41fef4-e852-47b3-b0d2-a5c608a8b5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:48.192396 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41fef4-e852-47b3-b0d2-a5c608a8b5c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:48.193226 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41fef4-e852-47b3-b0d2-a5c608a8b5c5 None admin] RBAC: Adding query filter params (role.id=601a166d56f647bda8256e971450cfdf, scope.project.id=ccd95a48530c4c86a3774301b969d6a9, user.id=a027185c09a8465fa88aadbe511a07f9) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:48.193543 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41fef4-e852-47b3-b0d2-a5c608a8b5c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:48.195012 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41fef4-e852-47b3-b0d2-a5c608a8b5c5 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:48.200947 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 636/1246] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:11:48 2022] GET /identity/v3/role_assignments?user.id=a027185c09a8465fa88aadbe511a07f9&scope.project.id=ccd95a48530c4c86a3774301b969d6a9&role.id=601a166d56f647bda8256e971450cfdf => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:50.296618 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26515f60-d1f9-4481-8e28-a32325af6c6c None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:50.297171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26515f60-d1f9-4481-8e28-a32325af6c6c None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:50.297171 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26515f60-d1f9-4481-8e28-a32325af6c6c None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:50.298580 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 611/1247] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:11:50.303808 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0ba14-6254-4ea3-8de9-26e2c1c0a642 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:50.304263 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0ba14-6254-4ea3-8de9-26e2c1c0a642 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:50.304445 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0ba14-6254-4ea3-8de9-26e2c1c0a642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:50.310002 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:50.323001 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-dca0ba14-6254-4ea3-8de9-26e2c1c0a642 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:11:50.324213 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-dca0ba14-6254-4ea3-8de9-26e2c1c0a642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:11:50.389253 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 637/1248] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:11:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:11:50.412137 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26515f60-d1f9-4481-8e28-a32325af6c6c None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:50.430661 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:50.515675 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26515f60-d1f9-4481-8e28-a32325af6c6c None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:50.548758 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa77fd10-e79f-4283-b1cd-f2d12f469f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:50.549492 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77fd10-e79f-4283-b1cd-f2d12f469f9f None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:50.549781 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77fd10-e79f-4283-b1cd-f2d12f469f9f None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:50.550064 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77fd10-e79f-4283-b1cd-f2d12f469f9f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:50.560744 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa77fd10-e79f-4283-b1cd-f2d12f469f9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:11:50.568667 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-fa77fd10-e79f-4283-b1cd-f2d12f469f9f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:11:50.568667 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:11:50.568667 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:11:50.568667 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:11:50.568667 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:11:50.568667 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:11:50.568667 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:11:50.568667 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:11:50.568667 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:11:50.568667 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:11:50.568667 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:11:50.568667 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:11:50.568667 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:11:50.568667 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:11:50.568667 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:11:50.568667 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:11:50.569836 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:11:50.569836 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:11:50.569836 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:11:50.569836 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:11:50.569836 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:11:50.569836 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:11:50.569836 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:11:50.569836 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:11:50.569836 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:11:50.569836 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:11:50.569836 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:11:50.569836 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:11:50.569836 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:11:50.569836 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:11:50.569836 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:11:50.569836 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:11:50.570817 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:11:50.570817 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:11:50.570817 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:11:50.570817 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:11:50.570817 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:11:50.570817 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:11:50.570817 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:11:50.570817 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:11:50.570817 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:11:50.570817 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:11:50.570817 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:11:50.570817 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:11:50.570817 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 612/1249] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:11:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:11:50.576438 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca0ba14-6254-4ea3-8de9-26e2c1c0a642 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:50.674983 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca0ba14-6254-4ea3-8de9-26e2c1c0a642 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:50.704551 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:50.709663 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223298f-6ab3-483f-8d93-ff99d83a7138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:50.710366 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223298f-6ab3-483f-8d93-ff99d83a7138 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:50.710654 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223298f-6ab3-483f-8d93-ff99d83a7138 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:50.710936 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223298f-6ab3-483f-8d93-ff99d83a7138 None admin] PATH_INFO: `/v3/roles` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:50.712242 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f223298f-6ab3-483f-8d93-ff99d83a7138 None admin] RBAC: Adding query filter params (name=admin) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:50.712594 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f223298f-6ab3-483f-8d93-ff99d83a7138 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:50.713980 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f223298f-6ab3-483f-8d93-ff99d83a7138 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:50.721945 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 638/1250] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:11:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:50.728664 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa77fd10-e79f-4283-b1cd-f2d12f469f9f None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:50.805335 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:50.827325 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa77fd10-e79f-4283-b1cd-f2d12f469f9f None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:50.861232 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8737a3-e298-4780-a0b6-bcdbfb7cacd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:50.862026 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8737a3-e298-4780-a0b6-bcdbfb7cacd9 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:50.862345 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8737a3-e298-4780-a0b6-bcdbfb7cacd9 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:50.862629 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8737a3-e298-4780-a0b6-bcdbfb7cacd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:50.872985 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8737a3-e298-4780-a0b6-bcdbfb7cacd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:50.874468 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8737a3-e298-4780-a0b6-bcdbfb7cacd9 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:50.891370 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-9e8737a3-e298-4780-a0b6-bcdbfb7cacd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:11:50.891370 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:11:50.891370 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:11:50.891370 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:11:50.891370 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:11:50.891370 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:11:50.891370 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:11:50.891370 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:11:50.891370 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:11:50.891370 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:11:50.891370 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:11:50.891370 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:11:50.891370 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:11:50.891370 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:11:50.891370 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:11:50.892454 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:11:50.892454 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:11:50.892454 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:11:50.892454 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:11:50.892454 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:11:50.892454 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:11:50.892454 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:11:50.892454 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:11:50.892454 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:11:50.892454 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:11:50.892454 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:11:50.892454 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:11:50.892454 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:11:50.892454 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:11:50.892454 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:11:50.892454 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:11:50.892454 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:11:50.893593 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:11:50.893593 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:11:50.893593 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:11:50.893593 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:11:50.893593 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 613/1251] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:11:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:11:50.898300 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223298f-6ab3-483f-8d93-ff99d83a7138 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:50.996131 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223298f-6ab3-483f-8d93-ff99d83a7138 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:51.028672 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d4361-b369-4048-93af-5cd0c78121a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:51.029334 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d4361-b369-4048-93af-5cd0c78121a9 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:51.029624 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d4361-b369-4048-93af-5cd0c78121a9 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:51.029911 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d4361-b369-4048-93af-5cd0c78121a9 None admin] PATH_INFO: `/v3/domains` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:51.030661 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599d4361-b369-4048-93af-5cd0c78121a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:51.030984 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599d4361-b369-4048-93af-5cd0c78121a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:51.032346 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599d4361-b369-4048-93af-5cd0c78121a9 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:51.044448 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 639/1252] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:51.050040 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8737a3-e298-4780-a0b6-bcdbfb7cacd9 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:51.148137 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8737a3-e298-4780-a0b6-bcdbfb7cacd9 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:51.173496 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:51.181766 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ab072-b090-414e-9e40-b51b053b18dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:51.182600 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ab072-b090-414e-9e40-b51b053b18dc None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:51.182900 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ab072-b090-414e-9e40-b51b053b18dc None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:51.183181 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ab072-b090-414e-9e40-b51b053b18dc None admin] PATH_INFO: `/v3/users/placement` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:51.190612 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24ab072-b090-414e-9e40-b51b053b18dc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:51.192365 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24ab072-b090-414e-9e40-b51b053b18dc None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:51.206610 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-b24ab072-b090-414e-9e40-b51b053b18dc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 21:11:51.206610 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:11:51.206610 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:11:51.206610 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:11:51.206610 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:11:51.206610 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:11:51.206610 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:11:51.206610 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:11:51.206610 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:11:51.206610 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:11:51.206610 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:11:51.206610 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:11:51.206610 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:11:51.206610 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:11:51.206610 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:11:51.206610 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:11:51.211264 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:11:51.211264 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:11:51.211264 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:11:51.211264 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:11:51.211264 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:11:51.211264 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:11:51.211264 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:11:51.211264 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:11:51.211264 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:11:51.211264 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:11:51.211264 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:11:51.211264 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:11:51.211264 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:11:51.211264 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:11:51.211264 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:11:51.211264 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:11:51.211264 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:11:51.211264 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:11:51.212576 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:11:51.212576 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:11:51.212576 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:11:51.212576 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:11:51.212576 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:11:51.212576 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:11:51.212576 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:11:51.212576 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:11:51.212576 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 21:11:51.212576 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:11:51.212576 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 614/1253] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:11:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:11:51.213995 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d4361-b369-4048-93af-5cd0c78121a9 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:51.269743 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:51.314037 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d4361-b369-4048-93af-5cd0c78121a9 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:51.349087 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481b6433-cd57-4289-a097-56e7867f542a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:51.349766 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b6433-cd57-4289-a097-56e7867f542a None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:51.350153 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b6433-cd57-4289-a097-56e7867f542a None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:51.350460 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b6433-cd57-4289-a097-56e7867f542a None admin] PATH_INFO: `/v3/users` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:51.351303 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481b6433-cd57-4289-a097-56e7867f542a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:51.351622 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481b6433-cd57-4289-a097-56e7867f542a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:51.353606 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481b6433-cd57-4289-a097-56e7867f542a None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:51.371658 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 640/1254] 10.222.0.30 () {56 vars in 1143 bytes} [Tue Jul 5 21:11:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:51.377680 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ab072-b090-414e-9e40-b51b053b18dc None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:51.479186 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ab072-b090-414e-9e40-b51b053b18dc None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:51.513918 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f048c7c-42c7-47d1-8193-fc316b171d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:51.514598 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f048c7c-42c7-47d1-8193-fc316b171d09 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:51.514887 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f048c7c-42c7-47d1-8193-fc316b171d09 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:51.515164 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f048c7c-42c7-47d1-8193-fc316b171d09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:51.569961 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:51.581857 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f048c7c-42c7-47d1-8193-fc316b171d09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:51.583373 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f048c7c-42c7-47d1-8193-fc316b171d09 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:51.679291 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 615/1255] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:11:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:11:51.685256 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481b6433-cd57-4289-a097-56e7867f542a None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:51.789296 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481b6433-cd57-4289-a097-56e7867f542a None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:51.802674 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:51.824372 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36759e56-a675-4172-8fa4-79918b76723e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:51.825172 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36759e56-a675-4172-8fa4-79918b76723e None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:51.825464 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36759e56-a675-4172-8fa4-79918b76723e None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:51.825749 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36759e56-a675-4172-8fa4-79918b76723e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:51.835815 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36759e56-a675-4172-8fa4-79918b76723e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:51.837986 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36759e56-a675-4172-8fa4-79918b76723e None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:51.855507 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-36759e56-a675-4172-8fa4-79918b76723e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:11:51.855507 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:11:51.855507 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:11:51.855507 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:11:51.855507 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:11:51.855507 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:11:51.855507 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:11:51.855507 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:11:51.855507 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:11:51.855507 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:11:51.855507 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:11:51.855507 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:11:51.855507 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:11:51.855507 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:11:51.855507 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:11:51.856653 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:11:51.856653 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:11:51.856653 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:11:51.856653 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:11:51.856653 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:11:51.856653 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:11:51.856653 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:11:51.856653 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:11:51.856653 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:11:51.856653 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:11:51.856653 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:11:51.856653 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:11:51.856653 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:11:51.856653 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:11:51.856653 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:11:51.856653 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:11:51.856653 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:11:51.857967 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:11:51.857967 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:11:51.857967 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:11:51.857967 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:11:51.857967 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 641/1256] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:11:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:11:51.862374 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f048c7c-42c7-47d1-8193-fc316b171d09 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:51.948065 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:51.959636 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f048c7c-42c7-47d1-8193-fc316b171d09 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:51.992512 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51702f-5050-4c60-95d2-1ff84dfd8d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:51.993210 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51702f-5050-4c60-95d2-1ff84dfd8d3f None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:51.993494 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51702f-5050-4c60-95d2-1ff84dfd8d3f None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:51.993776 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51702f-5050-4c60-95d2-1ff84dfd8d3f None admin] PATH_INFO: `/v3/domains` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:51.994521 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de51702f-5050-4c60-95d2-1ff84dfd8d3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:51.994837 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de51702f-5050-4c60-95d2-1ff84dfd8d3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:51.996201 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de51702f-5050-4c60-95d2-1ff84dfd8d3f None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:52.007431 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 616/1257] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:52.013709 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36759e56-a675-4172-8fa4-79918b76723e None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:52.111312 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36759e56-a675-4172-8fa4-79918b76723e None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:52.144044 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d2d88-d205-4662-89df-1c7fcc758283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:52.144837 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d2d88-d205-4662-89df-1c7fcc758283 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:52.145122 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d2d88-d205-4662-89df-1c7fcc758283 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:52.145397 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d2d88-d205-4662-89df-1c7fcc758283 None admin] PATH_INFO: `/v3/projects/service` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:52.152546 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d2d88-d205-4662-89df-1c7fcc758283 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:52.154086 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d2d88-d205-4662-89df-1c7fcc758283 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:52.167647 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-eb2d2d88-d205-4662-89df-1c7fcc758283 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:11:52.167647 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:11:52.167647 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:11:52.167647 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:11:52.167647 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:11:52.167647 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:11:52.167647 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:11:52.167647 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:11:52.167647 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:11:52.167647 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:11:52.167647 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:11:52.167647 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:11:52.167647 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:11:52.167647 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:11:52.167647 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:11:52.168684 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:11:52.168684 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:11:52.168684 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:11:52.168684 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:11:52.168684 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:11:52.168684 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:11:52.168684 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:11:52.168684 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:11:52.168684 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:11:52.168684 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:11:52.168684 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:11:52.168684 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:11:52.168684 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:11:52.168684 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:11:52.168684 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:11:52.168684 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:11:52.168684 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:11:52.170035 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:11:52.170035 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:11:52.170035 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:11:52.170035 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:11:52.170035 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:11:52.170035 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:11:52.170035 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:11:52.170035 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:11:52.170035 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 642/1258] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:11:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:11:52.174583 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51702f-5050-4c60-95d2-1ff84dfd8d3f None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:52.274344 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51702f-5050-4c60-95d2-1ff84dfd8d3f None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:52.310810 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd9575-a1b6-4d5a-90e2-f8929a7fe15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:52.311448 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd9575-a1b6-4d5a-90e2-f8929a7fe15a None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:52.311733 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd9575-a1b6-4d5a-90e2-f8929a7fe15a None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:52.312136 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd9575-a1b6-4d5a-90e2-f8929a7fe15a None admin] PATH_INFO: `/v3/projects` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:52.312935 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dd9575-a1b6-4d5a-90e2-f8929a7fe15a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:52.313250 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dd9575-a1b6-4d5a-90e2-f8929a7fe15a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:52.314716 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dd9575-a1b6-4d5a-90e2-f8929a7fe15a None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:52.327777 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 617/1259] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:11:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:52.333737 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d2d88-d205-4662-89df-1c7fcc758283 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:52.359403 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:52.433011 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d2d88-d205-4662-89df-1c7fcc758283 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:52.467878 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e59cf8-67c4-4169-b35b-71661debc8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:52.468620 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e59cf8-67c4-4169-b35b-71661debc8bc None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:52.468913 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e59cf8-67c4-4169-b35b-71661debc8bc None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:52.469201 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e59cf8-67c4-4169-b35b-71661debc8bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:52.470038 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e59cf8-67c4-4169-b35b-71661debc8bc None admin] RBAC: Adding query filter params (role.id=101b93f94624407f8c812ab86ebec32a, scope.project.id=ccd95a48530c4c86a3774301b969d6a9, user.id=a027185c09a8465fa88aadbe511a07f9) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:52.470386 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e59cf8-67c4-4169-b35b-71661debc8bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:52.471831 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e59cf8-67c4-4169-b35b-71661debc8bc None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:52.477334 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 643/1260] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:11:52 2022] GET /identity/v3/role_assignments?user.id=a027185c09a8465fa88aadbe511a07f9&scope.project.id=ccd95a48530c4c86a3774301b969d6a9&role.id=101b93f94624407f8c812ab86ebec32a => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:54.510147 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6142c-2c1e-4ed7-88c3-0c383abf7e2c None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:54.510696 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6142c-2c1e-4ed7-88c3-0c383abf7e2c None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:54.510696 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6142c-2c1e-4ed7-88c3-0c383abf7e2c None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:54.512163 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 618/1261] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:11:54.517372 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535cb8d4-6e4f-49c6-b959-df80fe0d3f2d None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:54.518941 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535cb8d4-6e4f-49c6-b959-df80fe0d3f2d None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:54.518941 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535cb8d4-6e4f-49c6-b959-df80fe0d3f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:54.535098 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-535cb8d4-6e4f-49c6-b959-df80fe0d3f2d None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:11:54.536289 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-535cb8d4-6e4f-49c6-b959-df80fe0d3f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:11:54.603853 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 644/1262] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:11:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:11:54.625998 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6142c-2c1e-4ed7-88c3-0c383abf7e2c None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:54.636896 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:54.728279 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6142c-2c1e-4ed7-88c3-0c383abf7e2c None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:54.762587 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74588524-370c-4911-a8cd-f06c25704ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:54.763390 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74588524-370c-4911-a8cd-f06c25704ddf None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:54.763683 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74588524-370c-4911-a8cd-f06c25704ddf None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:54.763968 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74588524-370c-4911-a8cd-f06c25704ddf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:54.775105 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74588524-370c-4911-a8cd-f06c25704ddf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:11:54.783139 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-74588524-370c-4911-a8cd-f06c25704ddf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:11:54.783139 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:11:54.783139 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:11:54.783139 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:11:54.783139 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:11:54.783139 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:11:54.783139 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:11:54.783139 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:11:54.783139 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:11:54.783139 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:11:54.783139 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:11:54.783139 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:11:54.783139 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:11:54.783139 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:11:54.783139 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:11:54.783139 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:11:54.784176 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:11:54.784176 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:11:54.784176 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:11:54.784176 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:11:54.784176 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:11:54.784176 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:11:54.784176 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:11:54.784176 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:11:54.784176 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:11:54.784176 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:11:54.784176 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:11:54.784176 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:11:54.784176 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:11:54.784176 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:11:54.784176 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:11:54.784176 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:11:54.785030 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:11:54.785030 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:11:54.785030 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:11:54.785030 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:11:54.785030 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:11:54.785030 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:11:54.785030 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:11:54.785030 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:11:54.785030 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:11:54.785030 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:11:54.785030 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:11:54.785030 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:11:54.786410 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 619/1263] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:11:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:11:54.791501 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535cb8d4-6e4f-49c6-b959-df80fe0d3f2d None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:54.809747 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:54.887072 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535cb8d4-6e4f-49c6-b959-df80fe0d3f2d None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:54.920089 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c7aade-feae-49be-b609-69f1cfd83c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:54.920761 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7aade-feae-49be-b609-69f1cfd83c93 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:54.921047 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7aade-feae-49be-b609-69f1cfd83c93 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:54.921326 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7aade-feae-49be-b609-69f1cfd83c93 None admin] PATH_INFO: `/v3/roles` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:54.922073 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c7aade-feae-49be-b609-69f1cfd83c93 None admin] RBAC: Adding query filter params (name=admin) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:54.922418 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c7aade-feae-49be-b609-69f1cfd83c93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:54.923793 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c7aade-feae-49be-b609-69f1cfd83c93 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:54.931656 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 645/1264] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:11:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:11:54.937314 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74588524-370c-4911-a8cd-f06c25704ddf None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:55.005037 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:55.037826 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74588524-370c-4911-a8cd-f06c25704ddf None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:55.069741 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de9b37c-c237-4a8c-b6eb-b765ff38047d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:55.070563 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9b37c-c237-4a8c-b6eb-b765ff38047d None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:55.070849 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9b37c-c237-4a8c-b6eb-b765ff38047d None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:55.071670 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9b37c-c237-4a8c-b6eb-b765ff38047d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:55.081868 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de9b37c-c237-4a8c-b6eb-b765ff38047d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:55.083329 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de9b37c-c237-4a8c-b6eb-b765ff38047d None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:55.101110 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-1de9b37c-c237-4a8c-b6eb-b765ff38047d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:11:55.101110 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:11:55.101110 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:11:55.101110 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:11:55.101110 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:11:55.101110 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:11:55.101110 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:11:55.101110 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:11:55.101110 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:11:55.101110 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:11:55.101110 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:11:55.101110 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:11:55.101110 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:11:55.101110 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:11:55.101110 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:11:55.102118 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:11:55.102118 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:11:55.102118 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:11:55.102118 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:11:55.102118 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:11:55.102118 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:11:55.102118 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:11:55.102118 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:11:55.102118 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:11:55.102118 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:11:55.102118 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:11:55.102118 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:11:55.102118 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:11:55.102118 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:11:55.102118 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:11:55.102118 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:11:55.102118 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:11:55.103190 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:11:55.103190 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:11:55.103190 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:11:55.103190 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:11:55.103190 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 620/1265] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:11:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:11:55.108240 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c7aade-feae-49be-b609-69f1cfd83c93 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:55.186498 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:55.206140 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c7aade-feae-49be-b609-69f1cfd83c93 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:55.241502 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875525c9-15a9-4ce1-a07b-a0b1741afdaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:55.242196 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875525c9-15a9-4ce1-a07b-a0b1741afdaa None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:55.242487 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875525c9-15a9-4ce1-a07b-a0b1741afdaa None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:55.243439 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875525c9-15a9-4ce1-a07b-a0b1741afdaa None admin] PATH_INFO: `/v3/domains` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:55.244181 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875525c9-15a9-4ce1-a07b-a0b1741afdaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:55.244492 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875525c9-15a9-4ce1-a07b-a0b1741afdaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:55.245858 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875525c9-15a9-4ce1-a07b-a0b1741afdaa None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:55.257045 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 646/1266] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:55.264824 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de9b37c-c237-4a8c-b6eb-b765ff38047d None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:55.365884 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de9b37c-c237-4a8c-b6eb-b765ff38047d None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:55.387505 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:55.401178 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564733b-abcc-4310-a089-450352c82231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:55.402016 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564733b-abcc-4310-a089-450352c82231 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:55.402925 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564733b-abcc-4310-a089-450352c82231 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:55.402925 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564733b-abcc-4310-a089-450352c82231 None admin] PATH_INFO: `/v3/users/placement` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:55.409972 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e564733b-abcc-4310-a089-450352c82231 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:55.411452 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e564733b-abcc-4310-a089-450352c82231 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:55.425395 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-e564733b-abcc-4310-a089-450352c82231 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 21:11:55.425395 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:11:55.425395 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:11:55.425395 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:11:55.425395 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:11:55.425395 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:11:55.425395 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:11:55.425395 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:11:55.425395 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:11:55.425395 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:11:55.425395 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:11:55.425395 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:11:55.425395 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:11:55.425395 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:11:55.425395 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:11:55.425395 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:11:55.426988 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:11:55.426988 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:11:55.426988 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:11:55.426988 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:11:55.426988 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:11:55.426988 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:11:55.426988 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:11:55.426988 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:11:55.426988 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:11:55.426988 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:11:55.426988 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:11:55.426988 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:11:55.426988 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:11:55.426988 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:11:55.426988 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:11:55.426988 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:11:55.426988 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:11:55.426988 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:11:55.428216 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:11:55.428216 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:11:55.428216 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:11:55.428216 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:11:55.428216 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:11:55.428216 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:11:55.428216 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:11:55.428216 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:11:55.428216 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 21:11:55.428216 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:11:55.428216 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 621/1267] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:11:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:11:55.433075 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875525c9-15a9-4ce1-a07b-a0b1741afdaa None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:55.532194 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875525c9-15a9-4ce1-a07b-a0b1741afdaa None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:55.564641 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce4d567-2524-450a-84de-54b891a06608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:55.565316 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4d567-2524-450a-84de-54b891a06608 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:55.565607 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4d567-2524-450a-84de-54b891a06608 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:55.565892 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4d567-2524-450a-84de-54b891a06608 None admin] PATH_INFO: `/v3/users` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:55.566759 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce4d567-2524-450a-84de-54b891a06608 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:55.567329 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce4d567-2524-450a-84de-54b891a06608 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:55.568757 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce4d567-2524-450a-84de-54b891a06608 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:55.578109 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:55.586276 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 647/1268] 10.222.0.30 () {56 vars in 1143 bytes} [Tue Jul 5 21:11:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:55.592263 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564733b-abcc-4310-a089-450352c82231 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:55.693444 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564733b-abcc-4310-a089-450352c82231 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:55.726576 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd20d7e-9c3d-4303-888f-947abb9ea215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:55.727977 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd20d7e-9c3d-4303-888f-947abb9ea215 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:55.728264 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd20d7e-9c3d-4303-888f-947abb9ea215 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:55.728546 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd20d7e-9c3d-4303-888f-947abb9ea215 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:55.739087 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd20d7e-9c3d-4303-888f-947abb9ea215 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:55.740566 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd20d7e-9c3d-4303-888f-947abb9ea215 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:55.757952 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-dbd20d7e-9c3d-4303-888f-947abb9ea215 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:11:55.757952 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:11:55.757952 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:11:55.757952 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:11:55.757952 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:11:55.757952 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:11:55.757952 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:11:55.757952 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:11:55.757952 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:11:55.757952 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:11:55.757952 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:11:55.757952 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:11:55.757952 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:11:55.757952 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:11:55.757952 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:11:55.759147 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:11:55.759147 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:11:55.759147 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:11:55.759147 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:11:55.759147 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:11:55.759147 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:11:55.759147 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:11:55.759147 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:11:55.759147 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:11:55.759147 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:11:55.759147 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:11:55.759147 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:11:55.759147 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:11:55.759147 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:11:55.759147 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:11:55.759147 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:11:55.759147 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:11:55.760245 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:11:55.760245 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:11:55.760245 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:11:55.760245 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:11:55.760245 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 622/1269] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:11:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:11:55.765116 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce4d567-2524-450a-84de-54b891a06608 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:55.863352 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce4d567-2524-450a-84de-54b891a06608 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:55.896692 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce97be-6a97-4a2d-8324-cc1ebf4e0edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:55.897356 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce97be-6a97-4a2d-8324-cc1ebf4e0edd None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:55.897642 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce97be-6a97-4a2d-8324-cc1ebf4e0edd None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:55.897923 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce97be-6a97-4a2d-8324-cc1ebf4e0edd None admin] PATH_INFO: `/v3/domains` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:55.898674 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce97be-6a97-4a2d-8324-cc1ebf4e0edd None admin] RBAC: Adding query filter params (name=Default) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:55.899016 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce97be-6a97-4a2d-8324-cc1ebf4e0edd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:55.900515 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce97be-6a97-4a2d-8324-cc1ebf4e0edd None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:55.911438 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 648/1270] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:55.918214 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd20d7e-9c3d-4303-888f-947abb9ea215 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:55.950640 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:56.017359 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd20d7e-9c3d-4303-888f-947abb9ea215 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:56.052010 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1643c9ee-1bb4-43ef-bdb5-a6cf4d3c952a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:56.052804 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643c9ee-1bb4-43ef-bdb5-a6cf4d3c952a None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:56.053095 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643c9ee-1bb4-43ef-bdb5-a6cf4d3c952a None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:56.053376 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643c9ee-1bb4-43ef-bdb5-a6cf4d3c952a None admin] PATH_INFO: `/v3/projects/service` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:56.059983 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1643c9ee-1bb4-43ef-bdb5-a6cf4d3c952a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:56.062985 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1643c9ee-1bb4-43ef-bdb5-a6cf4d3c952a None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:56.075969 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-1643c9ee-1bb4-43ef-bdb5-a6cf4d3c952a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:11:56.075969 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:11:56.075969 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:11:56.075969 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:11:56.075969 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:11:56.075969 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:11:56.075969 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:11:56.075969 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:11:56.075969 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:11:56.075969 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:11:56.075969 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:11:56.075969 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:11:56.075969 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:11:56.075969 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:11:56.075969 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:11:56.077059 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:11:56.077059 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:11:56.077059 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:11:56.077059 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:11:56.077059 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:11:56.077059 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:11:56.077059 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:11:56.077059 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:11:56.077059 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:11:56.077059 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:11:56.077059 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:11:56.077059 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:11:56.077059 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:11:56.077059 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:11:56.077059 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:11:56.077059 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:11:56.077059 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:11:56.078389 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:11:56.078389 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:11:56.078389 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:11:56.078389 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:11:56.078389 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:11:56.078389 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:11:56.078389 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:11:56.078389 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:11:56.078389 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 623/1271] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:11:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:11:56.083134 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce97be-6a97-4a2d-8324-cc1ebf4e0edd None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:56.140680 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:56.182647 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce97be-6a97-4a2d-8324-cc1ebf4e0edd None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:56.216424 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85756555-4f84-45c0-85e5-1fa9da233130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:56.217089 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85756555-4f84-45c0-85e5-1fa9da233130 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:56.217379 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85756555-4f84-45c0-85e5-1fa9da233130 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:56.217663 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85756555-4f84-45c0-85e5-1fa9da233130 None admin] PATH_INFO: `/v3/projects` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:56.218483 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85756555-4f84-45c0-85e5-1fa9da233130 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:56.218800 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85756555-4f84-45c0-85e5-1fa9da233130 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:56.220238 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85756555-4f84-45c0-85e5-1fa9da233130 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:56.233533 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 649/1272] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:11:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:56.239481 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1643c9ee-1bb4-43ef-bdb5-a6cf4d3c952a None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:56.332941 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:56.342237 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1643c9ee-1bb4-43ef-bdb5-a6cf4d3c952a None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:56.376890 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c917e-129a-40ac-b507-4fa1f749d7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:56.377778 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c917e-129a-40ac-b507-4fa1f749d7a3 None admin] REQUEST_METHOD: `PUT` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:56.378062 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c917e-129a-40ac-b507-4fa1f749d7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:56.378519 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c917e-129a-40ac-b507-4fa1f749d7a3 None admin] PATH_INFO: `/v3/projects/ccd95a48530c4c86a3774301b969d6a9/users/a027185c09a8465fa88aadbe511a07f9/roles/101b93f94624407f8c812ab86ebec32a` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:56.380484 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1c917e-129a-40ac-b507-4fa1f749d7a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=ccd95a48530c4c86a3774301b969d6a9, user_id=a027185c09a8465fa88aadbe511a07f9, role_id=101b93f94624407f8c812ab86ebec32a)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:56.381926 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1c917e-129a-40ac-b507-4fa1f749d7a3 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:56.479456 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 624/1273] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:11:56 2022] PUT /identity/v3/projects/ccd95a48530c4c86a3774301b969d6a9/users/a027185c09a8465fa88aadbe511a07f9/roles/101b93f94624407f8c812ab86ebec32a => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:11:58.529772 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27a59a-7892-4be7-a07f-4a1ebc0666c0 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:58.530371 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27a59a-7892-4be7-a07f-4a1ebc0666c0 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:58.530466 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27a59a-7892-4be7-a07f-4a1ebc0666c0 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:58.531822 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 650/1274] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:11:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:11:58.537043 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ada56-eed9-4df5-a11d-c9823470f332 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:58.537483 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ada56-eed9-4df5-a11d-c9823470f332 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:58.537584 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ada56-eed9-4df5-a11d-c9823470f332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:58.553636 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-6f7ada56-eed9-4df5-a11d-c9823470f332 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:11:58.554842 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-6f7ada56-eed9-4df5-a11d-c9823470f332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:11:58.622859 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 625/1275] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:11:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:11:58.646272 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27a59a-7892-4be7-a07f-4a1ebc0666c0 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:58.757781 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27a59a-7892-4be7-a07f-4a1ebc0666c0 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:58.775394 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:58.792443 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e67d2-ed70-4828-8057-20b6b467c5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:58.793271 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e67d2-ed70-4828-8057-20b6b467c5b8 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:58.793561 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e67d2-ed70-4828-8057-20b6b467c5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:58.793848 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e67d2-ed70-4828-8057-20b6b467c5b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:58.803804 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88e67d2-ed70-4828-8057-20b6b467c5b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:11:58.812404 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-b88e67d2-ed70-4828-8057-20b6b467c5b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:11:58.812404 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:11:58.812404 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:11:58.812404 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:11:58.812404 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:11:58.812404 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:11:58.812404 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:11:58.812404 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:11:58.812404 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:11:58.812404 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:11:58.812404 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:11:58.812404 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:11:58.812404 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:11:58.812404 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:11:58.812404 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:11:58.812404 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:11:58.813532 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:11:58.813532 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:11:58.813532 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:11:58.813532 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:11:58.813532 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:11:58.813532 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:11:58.813532 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:11:58.813532 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:11:58.813532 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:11:58.813532 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:11:58.813532 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:11:58.813532 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:11:58.813532 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:11:58.813532 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:11:58.813532 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:11:58.813532 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:11:58.814488 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:11:58.814488 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:11:58.814488 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:11:58.814488 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:11:58.814488 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:11:58.814488 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:11:58.814488 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:11:58.814488 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:11:58.814488 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:11:58.814488 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:11:58.814488 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:11:58.814488 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:11:58.814488 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 651/1276] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:11:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:11:58.819906 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ada56-eed9-4df5-a11d-c9823470f332 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:58.901306 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:58.919491 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ada56-eed9-4df5-a11d-c9823470f332 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:58.952802 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b316163d-f208-4e6d-8d93-5fced7fea73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:58.953473 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316163d-f208-4e6d-8d93-5fced7fea73b None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:58.953758 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316163d-f208-4e6d-8d93-5fced7fea73b None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:58.954081 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316163d-f208-4e6d-8d93-5fced7fea73b None admin] PATH_INFO: `/v3/roles` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:58.954848 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b316163d-f208-4e6d-8d93-5fced7fea73b None admin] RBAC: Adding query filter params (name=admin) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:58.955156 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b316163d-f208-4e6d-8d93-5fced7fea73b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:58.956528 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b316163d-f208-4e6d-8d93-5fced7fea73b None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:58.965554 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 626/1277] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:11:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:58.970860 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e67d2-ed70-4828-8057-20b6b467c5b8 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:59.074906 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e67d2-ed70-4828-8057-20b6b467c5b8 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:59.108373 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee571db-a9a5-470b-9842-a28042da36c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:59.109174 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee571db-a9a5-470b-9842-a28042da36c3 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:59.109466 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee571db-a9a5-470b-9842-a28042da36c3 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:59.109751 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee571db-a9a5-470b-9842-a28042da36c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:59.120556 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee571db-a9a5-470b-9842-a28042da36c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:59.126671 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee571db-a9a5-470b-9842-a28042da36c3 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:59.139048 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-1ee571db-a9a5-470b-9842-a28042da36c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:11:59.139048 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:11:59.139048 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:11:59.139048 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:11:59.139048 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:11:59.139048 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:11:59.139048 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:11:59.139048 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:11:59.139048 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:11:59.139048 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:11:59.139048 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:11:59.139048 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:11:59.139048 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:11:59.139048 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:11:59.139048 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:11:59.140119 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:11:59.140119 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:11:59.140119 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:11:59.140119 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:11:59.140119 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:11:59.140119 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:11:59.140119 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:11:59.140119 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:11:59.140119 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:11:59.140119 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:11:59.140119 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:11:59.140119 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:11:59.140119 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:11:59.140119 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:11:59.140119 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:11:59.140119 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:11:59.140119 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:11:59.145781 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:11:59.145781 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:11:59.145781 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:11:59.145781 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:11:59.145781 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 652/1278] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:11:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:11:59.146085 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b316163d-f208-4e6d-8d93-5fced7fea73b None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:59.247267 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b316163d-f208-4e6d-8d93-5fced7fea73b None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:59.280418 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4965798-944a-44c0-aed2-2914cf741221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:59.281087 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4965798-944a-44c0-aed2-2914cf741221 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:59.281378 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4965798-944a-44c0-aed2-2914cf741221 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:59.281661 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4965798-944a-44c0-aed2-2914cf741221 None admin] PATH_INFO: `/v3/domains` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:59.282432 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4965798-944a-44c0-aed2-2914cf741221 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:59.282746 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4965798-944a-44c0-aed2-2914cf741221 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:59.284112 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4965798-944a-44c0-aed2-2914cf741221 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:59.296227 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 627/1279] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:11:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:59.301861 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee571db-a9a5-470b-9842-a28042da36c3 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:59.333999 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:59.401605 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee571db-a9a5-470b-9842-a28042da36c3 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:59.435180 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d72eb-d01c-4cd4-8a28-6a548b2bc2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:59.435989 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d72eb-d01c-4cd4-8a28-6a548b2bc2a8 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:59.436281 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d72eb-d01c-4cd4-8a28-6a548b2bc2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:59.436562 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d72eb-d01c-4cd4-8a28-6a548b2bc2a8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:59.443837 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d72eb-d01c-4cd4-8a28-6a548b2bc2a8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:59.445296 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d72eb-d01c-4cd4-8a28-6a548b2bc2a8 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:59.460421 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-826d72eb-d01c-4cd4-8a28-6a548b2bc2a8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 21:11:59.460421 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:11:59.460421 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:11:59.460421 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:11:59.460421 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:11:59.460421 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:11:59.460421 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:11:59.460421 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:11:59.460421 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:11:59.460421 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:11:59.460421 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:11:59.460421 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:11:59.460421 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:11:59.460421 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:11:59.460421 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:11:59.460421 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:11:59.462230 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:11:59.462230 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:11:59.462230 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:11:59.462230 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:11:59.462230 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:11:59.462230 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:11:59.462230 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:11:59.462230 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:11:59.462230 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:11:59.462230 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:11:59.462230 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:11:59.462230 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:11:59.462230 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:11:59.462230 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:11:59.462230 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:11:59.462230 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:11:59.462230 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:11:59.462230 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:11:59.463481 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:11:59.463481 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:11:59.463481 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:11:59.463481 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:11:59.463481 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:11:59.463481 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:11:59.463481 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:11:59.463481 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:11:59.463481 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 21:11:59.463481 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:11:59.463481 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 653/1280] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:11:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:11:59.468328 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4965798-944a-44c0-aed2-2914cf741221 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:59.472299 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:59.568121 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4965798-944a-44c0-aed2-2914cf741221 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:59.601866 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b6af2-9950-4fe7-b047-7e834bb248f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:59.602653 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b6af2-9950-4fe7-b047-7e834bb248f7 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:59.602941 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b6af2-9950-4fe7-b047-7e834bb248f7 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:59.603220 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b6af2-9950-4fe7-b047-7e834bb248f7 None admin] PATH_INFO: `/v3/users` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:59.604050 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432b6af2-9950-4fe7-b047-7e834bb248f7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:11:59.604362 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432b6af2-9950-4fe7-b047-7e834bb248f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:59.605798 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432b6af2-9950-4fe7-b047-7e834bb248f7 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:59.623028 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 628/1281] 10.222.0.30 () {56 vars in 1143 bytes} [Tue Jul 5 21:11:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:11:59.629340 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d72eb-d01c-4cd4-8a28-6a548b2bc2a8 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:59.719818 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:59.729159 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d72eb-d01c-4cd4-8a28-6a548b2bc2a8 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:11:59.763960 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df42b81-ae22-440f-b06b-bf185b206402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:11:59.764605 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df42b81-ae22-440f-b06b-bf185b206402 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:11:59.764891 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df42b81-ae22-440f-b06b-bf185b206402 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:11:59.765172 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df42b81-ae22-440f-b06b-bf185b206402 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:11:59.831353 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df42b81-ae22-440f-b06b-bf185b206402 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:11:59.832736 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df42b81-ae22-440f-b06b-bf185b206402 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:11:59.918099 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:11:59.928237 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 654/1282] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:11:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:11:59.934538 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b6af2-9950-4fe7-b047-7e834bb248f7 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:11:59.998536 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:12:00.035928 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b6af2-9950-4fe7-b047-7e834bb248f7 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:12:00.074990 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16fe5e7-231f-456d-9ff4-26e5d7c9c999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:12:00.075787 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fe5e7-231f-456d-9ff4-26e5d7c9c999 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:12:00.076075 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fe5e7-231f-456d-9ff4-26e5d7c9c999 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:12:00.076354 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fe5e7-231f-456d-9ff4-26e5d7c9c999 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:12:00.086641 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16fe5e7-231f-456d-9ff4-26e5d7c9c999 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:12:00.088036 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16fe5e7-231f-456d-9ff4-26e5d7c9c999 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:12:00.105808 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-b16fe5e7-231f-456d-9ff4-26e5d7c9c999 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:12:00.105808 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:12:00.105808 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:12:00.105808 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:12:00.105808 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:12:00.105808 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:12:00.105808 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:12:00.105808 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:12:00.105808 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:12:00.105808 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:12:00.105808 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:12:00.105808 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:12:00.105808 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:12:00.105808 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:12:00.105808 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:12:00.106955 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:12:00.106955 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:12:00.106955 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:12:00.106955 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:12:00.106955 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:12:00.106955 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:12:00.106955 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:12:00.106955 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:12:00.106955 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:12:00.106955 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:12:00.106955 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:12:00.106955 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:12:00.106955 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:12:00.106955 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:12:00.106955 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:12:00.106955 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:12:00.106955 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:12:00.108169 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:12:00.108169 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:12:00.108169 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:12:00.108169 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:12:00.108169 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 629/1283] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:11:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:12:00.112826 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df42b81-ae22-440f-b06b-bf185b206402 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:12:00.210970 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df42b81-ae22-440f-b06b-bf185b206402 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:12:00.246143 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1461ff-a7c0-4ef3-ab8c-7dcef4ccda67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:12:00.246852 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1461ff-a7c0-4ef3-ab8c-7dcef4ccda67 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:12:00.247143 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1461ff-a7c0-4ef3-ab8c-7dcef4ccda67 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:12:00.247426 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1461ff-a7c0-4ef3-ab8c-7dcef4ccda67 None admin] PATH_INFO: `/v3/domains` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:12:00.248155 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1461ff-a7c0-4ef3-ab8c-7dcef4ccda67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:12:00.248473 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1461ff-a7c0-4ef3-ab8c-7dcef4ccda67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:12:00.249963 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1461ff-a7c0-4ef3-ab8c-7dcef4ccda67 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:12:00.262223 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 655/1284] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:12:00.267872 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16fe5e7-231f-456d-9ff4-26e5d7c9c999 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:12:00.367200 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16fe5e7-231f-456d-9ff4-26e5d7c9c999 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:12:00.381613 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:12:00.400986 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d4d99-fa0d-44b1-93e9-8e72299b18e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:12:00.401774 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d4d99-fa0d-44b1-93e9-8e72299b18e0 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:12:00.402059 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d4d99-fa0d-44b1-93e9-8e72299b18e0 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:12:00.402364 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d4d99-fa0d-44b1-93e9-8e72299b18e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:12:00.408809 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d4d99-fa0d-44b1-93e9-8e72299b18e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:12:00.410276 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d4d99-fa0d-44b1-93e9-8e72299b18e0 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:12:00.424633 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application [None req-549d4d99-fa0d-44b1-93e9-8e72299b18e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:12:00.424633 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:12:00.424633 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:12:00.424633 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:12:00.424633 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:12:00.424633 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:12:00.424633 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:12:00.424633 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:12:00.424633 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:12:00.424633 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:12:00.424633 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:12:00.424633 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:12:00.424633 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:12:00.424633 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:12:00.424633 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:12:00.425715 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:12:00.425715 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:12:00.425715 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:12:00.425715 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:12:00.425715 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:12:00.425715 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:12:00.425715 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:12:00.425715 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:12:00.425715 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application with Lock( Jul 05 21:12:00.425715 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:12:00.425715 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:12:00.425715 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:12:00.425715 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:12:00.425715 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:12:00.425715 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:12:00.425715 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:12:00.425715 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:12:00.426705 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:12:00.426705 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:12:00.426705 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:12:00.426705 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:12:00.426705 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:12:00.426705 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:12:00.426705 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:12:00.426705 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: ERROR keystone.server.flask.application Jul 05 21:12:00.426705 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 630/1285] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:12:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:12:00.432630 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1461ff-a7c0-4ef3-ab8c-7dcef4ccda67 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:12:00.483592 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:12:00.531532 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1461ff-a7c0-4ef3-ab8c-7dcef4ccda67 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:12:00.564997 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17856851-b1db-483a-b2e2-9731b27ebc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:12:00.565736 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17856851-b1db-483a-b2e2-9731b27ebc45 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:12:00.565956 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17856851-b1db-483a-b2e2-9731b27ebc45 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:12:00.566273 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17856851-b1db-483a-b2e2-9731b27ebc45 None admin] PATH_INFO: `/v3/projects` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:12:00.567324 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17856851-b1db-483a-b2e2-9731b27ebc45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:12:00.567649 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17856851-b1db-483a-b2e2-9731b27ebc45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:12:00.569191 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17856851-b1db-483a-b2e2-9731b27ebc45 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:12:00.581461 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 656/1286] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:12:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:12:00.588196 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d4d99-fa0d-44b1-93e9-8e72299b18e0 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:12:00.687054 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d4d99-fa0d-44b1-93e9-8e72299b18e0 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:12:00.722895 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c602412-ce52-4bc7-877e-df3aeaf65399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:12:00.723585 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c602412-ce52-4bc7-877e-df3aeaf65399 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:12:00.723875 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c602412-ce52-4bc7-877e-df3aeaf65399 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:12:00.724147 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c602412-ce52-4bc7-877e-df3aeaf65399 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:12:00.724965 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c602412-ce52-4bc7-877e-df3aeaf65399 None admin] RBAC: Adding query filter params (role.id=101b93f94624407f8c812ab86ebec32a, scope.project.id=ccd95a48530c4c86a3774301b969d6a9, user.id=a027185c09a8465fa88aadbe511a07f9) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:12:00.725277 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c602412-ce52-4bc7-877e-df3aeaf65399 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:12:00.726747 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c602412-ce52-4bc7-877e-df3aeaf65399 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:12:00.733304 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 631/1287] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:12:00 2022] GET /identity/v3/role_assignments?user.id=a027185c09a8465fa88aadbe511a07f9&scope.project.id=ccd95a48530c4c86a3774301b969d6a9&role.id=101b93f94624407f8c812ab86ebec32a => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:12:02.804767 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171570a-6a04-4da4-affe-ffb981d80e92 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:12:02.805867 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171570a-6a04-4da4-affe-ffb981d80e92 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:12:02.805867 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171570a-6a04-4da4-affe-ffb981d80e92 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:12:02.807414 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 657/1288] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:12:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:12:02.812666 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d2421-4dcd-4d0d-9b6d-5bd806871e08 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:12:02.816580 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d2421-4dcd-4d0d-9b6d-5bd806871e08 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:12:02.816580 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d2421-4dcd-4d0d-9b6d-5bd806871e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:12:02.831913 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-c64d2421-4dcd-4d0d-9b6d-5bd806871e08 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:12:02.833114 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-c64d2421-4dcd-4d0d-9b6d-5bd806871e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:12:02.862086 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:12:02.898288 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 632/1289] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:12:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:12:02.920191 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171570a-6a04-4da4-affe-ffb981d80e92 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:12:03.020963 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171570a-6a04-4da4-affe-ffb981d80e92 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:12:03.031989 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:12:03.055068 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cebee07-b9ea-4963-bdc4-a6c81fb55156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:12:03.056069 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebee07-b9ea-4963-bdc4-a6c81fb55156 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:12:03.056362 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebee07-b9ea-4963-bdc4-a6c81fb55156 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:12:03.056646 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebee07-b9ea-4963-bdc4-a6c81fb55156 None admin] PATH_INFO: `/v3/services/placement` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:12:03.057303 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cebee07-b9ea-4963-bdc4-a6c81fb55156 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:12:03.058729 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cebee07-b9ea-4963-bdc4-a6c81fb55156 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:12:03.071196 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-1cebee07-b9ea-4963-bdc4-a6c81fb55156 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 21:12:03.071196 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:12:03.071196 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:12:03.071196 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:12:03.071196 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:12:03.071196 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:12:03.071196 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:12:03.071196 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:12:03.071196 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 21:12:03.071196 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:12:03.071196 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:12:03.071196 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:12:03.071196 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:12:03.071196 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:12:03.071196 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:12:03.071196 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:12:03.071196 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:12:03.072273 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:12:03.072273 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:12:03.072273 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:12:03.072273 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:12:03.072273 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:12:03.072273 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:12:03.072273 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:12:03.072273 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:12:03.072273 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:12:03.072273 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:12:03.072273 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:12:03.072273 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:12:03.072273 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:12:03.072273 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:12:03.072273 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:12:03.072273 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:12:03.073173 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:12:03.073173 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:12:03.073173 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:12:03.073173 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:12:03.073173 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:12:03.073173 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:12:03.073173 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:12:03.073173 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:12:03.073173 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:12:03.073173 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:12:03.073173 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:12:03.073173 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:12:03.073173 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 21:12:03.073173 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:12:03.073173 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 658/1290] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Jul 5 21:12:02 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:12:03.078945 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d2421-4dcd-4d0d-9b6d-5bd806871e08 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:12:03.177264 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d2421-4dcd-4d0d-9b6d-5bd806871e08 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:12:03.211049 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d234c36-58b0-40ef-a99d-edbb413d9d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:12:03.212300 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d234c36-58b0-40ef-a99d-edbb413d9d3e None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:12:03.212588 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d234c36-58b0-40ef-a99d-edbb413d9d3e None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:12:03.212868 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d234c36-58b0-40ef-a99d-edbb413d9d3e None admin] PATH_INFO: `/v3/services` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:12:03.213568 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d234c36-58b0-40ef-a99d-edbb413d9d3e None admin] RBAC: Adding query filter params (name=placement) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:12:03.213876 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d234c36-58b0-40ef-a99d-edbb413d9d3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:12:03.215280 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d234c36-58b0-40ef-a99d-edbb413d9d3e None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:12:03.220219 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 633/1291] 10.222.0.30 () {56 vars in 1116 bytes} [Tue Jul 5 21:12:03 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:12:03.225948 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cebee07-b9ea-4963-bdc4-a6c81fb55156 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:12:03.331137 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cebee07-b9ea-4963-bdc4-a6c81fb55156 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:12:03.364785 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c18af-1a58-4d43-b93d-0425bae459ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:12:03.365441 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c18af-1a58-4d43-b93d-0425bae459ca None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:12:03.365727 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c18af-1a58-4d43-b93d-0425bae459ca None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:12:03.366121 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c18af-1a58-4d43-b93d-0425bae459ca None admin] PATH_INFO: `/v3/services` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:12:03.366866 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c18af-1a58-4d43-b93d-0425bae459ca None admin] RBAC: Adding query filter params (type=placement) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:12:03.367174 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c18af-1a58-4d43-b93d-0425bae459ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:12:03.368604 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c18af-1a58-4d43-b93d-0425bae459ca None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:12:03.373063 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 659/1292] 10.222.0.30 () {56 vars in 1116 bytes} [Tue Jul 5 21:12:03 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:12:05.374024 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20afbf-7348-4e82-b1c8-2f13b256eb48 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:12:05.374558 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20afbf-7348-4e82-b1c8-2f13b256eb48 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:12:05.374779 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20afbf-7348-4e82-b1c8-2f13b256eb48 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:12:05.376178 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 634/1293] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:12:05.381242 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c39ee-0664-4b8a-bec2-59dbc5a95171 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:12:05.381686 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c39ee-0664-4b8a-bec2-59dbc5a95171 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:12:05.381798 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c39ee-0664-4b8a-bec2-59dbc5a95171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:12:05.398869 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-e83c39ee-0664-4b8a-bec2-59dbc5a95171 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:12:05.400696 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-e83c39ee-0664-4b8a-bec2-59dbc5a95171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:12:05.429357 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:12:05.466609 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 660/1294] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:12:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:12:05.489256 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab20afbf-7348-4e82-b1c8-2f13b256eb48 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:12:05.520944 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:12:05.589156 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab20afbf-7348-4e82-b1c8-2f13b256eb48 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:12:05.621376 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86402cf9-5963-48ea-9640-1d757258e38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:12:05.622305 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86402cf9-5963-48ea-9640-1d757258e38b None admin] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:12:05.622598 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86402cf9-5963-48ea-9640-1d757258e38b None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:12:05.623154 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86402cf9-5963-48ea-9640-1d757258e38b None admin] PATH_INFO: `/v3/services` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:12:05.624633 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86402cf9-5963-48ea-9640-1d757258e38b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:12:05.625992 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86402cf9-5963-48ea-9640-1d757258e38b None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:12:05.702659 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 635/1295] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Jul 5 21:12:05 2022] POST /identity/v3/services => generated 246 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:12:07.721988 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9ae44-ea68-4390-b1e4-b3b240f7d2ab None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:12:07.722557 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9ae44-ea68-4390-b1e4-b3b240f7d2ab None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:12:07.722659 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9ae44-ea68-4390-b1e4-b3b240f7d2ab None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:12:07.724026 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 661/1296] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:12:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:12:07.730000 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d34cb-615c-459d-868b-db3443d3fba8 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:12:07.730520 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d34cb-615c-459d-868b-db3443d3fba8 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:12:07.730627 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d34cb-615c-459d-868b-db3443d3fba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:12:07.747448 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-e69d34cb-615c-459d-868b-db3443d3fba8 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:12:07.748628 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-e69d34cb-615c-459d-868b-db3443d3fba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:12:07.820355 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 636/1297] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:12:07 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:12:07.844502 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9ae44-ea68-4390-b1e4-b3b240f7d2ab None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:12:07.944751 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9ae44-ea68-4390-b1e4-b3b240f7d2ab None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:12:07.978552 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89acd1a6-ccb8-4ca5-b595-64714faf1b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:12:07.979332 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acd1a6-ccb8-4ca5-b595-64714faf1b12 None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:12:07.979578 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acd1a6-ccb8-4ca5-b595-64714faf1b12 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:12:07.979857 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acd1a6-ccb8-4ca5-b595-64714faf1b12 None admin] PATH_INFO: `/v3/services/placement` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:12:07.980512 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89acd1a6-ccb8-4ca5-b595-64714faf1b12 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:12:07.981876 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89acd1a6-ccb8-4ca5-b595-64714faf1b12 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:12:07.994157 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-89acd1a6-ccb8-4ca5-b595-64714faf1b12 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 21:12:07.994157 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:12:07.994157 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:12:07.994157 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:12:07.994157 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:12:07.994157 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:12:07.994157 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:12:07.994157 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:12:07.994157 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 21:12:07.994157 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:12:07.994157 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:12:07.994157 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:12:07.994157 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:12:07.994157 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:12:07.994157 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:12:07.994157 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:12:07.994157 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:12:07.995187 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:12:07.995187 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:12:07.995187 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:12:07.995187 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:12:07.995187 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:12:07.995187 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:12:07.995187 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:12:07.995187 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:12:07.995187 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:12:07.995187 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:12:07.995187 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:12:07.995187 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:12:07.995187 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:12:07.995187 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:12:07.995187 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:12:07.995187 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:12:07.996435 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:12:07.996435 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:12:07.996435 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:12:07.996435 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:12:07.996435 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:12:07.996435 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:12:07.996435 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:12:07.996435 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:12:07.996435 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:12:07.996435 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:12:07.996435 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:12:07.996435 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:12:07.996435 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 21:12:07.996435 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:12:07.996435 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 662/1298] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Jul 5 21:12:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:12:08.001373 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d34cb-615c-459d-868b-db3443d3fba8 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:12:08.020412 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:12:08.099929 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d34cb-615c-459d-868b-db3443d3fba8 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:12:08.134543 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a4e3d-a25d-465e-ae8c-dfe7838ed6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:12:08.135265 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a4e3d-a25d-465e-ae8c-dfe7838ed6e5 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:12:08.135561 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a4e3d-a25d-465e-ae8c-dfe7838ed6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:12:08.135844 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a4e3d-a25d-465e-ae8c-dfe7838ed6e5 None admin] PATH_INFO: `/v3/services` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:12:08.136550 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8a4e3d-a25d-465e-ae8c-dfe7838ed6e5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:12:08.136872 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8a4e3d-a25d-465e-ae8c-dfe7838ed6e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:12:08.138267 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8a4e3d-a25d-465e-ae8c-dfe7838ed6e5 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:12:08.143431 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 637/1299] 10.222.0.30 () {56 vars in 1116 bytes} [Tue Jul 5 21:12:08 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:12:08.149311 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89acd1a6-ccb8-4ca5-b595-64714faf1b12 None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:12:08.181109 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:12:08.249030 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89acd1a6-ccb8-4ca5-b595-64714faf1b12 None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:12:08.282180 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753bbb5-f47c-45a8-a89b-a5156cbb9d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:12:08.282832 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753bbb5-f47c-45a8-a89b-a5156cbb9d6b None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:12:08.283121 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753bbb5-f47c-45a8-a89b-a5156cbb9d6b None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:12:08.283396 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753bbb5-f47c-45a8-a89b-a5156cbb9d6b None admin] PATH_INFO: `/v3/endpoints` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:12:08.284172 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753bbb5-f47c-45a8-a89b-a5156cbb9d6b None admin] RBAC: Adding query filter params (interface=public, service_id=7a95154ad14f463b988b900438116708, region_id=RegionOne) {{(pid=108009) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:12:08.284487 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753bbb5-f47c-45a8-a89b-a5156cbb9d6b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:12:08.285904 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753bbb5-f47c-45a8-a89b-a5156cbb9d6b None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:12:08.291167 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 663/1300] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Jul 5 21:12:08 2022] GET /identity/v3/endpoints?service_id=7a95154ad14f463b988b900438116708&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:12:08.296876 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a4e3d-a25d-465e-ae8c-dfe7838ed6e5 None admin] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:12:08.381142 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:12:08.399960 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a4e3d-a25d-465e-ae8c-dfe7838ed6e5 None admin] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:12:08.435779 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031967f-d88c-4f68-becb-fed1d0e253e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:12:08.436442 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031967f-d88c-4f68-becb-fed1d0e253e6 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:12:08.436732 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031967f-d88c-4f68-becb-fed1d0e253e6 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:12:08.437075 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031967f-d88c-4f68-becb-fed1d0e253e6 None admin] PATH_INFO: `/v3/services` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:12:08.437720 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031967f-d88c-4f68-becb-fed1d0e253e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:12:08.439124 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031967f-d88c-4f68-becb-fed1d0e253e6 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:12:08.446045 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 638/1301] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Jul 5 21:12:08 2022] GET /identity/v3/services => generated 2191 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:12:10.439842 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8cd4b5-a53e-4b63-93a5-dbba72b1236b None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:12:10.440405 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8cd4b5-a53e-4b63-93a5-dbba72b1236b None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:12:10.440500 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8cd4b5-a53e-4b63-93a5-dbba72b1236b None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:12:10.441819 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 664/1302] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:12:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:12:10.447890 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73acc732-f396-4a8e-aaae-e84ce1cdbb2c None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:12:10.448296 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73acc732-f396-4a8e-aaae-e84ce1cdbb2c None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:12:10.448548 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73acc732-f396-4a8e-aaae-e84ce1cdbb2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:12:10.464672 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-73acc732-f396-4a8e-aaae-e84ce1cdbb2c None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:12:10.465863 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-73acc732-f396-4a8e-aaae-e84ce1cdbb2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:12:10.531197 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 639/1303] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:12:10 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:12:10.553903 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8cd4b5-a53e-4b63-93a5-dbba72b1236b None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:12:10.648928 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:12:10.655642 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8cd4b5-a53e-4b63-93a5-dbba72b1236b None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:12:10.689143 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7334f82-8397-47cb-a3ff-a8f00a4c010d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:12:10.689941 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7334f82-8397-47cb-a3ff-a8f00a4c010d None admin] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:12:10.690261 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7334f82-8397-47cb-a3ff-a8f00a4c010d None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:12:10.690542 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7334f82-8397-47cb-a3ff-a8f00a4c010d None admin] PATH_INFO: `/v3/services/placement` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:12:10.691193 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7334f82-8397-47cb-a3ff-a8f00a4c010d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:12:10.692843 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7334f82-8397-47cb-a3ff-a8f00a4c010d None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:12:10.704543 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application [None req-d7334f82-8397-47cb-a3ff-a8f00a4c010d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 21:12:10.704543 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:12:10.704543 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:12:10.704543 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:12:10.704543 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:12:10.704543 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:12:10.704543 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:12:10.704543 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:12:10.704543 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 21:12:10.704543 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:12:10.704543 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:12:10.704543 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:12:10.704543 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:12:10.704543 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:12:10.704543 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:12:10.704543 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:12:10.704543 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:12:10.705785 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:12:10.705785 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:12:10.705785 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:12:10.705785 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:12:10.705785 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:12:10.705785 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:12:10.705785 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:12:10.705785 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:12:10.705785 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:12:10.705785 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:12:10.705785 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:12:10.705785 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:12:10.705785 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:12:10.705785 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:12:10.705785 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:12:10.705785 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:12:10.706888 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:12:10.706888 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application with Lock( Jul 05 21:12:10.706888 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:12:10.706888 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:12:10.706888 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:12:10.706888 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:12:10.706888 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:12:10.706888 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:12:10.706888 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:12:10.706888 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:12:10.706888 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:12:10.706888 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:12:10.706888 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 21:12:10.706888 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: ERROR keystone.server.flask.application Jul 05 21:12:10.706888 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 665/1304] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Jul 5 21:12:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:12:10.712001 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73acc732-f396-4a8e-aaae-e84ce1cdbb2c None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:12:10.787877 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:12:10.810808 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73acc732-f396-4a8e-aaae-e84ce1cdbb2c None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:12:10.842725 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfdfcb7-9fa4-4af4-b89f-d60de3034eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:12:10.843389 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfdfcb7-9fa4-4af4-b89f-d60de3034eb2 None admin] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:12:10.843676 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfdfcb7-9fa4-4af4-b89f-d60de3034eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:12:10.843961 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfdfcb7-9fa4-4af4-b89f-d60de3034eb2 None admin] PATH_INFO: `/v3/services` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:12:10.844662 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfdfcb7-9fa4-4af4-b89f-d60de3034eb2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=108008) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:12:10.844973 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfdfcb7-9fa4-4af4-b89f-d60de3034eb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:12:10.846371 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfdfcb7-9fa4-4af4-b89f-d60de3034eb2 None admin] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:12:10.851602 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 640/1305] 10.222.0.30 () {56 vars in 1116 bytes} [Tue Jul 5 21:12:10 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:12:10.857970 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7334f82-8397-47cb-a3ff-a8f00a4c010d None admin] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:12:10.955796 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7334f82-8397-47cb-a3ff-a8f00a4c010d None admin] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:12:10.989323 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27baf91-07ae-4e1d-99ce-32e67fa68dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3b4b48661074142b14910bc96e359ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:12:10.990072 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27baf91-07ae-4e1d-99ce-32e67fa68dd1 None admin] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:12:10.990398 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27baf91-07ae-4e1d-99ce-32e67fa68dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:12:10.990680 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27baf91-07ae-4e1d-99ce-32e67fa68dd1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:12:10.991417 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27baf91-07ae-4e1d-99ce-32e67fa68dd1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:12:10.992838 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27baf91-07ae-4e1d-99ce-32e67fa68dd1 None admin] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:12:11.090203 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 666/1306] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Jul 5 21:12:10 2022] POST /identity/v3/endpoints => generated 331 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:12:20.920670 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=30 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:12:21.085146 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:17:58.348099 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f93d1-b0e2-4366-bd9f-a1c8eca355d2 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:17:58.348599 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f93d1-b0e2-4366-bd9f-a1c8eca355d2 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:17:58.348681 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f93d1-b0e2-4366-bd9f-a1c8eca355d2 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:17:58.350664 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 641/1307] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:17:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:17:58.356261 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43dd6a-7a8b-4cdb-af1d-caaf6a968a7a None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:17:58.356725 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43dd6a-7a8b-4cdb-af1d-caaf6a968a7a None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:17:58.356808 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43dd6a-7a8b-4cdb-af1d-caaf6a968a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:17:58.438409 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-5d43dd6a-7a8b-4cdb-af1d-caaf6a968a7a None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:17:58.439781 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-5d43dd6a-7a8b-4cdb-af1d-caaf6a968a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:17:58.574560 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 667/1308] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:17:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:17:58.607339 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d51f0-76ce-4c24-a0e9-80daf8610ded None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:17:58.607551 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d51f0-76ce-4c24-a0e9-80daf8610ded None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:17:58.607844 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d51f0-76ce-4c24-a0e9-80daf8610ded None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:17:58.609624 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 642/1309] 10.222.0.30 () {54 vars in 964 bytes} [Tue Jul 5 21:17:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:17:58.615286 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e90e9-04e2-4611-b465-14349a969b3e None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:17:58.615580 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e90e9-04e2-4611-b465-14349a969b3e None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:17:58.615868 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e90e9-04e2-4611-b465-14349a969b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:17:58.730074 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-112e90e9-04e2-4611-b465-14349a969b3e None None] MFA Rules not processed for user `a3947355cf8a4b75bd31c5e6125e75e4`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:17:58.731465 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-112e90e9-04e2-4611-b465-14349a969b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:17:58.759912 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:17:58.833248 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 668/1310] 10.222.0.30 () {58 vars in 1061 bytes} [Tue Jul 5 21:17:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:17:58.842315 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d51f0-76ce-4c24-a0e9-80daf8610ded None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:17:58.844494 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-778d51f0-76ce-4c24-a0e9-80daf8610ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:17:58.970178 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d51f0-76ce-4c24-a0e9-80daf8610ded None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:17:59.048456 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0ea03-ea2c-4d27-bae0-66c1bb99b550 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3947355cf8a4b75bd31c5e6125e75e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd95a48530c4c86a3774301b969d6a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:17:59.049036 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0ea03-ea2c-4d27-bae0-66c1bb99b550 service neutron] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:17:59.049323 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0ea03-ea2c-4d27-bae0-66c1bb99b550 service neutron] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:17:59.049602 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0ea03-ea2c-4d27-bae0-66c1bb99b550 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:17:59.051286 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-70a0ea03-ea2c-4d27-bae0-66c1bb99b550 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:17:59.108875 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:17:59.167730 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a0ea03-ea2c-4d27-bae0-66c1bb99b550 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:17:59.169173 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a0ea03-ea2c-4d27-bae0-66c1bb99b550 service neutron] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:17:59.190359 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 643/1311] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:17:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:18:01.588235 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5dce1b-9abd-4c0e-b770-4fd49d7fd906 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:01.588811 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5dce1b-9abd-4c0e-b770-4fd49d7fd906 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:01.588910 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5dce1b-9abd-4c0e-b770-4fd49d7fd906 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:01.590408 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 669/1312] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:18:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:18:01.595857 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29cc6cf-3d97-4675-9267-06a15d953b97 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:01.596274 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29cc6cf-3d97-4675-9267-06a15d953b97 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:01.596435 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29cc6cf-3d97-4675-9267-06a15d953b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:01.675895 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-a29cc6cf-3d97-4675-9267-06a15d953b97 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:18:01.677116 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-a29cc6cf-3d97-4675-9267-06a15d953b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:18:01.774899 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 644/1313] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:18:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:18:01.813955 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5dce1b-9abd-4c0e-b770-4fd49d7fd906 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:18:01.815771 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-4b5dce1b-9abd-4c0e-b770-4fd49d7fd906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:18:01.928915 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5dce1b-9abd-4c0e-b770-4fd49d7fd906 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:18:02.005432 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:18:02.008020 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc87ec-7c96-4a31-8def-3ce397f4f323 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3947355cf8a4b75bd31c5e6125e75e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd95a48530c4c86a3774301b969d6a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:18:02.008672 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc87ec-7c96-4a31-8def-3ce397f4f323 service neutron] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:02.008961 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc87ec-7c96-4a31-8def-3ce397f4f323 service neutron] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:02.009261 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc87ec-7c96-4a31-8def-3ce397f4f323 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:02.010928 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-5edc87ec-7c96-4a31-8def-3ce397f4f323 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:18:02.124430 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc87ec-7c96-4a31-8def-3ce397f4f323 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:18:02.125910 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc87ec-7c96-4a31-8def-3ce397f4f323 service neutron] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:18:02.143950 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 670/1314] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:18:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:18:04.716060 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8ecae-25c7-4364-922f-d9f6fce53e0d None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:04.716588 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8ecae-25c7-4364-922f-d9f6fce53e0d None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:04.716685 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8ecae-25c7-4364-922f-d9f6fce53e0d None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:04.718029 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 645/1315] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:18:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:18:04.723718 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d864609-bfea-423a-bdcc-b6857f43ca47 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:04.724136 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d864609-bfea-423a-bdcc-b6857f43ca47 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:04.724284 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d864609-bfea-423a-bdcc-b6857f43ca47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:04.787764 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-4d864609-bfea-423a-bdcc-b6857f43ca47 None None] MFA Rules not processed for user `f904c02f9f084df4917f5d2d38174f29`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:18:04.788974 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-4d864609-bfea-423a-bdcc-b6857f43ca47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:18:04.839192 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:18:04.882569 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 671/1316] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:18:04 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:18:04.937203 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78420f3-8526-478d-97dd-aab59c11e921 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:04.937499 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78420f3-8526-478d-97dd-aab59c11e921 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:04.937819 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78420f3-8526-478d-97dd-aab59c11e921 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:04.939240 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 646/1317] 10.222.0.30 () {54 vars in 964 bytes} [Tue Jul 5 21:18:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:18:04.945509 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524e558-bc4e-4dd6-abe8-68950ea45a87 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:04.945800 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524e558-bc4e-4dd6-abe8-68950ea45a87 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:04.946081 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524e558-bc4e-4dd6-abe8-68950ea45a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:05.019475 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-1524e558-bc4e-4dd6-abe8-68950ea45a87 None None] MFA Rules not processed for user `a3947355cf8a4b75bd31c5e6125e75e4`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:18:05.020617 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-1524e558-bc4e-4dd6-abe8-68950ea45a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:18:05.094987 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 672/1318] 10.222.0.30 () {58 vars in 1061 bytes} [Tue Jul 5 21:18:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:18:05.104028 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78420f3-8526-478d-97dd-aab59c11e921 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:18:05.105535 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-f78420f3-8526-478d-97dd-aab59c11e921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:18:05.115890 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:18:05.207685 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78420f3-8526-478d-97dd-aab59c11e921 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:18:05.279759 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b582d288-d752-4af2-9921-72d69c44371d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3947355cf8a4b75bd31c5e6125e75e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd95a48530c4c86a3774301b969d6a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:18:05.280345 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582d288-d752-4af2-9921-72d69c44371d service neutron] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:05.280635 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582d288-d752-4af2-9921-72d69c44371d service neutron] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:05.280916 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582d288-d752-4af2-9921-72d69c44371d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:05.282615 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-b582d288-d752-4af2-9921-72d69c44371d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:18:05.344663 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:18:05.390660 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b582d288-d752-4af2-9921-72d69c44371d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:18:05.392635 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b582d288-d752-4af2-9921-72d69c44371d service neutron] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:18:05.412625 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 647/1319] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:18:05 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:18:08.576892 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb00b66-8ed9-4660-86a7-2c2d03d3d0e5 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:08.577416 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb00b66-8ed9-4660-86a7-2c2d03d3d0e5 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:08.577416 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb00b66-8ed9-4660-86a7-2c2d03d3d0e5 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:08.579297 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 673/1320] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:18:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:18:08.584361 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa640bc5-34e5-48a4-b16a-89b2d79db98b None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:08.584743 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa640bc5-34e5-48a4-b16a-89b2d79db98b None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:08.584935 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa640bc5-34e5-48a4-b16a-89b2d79db98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:08.647960 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-fa640bc5-34e5-48a4-b16a-89b2d79db98b None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:18:08.649169 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-fa640bc5-34e5-48a4-b16a-89b2d79db98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:18:08.746233 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 648/1321] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:18:08 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:18:08.785604 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb00b66-8ed9-4660-86a7-2c2d03d3d0e5 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:18:08.787211 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-7eb00b66-8ed9-4660-86a7-2c2d03d3d0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:18:08.838074 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:18:08.891466 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb00b66-8ed9-4660-86a7-2c2d03d3d0e5 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:18:08.962728 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34501966-a954-4186-a02d-cd31524e18ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3947355cf8a4b75bd31c5e6125e75e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd95a48530c4c86a3774301b969d6a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:18:08.963375 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34501966-a954-4186-a02d-cd31524e18ce service neutron] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:08.963661 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34501966-a954-4186-a02d-cd31524e18ce service neutron] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:08.963939 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34501966-a954-4186-a02d-cd31524e18ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:08.965558 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-34501966-a954-4186-a02d-cd31524e18ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:18:09.058176 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:18:09.071856 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34501966-a954-4186-a02d-cd31524e18ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:18:09.073294 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34501966-a954-4186-a02d-cd31524e18ce service neutron] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:18:09.093874 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 674/1322] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:18:08 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:18:12.188182 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0e498-c48f-485f-9e50-7426ec9fd151 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:12.188763 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0e498-c48f-485f-9e50-7426ec9fd151 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:12.188763 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0e498-c48f-485f-9e50-7426ec9fd151 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:12.190137 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 649/1323] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:18:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:18:12.195628 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d2a98-ba15-4c9d-a60a-5e4ff7305cc0 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:12.196059 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d2a98-ba15-4c9d-a60a-5e4ff7305cc0 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:12.196197 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d2a98-ba15-4c9d-a60a-5e4ff7305cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:12.262884 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-214d2a98-ba15-4c9d-a60a-5e4ff7305cc0 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:18:12.264103 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-214d2a98-ba15-4c9d-a60a-5e4ff7305cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:18:12.365089 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 675/1324] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:18:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:18:12.401969 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec0e498-c48f-485f-9e50-7426ec9fd151 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:18:12.403642 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-3ec0e498-c48f-485f-9e50-7426ec9fd151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:18:12.425270 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:18:12.517263 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec0e498-c48f-485f-9e50-7426ec9fd151 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:18:12.598590 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7c72c5-97da-4f69-9b60-18b5adf2ccc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3947355cf8a4b75bd31c5e6125e75e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd95a48530c4c86a3774301b969d6a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:18:12.599262 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c72c5-97da-4f69-9b60-18b5adf2ccc0 service neutron] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:12.599551 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c72c5-97da-4f69-9b60-18b5adf2ccc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:12.599832 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c72c5-97da-4f69-9b60-18b5adf2ccc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:12.601587 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-8e7c72c5-97da-4f69-9b60-18b5adf2ccc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:18:12.681741 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:18:12.722397 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7c72c5-97da-4f69-9b60-18b5adf2ccc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:18:12.724339 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7c72c5-97da-4f69-9b60-18b5adf2ccc0 service neutron] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:18:12.744611 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 650/1325] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:18:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:18:14.852967 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68300c4-8d92-4c55-b536-8607025cea38 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:14.853508 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68300c4-8d92-4c55-b536-8607025cea38 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:14.853508 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68300c4-8d92-4c55-b536-8607025cea38 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:14.854954 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 676/1326] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:18:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:18:14.860862 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c94c3-d8e1-42bc-afd6-2178724fc941 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:14.861328 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c94c3-d8e1-42bc-afd6-2178724fc941 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:14.861428 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c94c3-d8e1-42bc-afd6-2178724fc941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:14.928609 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-dc6c94c3-d8e1-42bc-afd6-2178724fc941 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:18:14.929740 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-dc6c94c3-d8e1-42bc-afd6-2178724fc941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:18:15.027378 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 651/1327] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:18:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:18:15.065544 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68300c4-8d92-4c55-b536-8607025cea38 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:18:15.067181 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-a68300c4-8d92-4c55-b536-8607025cea38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:18:15.130026 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:18:15.173239 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68300c4-8d92-4c55-b536-8607025cea38 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:18:15.246970 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58539a10-6709-4572-a4dd-97bf503ff02d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3947355cf8a4b75bd31c5e6125e75e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd95a48530c4c86a3774301b969d6a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:18:15.247624 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58539a10-6709-4572-a4dd-97bf503ff02d service neutron] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:15.247909 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58539a10-6709-4572-a4dd-97bf503ff02d service neutron] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:15.248185 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58539a10-6709-4572-a4dd-97bf503ff02d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:15.249907 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-58539a10-6709-4572-a4dd-97bf503ff02d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:18:15.364060 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:18:15.366659 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58539a10-6709-4572-a4dd-97bf503ff02d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:18:15.368103 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58539a10-6709-4572-a4dd-97bf503ff02d service neutron] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:18:15.387064 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 677/1328] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:18:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:18:17.477718 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ac70e-520c-4399-b475-98912c679174 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:17.478273 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ac70e-520c-4399-b475-98912c679174 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:17.478392 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ac70e-520c-4399-b475-98912c679174 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:17.479674 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 652/1329] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:18:17.485354 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197659b5-f762-4dbd-9dbb-b0a1e8d921f5 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:17.485791 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197659b5-f762-4dbd-9dbb-b0a1e8d921f5 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:17.486043 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197659b5-f762-4dbd-9dbb-b0a1e8d921f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:17.550440 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-197659b5-f762-4dbd-9dbb-b0a1e8d921f5 None None] MFA Rules not processed for user `f904c02f9f084df4917f5d2d38174f29`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:18:17.551661 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-197659b5-f762-4dbd-9dbb-b0a1e8d921f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:18:17.650892 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 678/1330] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:18:17 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:18:17.689513 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ac70e-520c-4399-b475-98912c679174 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:18:17.691205 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-087ac70e-520c-4399-b475-98912c679174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:18:17.725118 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:18:17.797665 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ac70e-520c-4399-b475-98912c679174 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:18:17.871060 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64bc901-605e-4923-b1b1-fb7545d64fbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3947355cf8a4b75bd31c5e6125e75e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd95a48530c4c86a3774301b969d6a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:18:17.871632 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bc901-605e-4923-b1b1-fb7545d64fbb service neutron] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:17.871924 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bc901-605e-4923-b1b1-fb7545d64fbb service neutron] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:17.872210 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bc901-605e-4923-b1b1-fb7545d64fbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:17.873843 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-c64bc901-605e-4923-b1b1-fb7545d64fbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:18:17.954675 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:18:17.985782 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64bc901-605e-4923-b1b1-fb7545d64fbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:18:17.987257 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64bc901-605e-4923-b1b1-fb7545d64fbb service neutron] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:18:18.005463 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 653/1331] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:18:17 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:18:20.601916 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48838f9d-ee81-4e37-b3d0-5397fa641e76 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:20.602451 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48838f9d-ee81-4e37-b3d0-5397fa641e76 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:20.602451 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48838f9d-ee81-4e37-b3d0-5397fa641e76 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:20.603835 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 679/1332] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:18:20.608857 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2c321-7a02-4eb1-a5b4-0b98aa869e6a None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:20.609811 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2c321-7a02-4eb1-a5b4-0b98aa869e6a None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:20.609950 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2c321-7a02-4eb1-a5b4-0b98aa869e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:20.672571 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-b6a2c321-7a02-4eb1-a5b4-0b98aa869e6a None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:18:20.674074 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-b6a2c321-7a02-4eb1-a5b4-0b98aa869e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:18:20.769533 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 654/1333] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:18:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:18:20.805350 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48838f9d-ee81-4e37-b3d0-5397fa641e76 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:18:20.806924 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-48838f9d-ee81-4e37-b3d0-5397fa641e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:18:20.875961 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:18:20.908625 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48838f9d-ee81-4e37-b3d0-5397fa641e76 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:18:20.981436 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbfcbcc-cb46-4038-b642-233d6ed8a993 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3947355cf8a4b75bd31c5e6125e75e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd95a48530c4c86a3774301b969d6a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:18:20.982085 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbfcbcc-cb46-4038-b642-233d6ed8a993 service neutron] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:20.982396 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbfcbcc-cb46-4038-b642-233d6ed8a993 service neutron] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:20.982671 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbfcbcc-cb46-4038-b642-233d6ed8a993 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:20.984381 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-edbfcbcc-cb46-4038-b642-233d6ed8a993 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:18:21.091034 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbfcbcc-cb46-4038-b642-233d6ed8a993 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:18:21.092469 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbfcbcc-cb46-4038-b642-233d6ed8a993 service neutron] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:18:21.102284 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:18:21.110177 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 680/1334] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:18:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:18:23.180078 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129783d-32e9-4c46-b782-af095239d86c None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:23.180617 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129783d-32e9-4c46-b782-af095239d86c None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:23.180617 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129783d-32e9-4c46-b782-af095239d86c None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:23.182023 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 655/1335] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:18:23.187653 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc74657-11c1-4eeb-aedb-0ff61f1c3d9b None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:23.188467 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc74657-11c1-4eeb-aedb-0ff61f1c3d9b None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:23.188467 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc74657-11c1-4eeb-aedb-0ff61f1c3d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:23.252653 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-afc74657-11c1-4eeb-aedb-0ff61f1c3d9b None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:18:23.253873 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-afc74657-11c1-4eeb-aedb-0ff61f1c3d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:18:23.351891 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 681/1336] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:18:23.392046 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a129783d-32e9-4c46-b782-af095239d86c None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:18:23.393582 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-a129783d-32e9-4c46-b782-af095239d86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:18:23.433616 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:18:23.497135 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a129783d-32e9-4c46-b782-af095239d86c None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:18:23.569825 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823f7b9-c72b-4ea6-a838-c48816958704 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3947355cf8a4b75bd31c5e6125e75e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd95a48530c4c86a3774301b969d6a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:18:23.570761 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823f7b9-c72b-4ea6-a838-c48816958704 service neutron] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:23.571051 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823f7b9-c72b-4ea6-a838-c48816958704 service neutron] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:23.571335 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823f7b9-c72b-4ea6-a838-c48816958704 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:23.572986 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-1823f7b9-c72b-4ea6-a838-c48816958704 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:18:23.655074 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:18:23.680660 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1823f7b9-c72b-4ea6-a838-c48816958704 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:18:23.682152 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1823f7b9-c72b-4ea6-a838-c48816958704 service neutron] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:18:23.700763 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 656/1337] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:18:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:18:26.371382 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252270a-2eb3-4b79-b6ac-8527aee876ac None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:26.371948 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252270a-2eb3-4b79-b6ac-8527aee876ac None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:26.371948 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252270a-2eb3-4b79-b6ac-8527aee876ac None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:26.373328 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 682/1338] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:18:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:18:26.379284 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51defda2-6ec2-4b91-88ea-12ace6e358bf None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:26.379739 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51defda2-6ec2-4b91-88ea-12ace6e358bf None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:26.379866 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51defda2-6ec2-4b91-88ea-12ace6e358bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:26.444550 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-51defda2-6ec2-4b91-88ea-12ace6e358bf None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:18:26.446014 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-51defda2-6ec2-4b91-88ea-12ace6e358bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:18:26.539632 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 657/1339] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:18:26 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:18:26.576074 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252270a-2eb3-4b79-b6ac-8527aee876ac None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:18:26.577651 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-8252270a-2eb3-4b79-b6ac-8527aee876ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:18:26.651928 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:18:26.678964 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252270a-2eb3-4b79-b6ac-8527aee876ac None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:18:26.750702 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7074a879-07e5-4108-a28b-25067b621000 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3947355cf8a4b75bd31c5e6125e75e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd95a48530c4c86a3774301b969d6a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:18:26.751352 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074a879-07e5-4108-a28b-25067b621000 service neutron] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:26.751641 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074a879-07e5-4108-a28b-25067b621000 service neutron] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:26.751924 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074a879-07e5-4108-a28b-25067b621000 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:26.753573 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-7074a879-07e5-4108-a28b-25067b621000 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:18:26.862230 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7074a879-07e5-4108-a28b-25067b621000 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:18:26.863597 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7074a879-07e5-4108-a28b-25067b621000 service neutron] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:18:26.881726 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 683/1340] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:18:26 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:18:31.144405 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d42c1-2af4-4f03-891d-e03a629a41c9 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:31.144958 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d42c1-2af4-4f03-891d-e03a629a41c9 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:31.144958 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d42c1-2af4-4f03-891d-e03a629a41c9 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:31.146375 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 658/1341] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:18:31.151644 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02b114-e54c-4836-8996-f142f3c3646b None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:31.152203 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02b114-e54c-4836-8996-f142f3c3646b None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:31.152203 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02b114-e54c-4836-8996-f142f3c3646b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:31.159523 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=100 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:18:31.228704 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-4e02b114-e54c-4836-8996-f142f3c3646b None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:18:31.232550 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-4e02b114-e54c-4836-8996-f142f3c3646b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:18:31.350018 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 684/1342] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:18:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:18:31.389339 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d42c1-2af4-4f03-891d-e03a629a41c9 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:18:31.391779 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-d97d42c1-2af4-4f03-891d-e03a629a41c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:18:31.443686 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:18:31.491069 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d42c1-2af4-4f03-891d-e03a629a41c9 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:18:31.494530 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f8f1fc-47a2-4f2c-84b6-ffb21400c448 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3947355cf8a4b75bd31c5e6125e75e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd95a48530c4c86a3774301b969d6a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:18:31.495190 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8f1fc-47a2-4f2c-84b6-ffb21400c448 service neutron] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:31.495481 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8f1fc-47a2-4f2c-84b6-ffb21400c448 service neutron] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:31.495765 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8f1fc-47a2-4f2c-84b6-ffb21400c448 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:31.504859 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f8f1fc-47a2-4f2c-84b6-ffb21400c448 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:18:31.506392 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f8f1fc-47a2-4f2c-84b6-ffb21400c448 service neutron] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:18:31.515704 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 659/1343] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:18:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:18:34.607125 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a3fb6-5cd9-41c0-a2c3-14da4dbe4588 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:34.607690 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a3fb6-5cd9-41c0-a2c3-14da4dbe4588 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:34.607690 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a3fb6-5cd9-41c0-a2c3-14da4dbe4588 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:34.609715 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 685/1344] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:18:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:18:34.615094 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab26a1-d554-4ceb-8e4a-314f4f874f11 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:34.615512 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab26a1-d554-4ceb-8e4a-314f4f874f11 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:34.615791 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab26a1-d554-4ceb-8e4a-314f4f874f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:34.644279 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-bcab26a1-d554-4ceb-8e4a-314f4f874f11 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:18:34.645503 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-bcab26a1-d554-4ceb-8e4a-314f4f874f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:18:34.724026 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 660/1345] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:18:34 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:18:34.761161 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a3fb6-5cd9-41c0-a2c3-14da4dbe4588 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:18:34.772314 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a3fb6-5cd9-41c0-a2c3-14da4dbe4588 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:18:34.775833 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd09c3f-ac43-4c14-b801-1a8626257b8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3947355cf8a4b75bd31c5e6125e75e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd95a48530c4c86a3774301b969d6a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:18:34.776475 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd09c3f-ac43-4c14-b801-1a8626257b8a service neutron] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:34.776767 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd09c3f-ac43-4c14-b801-1a8626257b8a service neutron] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:34.777049 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd09c3f-ac43-4c14-b801-1a8626257b8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:34.786538 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd09c3f-ac43-4c14-b801-1a8626257b8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:18:34.787970 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd09c3f-ac43-4c14-b801-1a8626257b8a service neutron] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:18:34.797673 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 686/1346] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:18:34 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:18:39.103314 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eba8f6-28d7-473f-b81e-bc03d0288b92 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:39.103867 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eba8f6-28d7-473f-b81e-bc03d0288b92 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:39.103867 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eba8f6-28d7-473f-b81e-bc03d0288b92 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:39.105190 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 661/1347] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:18:39.111364 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa514f1-fba0-4003-8627-61b319e04931 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:39.111830 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa514f1-fba0-4003-8627-61b319e04931 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:39.112083 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa514f1-fba0-4003-8627-61b319e04931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:39.130231 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-cfa514f1-fba0-4003-8627-61b319e04931 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:18:39.131145 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-cfa514f1-fba0-4003-8627-61b319e04931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:18:39.139021 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 687/1348] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:18:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:18:39.176543 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eba8f6-28d7-473f-b81e-bc03d0288b92 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:18:39.187679 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eba8f6-28d7-473f-b81e-bc03d0288b92 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:18:39.191485 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ee0b9-610b-4e58-91b5-571b4878f49d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3947355cf8a4b75bd31c5e6125e75e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd95a48530c4c86a3774301b969d6a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:18:39.192213 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ee0b9-610b-4e58-91b5-571b4878f49d service neutron] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:39.192569 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ee0b9-610b-4e58-91b5-571b4878f49d service neutron] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:39.192919 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ee0b9-610b-4e58-91b5-571b4878f49d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:39.203606 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5ee0b9-610b-4e58-91b5-571b4878f49d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:18:39.205173 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5ee0b9-610b-4e58-91b5-571b4878f49d service neutron] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:18:39.215582 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 662/1349] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:18:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:18:44.146654 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130ad3a-bde4-476a-912b-81ca989ad9ae None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:44.147622 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130ad3a-bde4-476a-912b-81ca989ad9ae None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:44.148113 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130ad3a-bde4-476a-912b-81ca989ad9ae None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:44.154181 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 688/1350] 10.222.0.30 () {54 vars in 921 bytes} [Tue Jul 5 21:18:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:18:44.177561 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc993bac-4062-4d11-bab6-e80e856f41f3 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:44.177561 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc993bac-4062-4d11-bab6-e80e856f41f3 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:44.177561 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc993bac-4062-4d11-bab6-e80e856f41f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:44.281740 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-bc993bac-4062-4d11-bab6-e80e856f41f3 None None] MFA Rules not processed for user `a027185c09a8465fa88aadbe511a07f9`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:18:44.283453 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-bc993bac-4062-4d11-bab6-e80e856f41f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:18:44.322975 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:18:44.376617 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 663/1351] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Jul 5 21:18:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:18:48.674997 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e0672-2067-4d15-9ea0-bbd05c585625 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:48.675575 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e0672-2067-4d15-9ea0-bbd05c585625 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:48.675575 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e0672-2067-4d15-9ea0-bbd05c585625 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:48.677042 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 689/1352] 10.222.0.30 () {54 vars in 921 bytes} [Tue Jul 5 21:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:18:48.682249 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d540b-5cdd-4c09-abe7-e2d1c4446131 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:48.682718 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d540b-5cdd-4c09-abe7-e2d1c4446131 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:48.682826 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d540b-5cdd-4c09-abe7-e2d1c4446131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:48.704185 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-699d540b-5cdd-4c09-abe7-e2d1c4446131 None None] MFA Rules not processed for user `a027185c09a8465fa88aadbe511a07f9`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:18:48.705404 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-699d540b-5cdd-4c09-abe7-e2d1c4446131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:18:48.718289 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 664/1353] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Jul 5 21:18:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:18:49.124577 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=72 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:18:50.413766 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ac4d0-dacc-40f9-8ede-21d55d441cf8 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:50.414443 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ac4d0-dacc-40f9-8ede-21d55d441cf8 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:50.414443 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ac4d0-dacc-40f9-8ede-21d55d441cf8 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:50.415739 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 690/1354] 10.222.0.30 () {54 vars in 921 bytes} [Tue Jul 5 21:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:18:50.421322 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9579d5-73c3-4f70-bc83-c25c538ca2f4 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:50.422248 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9579d5-73c3-4f70-bc83-c25c538ca2f4 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:50.422536 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9579d5-73c3-4f70-bc83-c25c538ca2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:50.440669 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-1e9579d5-73c3-4f70-bc83-c25c538ca2f4 None None] MFA Rules not processed for user `a027185c09a8465fa88aadbe511a07f9`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:18:50.441873 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-1e9579d5-73c3-4f70-bc83-c25c538ca2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:18:50.450715 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 665/1355] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Jul 5 21:18:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:18:54.012838 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef0879-249f-400b-a8e3-730e47b06909 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:54.013726 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef0879-249f-400b-a8e3-730e47b06909 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:54.014186 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef0879-249f-400b-a8e3-730e47b06909 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:54.016905 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 691/1356] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:18:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:18:54.022604 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca9506-1c98-490f-8e5c-aff219248305 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:54.023431 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca9506-1c98-490f-8e5c-aff219248305 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:54.023722 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca9506-1c98-490f-8e5c-aff219248305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:54.047922 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-97ca9506-1c98-490f-8e5c-aff219248305 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:18:54.049999 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-97ca9506-1c98-490f-8e5c-aff219248305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:18:54.064460 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 666/1357] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:18:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:18:54.122509 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f8585-1411-4255-91fa-95f3dbd80b0c None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:54.122806 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f8585-1411-4255-91fa-95f3dbd80b0c None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:54.123295 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f8585-1411-4255-91fa-95f3dbd80b0c None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:54.125204 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 692/1358] 10.222.0.30 () {54 vars in 961 bytes} [Tue Jul 5 21:18:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:18:54.133061 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd80464-9e0a-4ece-9bd7-2bbfbe5933e4 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:54.133360 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd80464-9e0a-4ece-9bd7-2bbfbe5933e4 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:54.133646 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd80464-9e0a-4ece-9bd7-2bbfbe5933e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:54.188460 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-9cd80464-9e0a-4ece-9bd7-2bbfbe5933e4 None None] MFA Rules not processed for user `be0701b0a7ff479e8b3214afaf618acd`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:18:54.189741 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-9cd80464-9e0a-4ece-9bd7-2bbfbe5933e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:18:54.292692 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 667/1359] 10.222.0.30 () {58 vars in 1058 bytes} [Tue Jul 5 21:18:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:18:54.301891 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659f8585-1411-4255-91fa-95f3dbd80b0c None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:18:54.318333 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659f8585-1411-4255-91fa-95f3dbd80b0c None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:18:54.325155 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638394b0-045f-488b-a752-0545e792b574 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be0701b0a7ff479e8b3214afaf618acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd95a48530c4c86a3774301b969d6a9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:18:54.326113 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638394b0-045f-488b-a752-0545e792b574 service nova] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:54.326552 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638394b0-045f-488b-a752-0545e792b574 service nova] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:54.327471 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638394b0-045f-488b-a752-0545e792b574 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:54.339929 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638394b0-045f-488b-a752-0545e792b574 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:18:54.342378 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638394b0-045f-488b-a752-0545e792b574 service nova] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:18:54.355605 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 693/1360] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:18:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:18:56.624394 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155e773-f6f3-467f-9f61-e74dc2d7f307 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:56.624967 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155e773-f6f3-467f-9f61-e74dc2d7f307 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:56.625069 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155e773-f6f3-467f-9f61-e74dc2d7f307 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:56.626734 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 668/1361] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:18:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:18:56.633104 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bdb915-2a0c-44e1-a61a-15cdacd6ad26 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:56.633643 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bdb915-2a0c-44e1-a61a-15cdacd6ad26 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:56.633746 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bdb915-2a0c-44e1-a61a-15cdacd6ad26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:56.670389 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-f4bdb915-2a0c-44e1-a61a-15cdacd6ad26 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:18:56.673543 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-f4bdb915-2a0c-44e1-a61a-15cdacd6ad26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:18:56.690317 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 694/1362] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:18:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:18:56.739758 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155e773-f6f3-467f-9f61-e74dc2d7f307 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:18:56.755363 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155e773-f6f3-467f-9f61-e74dc2d7f307 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:18:56.761366 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b5e18-081b-43fb-bae8-04436fa93938 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be0701b0a7ff479e8b3214afaf618acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd95a48530c4c86a3774301b969d6a9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:18:56.762019 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b5e18-081b-43fb-bae8-04436fa93938 service nova] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:56.762346 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b5e18-081b-43fb-bae8-04436fa93938 service nova] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:56.762633 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b5e18-081b-43fb-bae8-04436fa93938 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:56.771884 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b5e18-081b-43fb-bae8-04436fa93938 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:18:56.773529 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b5e18-081b-43fb-bae8-04436fa93938 service nova] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:18:56.784794 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 669/1363] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:18:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:18:59.360781 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058571d8-6784-4941-8d11-78f6e5b960c6 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:59.361287 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058571d8-6784-4941-8d11-78f6e5b960c6 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:59.361385 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058571d8-6784-4941-8d11-78f6e5b960c6 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:59.362764 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 695/1364] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:18:59.368153 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8e7e4-902e-448f-9d72-fb4f5c055e5b None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:59.368592 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8e7e4-902e-448f-9d72-fb4f5c055e5b None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:59.368791 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8e7e4-902e-448f-9d72-fb4f5c055e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:59.388424 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-50a8e7e4-902e-448f-9d72-fb4f5c055e5b None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:18:59.390448 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-50a8e7e4-902e-448f-9d72-fb4f5c055e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:18:59.398450 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 670/1365] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:18:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:18:59.444391 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf4899-0604-4798-87d3-a060a78385f6 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:59.444686 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf4899-0604-4798-87d3-a060a78385f6 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:59.444973 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf4899-0604-4798-87d3-a060a78385f6 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:59.446675 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 696/1366] 10.222.0.30 () {54 vars in 961 bytes} [Tue Jul 5 21:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:18:59.451852 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dace29a-b8f7-440d-80fc-7b06e9eff16a None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:59.452147 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dace29a-b8f7-440d-80fc-7b06e9eff16a None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:59.452506 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dace29a-b8f7-440d-80fc-7b06e9eff16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:59.470512 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-7dace29a-b8f7-440d-80fc-7b06e9eff16a None None] MFA Rules not processed for user `be0701b0a7ff479e8b3214afaf618acd`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:18:59.471716 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-7dace29a-b8f7-440d-80fc-7b06e9eff16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:18:59.480959 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 671/1367] 10.222.0.30 () {58 vars in 1058 bytes} [Tue Jul 5 21:18:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:18:59.489114 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf4899-0604-4798-87d3-a060a78385f6 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:18:59.505019 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf4899-0604-4798-87d3-a060a78385f6 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:18:59.510370 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b656be-4ca1-409c-a4ba-c40d96d3b6f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be0701b0a7ff479e8b3214afaf618acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd95a48530c4c86a3774301b969d6a9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:18:59.511021 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b656be-4ca1-409c-a4ba-c40d96d3b6f8 service nova] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:18:59.511312 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b656be-4ca1-409c-a4ba-c40d96d3b6f8 service nova] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:18:59.511591 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b656be-4ca1-409c-a4ba-c40d96d3b6f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:18:59.520516 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b656be-4ca1-409c-a4ba-c40d96d3b6f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:18:59.522092 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b656be-4ca1-409c-a4ba-c40d96d3b6f8 service nova] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:18:59.531730 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 697/1368] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:18:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:19:01.787546 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121ba09-aa7a-4277-b684-c44f9509d0d3 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:01.788175 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121ba09-aa7a-4277-b684-c44f9509d0d3 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:01.788175 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121ba09-aa7a-4277-b684-c44f9509d0d3 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:01.789462 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 672/1369] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:19:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:19:01.794863 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4050345-0e44-4230-8d8c-43a3f2850ebc None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:01.795295 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4050345-0e44-4230-8d8c-43a3f2850ebc None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:01.795971 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4050345-0e44-4230-8d8c-43a3f2850ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:01.814178 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-f4050345-0e44-4230-8d8c-43a3f2850ebc None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:19:01.815389 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-f4050345-0e44-4230-8d8c-43a3f2850ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:19:01.823770 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 698/1370] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:19:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:19:01.868721 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121ba09-aa7a-4277-b684-c44f9509d0d3 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:19:01.884268 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121ba09-aa7a-4277-b684-c44f9509d0d3 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:19:01.889895 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec6313c-df38-42a3-87fd-59d5db05a945 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be0701b0a7ff479e8b3214afaf618acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd95a48530c4c86a3774301b969d6a9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:19:01.890674 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6313c-df38-42a3-87fd-59d5db05a945 service nova] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:01.891018 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6313c-df38-42a3-87fd-59d5db05a945 service nova] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:01.891368 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6313c-df38-42a3-87fd-59d5db05a945 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:01.899945 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec6313c-df38-42a3-87fd-59d5db05a945 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:19:01.901536 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec6313c-df38-42a3-87fd-59d5db05a945 service nova] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:19:01.911976 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 673/1371] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:19:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:19:02.332408 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1875141-3c22-429a-8c53-3bc2942e82d2 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:02.332722 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1875141-3c22-429a-8c53-3bc2942e82d2 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:02.333207 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1875141-3c22-429a-8c53-3bc2942e82d2 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:02.334692 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 699/1372] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:19:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:19:02.340224 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9874df8f-4650-43c4-af23-13309248d35f None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:02.340765 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9874df8f-4650-43c4-af23-13309248d35f None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:02.341437 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9874df8f-4650-43c4-af23-13309248d35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:02.361370 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-9874df8f-4650-43c4-af23-13309248d35f None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:19:02.362985 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-9874df8f-4650-43c4-af23-13309248d35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:19:02.377867 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 674/1373] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:19:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:19:02.733408 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f392890-fd01-438f-8965-dba428009f92 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:02.733831 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f392890-fd01-438f-8965-dba428009f92 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:02.734249 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f392890-fd01-438f-8965-dba428009f92 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:02.735769 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 700/1374] 10.222.0.30 () {54 vars in 963 bytes} [Tue Jul 5 21:19:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:19:02.740786 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362ee89-faa9-4535-ad1b-38a2360e5f06 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:02.741084 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362ee89-faa9-4535-ad1b-38a2360e5f06 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:02.741370 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362ee89-faa9-4535-ad1b-38a2360e5f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:02.749051 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:19:02.794594 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-2362ee89-faa9-4535-ad1b-38a2360e5f06 None None] MFA Rules not processed for user `4b5719dcd7314f1487b5e168e07039f8`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:19:02.795984 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-2362ee89-faa9-4535-ad1b-38a2360e5f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:19:02.860302 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 675/1375] 10.222.0.30 () {58 vars in 1060 bytes} [Tue Jul 5 21:19:02 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:19:02.867844 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f392890-fd01-438f-8965-dba428009f92 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:19:02.878706 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f392890-fd01-438f-8965-dba428009f92 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:19:02.882278 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c3c34-0ced-4043-ba7f-eac6d400121e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5719dcd7314f1487b5e168e07039f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd95a48530c4c86a3774301b969d6a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:19:02.883120 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c3c34-0ced-4043-ba7f-eac6d400121e service cinder] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:02.883557 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c3c34-0ced-4043-ba7f-eac6d400121e service cinder] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:02.883987 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c3c34-0ced-4043-ba7f-eac6d400121e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:02.893542 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c3c34-0ced-4043-ba7f-eac6d400121e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:19:02.895232 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c3c34-0ced-4043-ba7f-eac6d400121e service cinder] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:19:02.905465 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 701/1376] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:19:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:19:04.167086 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81080d-ab1c-4b0c-8ac4-f7a368a4a619 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:04.167622 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81080d-ab1c-4b0c-8ac4-f7a368a4a619 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:04.167750 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81080d-ab1c-4b0c-8ac4-f7a368a4a619 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:04.169013 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 676/1377] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:19:04.175066 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3545313-d17f-4c95-86d1-dbf66bf4c347 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:04.175506 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3545313-d17f-4c95-86d1-dbf66bf4c347 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:04.175666 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3545313-d17f-4c95-86d1-dbf66bf4c347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:04.193899 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-b3545313-d17f-4c95-86d1-dbf66bf4c347 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:19:04.195426 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-b3545313-d17f-4c95-86d1-dbf66bf4c347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:19:04.203297 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 702/1378] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:19:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:19:04.247524 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81080d-ab1c-4b0c-8ac4-f7a368a4a619 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:19:04.262612 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81080d-ab1c-4b0c-8ac4-f7a368a4a619 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:19:04.268501 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d683c5-c5f7-4f28-897c-272f0fa8bc14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be0701b0a7ff479e8b3214afaf618acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd95a48530c4c86a3774301b969d6a9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:19:04.269151 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d683c5-c5f7-4f28-897c-272f0fa8bc14 service nova] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:04.269442 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d683c5-c5f7-4f28-897c-272f0fa8bc14 service nova] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:04.269726 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d683c5-c5f7-4f28-897c-272f0fa8bc14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:04.278231 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d683c5-c5f7-4f28-897c-272f0fa8bc14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:19:04.280376 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d683c5-c5f7-4f28-897c-272f0fa8bc14 service nova] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:19:04.289999 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 677/1379] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:19:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:19:06.489402 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda2741-1a1c-417f-ae47-90327e851ce1 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:06.489899 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda2741-1a1c-417f-ae47-90327e851ce1 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:06.490026 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda2741-1a1c-417f-ae47-90327e851ce1 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:06.491691 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 703/1380] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:19:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:19:06.497333 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2dc789-4b13-42ef-863d-a67c2cf32700 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:06.497763 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2dc789-4b13-42ef-863d-a67c2cf32700 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:06.497897 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2dc789-4b13-42ef-863d-a67c2cf32700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:06.520374 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-bc2dc789-4b13-42ef-863d-a67c2cf32700 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:19:06.521501 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-bc2dc789-4b13-42ef-863d-a67c2cf32700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:19:06.529586 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 678/1381] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:19:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:19:06.577822 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda2741-1a1c-417f-ae47-90327e851ce1 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:19:06.598311 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda2741-1a1c-417f-ae47-90327e851ce1 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:19:06.604712 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af60770-ab2e-4818-baed-7946bd968132 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be0701b0a7ff479e8b3214afaf618acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd95a48530c4c86a3774301b969d6a9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:19:06.605477 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af60770-ab2e-4818-baed-7946bd968132 service nova] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:06.605878 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af60770-ab2e-4818-baed-7946bd968132 service nova] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:06.606298 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af60770-ab2e-4818-baed-7946bd968132 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:06.616395 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af60770-ab2e-4818-baed-7946bd968132 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:19:06.618202 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af60770-ab2e-4818-baed-7946bd968132 service nova] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:19:06.642699 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 704/1382] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:19:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:19:08.825492 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af73ec-c021-4812-89da-7bcc3961cde6 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:08.826074 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af73ec-c021-4812-89da-7bcc3961cde6 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:08.826074 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af73ec-c021-4812-89da-7bcc3961cde6 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:08.827488 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 679/1383] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:19:08.832625 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538ce21-81cc-44d1-8bae-476ea4e9208d None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:08.833046 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538ce21-81cc-44d1-8bae-476ea4e9208d None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:08.833192 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538ce21-81cc-44d1-8bae-476ea4e9208d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:08.851825 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-1538ce21-81cc-44d1-8bae-476ea4e9208d None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:19:08.853012 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-1538ce21-81cc-44d1-8bae-476ea4e9208d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:19:08.862403 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 705/1384] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:19:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:19:08.902464 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af73ec-c021-4812-89da-7bcc3961cde6 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:19:08.917977 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af73ec-c021-4812-89da-7bcc3961cde6 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:19:08.924377 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e92b8-dee7-47ef-8adf-2181f722759d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be0701b0a7ff479e8b3214afaf618acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd95a48530c4c86a3774301b969d6a9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:19:08.925139 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e92b8-dee7-47ef-8adf-2181f722759d service nova] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:08.925531 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e92b8-dee7-47ef-8adf-2181f722759d service nova] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:08.925911 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e92b8-dee7-47ef-8adf-2181f722759d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:08.936519 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e92b8-dee7-47ef-8adf-2181f722759d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:19:08.938334 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e92b8-dee7-47ef-8adf-2181f722759d service nova] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:19:08.948881 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 680/1385] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:19:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:19:11.001457 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5fce73-e06a-42b0-9509-ebf100ac706e None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:11.002051 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5fce73-e06a-42b0-9509-ebf100ac706e None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:11.002051 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5fce73-e06a-42b0-9509-ebf100ac706e None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:11.003441 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 706/1386] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:19:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:19:11.008723 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa29a5-ef57-4562-af71-c5de1a62af8e None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:11.009245 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa29a5-ef57-4562-af71-c5de1a62af8e None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:11.009245 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa29a5-ef57-4562-af71-c5de1a62af8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:11.027397 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-dcaa29a5-ef57-4562-af71-c5de1a62af8e None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:19:11.028615 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-dcaa29a5-ef57-4562-af71-c5de1a62af8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:19:11.037172 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 681/1387] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:19:11.082340 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5fce73-e06a-42b0-9509-ebf100ac706e None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:19:11.101602 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5fce73-e06a-42b0-9509-ebf100ac706e None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:19:11.109965 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef819f2-5207-4ac3-9f8d-f005841db38e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be0701b0a7ff479e8b3214afaf618acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd95a48530c4c86a3774301b969d6a9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:19:11.111002 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef819f2-5207-4ac3-9f8d-f005841db38e service nova] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:11.111441 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef819f2-5207-4ac3-9f8d-f005841db38e service nova] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:11.111796 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef819f2-5207-4ac3-9f8d-f005841db38e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:11.123084 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef819f2-5207-4ac3-9f8d-f005841db38e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:19:11.125630 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef819f2-5207-4ac3-9f8d-f005841db38e service nova] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:19:11.138294 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 707/1388] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:19:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:19:13.371286 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d216c-77b6-4c6f-83e3-59c91c54fac5 None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:13.371815 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d216c-77b6-4c6f-83e3-59c91c54fac5 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:13.371929 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d216c-77b6-4c6f-83e3-59c91c54fac5 None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:13.373773 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 682/1389] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:19:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:19:13.380189 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47a871-3481-431b-b9bf-1346e69fef33 None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:13.382711 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47a871-3481-431b-b9bf-1346e69fef33 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:13.382711 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47a871-3481-431b-b9bf-1346e69fef33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:13.400067 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-1b47a871-3481-431b-b9bf-1346e69fef33 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:19:13.401280 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-1b47a871-3481-431b-b9bf-1346e69fef33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:19:13.409489 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 708/1390] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:19:13.463912 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d216c-77b6-4c6f-83e3-59c91c54fac5 None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:19:13.479023 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d216c-77b6-4c6f-83e3-59c91c54fac5 None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:19:13.484720 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72780c05-7fe7-4432-b32a-819232c7ac2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be0701b0a7ff479e8b3214afaf618acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd95a48530c4c86a3774301b969d6a9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:19:13.485368 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72780c05-7fe7-4432-b32a-819232c7ac2d service nova] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:13.485658 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72780c05-7fe7-4432-b32a-819232c7ac2d service nova] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:13.485974 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72780c05-7fe7-4432-b32a-819232c7ac2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:13.494379 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72780c05-7fe7-4432-b32a-819232c7ac2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:19:13.495962 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72780c05-7fe7-4432-b32a-819232c7ac2d service nova] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:19:13.506072 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 683/1391] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:19:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:19:15.986857 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817a0be-9fea-4867-b53d-1080564addd2 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:15.987470 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817a0be-9fea-4867-b53d-1080564addd2 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:15.987470 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817a0be-9fea-4867-b53d-1080564addd2 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:15.988834 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 709/1392] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:19:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:19:15.994424 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122754f-0c47-434e-bdaa-242fe80007b6 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:15.994878 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122754f-0c47-434e-bdaa-242fe80007b6 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:15.995027 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122754f-0c47-434e-bdaa-242fe80007b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:16.013116 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-d122754f-0c47-434e-bdaa-242fe80007b6 None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:19:16.015006 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-d122754f-0c47-434e-bdaa-242fe80007b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:19:16.023108 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 684/1393] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:19:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:19:16.069227 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f817a0be-9fea-4867-b53d-1080564addd2 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:19:16.084800 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f817a0be-9fea-4867-b53d-1080564addd2 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:19:16.090357 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119cc4f-142e-48f3-b332-577f3e75a37a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be0701b0a7ff479e8b3214afaf618acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd95a48530c4c86a3774301b969d6a9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:19:16.091010 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119cc4f-142e-48f3-b332-577f3e75a37a service nova] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:16.091299 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119cc4f-142e-48f3-b332-577f3e75a37a service nova] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:16.091587 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119cc4f-142e-48f3-b332-577f3e75a37a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:16.100718 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f119cc4f-142e-48f3-b332-577f3e75a37a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:19:16.102336 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f119cc4f-142e-48f3-b332-577f3e75a37a service nova] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:19:16.112313 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 710/1394] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:19:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:19:18.325136 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6d6a1-4979-431c-8064-a84eac5b5c7f None None] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:18.325652 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6d6a1-4979-431c-8064-a84eac5b5c7f None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:18.325760 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6d6a1-4979-431c-8064-a84eac5b5c7f None None] PATH_INFO: `/` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:18.327340 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 685/1395] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:19:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:19:18.332450 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777359ac-4adb-4a95-9cba-c6360f8c35fe None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:18.332878 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777359ac-4adb-4a95-9cba-c6360f8c35fe None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:18.333017 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777359ac-4adb-4a95-9cba-c6360f8c35fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:18.351339 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-777359ac-4adb-4a95-9cba-c6360f8c35fe None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:19:18.352539 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-777359ac-4adb-4a95-9cba-c6360f8c35fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:19:18.360914 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 711/1396] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:19:18.407240 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6d6a1-4979-431c-8064-a84eac5b5c7f None None] Authenticating user token {{(pid=108008) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:19:18.408726 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b3179-3d70-414e-a0e8-c51f41cbe152 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:18.409023 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b3179-3d70-414e-a0e8-c51f41cbe152 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:18.409313 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b3179-3d70-414e-a0e8-c51f41cbe152 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:18.410728 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 712/1397] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:19:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:19:18.415449 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae6c8c-1a5a-4ded-a288-f1ff6295564f None None] REQUEST_METHOD: `POST` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:18.415737 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae6c8c-1a5a-4ded-a288-f1ff6295564f None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:18.416018 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae6c8c-1a5a-4ded-a288-f1ff6295564f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:18.421983 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6d6a1-4979-431c-8064-a84eac5b5c7f None None] Validating token access rules against request {{(pid=108008) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:19:18.427363 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4aa5ed-a46b-4af0-9775-40308d5c850e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be0701b0a7ff479e8b3214afaf618acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd95a48530c4c86a3774301b969d6a9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108008) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:19:18.428011 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4aa5ed-a46b-4af0-9775-40308d5c850e service nova] REQUEST_METHOD: `GET` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:18.428299 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4aa5ed-a46b-4af0-9775-40308d5c850e service nova] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:18.428580 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4aa5ed-a46b-4af0-9775-40308d5c850e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:18.433445 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.auth.core [None req-68ae6c8c-1a5a-4ded-a288-f1ff6295564f None None] MFA Rules not processed for user `c3b4b48661074142b14910bc96e359ec`. Rule list: `[]` (Enabled: `True`). {{(pid=108009) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:19:18.435349 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.fernet_utils [None req-68ae6c8c-1a5a-4ded-a288-f1ff6295564f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108009) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:19:18.437019 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4aa5ed-a46b-4af0-9775-40308d5c850e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:19:18.438625 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4aa5ed-a46b-4af0-9775-40308d5c850e service nova] RBAC: Authorization granted {{(pid=108008) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:19:18.443240 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 713/1398] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:19:18.451023 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 686/1399] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:19:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:19:18.499194 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15374cd-e114-4288-930b-3648e4064454 None None] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:18.500505 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15374cd-e114-4288-930b-3648e4064454 None None] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:18.500505 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15374cd-e114-4288-930b-3648e4064454 None None] PATH_INFO: `/` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:18.501157 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 714/1400] 10.222.0.30 () {54 vars in 962 bytes} [Tue Jul 5 21:19:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:19:18.506210 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41750cc-3386-405e-9ae9-11fa565b3530 None None] REQUEST_METHOD: `POST` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:18.506514 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41750cc-3386-405e-9ae9-11fa565b3530 None None] SCRIPT_NAME: `/identity` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:18.506798 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41750cc-3386-405e-9ae9-11fa565b3530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=108008) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:18.558193 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.auth.core [None req-f41750cc-3386-405e-9ae9-11fa565b3530 None None] MFA Rules not processed for user `598e27ffd54748f6aadb3d7cab5a4ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=108008) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:19:18.559404 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG keystone.common.fernet_utils [None req-f41750cc-3386-405e-9ae9-11fa565b3530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=108008) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:19:18.599417 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=100 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:19:18.619257 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: [pid: 108008|app: 0|req: 687/1401] 10.222.0.30 () {58 vars in 1059 bytes} [Tue Jul 5 21:19:18 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:19:18.627467 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15374cd-e114-4288-930b-3648e4064454 None None] Authenticating user token {{(pid=108009) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:19:18.638083 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15374cd-e114-4288-930b-3648e4064454 None None] Validating token access rules against request {{(pid=108009) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:19:18.642738 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7660ca29-c033-4e68-ab32-cd932d6f4acf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '598e27ffd54748f6aadb3d7cab5a4ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccd95a48530c4c86a3774301b969d6a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108009) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:19:18.643507 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660ca29-c033-4e68-ab32-cd932d6f4acf service glance] REQUEST_METHOD: `GET` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:19:18.643791 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660ca29-c033-4e68-ab32-cd932d6f4acf service glance] SCRIPT_NAME: `/identity` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:19:18.644068 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660ca29-c033-4e68-ab32-cd932d6f4acf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=108009) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:19:18.660140 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7660ca29-c033-4e68-ab32-cd932d6f4acf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:19:18.660140 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7660ca29-c033-4e68-ab32-cd932d6f4acf service glance] RBAC: Authorization granted {{(pid=108009) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:19:18.667137 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: [pid: 108009|app: 0|req: 715/1402] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:19:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:19:28.649215 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: DEBUG dbcounter [-] [108008] Writing DB stats keystone:SELECT=7 {{(pid=108008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:19:28.661988 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: DEBUG dbcounter [-] [108009] Writing DB stats keystone:SELECT=63 {{(pid=108009) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:19:40.938891 dv-cinder-847335-3-iscsi systemd[1]: Stopping Devstack devstack@keystone.service... Jul 05 21:19:40.939104 dv-cinder-847335-3-iscsi devstack@keystone.service[107993]: Tue Jul 5 21:19:40 2022 - graceful shutdown triggered... Jul 05 21:19:40.939638 dv-cinder-847335-3-iscsi devstack@keystone.service[108008]: Gracefully killing worker 1 (pid: 108008)... Jul 05 21:19:40.940045 dv-cinder-847335-3-iscsi devstack@keystone.service[108009]: Gracefully killing worker 2 (pid: 108009)... Jul 05 21:19:41.940725 dv-cinder-847335-3-iscsi devstack@keystone.service[107993]: worker 1 buried after 1 seconds Jul 05 21:19:41.940725 dv-cinder-847335-3-iscsi devstack@keystone.service[107993]: worker 2 buried after 1 seconds Jul 05 21:19:41.940725 dv-cinder-847335-3-iscsi devstack@keystone.service[107993]: goodbye to uWSGI. Jul 05 21:19:41.942467 dv-cinder-847335-3-iscsi systemd[1]: devstack@keystone.service: Succeeded. Jul 05 21:19:41.943008 dv-cinder-847335-3-iscsi systemd[1]: Stopped Devstack devstack@keystone.service. Jul 05 21:25:04.288407 dv-cinder-847335-3-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jul 05 21:25:04.298534 dv-cinder-847335-3-iscsi devstack@keystone.service[172843]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 05 21:25:04.300502 dv-cinder-847335-3-iscsi devstack@keystone.service[172843]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 5 21:25:04 2022] *** Jul 05 21:25:04.300502 dv-cinder-847335-3-iscsi devstack@keystone.service[172843]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 05 21:25:04.300502 dv-cinder-847335-3-iscsi devstack@keystone.service[172843]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 05 21:25:04.300502 dv-cinder-847335-3-iscsi devstack@keystone.service[172843]: nodename: dv-cinder-847335-3-iscsi Jul 05 21:25:04.300502 dv-cinder-847335-3-iscsi devstack@keystone.service[172843]: machine: x86_64 Jul 05 21:25:04.300502 dv-cinder-847335-3-iscsi devstack@keystone.service[172843]: clock source: unix Jul 05 21:25:04.300502 dv-cinder-847335-3-iscsi devstack@keystone.service[172843]: pcre jit disabled Jul 05 21:25:04.300502 dv-cinder-847335-3-iscsi devstack@keystone.service[172843]: detected number of CPU cores: 4 Jul 05 21:25:04.300502 dv-cinder-847335-3-iscsi devstack@keystone.service[172843]: current working directory: / Jul 05 21:25:04.300502 dv-cinder-847335-3-iscsi devstack@keystone.service[172843]: detected binary path: /usr/bin/uwsgi-core Jul 05 21:25:04.301270 dv-cinder-847335-3-iscsi devstack@keystone.service[172843]: your processes number limit is 47680 Jul 05 21:25:04.301270 dv-cinder-847335-3-iscsi devstack@keystone.service[172843]: your memory page size is 4096 bytes Jul 05 21:25:04.301270 dv-cinder-847335-3-iscsi devstack@keystone.service[172843]: detected max file descriptor number: 2048 Jul 05 21:25:04.301270 dv-cinder-847335-3-iscsi devstack@keystone.service[172843]: lock engine: pthread robust mutexes Jul 05 21:25:04.301270 dv-cinder-847335-3-iscsi devstack@keystone.service[172843]: thunder lock: enabled Jul 05 21:25:04.301270 dv-cinder-847335-3-iscsi devstack@keystone.service[172843]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 05 21:25:04.301270 dv-cinder-847335-3-iscsi devstack@keystone.service[172843]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 05 21:25:04.346559 dv-cinder-847335-3-iscsi devstack@keystone.service[172843]: Python main interpreter initialized at 0x55f06e7af9c0 Jul 05 21:25:04.346559 dv-cinder-847335-3-iscsi devstack@keystone.service[172843]: python threads support enabled Jul 05 21:25:04.346559 dv-cinder-847335-3-iscsi devstack@keystone.service[172843]: your server socket listen backlog is limited to 100 connections Jul 05 21:25:04.346559 dv-cinder-847335-3-iscsi devstack@keystone.service[172843]: your mercy for graceful operations on workers is 90 seconds Jul 05 21:25:04.347100 dv-cinder-847335-3-iscsi devstack@keystone.service[172843]: mapped 403077 bytes (393 KB) for 2 cores Jul 05 21:25:04.347260 dv-cinder-847335-3-iscsi devstack@keystone.service[172843]: *** Operational MODE: preforking *** Jul 05 21:25:04.347698 dv-cinder-847335-3-iscsi devstack@keystone.service[172843]: *** uWSGI is running in multiple interpreter mode *** Jul 05 21:25:04.347698 dv-cinder-847335-3-iscsi devstack@keystone.service[172843]: spawned uWSGI master process (pid: 172843) Jul 05 21:25:04.347915 dv-cinder-847335-3-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jul 05 21:25:04.353266 dv-cinder-847335-3-iscsi devstack@keystone.service[172843]: spawned uWSGI worker 1 (pid: 172889, cores: 1) Jul 05 21:25:04.353266 dv-cinder-847335-3-iscsi devstack@keystone.service[172843]: spawned uWSGI worker 2 (pid: 172890, cores: 1) Jul 05 21:25:04.353266 dv-cinder-847335-3-iscsi devstack@keystone.service[172843]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 05 21:25:09.910447 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 21:25:09.910447 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: from cryptography.utils import int_from_bytes Jul 05 21:25:09.911320 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 21:25:09.911320 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: from cryptography.utils import int_from_bytes Jul 05 21:25:09.925052 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 21:25:09.925052 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: from cryptography.utils import int_from_bytes Jul 05 21:25:09.925582 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 21:25:09.925582 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: from cryptography.utils import int_from_bytes Jul 05 21:25:09.961269 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 05 21:25:09.961491 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 05 21:25:09.961690 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] command line args: [] {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 05 21:25:09.961969 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 05 21:25:09.962172 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ================================================================================ {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 05 21:25:09.962439 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] admin_token = **** {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.962693 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] config_dir = [] {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.962886 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.963074 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] config_source = [] {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.963260 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] debug = True {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.963467 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.964626 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.964626 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] insecure_debug = False {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.964626 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.964626 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.965092 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] list_limit = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.965092 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] log_config_append = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.965092 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.965360 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] log_dir = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.965450 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] log_file = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.965639 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.965894 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.966158 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.966415 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.966599 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.966782 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.967030 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.967281 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.967521 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.967759 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.967996 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.968234 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.968486 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.968741 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] notification_format = cadf {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.969020 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.969519 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.30/identity {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.969711 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] publish_errors = False {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.969953 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.970222 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.970409 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.970664 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.970906 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.971146 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] standard_threads = False {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.971382 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] strict_password_check = False {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.971629 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.971810 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] use_eventlog = False {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.971991 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] use_journal = False {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.972171 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] use_json = False {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.972350 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] use_stderr = False {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.972530 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] use_syslog = False {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.972766 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] watch_log_file = False {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.972950 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 05 21:25:09.973061 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.973153 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 05 21:25:09.973261 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.973364 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] command line args: [] {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 05 21:25:09.973533 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.973651 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 05 21:25:09.973766 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ================================================================================ {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 05 21:25:09.973875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.974018 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.974248 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] admin_token = **** {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.974344 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.974447 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] config_dir = [] {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.974447 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.975283 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] config_source = [] {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.975379 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.975478 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] debug = True {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.975578 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.975682 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.975796 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.975888 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.975981 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.976066 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] insecure_debug = False {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.976148 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.976284 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.976383 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.976536 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.976644 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.976771 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] list_limit = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.976869 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.976967 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] log_config_append = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.977092 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.977191 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.977276 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] log_dir = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.977370 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.977462 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] log_file = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.977556 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.977674 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.977814 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.977931 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.978074 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.978224 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.978352 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.978452 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.978585 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.978702 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.978799 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.978897 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.978988 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.979200 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.979298 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.979449 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.979541 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.979683 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.979776 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.979919 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.980012 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.980153 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.980264 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.980394 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.980484 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.980636 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] notification_format = cadf {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.980742 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.980889 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.980987 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.981145 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.981385 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.981482 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.30/identity {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.981577 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] publish_errors = False {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.981673 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.981792 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.981891 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.982026 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.982159 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.982257 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.982362 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.982479 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.982598 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.982715 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.982823 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.982952 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] standard_threads = False {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.983066 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.983183 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] strict_password_check = False {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.983324 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.983430 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.983529 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.983631 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] use_eventlog = False {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.983755 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.983855 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] use_journal = False {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.983946 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] use_json = False {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.984038 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.984135 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] use_stderr = False {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.984220 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.984320 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] use_syslog = False {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.984442 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.984557 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] watch_log_file = False {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:25:09.984700 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.984801 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.984937 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.985040 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.985181 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.985284 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.985417 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.985519 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.985660 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.985770 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.985898 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.985998 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.986171 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.986282 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.986414 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.986506 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.986658 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.986758 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.986902 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.987008 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.987144 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.987243 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.987376 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.987473 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.987613 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.987722 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.987851 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.987950 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.988097 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.988188 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.988336 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.988437 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.988572 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.988670 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.988807 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.988913 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.989070 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.989168 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.989316 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.989412 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.989552 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.989650 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.989790 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.989892 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.990033 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.990150 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.990364 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.990464 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.990617 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.990716 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.990855 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.990957 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.991091 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.991201 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.991324 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.991435 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.991564 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.991669 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.991814 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.991933 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.992064 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.992166 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] cache.enabled = True {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.992299 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.992400 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.992533 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.992633 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.992781 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.992912 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.993030 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.993131 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.993269 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.993359 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.993512 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.993617 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.993742 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.993843 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.993978 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.994081 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.994236 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.994347 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.994471 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.994583 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.994706 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.994798 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.994938 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.995045 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.995175 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.995287 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.995416 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.995513 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.995658 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.995768 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.995888 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.996071 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.996166 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.996255 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.996345 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.996430 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.996570 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.996670 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.996807 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.996911 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.997039 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.997145 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.997273 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.997372 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.997510 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.997601 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.997744 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.997834 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.997981 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.998091 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.998243 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.998350 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.998482 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.998615 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.998708 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.998802 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.998951 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.999043 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] auth.external = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.999186 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] auth.mapped = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.999291 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.999421 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.999536 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.999657 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.999749 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:09.999918 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.000018 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] auth.password = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.000155 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] auth.token = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.000246 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.000384 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.000474 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.000623 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] catalog.caching = True {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.000721 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.000858 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.000956 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.001095 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.001200 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.001347 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.001439 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.001594 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.001699 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.001827 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.001932 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.002068 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] credential.caching = True {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.002240 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.002330 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] credential.driver = sql {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.002413 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.002586 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.002689 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.002843 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.002941 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] cache.enabled = True {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.003088 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.003181 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.003323 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.003432 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.003571 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.003684 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.003811 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.003903 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.004050 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.004151 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.004288 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.004381 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.004524 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.004617 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.004761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.004862 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.005023 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.005148 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.005272 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.005379 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.005516 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.005621 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.006280 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.006396 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.006534 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.006678 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] federation.caching = True {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.006771 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.006994 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.007095 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.007229 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.007341 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] federation.driver = sql {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.007448 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.007544 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.007683 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.007789 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.007960 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.008052 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.008148 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.008244 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.008357 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.008462 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.008598 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.008691 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.008837 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.008941 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.009087 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.009188 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.009326 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.009424 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.009582 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.009674 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] identity.caching = True {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.009836 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.009936 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.010075 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.010201 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.010336 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] auth.external = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.010436 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.010571 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] auth.mapped = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.010674 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.010833 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] identity.driver = sql {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.010930 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.011072 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.011164 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.011311 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] auth.password = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.011465 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.011562 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] auth.token = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.011658 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.011774 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.011867 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.012013 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] catalog.caching = True {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.012118 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.012246 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.012344 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.012481 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.012573 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.012729 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.012836 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.012976 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.013073 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.013211 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.013316 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.013448 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] credential.caching = True {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.013569 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.013699 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] credential.driver = sql {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.013792 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.013950 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.014049 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.014222 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.014329 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.014461 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.014552 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.014703 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.014795 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.014937 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.015045 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.015170 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.015274 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.015409 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.015509 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.015675 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.015804 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.015917 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.016011 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.016140 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.016243 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.016376 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.016469 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.016629 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.016733 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.016880 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.016972 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.017143 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.017231 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.017357 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.017457 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] federation.caching = True {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.017595 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.017688 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.017838 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.017936 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] federation.driver = sql {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.018081 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.018256 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.018351 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ldap.password = **** {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.018435 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.018566 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.018660 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.018804 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.018896 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.019047 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.019138 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.019285 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.019376 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.019528 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.019618 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.019767 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.019857 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.020016 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.020125 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.020249 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.020353 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] identity.caching = True {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.020487 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.020579 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.020732 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.020823 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.020972 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.021064 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.021208 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.021307 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.022172 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] identity.driver = sql {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.022288 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.022420 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.022513 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.022665 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.022756 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ldap.user = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.022920 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.023013 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.023177 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.023269 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.023414 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.023507 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.023650 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.023756 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.023887 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.023991 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.024136 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.024239 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.024375 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.024466 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.024612 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.024705 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.024855 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.024953 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.025096 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.025188 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.025337 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.025436 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.025573 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.025675 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.025824 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.025922 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.026060 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.026174 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.026325 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.026443 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.026563 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.026662 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.026802 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.026895 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.027038 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.027137 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.027280 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.027372 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.027518 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.027616 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.027751 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.027854 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.027989 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.028080 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.028229 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.028322 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.028488 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.028647 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.028746 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.028835 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.028967 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.029073 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.029226 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] policy.driver = sql {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.029334 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.029462 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.029562 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.029710 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.029826 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ldap.password = **** {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.029947 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.030047 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.030215 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] receipt.caching = True {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.030303 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.030450 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.030557 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.030691 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.030792 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.030932 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.031034 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.031165 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.031269 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.031406 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.031516 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.031642 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.031733 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] resource.caching = True {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.031879 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.031971 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.032130 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.032232 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] resource.driver = sql {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.032374 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.032464 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.032609 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.032699 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.032847 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.032948 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.033086 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.033177 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] revoke.caching = True {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.033320 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ldap.user = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.033422 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.033558 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.033666 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.033802 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] role.cache_time = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.033894 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.034035 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.034142 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] role.caching = True {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.034309 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.034418 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] role.driver = sql {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.034558 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.034657 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] role.list_limit = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.034806 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.034906 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.035043 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.035153 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.035276 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.035369 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.035518 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.035610 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.035756 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.035858 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.035995 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.036089 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.036226 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.036325 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.036474 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.036575 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.036714 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.036813 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.036957 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.037079 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.037223 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.037334 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.037473 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.037610 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.037718 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.037806 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.037951 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.038110 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.038226 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.038375 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.038478 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.038632 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.038746 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.038887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.038993 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.039133 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.039237 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.039381 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.039488 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.039617 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.039710 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.039872 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.039964 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] policy.driver = sql {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.040103 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.040203 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.040351 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.040459 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.040583 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.040675 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.040818 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] receipt.caching = True {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.040991 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.041081 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.041165 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.041293 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.041385 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.041537 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.041644 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.041772 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.041867 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.042010 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.042103 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.042271 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.042375 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] resource.caching = True {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.042508 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] token.cache_time = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.042601 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.042748 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] token.caching = True {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.042854 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] resource.driver = sql {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.042984 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.043090 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.043234 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] token.provider = fernet {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.043333 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.043475 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.043577 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.043709 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] revoke.caching = True {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.043809 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.043972 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.044060 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.044182 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.044282 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.044423 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] role.cache_time = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.044536 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.044662 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] role.caching = True {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.044778 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.044911 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] role.driver = sql {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.045005 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] trust.driver = sql {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.045145 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] role.list_limit = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.045268 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.045386 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.045490 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.045628 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.045738 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.045877 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.045983 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.046142 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.046237 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.046383 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.046489 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.046631 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.046723 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.046881 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.046973 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.047132 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.047231 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] database.connection = **** {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.047367 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.047470 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.047616 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.047709 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.047866 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.047968 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.048108 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.048215 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.048345 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.048447 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.048583 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.048737 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.048830 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.048979 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.049077 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.049232 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.049335 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.049485 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.049586 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.049734 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.049839 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.049974 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.050078 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.050236 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.050338 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.050476 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.050567 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.050724 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.050825 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.050961 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.051054 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.051190 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.051282 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.051424 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.051528 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.051615 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=172889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 05 21:25:10.051699 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.051899 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.052154 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.052404 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.052697 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.053101 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.053347 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] token.cache_time = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.053590 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] token.caching = True {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.053832 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.054085 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] token.provider = fernet {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.054351 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.054610 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.054861 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.055102 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.055350 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.055602 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.055852 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] trust.driver = sql {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.056092 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.056334 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.056571 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.056819 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.057071 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.057303 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.057547 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.057844 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.058106 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] database.connection = **** {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.058381 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.058633 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.058875 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.059119 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.059359 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.059598 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.059836 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.060074 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.060321 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.060560 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.060807 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.061046 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.061295 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.061533 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.061781 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.062016 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.062283 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.062524 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:25:10.062697 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=172890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 05 21:25:10.082757 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=172889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.082995 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=172889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.083226 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=172889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.087957 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=172890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.088193 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=172890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.088425 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=172890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.091994 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=172889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.096717 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=172890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.121239 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=172889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.121475 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=172889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.123938 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=172890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.124176 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=172890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.250525 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=172890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.264486 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=172889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.300217 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=172890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.300454 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=172890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.305119 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=172889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.305355 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=172889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.365888 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=172889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.366272 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=172889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.366393 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=172889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.366568 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=172890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.366693 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=172889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.366802 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=172890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.366903 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=172889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.366991 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=172890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.367090 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=172889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.367177 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=172890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.367402 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=172890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.367618 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=172890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.390262 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=172890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.390491 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=172890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.390610 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=172889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.390724 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=172890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.390819 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=172889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.390999 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=172890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.391088 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=172889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.391180 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=172890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.391281 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=172889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.391368 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=172890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.391466 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=172889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.391565 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=172890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.391659 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=172889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.391801 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=172889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.403089 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=172890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.403584 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=172889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.416089 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=172890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.416325 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=172890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.416472 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=172889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.416569 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=172890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.416711 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=172889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.416825 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=172890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.416938 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=172889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.417032 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=172890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.417160 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=172889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.417267 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=172890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.417363 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=172890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.417456 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=172889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.417580 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=172889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.417796 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=172889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:25:10.434713 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.434924 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 05 21:25:10.435031 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.435217 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 05 21:25:10.435313 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.435451 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 05 21:25:10.435548 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.435720 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.435834 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 05 21:25:10.435982 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.436092 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.436240 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.436347 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.436496 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.436600 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.436750 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.447667 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.447861 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.447971 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.448145 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.448266 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.448410 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.448506 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.448686 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.457001 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=172889) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:25:10.457107 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=172890) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:25:10.460888 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=172889) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:25:10.461172 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.461451 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=172890) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:25:10.461547 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.461733 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.461832 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.462011 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.462111 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.462295 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.462433 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.462554 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.462717 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.462810 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.462978 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.463073 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.463246 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.463339 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.463517 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.463625 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.463788 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.464059 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.464466 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.490750 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.492037 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.492366 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=172889) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:25:10.492649 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.493651 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=172890) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:25:10.493936 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.497953 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=172889) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:25:10.498261 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.498660 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.499224 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=172890) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:25:10.499504 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.499782 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.506071 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=172889) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:25:10.506336 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.507218 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=172890) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:25:10.507503 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.510848 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=172889) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:25:10.511179 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.511421 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.511706 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.511986 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.512177 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=172890) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:25:10.512277 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.512468 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.512562 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.512750 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.512858 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.513031 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.513305 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.513580 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.513848 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.514114 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.532061 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.532340 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.533331 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.533620 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.536917 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=172889) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:25:10.538438 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=172890) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:25:10.540646 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.540943 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.542190 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.542490 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.546106 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=172889) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:25:10.547526 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=172890) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:25:10.549757 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=172889) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:25:10.551149 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=172890) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:25:10.553984 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.554303 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.554603 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.554912 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.555195 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.555478 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.556914 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.557217 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.557507 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.557794 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.558081 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.558385 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.575584 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=172889) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:25:10.575875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.576146 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.576408 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.578182 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=172890) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:25:10.578566 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.578839 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.579104 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.585042 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.586792 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.587073 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.587181 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.588782 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.589061 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.590336 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=172889) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:25:10.590618 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.590899 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.591180 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.591474 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.592149 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=172890) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:25:10.592432 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.592716 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.593006 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.593295 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.605202 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=172889) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:25:10.605483 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.605767 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.606058 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.606366 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.606782 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=172890) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:25:10.607060 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.607340 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.607617 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.607895 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.608032 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.608170 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.608326 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.608514 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.626966 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=172889) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:25:10.627203 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=172890) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:25:10.630290 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=172889) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:25:10.630491 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=172890) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:25:10.634376 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.634510 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.636131 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.636223 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.637773 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=172890) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:25:10.637866 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=172889) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:25:10.638054 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.638187 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.638357 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.638448 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.645652 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.645760 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.647457 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=172889) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:25:10.647558 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=172890) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:25:10.650712 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.650808 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.651017 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.651121 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.651308 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.651482 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.651574 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.651765 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.660780 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=172890) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:25:10.660943 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=172889) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:25:10.661070 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.661232 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.661358 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.661524 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.669459 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=172889) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:25:10.669630 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=172890) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:25:10.669744 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.669911 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.670003 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.670213 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.670310 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.670491 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.670585 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.670765 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.670921 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.671039 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.671209 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.671355 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.671494 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.671610 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.671772 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.671863 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.672055 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.672147 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.672336 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.672440 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.672604 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.672696 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.672865 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.672954 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.673139 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=172890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.673240 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=172889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:25:10.712432 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f06e7af9c0 pid: 172890 (default app) Jul 05 21:25:10.713014 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f06e7af9c0 pid: 172889 (default app) Jul 05 21:25:10.715852 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d0af4-d9c5-4dfd-837d-d84a385a104a None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:10.716150 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d0af4-d9c5-4dfd-837d-d84a385a104a None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:10.716434 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d0af4-d9c5-4dfd-837d-d84a385a104a None None] PATH_INFO: `/v3` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:10.720623 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 791 bytes} [Tue Jul 5 21:25:10 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:19.174302 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2033b-512a-4ddb-b574-f2249abae04f None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:19.174847 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2033b-512a-4ddb-b574-f2249abae04f None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:19.174968 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2033b-512a-4ddb-b574-f2249abae04f None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:19.179187 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 1/2] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:25:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:25:19.185089 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec967663-2fb0-4a55-9b00-18b67132eb21 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:19.185506 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec967663-2fb0-4a55-9b00-18b67132eb21 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:19.185655 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec967663-2fb0-4a55-9b00-18b67132eb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:19.256041 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: INFO dbcounter [None req-ec967663-2fb0-4a55-9b00-18b67132eb21 None None] Registered counter for database keystone Jul 05 21:25:19.277662 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG oslo_db.sqlalchemy.engines [None req-ec967663-2fb0-4a55-9b00-18b67132eb21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=172890) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 21:25:19.284145 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writer thread running {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 21:25:19.467557 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG passlib.handlers.bcrypt [None req-ec967663-2fb0-4a55-9b00-18b67132eb21 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=172890) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 05 21:25:19.467990 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG passlib.handlers.bcrypt [None req-ec967663-2fb0-4a55-9b00-18b67132eb21 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=172890) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 05 21:25:19.522643 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-ec967663-2fb0-4a55-9b00-18b67132eb21 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:25:19.524787 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-ec967663-2fb0-4a55-9b00-18b67132eb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:25:19.652719 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 2/3] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:25:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 05 21:25:19.711959 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f2033b-512a-4ddb-b574-f2249abae04f None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:19.783449 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: INFO dbcounter [None req-56f2033b-512a-4ddb-b574-f2249abae04f None None] Registered counter for database keystone Jul 05 21:25:19.802855 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG oslo_db.sqlalchemy.engines [None req-56f2033b-512a-4ddb-b574-f2249abae04f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=172889) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 21:25:19.809225 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writer thread running {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 21:25:19.929151 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f2033b-512a-4ddb-b574-f2249abae04f None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:19.933569 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0250f8b-e6bd-4b46-9708-1939082dfeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9675d05c7a01416aae7c5c400d679f19', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:19.934273 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0250f8b-e6bd-4b46-9708-1939082dfeee admin admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:19.934573 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0250f8b-e6bd-4b46-9708-1939082dfeee admin admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:19.934861 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0250f8b-e6bd-4b46-9708-1939082dfeee admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:19.943059 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0250f8b-e6bd-4b46-9708-1939082dfeee admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:19.995354 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a0250f8b-e6bd-4b46-9708-1939082dfeee admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 05 21:25:19.995709 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0250f8b-e6bd-4b46-9708-1939082dfeee admin admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:20.005363 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 2/4] 10.222.0.30 () {58 vars in 1324 bytes} [Tue Jul 5 21:25:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 21:25:20.012067 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec967663-2fb0-4a55-9b00-18b67132eb21 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:20.027933 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec967663-2fb0-4a55-9b00-18b67132eb21 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:20.032513 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae5f5df-832b-4855-9ff2-1e499b67039c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9675d05c7a01416aae7c5c400d679f19', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:20.033695 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5f5df-832b-4855-9ff2-1e499b67039c admin admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:20.033945 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5f5df-832b-4855-9ff2-1e499b67039c admin admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:20.034262 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5f5df-832b-4855-9ff2-1e499b67039c admin admin] PATH_INFO: `/v3/projects/9675d05c7a01416aae7c5c400d679f19` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:20.035789 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae5f5df-832b-4855-9ff2-1e499b67039c admin admin] RBAC: Authorizing `identity:get_project(project_id=9675d05c7a01416aae7c5c400d679f19)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:20.091468 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0ae5f5df-832b-4855-9ff2-1e499b67039c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 05 21:25:20.091824 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae5f5df-832b-4855-9ff2-1e499b67039c admin admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:20.096717 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 3/5] 10.222.0.30 () {56 vars in 1207 bytes} [Tue Jul 5 21:25:20 2022] GET /identity/v3/projects/9675d05c7a01416aae7c5c400d679f19 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:22.104147 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ab8fb-fb9b-475d-ba2d-91b443da58ff None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:22.104721 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ab8fb-fb9b-475d-ba2d-91b443da58ff None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:22.104721 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ab8fb-fb9b-475d-ba2d-91b443da58ff None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:22.108818 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 3/6] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:25:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:25:22.114283 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424cbe6-a083-471c-bd7e-e9399b37a903 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:22.114721 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424cbe6-a083-471c-bd7e-e9399b37a903 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:22.114857 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424cbe6-a083-471c-bd7e-e9399b37a903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:22.135322 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-4424cbe6-a083-471c-bd7e-e9399b37a903 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:25:22.136847 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-4424cbe6-a083-471c-bd7e-e9399b37a903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:25:22.144713 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 4/7] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:25:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 05 21:25:22.167290 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ab8fb-fb9b-475d-ba2d-91b443da58ff None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:22.179421 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ab8fb-fb9b-475d-ba2d-91b443da58ff None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:22.184165 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad60b2-70a4-448c-9ed4-443af84a0a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9675d05c7a01416aae7c5c400d679f19', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:22.184806 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad60b2-70a4-448c-9ed4-443af84a0a5d admin admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:22.185101 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad60b2-70a4-448c-9ed4-443af84a0a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:22.185383 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad60b2-70a4-448c-9ed4-443af84a0a5d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:22.193195 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ad60b2-70a4-448c-9ed4-443af84a0a5d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:22.195046 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ad60b2-70a4-448c-9ed4-443af84a0a5d admin admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:22.206045 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 4/8] 10.222.0.30 () {58 vars in 1324 bytes} [Tue Jul 5 21:25:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 21:25:22.212365 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424cbe6-a083-471c-bd7e-e9399b37a903 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:22.221528 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424cbe6-a083-471c-bd7e-e9399b37a903 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:22.226014 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25cb2d-6d73-4c27-9290-64f024a3eb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9675d05c7a01416aae7c5c400d679f19', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:22.227034 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25cb2d-6d73-4c27-9290-64f024a3eb28 admin admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:22.227323 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25cb2d-6d73-4c27-9290-64f024a3eb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:22.227605 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25cb2d-6d73-4c27-9290-64f024a3eb28 admin admin] PATH_INFO: `/v3/users/8f7b68cdb43a4c0b96cd3cbfc39bee35` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:22.229019 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd25cb2d-6d73-4c27-9290-64f024a3eb28 admin admin] RBAC: Authorizing `identity:get_user(user_id=8f7b68cdb43a4c0b96cd3cbfc39bee35)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:22.230900 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd25cb2d-6d73-4c27-9290-64f024a3eb28 admin admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:22.232470 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 5/9] 10.222.0.30 () {56 vars in 1198 bytes} [Tue Jul 5 21:25:22 2022] GET /identity/v3/users/8f7b68cdb43a4c0b96cd3cbfc39bee35 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:24.347402 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d449f11-bf67-45a1-849c-e1f64efe65e2 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:24.347969 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d449f11-bf67-45a1-849c-e1f64efe65e2 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:24.347969 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d449f11-bf67-45a1-849c-e1f64efe65e2 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:24.349371 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 5/10] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:25:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:25:24.355241 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77747c44-4777-438d-bcec-736e279573c1 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:24.355797 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77747c44-4777-438d-bcec-736e279573c1 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:24.355906 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77747c44-4777-438d-bcec-736e279573c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:24.359676 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbb040-fd92-40b2-a8b4-68f210ac6d35 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:24.359976 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbb040-fd92-40b2-a8b4-68f210ac6d35 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:24.360261 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbb040-fd92-40b2-a8b4-68f210ac6d35 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:24.361545 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 6/11] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:25:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:25:24.366480 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878774c9-2178-484a-abb2-ce77bceb9b93 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:24.366771 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878774c9-2178-484a-abb2-ce77bceb9b93 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:24.367077 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878774c9-2178-484a-abb2-ce77bceb9b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:24.373716 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-77747c44-4777-438d-bcec-736e279573c1 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:25:24.374943 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-77747c44-4777-438d-bcec-736e279573c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:25:24.406954 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG passlib.handlers.bcrypt [None req-878774c9-2178-484a-abb2-ce77bceb9b93 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=172889) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 05 21:25:24.407383 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG passlib.handlers.bcrypt [None req-878774c9-2178-484a-abb2-ce77bceb9b93 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=172889) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 05 21:25:24.453983 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-878774c9-2178-484a-abb2-ce77bceb9b93 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:25:24.455635 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-878774c9-2178-484a-abb2-ce77bceb9b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:25:24.458933 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 6/12] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:25:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:25:24.483872 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77747c44-4777-438d-bcec-736e279573c1 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:24.507799 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:24.558757 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 7/13] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:25:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:25:24.581328 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878774c9-2178-484a-abb2-ce77bceb9b93 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:24.591706 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77747c44-4777-438d-bcec-736e279573c1 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:24.626474 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15ad02-45a9-4c66-a90d-be754c933989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:24.627202 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15ad02-45a9-4c66-a90d-be754c933989 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:24.627496 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15ad02-45a9-4c66-a90d-be754c933989 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:24.627805 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15ad02-45a9-4c66-a90d-be754c933989 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:24.639263 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd15ad02-45a9-4c66-a90d-be754c933989 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:25:24.651046 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-cd15ad02-45a9-4c66-a90d-be754c933989 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:25:24.651046 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:25:24.651046 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:25:24.651046 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:25:24.651046 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:25:24.651046 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:25:24.651046 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:25:24.651046 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:25:24.651046 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:25:24.651046 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:25:24.651046 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:25:24.651046 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:25:24.651046 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:25:24.651046 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:25:24.651046 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:25:24.651046 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:25:24.652170 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:25:24.652170 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:25:24.652170 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:25:24.652170 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:25:24.652170 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:25:24.652170 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:25:24.652170 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:25:24.652170 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:25:24.652170 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:25:24.652170 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:25:24.652170 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:25:24.652170 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:25:24.652170 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:25:24.652170 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:25:24.652170 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:25:24.652170 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:25:24.653149 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:25:24.653149 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:25:24.653149 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:25:24.653149 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:25:24.653149 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:25:24.653149 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:25:24.653149 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:25:24.653149 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:25:24.653149 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:25:24.653149 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:25:24.653149 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:25:24.653149 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:25:24.653149 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 7/14] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:25:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:25:24.658250 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15ad02-45a9-4c66-a90d-be754c933989 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:24.686542 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878774c9-2178-484a-abb2-ce77bceb9b93 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:24.688865 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:24.724326 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebaeeee-4987-44a3-b935-2d44b3c42604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:24.725300 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebaeeee-4987-44a3-b935-2d44b3c42604 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:24.725621 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebaeeee-4987-44a3-b935-2d44b3c42604 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:24.725913 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebaeeee-4987-44a3-b935-2d44b3c42604 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:24.741483 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:24.761054 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15ad02-45a9-4c66-a90d-be754c933989 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:24.795627 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebaeeee-4987-44a3-b935-2d44b3c42604 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:24.795825 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcec415-deab-45fe-9f7c-44cb52f580e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:24.796464 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcec415-deab-45fe-9f7c-44cb52f580e5 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:24.796755 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcec415-deab-45fe-9f7c-44cb52f580e5 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:24.797036 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcec415-deab-45fe-9f7c-44cb52f580e5 None admin] PATH_INFO: `/v3/roles` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:24.797221 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebaeeee-4987-44a3-b935-2d44b3c42604 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:24.797790 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcec415-deab-45fe-9f7c-44cb52f580e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:25:24.798100 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcec415-deab-45fe-9f7c-44cb52f580e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:24.799531 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcec415-deab-45fe-9f7c-44cb52f580e5 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:24.811666 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 8/15] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:25:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:25:24.817162 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcec415-deab-45fe-9f7c-44cb52f580e5 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:24.896432 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 8/16] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:25:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 21:25:24.902651 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebaeeee-4987-44a3-b935-2d44b3c42604 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:24.905981 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:24.918303 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcec415-deab-45fe-9f7c-44cb52f580e5 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:24.953955 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529b5ac-6fea-48e5-a584-aaa375db8879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:24.954869 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529b5ac-6fea-48e5-a584-aaa375db8879 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:24.955154 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529b5ac-6fea-48e5-a584-aaa375db8879 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:24.955437 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529b5ac-6fea-48e5-a584-aaa375db8879 None admin] PATH_INFO: `/v3/users/8f7b68cdb43a4c0b96cd3cbfc39bee35` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:24.956659 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529b5ac-6fea-48e5-a584-aaa375db8879 None admin] RBAC: Authorizing `identity:get_user(user_id=8f7b68cdb43a4c0b96cd3cbfc39bee35)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:24.958136 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529b5ac-6fea-48e5-a584-aaa375db8879 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:24.959763 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 9/17] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:25:24 2022] GET /identity/v3/users/8f7b68cdb43a4c0b96cd3cbfc39bee35 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:25:24.965166 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529b5ac-6fea-48e5-a584-aaa375db8879 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:24.979632 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:25.002789 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebaeeee-4987-44a3-b935-2d44b3c42604 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:25.038645 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba6822-dfa9-4b42-b400-d6ec85c26b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:25.039665 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba6822-dfa9-4b42-b400-d6ec85c26b63 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:25.039960 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba6822-dfa9-4b42-b400-d6ec85c26b63 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:25.040250 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba6822-dfa9-4b42-b400-d6ec85c26b63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:25.058798 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ba6822-dfa9-4b42-b400-d6ec85c26b63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:25.060285 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ba6822-dfa9-4b42-b400-d6ec85c26b63 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:25.063088 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529b5ac-6fea-48e5-a584-aaa375db8879 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:25.082268 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-62ba6822-dfa9-4b42-b400-d6ec85c26b63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:25:25.082268 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:25:25.082268 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:25:25.082268 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:25:25.082268 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:25:25.082268 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:25:25.082268 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:25:25.082268 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:25:25.082268 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:25:25.082268 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:25:25.082268 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:25:25.082268 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:25:25.082268 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:25:25.082268 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:25:25.082268 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:25:25.083286 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:25:25.083286 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:25:25.083286 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:25:25.083286 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:25:25.083286 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:25:25.083286 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:25:25.083286 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:25:25.083286 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:25:25.083286 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:25:25.083286 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:25:25.083286 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:25:25.083286 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:25:25.083286 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:25:25.083286 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:25:25.083286 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:25:25.083286 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:25:25.083286 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:25:25.084253 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:25:25.084253 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:25:25.084253 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:25:25.084253 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:25:25.084253 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 9/18] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:25:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:25:25.090100 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba6822-dfa9-4b42-b400-d6ec85c26b63 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:25.099541 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97b829-9480-44dc-b4ca-6d2425a6624f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:25.100356 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97b829-9480-44dc-b4ca-6d2425a6624f None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:25.100648 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97b829-9480-44dc-b4ca-6d2425a6624f None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:25.100936 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97b829-9480-44dc-b4ca-6d2425a6624f None admin] PATH_INFO: `/v3/domains/default` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:25.102481 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e97b829-9480-44dc-b4ca-6d2425a6624f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:25.103975 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e97b829-9480-44dc-b4ca-6d2425a6624f None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:25.105599 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 10/19] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:25:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:25:25.111240 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97b829-9480-44dc-b4ca-6d2425a6624f None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:25.146015 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:25.190651 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba6822-dfa9-4b42-b400-d6ec85c26b63 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:25.192216 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:25.212477 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97b829-9480-44dc-b4ca-6d2425a6624f None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:25.224697 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61767b30-4f33-49c3-b5b2-3ebc73f70917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:25.225377 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61767b30-4f33-49c3-b5b2-3ebc73f70917 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:25.225674 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61767b30-4f33-49c3-b5b2-3ebc73f70917 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:25.225983 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61767b30-4f33-49c3-b5b2-3ebc73f70917 None admin] PATH_INFO: `/v3/domains` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:25.227278 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61767b30-4f33-49c3-b5b2-3ebc73f70917 None admin] RBAC: Adding query filter params (name=Default) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:25:25.227599 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61767b30-4f33-49c3-b5b2-3ebc73f70917 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:25.229052 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61767b30-4f33-49c3-b5b2-3ebc73f70917 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:25.246830 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 10/20] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:25:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:25:25.247141 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11327ced-47c1-4629-9dd8-5c17b5d3bd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:25.247867 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11327ced-47c1-4629-9dd8-5c17b5d3bd3f None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:25.248248 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11327ced-47c1-4629-9dd8-5c17b5d3bd3f None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:25.248601 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11327ced-47c1-4629-9dd8-5c17b5d3bd3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:25.249522 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11327ced-47c1-4629-9dd8-5c17b5d3bd3f None admin] RBAC: Adding query filter params (role.id=00090b1962654604b8e106a05d44d06a, scope.domain.id=default, user.id=8f7b68cdb43a4c0b96cd3cbfc39bee35) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:25:25.249918 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11327ced-47c1-4629-9dd8-5c17b5d3bd3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:25.251466 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11327ced-47c1-4629-9dd8-5c17b5d3bd3f None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:25.260016 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 11/21] 10.222.0.30 () {56 vars in 1322 bytes} [Tue Jul 5 21:25:25 2022] GET /identity/v3/role_assignments?user.id=8f7b68cdb43a4c0b96cd3cbfc39bee35&scope.domain.id=default&role.id=00090b1962654604b8e106a05d44d06a => generated 233 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:25:27.558694 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92465a36-10f7-4d4e-b9e5-4c0b97259adf None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:27.590548 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92465a36-10f7-4d4e-b9e5-4c0b97259adf None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:27.590548 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92465a36-10f7-4d4e-b9e5-4c0b97259adf None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:27.590548 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 11/22] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:25:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:25:27.591796 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c13038-70ab-4910-b259-99b5762edc54 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:27.591796 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c13038-70ab-4910-b259-99b5762edc54 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:27.591796 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c13038-70ab-4910-b259-99b5762edc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:27.595486 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-84c13038-70ab-4910-b259-99b5762edc54 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:25:27.596707 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-84c13038-70ab-4910-b259-99b5762edc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:25:27.691304 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 12/23] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:25:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:25:27.736805 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92465a36-10f7-4d4e-b9e5-4c0b97259adf None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:27.784676 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80d49f-38eb-4921-bd0a-282f58898021 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:27.785041 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80d49f-38eb-4921-bd0a-282f58898021 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:27.785229 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80d49f-38eb-4921-bd0a-282f58898021 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:27.786860 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 13/24] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:25:27.792608 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406d197-06ca-4757-b40e-22fb03e16c5c None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:27.792907 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406d197-06ca-4757-b40e-22fb03e16c5c None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:27.793199 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406d197-06ca-4757-b40e-22fb03e16c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:27.819403 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-d406d197-06ca-4757-b40e-22fb03e16c5c None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:25:27.820793 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-d406d197-06ca-4757-b40e-22fb03e16c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:25:27.933319 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92465a36-10f7-4d4e-b9e5-4c0b97259adf None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:27.935748 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 14/25] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:25:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:25:27.969920 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:27.995166 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d406d197-06ca-4757-b40e-22fb03e16c5c None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:27.998417 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:28.002987 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af444f57-2607-4780-b66c-2e95d875c3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:28.004062 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af444f57-2607-4780-b66c-2e95d875c3a0 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:28.004624 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af444f57-2607-4780-b66c-2e95d875c3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:28.005129 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af444f57-2607-4780-b66c-2e95d875c3a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:28.026440 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af444f57-2607-4780-b66c-2e95d875c3a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:25:28.040337 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-af444f57-2607-4780-b66c-2e95d875c3a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:25:28.040337 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:25:28.040337 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:25:28.040337 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:25:28.040337 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:25:28.040337 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:25:28.040337 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:25:28.040337 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:25:28.040337 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:25:28.040337 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:25:28.040337 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:25:28.040337 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:25:28.040337 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:25:28.040337 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:25:28.040337 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:25:28.040337 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:25:28.041494 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:25:28.041494 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:25:28.041494 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:25:28.041494 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:25:28.041494 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:25:28.041494 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:25:28.041494 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:25:28.041494 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:25:28.041494 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:25:28.041494 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:25:28.041494 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:25:28.041494 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:25:28.041494 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:25:28.041494 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:25:28.041494 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:25:28.041494 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:25:28.043268 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:25:28.043268 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:25:28.043268 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:25:28.043268 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:25:28.043268 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:25:28.043268 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:25:28.043268 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:25:28.043268 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:25:28.043268 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:25:28.043268 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:25:28.043268 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:25:28.043268 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:25:28.043268 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 12/26] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:25:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:25:28.050096 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af444f57-2607-4780-b66c-2e95d875c3a0 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:28.176454 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d406d197-06ca-4757-b40e-22fb03e16c5c None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:28.216543 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af444f57-2607-4780-b66c-2e95d875c3a0 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:28.240275 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31840ac1-e845-4412-bbde-4efd1c4cae97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:28.243169 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31840ac1-e845-4412-bbde-4efd1c4cae97 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:28.243169 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31840ac1-e845-4412-bbde-4efd1c4cae97 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:28.243169 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31840ac1-e845-4412-bbde-4efd1c4cae97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:28.264765 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31840ac1-e845-4412-bbde-4efd1c4cae97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:28.266330 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31840ac1-e845-4412-bbde-4efd1c4cae97 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:28.266864 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20e44f-5409-4b73-9d82-dcf1e04f2298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:28.267574 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20e44f-5409-4b73-9d82-dcf1e04f2298 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:28.267871 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20e44f-5409-4b73-9d82-dcf1e04f2298 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:28.268162 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20e44f-5409-4b73-9d82-dcf1e04f2298 None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:28.268954 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c20e44f-5409-4b73-9d82-dcf1e04f2298 None admin] RBAC: Adding query filter params (name=admin) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:25:28.269274 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c20e44f-5409-4b73-9d82-dcf1e04f2298 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:28.270726 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c20e44f-5409-4b73-9d82-dcf1e04f2298 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:28.284531 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 13/27] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:25:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:25:28.290896 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20e44f-5409-4b73-9d82-dcf1e04f2298 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:28.296026 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-31840ac1-e845-4412-bbde-4efd1c4cae97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:25:28.296026 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:25:28.296026 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:25:28.296026 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:25:28.296026 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:25:28.296026 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:25:28.296026 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:25:28.296026 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:25:28.296026 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:25:28.296026 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:25:28.296026 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:25:28.296026 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:25:28.296026 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:25:28.296026 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:25:28.296026 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:25:28.298589 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:25:28.298589 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:25:28.298589 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:25:28.298589 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:25:28.298589 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:25:28.298589 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:25:28.298589 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:25:28.298589 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:25:28.298589 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:25:28.298589 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:25:28.298589 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:25:28.298589 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:25:28.298589 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:25:28.298589 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:25:28.298589 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:25:28.298589 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:25:28.298589 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:25:28.300764 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:25:28.300764 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:25:28.300764 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:25:28.300764 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:25:28.300764 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 15/28] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:25:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:25:28.304259 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31840ac1-e845-4412-bbde-4efd1c4cae97 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:28.343776 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:28.390561 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:28.429527 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20e44f-5409-4b73-9d82-dcf1e04f2298 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:28.488978 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31840ac1-e845-4412-bbde-4efd1c4cae97 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:28.496768 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b9938-3cef-4018-9de7-68ed8c22681f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:28.497670 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b9938-3cef-4018-9de7-68ed8c22681f None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:28.497967 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b9938-3cef-4018-9de7-68ed8c22681f None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:28.498292 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b9938-3cef-4018-9de7-68ed8c22681f None admin] PATH_INFO: `/v3/users/8f7b68cdb43a4c0b96cd3cbfc39bee35` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:28.503233 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72b9938-3cef-4018-9de7-68ed8c22681f None admin] RBAC: Authorizing `identity:get_user(user_id=8f7b68cdb43a4c0b96cd3cbfc39bee35)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:28.504726 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72b9938-3cef-4018-9de7-68ed8c22681f None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:28.506657 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 14/29] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:25:28 2022] GET /identity/v3/users/8f7b68cdb43a4c0b96cd3cbfc39bee35 => generated 247 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:25:28.507638 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b158560-ba56-4625-831f-bf399bfe7f25 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:28.508179 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b158560-ba56-4625-831f-bf399bfe7f25 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:28.508475 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b158560-ba56-4625-831f-bf399bfe7f25 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:28.509900 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 15/30] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:25:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:25:28.513414 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b158560-ba56-4625-831f-bf399bfe7f25 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:28.526918 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a41f2-c462-4135-bca8-f1e4b06e494f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:28.527737 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a41f2-c462-4135-bca8-f1e4b06e494f None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:28.528130 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a41f2-c462-4135-bca8-f1e4b06e494f None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:28.528535 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a41f2-c462-4135-bca8-f1e4b06e494f None admin] PATH_INFO: `/v3/domains` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:28.529381 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a41f2-c462-4135-bca8-f1e4b06e494f None admin] RBAC: Adding query filter params (name=Default) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:25:28.529798 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a41f2-c462-4135-bca8-f1e4b06e494f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:28.531345 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a41f2-c462-4135-bca8-f1e4b06e494f None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:28.568357 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 16/31] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:28.569755 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04dcd5-f8c0-468e-a51d-2936ec08d1a0 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:28.570056 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04dcd5-f8c0-468e-a51d-2936ec08d1a0 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:28.570527 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04dcd5-f8c0-468e-a51d-2936ec08d1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:28.590591 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-ac04dcd5-f8c0-468e-a51d-2936ec08d1a0 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:25:28.591790 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-ac04dcd5-f8c0-468e-a51d-2936ec08d1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:25:28.657321 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b158560-ba56-4625-831f-bf399bfe7f25 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:28.665741 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:28.669559 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 17/32] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:25:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:25:28.670525 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04dcd5-f8c0-468e-a51d-2936ec08d1a0 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:28.696290 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9bbe69-a372-4a9b-bd32-e545deec34cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:28.697526 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9bbe69-a372-4a9b-bd32-e545deec34cd None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:28.698043 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9bbe69-a372-4a9b-bd32-e545deec34cd None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:28.698726 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9bbe69-a372-4a9b-bd32-e545deec34cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:28.700224 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9bbe69-a372-4a9b-bd32-e545deec34cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:28.702274 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9bbe69-a372-4a9b-bd32-e545deec34cd None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:28.704756 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 16/33] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:25:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:28.706816 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d97d5-749f-452c-8872-f23c462fa020 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:28.707814 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d97d5-749f-452c-8872-f23c462fa020 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:28.708578 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d97d5-749f-452c-8872-f23c462fa020 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:28.710279 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 17/34] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:25:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:25:28.712307 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d97d5-749f-452c-8872-f23c462fa020 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:28.734698 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:28.797667 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04dcd5-f8c0-468e-a51d-2936ec08d1a0 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:28.831316 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d97d5-749f-452c-8872-f23c462fa020 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:28.839418 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0a09b-3475-47ba-a676-d7622f3a1bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:28.840109 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0a09b-3475-47ba-a676-d7622f3a1bcc None admin] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:28.840407 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0a09b-3475-47ba-a676-d7622f3a1bcc None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:28.840695 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0a09b-3475-47ba-a676-d7622f3a1bcc None admin] PATH_INFO: `/v3/projects` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:28.841424 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0a09b-3475-47ba-a676-d7622f3a1bcc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:28.842946 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0a09b-3475-47ba-a676-d7622f3a1bcc None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:28.868854 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a4029-91e4-4735-ac20-9609313e41af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:28.869538 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a4029-91e4-4735-ac20-9609313e41af None admin] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:28.869833 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a4029-91e4-4735-ac20-9609313e41af None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:28.870121 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a4029-91e4-4735-ac20-9609313e41af None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:28.870915 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a4029-91e4-4735-ac20-9609313e41af None admin] RBAC: Authorizing `identity:create_role()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:28.877894 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a4029-91e4-4735-ac20-9609313e41af None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:29.065510 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 18/35] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Jul 5 21:25:28 2022] POST /identity/v3/projects => generated 301 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:25:29.066437 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0a09b-3475-47ba-a676-d7622f3a1bcc None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:29.097215 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 18/36] 10.222.0.30 () {60 vars in 1131 bytes} [Tue Jul 5 21:25:28 2022] POST /identity/v3/roles => generated 219 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:25:29.099216 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e505f2-470b-4173-8de2-cf0fc75362e7 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:29.099756 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e505f2-470b-4173-8de2-cf0fc75362e7 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:29.100221 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e505f2-470b-4173-8de2-cf0fc75362e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:29.120856 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-28e505f2-470b-4173-8de2-cf0fc75362e7 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:25:29.123328 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-28e505f2-470b-4173-8de2-cf0fc75362e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:25:29.183378 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:29.276546 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 19/37] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:25:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:25:29.278329 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae32dcd-28d1-4e01-96e0-dc27dad100d0 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:29.278911 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae32dcd-28d1-4e01-96e0-dc27dad100d0 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:29.279447 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae32dcd-28d1-4e01-96e0-dc27dad100d0 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:29.281060 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 20/38] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:25:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:25:29.287286 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11627b63-a9ee-44ae-8c09-043db20608b1 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:29.288030 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11627b63-a9ee-44ae-8c09-043db20608b1 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:29.288526 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11627b63-a9ee-44ae-8c09-043db20608b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:29.323895 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-11627b63-a9ee-44ae-8c09-043db20608b1 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:25:29.325436 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-11627b63-a9ee-44ae-8c09-043db20608b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:25:29.368646 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:29.375108 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0a09b-3475-47ba-a676-d7622f3a1bcc None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:29.410811 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 21/39] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:25:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:25:29.411661 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11627b63-a9ee-44ae-8c09-043db20608b1 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:29.417397 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4036bf-5a20-407d-9cce-6c40c6f3da88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:29.418694 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4036bf-5a20-407d-9cce-6c40c6f3da88 None admin] REQUEST_METHOD: `PUT` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:29.419236 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4036bf-5a20-407d-9cce-6c40c6f3da88 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:29.419694 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4036bf-5a20-407d-9cce-6c40c6f3da88 None admin] PATH_INFO: `/v3/domains/default/users/8f7b68cdb43a4c0b96cd3cbfc39bee35/roles/00090b1962654604b8e106a05d44d06a` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:29.422952 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4036bf-5a20-407d-9cce-6c40c6f3da88 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=8f7b68cdb43a4c0b96cd3cbfc39bee35, role_id=00090b1962654604b8e106a05d44d06a)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:29.424758 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4036bf-5a20-407d-9cce-6c40c6f3da88 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:29.514219 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:29.520488 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11627b63-a9ee-44ae-8c09-043db20608b1 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:29.526984 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 19/40] 10.222.0.30 () {58 vars in 1361 bytes} [Tue Jul 5 21:25:29 2022] PUT /identity/v3/domains/default/users/8f7b68cdb43a4c0b96cd3cbfc39bee35/roles/00090b1962654604b8e106a05d44d06a => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:25:29.527956 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4036bf-5a20-407d-9cce-6c40c6f3da88 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:29.568419 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd2aef-1280-4746-9085-80c17d3b1073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:29.569166 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd2aef-1280-4746-9085-80c17d3b1073 None admin] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:29.570120 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd2aef-1280-4746-9085-80c17d3b1073 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:29.570567 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd2aef-1280-4746-9085-80c17d3b1073 None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:29.571359 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd2aef-1280-4746-9085-80c17d3b1073 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:29.573086 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd2aef-1280-4746-9085-80c17d3b1073 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:29.638274 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 22/41] 10.222.0.30 () {60 vars in 1131 bytes} [Tue Jul 5 21:25:29 2022] POST /identity/v3/roles => generated 225 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:25:29.640074 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139825f0-0824-4996-abb2-413b72807915 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:29.640588 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139825f0-0824-4996-abb2-413b72807915 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:29.641002 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139825f0-0824-4996-abb2-413b72807915 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:29.643023 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 23/42] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:25:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:25:29.648416 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41fde88-f2fb-4120-a2c1-480f9fdfa1af None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:29.648888 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41fde88-f2fb-4120-a2c1-480f9fdfa1af None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:29.649289 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41fde88-f2fb-4120-a2c1-480f9fdfa1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:29.669640 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4036bf-5a20-407d-9cce-6c40c6f3da88 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:29.673392 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-a41fde88-f2fb-4120-a2c1-480f9fdfa1af None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:25:29.674970 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-a41fde88-f2fb-4120-a2c1-480f9fdfa1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:25:29.722548 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693c3b4-f922-48dd-8680-d224b6e7d035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:29.724183 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693c3b4-f922-48dd-8680-d224b6e7d035 None admin] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:29.724485 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693c3b4-f922-48dd-8680-d224b6e7d035 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:29.724774 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693c3b4-f922-48dd-8680-d224b6e7d035 None admin] PATH_INFO: `/v3/roles` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:29.725558 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c693c3b4-f922-48dd-8680-d224b6e7d035 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:29.727757 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c693c3b4-f922-48dd-8680-d224b6e7d035 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:29.762197 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 24/43] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:25:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:25:29.786242 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41fde88-f2fb-4120-a2c1-480f9fdfa1af None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:29.829078 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 20/44] 10.222.0.30 () {60 vars in 1131 bytes} [Tue Jul 5 21:25:29 2022] POST /identity/v3/roles => generated 223 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:25:29.887069 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:29.905516 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41fde88-f2fb-4120-a2c1-480f9fdfa1af None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:29.944307 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8269fbb6-a6c4-4267-9f9f-8fa29ca080fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:29.945134 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269fbb6-a6c4-4267-9f9f-8fa29ca080fa None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:29.945461 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269fbb6-a6c4-4267-9f9f-8fa29ca080fa None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:29.945750 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269fbb6-a6c4-4267-9f9f-8fa29ca080fa None admin] PATH_INFO: `/v3/domains/default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:29.947035 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8269fbb6-a6c4-4267-9f9f-8fa29ca080fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:29.948583 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8269fbb6-a6c4-4267-9f9f-8fa29ca080fa None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:29.950333 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 25/45] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:25:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:25:29.956199 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693c3b4-f922-48dd-8680-d224b6e7d035 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:29.978747 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:30.071813 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693c3b4-f922-48dd-8680-d224b6e7d035 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:30.106582 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf0e41b-fca9-4724-a6f1-22b3507844c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:30.107245 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0e41b-fca9-4724-a6f1-22b3507844c1 None admin] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:30.107535 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0e41b-fca9-4724-a6f1-22b3507844c1 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:30.107821 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0e41b-fca9-4724-a6f1-22b3507844c1 None admin] PATH_INFO: `/v3/projects` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:30.108533 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf0e41b-fca9-4724-a6f1-22b3507844c1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:30.110008 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf0e41b-fca9-4724-a6f1-22b3507844c1 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:30.227359 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 21/46] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Jul 5 21:25:29 2022] POST /identity/v3/projects => generated 312 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:25:31.644564 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499fbeae-2550-4f61-8e2a-3926ab1af55f None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:31.645097 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499fbeae-2550-4f61-8e2a-3926ab1af55f None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:31.645205 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499fbeae-2550-4f61-8e2a-3926ab1af55f None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:31.646595 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 26/47] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:25:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:25:31.651949 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775ff01-ab11-4dca-b4ef-b35d3d79728f None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:31.652395 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775ff01-ab11-4dca-b4ef-b35d3d79728f None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:31.652658 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775ff01-ab11-4dca-b4ef-b35d3d79728f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:31.670255 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-5775ff01-ab11-4dca-b4ef-b35d3d79728f None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:25:31.671788 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-5775ff01-ab11-4dca-b4ef-b35d3d79728f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:25:31.733898 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:31.738845 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 22/48] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:25:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:25:31.762216 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499fbeae-2550-4f61-8e2a-3926ab1af55f None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:31.862939 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499fbeae-2550-4f61-8e2a-3926ab1af55f None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:32.001555 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109566f-a646-4120-bc64-5750f9ad9b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:32.002374 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109566f-a646-4120-bc64-5750f9ad9b4d None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:32.002668 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109566f-a646-4120-bc64-5750f9ad9b4d None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:32.002950 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109566f-a646-4120-bc64-5750f9ad9b4d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:32.013782 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2109566f-a646-4120-bc64-5750f9ad9b4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:25:32.021414 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-2109566f-a646-4120-bc64-5750f9ad9b4d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:25:32.021414 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:25:32.021414 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:25:32.021414 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:25:32.021414 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:25:32.021414 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:25:32.021414 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:25:32.021414 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:25:32.021414 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:25:32.021414 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:25:32.021414 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:25:32.021414 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:25:32.021414 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:25:32.021414 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:25:32.021414 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:25:32.021414 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:25:32.022575 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:25:32.022575 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:25:32.022575 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:25:32.022575 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:25:32.022575 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:25:32.022575 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:25:32.022575 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:25:32.022575 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:25:32.022575 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:25:32.022575 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:25:32.022575 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:25:32.022575 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:25:32.022575 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:25:32.022575 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:25:32.022575 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:25:32.022575 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:25:32.024137 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:25:32.024137 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:25:32.024137 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:25:32.024137 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:25:32.024137 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:25:32.024137 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:25:32.024137 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:25:32.024137 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:25:32.024137 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:25:32.024137 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:25:32.024137 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:25:32.024137 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:25:32.024137 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 27/49] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:25:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:25:32.028909 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5775ff01-ab11-4dca-b4ef-b35d3d79728f None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:32.127564 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5775ff01-ab11-4dca-b4ef-b35d3d79728f None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:32.162264 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73eccb9-a466-48f0-9c1f-07b4e3e633f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:32.162935 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73eccb9-a466-48f0-9c1f-07b4e3e633f9 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:32.163227 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73eccb9-a466-48f0-9c1f-07b4e3e633f9 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:32.163511 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73eccb9-a466-48f0-9c1f-07b4e3e633f9 None admin] PATH_INFO: `/v3/roles` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:32.164839 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73eccb9-a466-48f0-9c1f-07b4e3e633f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:25:32.165152 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73eccb9-a466-48f0-9c1f-07b4e3e633f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:32.166587 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73eccb9-a466-48f0-9c1f-07b4e3e633f9 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:32.174774 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 23/50] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:25:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:32.180372 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109566f-a646-4120-bc64-5750f9ad9b4d None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:32.195514 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:32.280488 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109566f-a646-4120-bc64-5750f9ad9b4d None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:32.292699 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e550e-d7f8-4253-a292-330f3c9d89a9 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:32.292990 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e550e-d7f8-4253-a292-330f3c9d89a9 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:32.293274 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e550e-d7f8-4253-a292-330f3c9d89a9 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:32.294690 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 24/51] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:25:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:25:32.299513 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb345ae-005c-4f79-8b46-864d51b75038 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:32.299808 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb345ae-005c-4f79-8b46-864d51b75038 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:32.300098 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb345ae-005c-4f79-8b46-864d51b75038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:32.315222 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e1643-a497-487d-b261-6d8ca7c982ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:32.316150 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e1643-a497-487d-b261-6d8ca7c982ef None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:32.316448 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e1643-a497-487d-b261-6d8ca7c982ef None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:32.316738 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e1643-a497-487d-b261-6d8ca7c982ef None admin] PATH_INFO: `/v3/users/8f7b68cdb43a4c0b96cd3cbfc39bee35` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:32.316903 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-6bb345ae-005c-4f79-8b46-864d51b75038 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:25:32.317953 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2e1643-a497-487d-b261-6d8ca7c982ef None admin] RBAC: Authorizing `identity:get_user(user_id=8f7b68cdb43a4c0b96cd3cbfc39bee35)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:32.318120 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-6bb345ae-005c-4f79-8b46-864d51b75038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:25:32.319555 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2e1643-a497-487d-b261-6d8ca7c982ef None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:32.321823 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 28/52] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:25:32 2022] GET /identity/v3/users/8f7b68cdb43a4c0b96cd3cbfc39bee35 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:32.327170 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e1643-a497-487d-b261-6d8ca7c982ef None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:32.377839 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:32.388205 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 25/53] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:25:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:25:32.410458 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:32.412740 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb345ae-005c-4f79-8b46-864d51b75038 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:32.430487 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e1643-a497-487d-b261-6d8ca7c982ef None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:32.466329 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48989b4-3450-49fc-bdf3-040ebe7fc14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:32.467151 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48989b4-3450-49fc-bdf3-040ebe7fc14c None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:32.467448 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48989b4-3450-49fc-bdf3-040ebe7fc14c None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:32.467738 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48989b4-3450-49fc-bdf3-040ebe7fc14c None admin] PATH_INFO: `/v3/domains/default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:32.468955 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48989b4-3450-49fc-bdf3-040ebe7fc14c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:32.470447 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48989b4-3450-49fc-bdf3-040ebe7fc14c None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:32.472293 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 29/54] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:25:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:25:32.477940 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48989b4-3450-49fc-bdf3-040ebe7fc14c None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:32.519286 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb345ae-005c-4f79-8b46-864d51b75038 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:32.553432 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076194d-9dbb-44dc-9c6b-f4fbdaa30abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:32.554265 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076194d-9dbb-44dc-9c6b-f4fbdaa30abc None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:32.554561 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076194d-9dbb-44dc-9c6b-f4fbdaa30abc None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:32.554922 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076194d-9dbb-44dc-9c6b-f4fbdaa30abc None admin] PATH_INFO: `/v3/domains/default` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:32.556145 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e076194d-9dbb-44dc-9c6b-f4fbdaa30abc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:32.557638 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e076194d-9dbb-44dc-9c6b-f4fbdaa30abc None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:32.559491 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 26/55] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:25:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:32.564760 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076194d-9dbb-44dc-9c6b-f4fbdaa30abc None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:32.585387 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48989b4-3450-49fc-bdf3-040ebe7fc14c None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:32.620329 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e9442-4b08-4ea5-8b75-a9291e6a5a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:32.621011 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e9442-4b08-4ea5-8b75-a9291e6a5a66 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:32.621310 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e9442-4b08-4ea5-8b75-a9291e6a5a66 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:32.621599 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e9442-4b08-4ea5-8b75-a9291e6a5a66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:32.622488 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3e9442-4b08-4ea5-8b75-a9291e6a5a66 None admin] RBAC: Adding query filter params (role.id=00090b1962654604b8e106a05d44d06a, scope.domain.id=default, user.id=8f7b68cdb43a4c0b96cd3cbfc39bee35) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:25:32.622814 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3e9442-4b08-4ea5-8b75-a9291e6a5a66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:32.624010 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:32.624310 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3e9442-4b08-4ea5-8b75-a9291e6a5a66 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:32.634791 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 30/56] 10.222.0.30 () {56 vars in 1322 bytes} [Tue Jul 5 21:25:32 2022] GET /identity/v3/role_assignments?user.id=8f7b68cdb43a4c0b96cd3cbfc39bee35&scope.domain.id=default&role.id=00090b1962654604b8e106a05d44d06a => generated 530 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:25:32.667649 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076194d-9dbb-44dc-9c6b-f4fbdaa30abc None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:32.704833 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8205ce0-09df-4b3d-9287-266e4d62c0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:32.705513 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8205ce0-09df-4b3d-9287-266e4d62c0b3 None admin] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:32.705808 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8205ce0-09df-4b3d-9287-266e4d62c0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:32.706093 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8205ce0-09df-4b3d-9287-266e4d62c0b3 None admin] PATH_INFO: `/v3/projects` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:32.706849 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8205ce0-09df-4b3d-9287-266e4d62c0b3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:32.708345 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8205ce0-09df-4b3d-9287-266e4d62c0b3 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:32.780406 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 27/57] 10.222.0.30 () {60 vars in 1140 bytes} [Tue Jul 5 21:25:32 2022] POST /identity/v3/projects => generated 298 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:25:34.818470 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2abc94-d963-493d-b384-66b2fb70175c None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:34.818997 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2abc94-d963-493d-b384-66b2fb70175c None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:34.818997 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2abc94-d963-493d-b384-66b2fb70175c None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:34.820442 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 31/58] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:25:34.825873 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c0b3f-c8a0-4cd4-9bc0-f8d4d4372eb3 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:34.826311 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c0b3f-c8a0-4cd4-9bc0-f8d4d4372eb3 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:34.826486 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c0b3f-c8a0-4cd4-9bc0-f8d4d4372eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:34.843296 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-f19c0b3f-c8a0-4cd4-9bc0-f8d4d4372eb3 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:25:34.844495 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-f19c0b3f-c8a0-4cd4-9bc0-f8d4d4372eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:25:34.910661 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 28/59] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:25:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:25:34.936268 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2abc94-d963-493d-b384-66b2fb70175c None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:34.951998 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:35.037979 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2abc94-d963-493d-b384-66b2fb70175c None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:35.072442 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c74c1-e583-45f7-801e-cf8ab67791de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:35.073180 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c74c1-e583-45f7-801e-cf8ab67791de None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:35.073473 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c74c1-e583-45f7-801e-cf8ab67791de None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:35.073761 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c74c1-e583-45f7-801e-cf8ab67791de None admin] PATH_INFO: `/v3/domains/default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:35.074979 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c74c1-e583-45f7-801e-cf8ab67791de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:35.076459 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c74c1-e583-45f7-801e-cf8ab67791de None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:35.078088 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 32/60] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:25:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:35.084016 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19c0b3f-c8a0-4cd4-9bc0-f8d4d4372eb3 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:35.126341 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:35.181455 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19c0b3f-c8a0-4cd4-9bc0-f8d4d4372eb3 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:35.215829 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45524967-3cf4-45ad-a8c6-21dbc81a42df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:35.216503 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45524967-3cf4-45ad-a8c6-21dbc81a42df None admin] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:35.216796 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45524967-3cf4-45ad-a8c6-21dbc81a42df None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:35.217082 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45524967-3cf4-45ad-a8c6-21dbc81a42df None admin] PATH_INFO: `/v3/users` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:35.217805 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45524967-3cf4-45ad-a8c6-21dbc81a42df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:35.219337 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45524967-3cf4-45ad-a8c6-21dbc81a42df None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:35.322864 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 29/61] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:25:35 2022] POST /identity/v3/users => generated 275 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:25:38.400863 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f9d9b-5e8b-4d47-a25a-273eb54f4ce8 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:38.401486 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f9d9b-5e8b-4d47-a25a-273eb54f4ce8 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:38.401486 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f9d9b-5e8b-4d47-a25a-273eb54f4ce8 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:38.403031 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 33/62] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:25:38.411603 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51562437-8e35-4e47-8971-bd07d425052d None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:38.412077 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51562437-8e35-4e47-8971-bd07d425052d None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:38.412284 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51562437-8e35-4e47-8971-bd07d425052d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:38.440243 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-51562437-8e35-4e47-8971-bd07d425052d None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:25:38.441835 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-51562437-8e35-4e47-8971-bd07d425052d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:25:38.532015 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 30/63] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:25:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:25:38.579383 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f9d9b-5e8b-4d47-a25a-273eb54f4ce8 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:38.645955 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc06050-c746-4c9a-8f57-a69d5b32a059 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:38.646682 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc06050-c746-4c9a-8f57-a69d5b32a059 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:38.647207 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc06050-c746-4c9a-8f57-a69d5b32a059 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:38.653356 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 31/64] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:25:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:25:38.655458 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27850c-b846-44d1-a2f1-01250d59aa59 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:38.656119 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27850c-b846-44d1-a2f1-01250d59aa59 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:38.656645 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27850c-b846-44d1-a2f1-01250d59aa59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:38.676079 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-5a27850c-b846-44d1-a2f1-01250d59aa59 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:25:38.677628 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-5a27850c-b846-44d1-a2f1-01250d59aa59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:25:38.708385 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:38.744778 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:38.775758 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f9d9b-5e8b-4d47-a25a-273eb54f4ce8 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:38.797015 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 32/65] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:25:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:25:38.828799 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b077c6d-04dd-43bc-a404-4df9434c9298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:38.829672 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b077c6d-04dd-43bc-a404-4df9434c9298 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:38.829965 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b077c6d-04dd-43bc-a404-4df9434c9298 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:38.830273 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b077c6d-04dd-43bc-a404-4df9434c9298 None admin] PATH_INFO: `/v3/roles/member` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:38.834965 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27850c-b846-44d1-a2f1-01250d59aa59 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:38.864243 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b077c6d-04dd-43bc-a404-4df9434c9298 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:25:38.881536 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-9b077c6d-04dd-43bc-a404-4df9434c9298 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:25:38.881536 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:25:38.881536 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:25:38.881536 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:25:38.881536 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:25:38.881536 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:25:38.881536 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:25:38.881536 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:25:38.881536 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:25:38.881536 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:25:38.881536 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:25:38.881536 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:25:38.881536 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:25:38.881536 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:25:38.881536 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:25:38.881536 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:25:38.882742 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:25:38.882742 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:25:38.882742 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:25:38.882742 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:25:38.882742 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:25:38.882742 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:25:38.882742 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:25:38.882742 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:25:38.882742 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:25:38.882742 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:25:38.882742 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:25:38.882742 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:25:38.882742 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:25:38.882742 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:25:38.882742 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:25:38.882742 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:25:38.883865 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:25:38.883865 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:25:38.883865 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:25:38.883865 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:25:38.883865 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:25:38.883865 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:25:38.883865 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:25:38.883865 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:25:38.883865 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:25:38.883865 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:25:38.883865 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:25:38.883865 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:25:38.883865 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 34/66] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:25:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:25:38.899964 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b077c6d-04dd-43bc-a404-4df9434c9298 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:38.971467 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27850c-b846-44d1-a2f1-01250d59aa59 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:39.011147 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf816c-b269-41e1-b8da-0248495bf879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:39.012351 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf816c-b269-41e1-b8da-0248495bf879 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:39.012634 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf816c-b269-41e1-b8da-0248495bf879 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:39.012915 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf816c-b269-41e1-b8da-0248495bf879 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:39.024586 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadf816c-b269-41e1-b8da-0248495bf879 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:25:39.030700 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b077c6d-04dd-43bc-a404-4df9434c9298 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:39.032476 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-cadf816c-b269-41e1-b8da-0248495bf879 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:25:39.032476 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:25:39.032476 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:25:39.032476 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:25:39.032476 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:25:39.032476 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:25:39.032476 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:25:39.032476 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:25:39.032476 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:25:39.032476 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:25:39.032476 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:25:39.032476 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:25:39.032476 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:25:39.032476 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:25:39.032476 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:25:39.032476 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:25:39.033502 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:25:39.033502 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:25:39.033502 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:25:39.033502 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:25:39.033502 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:25:39.033502 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:25:39.033502 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:25:39.033502 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:25:39.033502 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:25:39.033502 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:25:39.033502 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:25:39.033502 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:25:39.033502 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:25:39.033502 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:25:39.033502 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:25:39.033502 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:25:39.034458 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:25:39.034458 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:25:39.034458 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:25:39.034458 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:25:39.034458 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:25:39.034458 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:25:39.034458 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:25:39.034458 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:25:39.034458 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:25:39.034458 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:25:39.034458 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:25:39.034458 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:25:39.034458 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 33/67] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:25:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:25:39.035217 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ceb77-a738-4a3a-9e8a-4b167bc0a58c None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:39.035217 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ceb77-a738-4a3a-9e8a-4b167bc0a58c None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:39.036749 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ceb77-a738-4a3a-9e8a-4b167bc0a58c None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:39.037151 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 34/68] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:25:39.042808 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7838bb-543d-48a9-b0e0-5ef90951a9d5 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:39.042808 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7838bb-543d-48a9-b0e0-5ef90951a9d5 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:39.042808 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7838bb-543d-48a9-b0e0-5ef90951a9d5 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:39.045206 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 35/69] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:25:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:25:39.046405 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7838bb-543d-48a9-b0e0-5ef90951a9d5 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:39.067193 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:39.075689 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef7b9f1-da4f-4546-96d3-f9c6909c5cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:39.094286 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7b9f1-da4f-4546-96d3-f9c6909c5cc6 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:39.094286 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7b9f1-da4f-4546-96d3-f9c6909c5cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:39.094286 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7b9f1-da4f-4546-96d3-f9c6909c5cc6 None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:39.094286 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef7b9f1-da4f-4546-96d3-f9c6909c5cc6 None admin] RBAC: Adding query filter params (name=member) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:25:39.094286 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef7b9f1-da4f-4546-96d3-f9c6909c5cc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:39.094286 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef7b9f1-da4f-4546-96d3-f9c6909c5cc6 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:39.094772 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 35/70] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:25:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:39.094772 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe2706-a2f5-45dc-b94c-e3206feb6c14 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:39.094772 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe2706-a2f5-45dc-b94c-e3206feb6c14 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:39.094772 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe2706-a2f5-45dc-b94c-e3206feb6c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:39.095648 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:39.108029 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-6bfe2706-a2f5-45dc-b94c-e3206feb6c14 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:25:39.109481 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-6bfe2706-a2f5-45dc-b94c-e3206feb6c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:25:39.159308 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7838bb-543d-48a9-b0e0-5ef90951a9d5 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:39.181413 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 36/71] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:25:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:25:39.182569 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c08606-db71-4a35-a4b5-88c24c9e890e None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:39.182868 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c08606-db71-4a35-a4b5-88c24c9e890e None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:39.183152 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c08606-db71-4a35-a4b5-88c24c9e890e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:39.200968 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-75c08606-db71-4a35-a4b5-88c24c9e890e None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:25:39.202045 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-75c08606-db71-4a35-a4b5-88c24c9e890e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:25:39.212179 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53672644-5d03-4fb5-9fd0-c9db7eb631f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:39.213623 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53672644-5d03-4fb5-9fd0-c9db7eb631f8 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:39.214103 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53672644-5d03-4fb5-9fd0-c9db7eb631f8 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:39.214604 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53672644-5d03-4fb5-9fd0-c9db7eb631f8 None admin] PATH_INFO: `/v3/roles` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:39.216151 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53672644-5d03-4fb5-9fd0-c9db7eb631f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:25:39.216656 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53672644-5d03-4fb5-9fd0-c9db7eb631f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:39.218822 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53672644-5d03-4fb5-9fd0-c9db7eb631f8 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:39.228841 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 36/72] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:25:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:39.229609 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53672644-5d03-4fb5-9fd0-c9db7eb631f8 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:39.275068 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 37/73] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:25:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:25:39.275847 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c08606-db71-4a35-a4b5-88c24c9e890e None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:39.324819 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:39.338337 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:39.344698 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53672644-5d03-4fb5-9fd0-c9db7eb631f8 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:39.376451 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c08606-db71-4a35-a4b5-88c24c9e890e None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:39.378754 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf294a-0505-4c39-9e2a-7cdd537352b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:39.379632 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf294a-0505-4c39-9e2a-7cdd537352b7 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:39.379928 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf294a-0505-4c39-9e2a-7cdd537352b7 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:39.380208 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf294a-0505-4c39-9e2a-7cdd537352b7 None admin] PATH_INFO: `/v3/users/2476d97d512545ff9b00e593487ef5fa` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:39.394240 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf294a-0505-4c39-9e2a-7cdd537352b7 None admin] RBAC: Authorizing `identity:get_user(user_id=2476d97d512545ff9b00e593487ef5fa)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:39.395722 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf294a-0505-4c39-9e2a-7cdd537352b7 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:39.397509 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 37/74] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:25:39 2022] GET /identity/v3/users/2476d97d512545ff9b00e593487ef5fa => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:39.399318 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eef8c7-6eec-4ff7-ae44-81792bb9eb5b None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:39.399689 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eef8c7-6eec-4ff7-ae44-81792bb9eb5b None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:39.399980 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eef8c7-6eec-4ff7-ae44-81792bb9eb5b None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:39.401305 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 38/75] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:25:39.401830 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eef8c7-6eec-4ff7-ae44-81792bb9eb5b None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:39.417123 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728414b-a1ac-4f92-abf0-4d9cbe320700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:39.417931 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728414b-a1ac-4f92-abf0-4d9cbe320700 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:39.418259 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728414b-a1ac-4f92-abf0-4d9cbe320700 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:39.418549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728414b-a1ac-4f92-abf0-4d9cbe320700 None admin] PATH_INFO: `/v3/roles/member` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:39.428936 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c728414b-a1ac-4f92-abf0-4d9cbe320700 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:25:39.437415 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-c728414b-a1ac-4f92-abf0-4d9cbe320700 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:25:39.437415 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:25:39.437415 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:25:39.437415 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:25:39.437415 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:25:39.437415 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:25:39.437415 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:25:39.437415 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:25:39.437415 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:25:39.437415 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:25:39.437415 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:25:39.437415 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:25:39.437415 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:25:39.437415 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:25:39.437415 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:25:39.437415 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:25:39.438648 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:25:39.438648 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:25:39.438648 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:25:39.438648 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:25:39.438648 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:25:39.438648 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:25:39.438648 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:25:39.438648 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:25:39.438648 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:25:39.438648 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:25:39.438648 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:25:39.438648 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:25:39.438648 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:25:39.438648 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:25:39.438648 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:25:39.438648 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:25:39.439568 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:25:39.439568 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:25:39.439568 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:25:39.439568 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:25:39.439568 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:25:39.439568 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:25:39.439568 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:25:39.439568 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:25:39.439568 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:25:39.439568 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:25:39.439568 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:25:39.439568 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:25:39.439568 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 38/76] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:25:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:25:39.439568 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728414b-a1ac-4f92-abf0-4d9cbe320700 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:39.503701 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eef8c7-6eec-4ff7-ae44-81792bb9eb5b None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:39.538356 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9034ca-767e-4baa-a5ad-db83721c7413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:39.539414 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9034ca-767e-4baa-a5ad-db83721c7413 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:39.539717 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9034ca-767e-4baa-a5ad-db83721c7413 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:39.539999 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9034ca-767e-4baa-a5ad-db83721c7413 None admin] PATH_INFO: `/v3/users/8f7b68cdb43a4c0b96cd3cbfc39bee35` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:39.541191 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9034ca-767e-4baa-a5ad-db83721c7413 None admin] RBAC: Authorizing `identity:get_user(user_id=8f7b68cdb43a4c0b96cd3cbfc39bee35)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:39.542700 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9034ca-767e-4baa-a5ad-db83721c7413 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:39.544411 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 39/77] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:25:39 2022] GET /identity/v3/users/8f7b68cdb43a4c0b96cd3cbfc39bee35 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:39.544701 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728414b-a1ac-4f92-abf0-4d9cbe320700 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:39.545193 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9034ca-767e-4baa-a5ad-db83721c7413 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:39.553716 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:39.575225 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:39.587090 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e55d0-bdb0-4aad-b830-37df0f5fa533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:39.587917 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e55d0-bdb0-4aad-b830-37df0f5fa533 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:39.588211 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e55d0-bdb0-4aad-b830-37df0f5fa533 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:39.588502 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e55d0-bdb0-4aad-b830-37df0f5fa533 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:39.599180 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e55d0-bdb0-4aad-b830-37df0f5fa533 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:25:39.607872 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-6e7e55d0-bdb0-4aad-b830-37df0f5fa533 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:25:39.607872 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:25:39.607872 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:25:39.607872 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:25:39.607872 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:25:39.607872 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:25:39.607872 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:25:39.607872 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:25:39.607872 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:25:39.607872 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:25:39.607872 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:25:39.607872 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:25:39.607872 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:25:39.607872 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:25:39.607872 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:25:39.607872 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:25:39.608971 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:25:39.608971 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:25:39.608971 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:25:39.608971 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:25:39.608971 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:25:39.608971 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:25:39.608971 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:25:39.608971 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:25:39.608971 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:25:39.608971 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:25:39.608971 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:25:39.608971 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:25:39.608971 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:25:39.608971 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:25:39.608971 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:25:39.608971 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:25:39.614866 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:25:39.614866 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:25:39.614866 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:25:39.614866 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:25:39.614866 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:25:39.614866 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:25:39.614866 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:25:39.614866 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:25:39.614866 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:25:39.614866 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:25:39.614866 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:25:39.614866 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:25:39.614866 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 39/78] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:25:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:25:39.614866 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fdb154-924f-4491-82a1-26a2ab84be21 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:39.615722 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fdb154-924f-4491-82a1-26a2ab84be21 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:39.615722 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fdb154-924f-4491-82a1-26a2ab84be21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:39.627929 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-83fdb154-924f-4491-82a1-26a2ab84be21 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:25:39.629154 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-83fdb154-924f-4491-82a1-26a2ab84be21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:25:39.645068 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9034ca-767e-4baa-a5ad-db83721c7413 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:39.680214 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9bf088-302d-4824-80aa-d873a9f6687e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:39.680875 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bf088-302d-4824-80aa-d873a9f6687e None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:39.681172 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bf088-302d-4824-80aa-d873a9f6687e None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:39.681460 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bf088-302d-4824-80aa-d873a9f6687e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:39.696848 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 40/79] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:25:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:25:39.707476 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fdb154-924f-4491-82a1-26a2ab84be21 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:39.750551 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9bf088-302d-4824-80aa-d873a9f6687e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:39.752039 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9bf088-302d-4824-80aa-d873a9f6687e None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:39.760275 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:39.809949 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fdb154-924f-4491-82a1-26a2ab84be21 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:39.823994 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:39.845335 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e2cf8-2cf5-4a81-b865-694ee706d4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:39.846353 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e2cf8-2cf5-4a81-b865-694ee706d4ec None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:39.846649 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e2cf8-2cf5-4a81-b865-694ee706d4ec None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:39.846937 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e2cf8-2cf5-4a81-b865-694ee706d4ec None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:39.847696 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e2cf8-2cf5-4a81-b865-694ee706d4ec None admin] RBAC: Adding query filter params (name=member) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:25:39.848011 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e2cf8-2cf5-4a81-b865-694ee706d4ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:39.849420 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e2cf8-2cf5-4a81-b865-694ee706d4ec None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:39.852447 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 40/80] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:25:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:25:39.853309 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9bf088-302d-4824-80aa-d873a9f6687e None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:39.861399 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 41/81] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:25:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:39.862273 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e2cf8-2cf5-4a81-b865-694ee706d4ec None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:39.952412 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9bf088-302d-4824-80aa-d873a9f6687e None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:39.959840 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:39.965303 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e2cf8-2cf5-4a81-b865-694ee706d4ec None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:39.987192 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e96bb4-1f69-424a-a658-18e6b3a614ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:39.987849 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e96bb4-1f69-424a-a658-18e6b3a614ca None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:39.988142 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e96bb4-1f69-424a-a658-18e6b3a614ca None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:39.988456 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e96bb4-1f69-424a-a658-18e6b3a614ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:39.999825 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18ada4-b12a-4302-9856-5ff592d02d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:40.000498 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18ada4-b12a-4302-9856-5ff592d02d2a None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:40.000793 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18ada4-b12a-4302-9856-5ff592d02d2a None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:40.001084 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18ada4-b12a-4302-9856-5ff592d02d2a None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:40.001838 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db18ada4-b12a-4302-9856-5ff592d02d2a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:25:40.002189 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db18ada4-b12a-4302-9856-5ff592d02d2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:40.003612 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db18ada4-b12a-4302-9856-5ff592d02d2a None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:40.012184 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 42/82] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:25:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:40.013052 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18ada4-b12a-4302-9856-5ff592d02d2a None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:40.047825 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:40.057761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e96bb4-1f69-424a-a658-18e6b3a614ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:40.069612 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e96bb4-1f69-424a-a658-18e6b3a614ca None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:40.112203 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18ada4-b12a-4302-9856-5ff592d02d2a None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:40.146691 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd75e54-851b-4ed3-ac87-c57cd0324b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:40.147504 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd75e54-851b-4ed3-ac87-c57cd0324b1f None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:40.147800 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd75e54-851b-4ed3-ac87-c57cd0324b1f None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:40.148084 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd75e54-851b-4ed3-ac87-c57cd0324b1f None admin] PATH_INFO: `/v3/domains/default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:40.149399 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd75e54-851b-4ed3-ac87-c57cd0324b1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:40.150919 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd75e54-851b-4ed3-ac87-c57cd0324b1f None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:40.152551 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 43/83] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:25:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:40.153336 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd75e54-851b-4ed3-ac87-c57cd0324b1f None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:40.165718 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 41/84] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:25:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:25:40.165718 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e96bb4-1f69-424a-a658-18e6b3a614ca None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:40.170407 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:40.256297 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd75e54-851b-4ed3-ac87-c57cd0324b1f None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:40.258759 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:40.269973 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e96bb4-1f69-424a-a658-18e6b3a614ca None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:40.291642 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ce862-7761-467d-a311-5161aa311a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:40.292525 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ce862-7761-467d-a311-5161aa311a24 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:40.292826 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ce862-7761-467d-a311-5161aa311a24 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:40.293116 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ce862-7761-467d-a311-5161aa311a24 None admin] PATH_INFO: `/v3/projects/f79334203c0a4279909fbe5e93cc441c` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:40.294363 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ce862-7761-467d-a311-5161aa311a24 None admin] RBAC: Authorizing `identity:get_project(project_id=f79334203c0a4279909fbe5e93cc441c)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:40.295828 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ce862-7761-467d-a311-5161aa311a24 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:40.297337 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d708cd-1def-4209-95bc-c83cfd2af49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:40.297526 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 44/85] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:25:40 2022] GET /identity/v3/projects/f79334203c0a4279909fbe5e93cc441c => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:40.298339 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ce862-7761-467d-a311-5161aa311a24 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:40.298907 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d708cd-1def-4209-95bc-c83cfd2af49d None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:40.299214 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d708cd-1def-4209-95bc-c83cfd2af49d None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:40.299510 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d708cd-1def-4209-95bc-c83cfd2af49d None admin] PATH_INFO: `/v3/users/2476d97d512545ff9b00e593487ef5fa` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:40.300946 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d708cd-1def-4209-95bc-c83cfd2af49d None admin] RBAC: Authorizing `identity:get_user(user_id=2476d97d512545ff9b00e593487ef5fa)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:40.303145 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d708cd-1def-4209-95bc-c83cfd2af49d None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:40.305418 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 42/86] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:25:40 2022] GET /identity/v3/users/2476d97d512545ff9b00e593487ef5fa => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:40.306265 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d708cd-1def-4209-95bc-c83cfd2af49d None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:40.382449 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:40.397780 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ce862-7761-467d-a311-5161aa311a24 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:40.407882 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d708cd-1def-4209-95bc-c83cfd2af49d None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:40.431901 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab5f3d-60ee-47ad-a721-0dc47b22c829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:40.432783 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab5f3d-60ee-47ad-a721-0dc47b22c829 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:40.433078 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab5f3d-60ee-47ad-a721-0dc47b22c829 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:40.433372 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab5f3d-60ee-47ad-a721-0dc47b22c829 None admin] PATH_INFO: `/v3/users/2476d97d512545ff9b00e593487ef5fa` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:40.434612 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dab5f3d-60ee-47ad-a721-0dc47b22c829 None admin] RBAC: Authorizing `identity:get_user(user_id=2476d97d512545ff9b00e593487ef5fa)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:40.436111 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dab5f3d-60ee-47ad-a721-0dc47b22c829 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:40.437746 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 45/87] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:25:40 2022] GET /identity/v3/users/2476d97d512545ff9b00e593487ef5fa => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:40.438551 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab5f3d-60ee-47ad-a721-0dc47b22c829 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:40.446262 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ff3d4-83bd-4444-b298-c422669b128b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:40.446951 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ff3d4-83bd-4444-b298-c422669b128b None admin] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:40.447246 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ff3d4-83bd-4444-b298-c422669b128b None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:40.447540 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ff3d4-83bd-4444-b298-c422669b128b None admin] PATH_INFO: `/v3/users` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:40.448268 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ff3d4-83bd-4444-b298-c422669b128b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:40.449735 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ff3d4-83bd-4444-b298-c422669b128b None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:40.480125 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:40.516936 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 43/88] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:25:40 2022] POST /identity/v3/users => generated 289 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:25:40.518014 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ff3d4-83bd-4444-b298-c422669b128b None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:40.540945 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab5f3d-60ee-47ad-a721-0dc47b22c829 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:40.586598 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5cba04-ac62-4869-ade9-2c2975646fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:40.587519 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5cba04-ac62-4869-ade9-2c2975646fdd None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:40.587811 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5cba04-ac62-4869-ade9-2c2975646fdd None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:40.588100 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5cba04-ac62-4869-ade9-2c2975646fdd None admin] PATH_INFO: `/v3/projects/f79334203c0a4279909fbe5e93cc441c` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:40.589410 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5cba04-ac62-4869-ade9-2c2975646fdd None admin] RBAC: Authorizing `identity:get_project(project_id=f79334203c0a4279909fbe5e93cc441c)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:40.590980 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5cba04-ac62-4869-ade9-2c2975646fdd None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:40.597716 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 46/89] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:25:40 2022] GET /identity/v3/projects/f79334203c0a4279909fbe5e93cc441c => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:40.597716 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5cba04-ac62-4869-ade9-2c2975646fdd None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:40.667219 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ff3d4-83bd-4444-b298-c422669b128b None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:40.702485 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:40.710717 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5cba04-ac62-4869-ade9-2c2975646fdd None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:40.710892 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043aedb-2cef-4f8b-8694-c0d7690758cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:40.710892 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043aedb-2cef-4f8b-8694-c0d7690758cc None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:40.710892 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043aedb-2cef-4f8b-8694-c0d7690758cc None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:40.710892 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043aedb-2cef-4f8b-8694-c0d7690758cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:40.713709 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043aedb-2cef-4f8b-8694-c0d7690758cc None admin] RBAC: Adding query filter params (role.id=a7a08ffb4e7f40f683e711c83a6186d0, scope.project.id=f79334203c0a4279909fbe5e93cc441c, user.id=2476d97d512545ff9b00e593487ef5fa) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:25:40.713709 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043aedb-2cef-4f8b-8694-c0d7690758cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:40.714757 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043aedb-2cef-4f8b-8694-c0d7690758cc None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:40.719276 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:40.721840 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 44/90] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:25:40 2022] GET /identity/v3/role_assignments?user.id=2476d97d512545ff9b00e593487ef5fa&scope.project.id=f79334203c0a4279909fbe5e93cc441c&role.id=a7a08ffb4e7f40f683e711c83a6186d0 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:40.728714 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043aedb-2cef-4f8b-8694-c0d7690758cc None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:40.764004 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98af32-2b6e-4a35-b291-0782a7a79588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:40.764712 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98af32-2b6e-4a35-b291-0782a7a79588 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:40.766231 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98af32-2b6e-4a35-b291-0782a7a79588 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:40.766539 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98af32-2b6e-4a35-b291-0782a7a79588 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:40.862493 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef98af32-2b6e-4a35-b291-0782a7a79588 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:40.864390 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef98af32-2b6e-4a35-b291-0782a7a79588 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:40.878925 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043aedb-2cef-4f8b-8694-c0d7690758cc None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:40.930089 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc783a-5629-46e1-80b4-8cf35e4cc687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:40.930804 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc783a-5629-46e1-80b4-8cf35e4cc687 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:40.931097 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc783a-5629-46e1-80b4-8cf35e4cc687 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:40.931370 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc783a-5629-46e1-80b4-8cf35e4cc687 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:40.984290 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 47/91] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:25:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:25:40.985185 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98af32-2b6e-4a35-b291-0782a7a79588 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:40.998491 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:41.000071 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:41.008887 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fc783a-5629-46e1-80b4-8cf35e4cc687 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:41.011611 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fc783a-5629-46e1-80b4-8cf35e4cc687 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:41.110320 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98af32-2b6e-4a35-b291-0782a7a79588 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:41.128890 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 45/92] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:25:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:25:41.129762 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc783a-5629-46e1-80b4-8cf35e4cc687 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:41.148329 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4aa4b0-369d-4d87-b2bf-4cac6102f098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:41.149747 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4aa4b0-369d-4d87-b2bf-4cac6102f098 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:41.150053 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4aa4b0-369d-4d87-b2bf-4cac6102f098 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:41.150374 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4aa4b0-369d-4d87-b2bf-4cac6102f098 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:41.151244 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4aa4b0-369d-4d87-b2bf-4cac6102f098 None admin] RBAC: Adding query filter params (role.id=00090b1962654604b8e106a05d44d06a, scope.project.id=f79334203c0a4279909fbe5e93cc441c, user.id=8f7b68cdb43a4c0b96cd3cbfc39bee35) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:25:41.151575 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4aa4b0-369d-4d87-b2bf-4cac6102f098 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:41.153211 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4aa4b0-369d-4d87-b2bf-4cac6102f098 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:41.159580 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 48/93] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:25:40 2022] GET /identity/v3/role_assignments?user.id=8f7b68cdb43a4c0b96cd3cbfc39bee35&scope.project.id=f79334203c0a4279909fbe5e93cc441c&role.id=00090b1962654604b8e106a05d44d06a => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:41.160410 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4aa4b0-369d-4d87-b2bf-4cac6102f098 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:41.233778 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:41.241326 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc783a-5629-46e1-80b4-8cf35e4cc687 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:41.281880 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90601c4-5684-43d9-a682-d7017b615015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:41.282979 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90601c4-5684-43d9-a682-d7017b615015 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:41.283276 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90601c4-5684-43d9-a682-d7017b615015 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:41.283724 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90601c4-5684-43d9-a682-d7017b615015 None admin] PATH_INFO: `/v3/projects/d3399a76e811441fab7a583158e440d0` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:41.285336 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90601c4-5684-43d9-a682-d7017b615015 None admin] RBAC: Authorizing `identity:get_project(project_id=d3399a76e811441fab7a583158e440d0)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:41.286858 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90601c4-5684-43d9-a682-d7017b615015 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:41.288762 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 46/94] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:25:41 2022] GET /identity/v3/projects/d3399a76e811441fab7a583158e440d0 => generated 312 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:41.295359 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90601c4-5684-43d9-a682-d7017b615015 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:41.308293 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:41.389691 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4aa4b0-369d-4d87-b2bf-4cac6102f098 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:41.467765 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6dd3f1-57cf-47a3-9ae4-16aeeb648020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:41.468790 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6dd3f1-57cf-47a3-9ae4-16aeeb648020 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:41.469085 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6dd3f1-57cf-47a3-9ae4-16aeeb648020 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:41.469371 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6dd3f1-57cf-47a3-9ae4-16aeeb648020 None admin] PATH_INFO: `/v3/projects/f79334203c0a4279909fbe5e93cc441c` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:41.475238 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6dd3f1-57cf-47a3-9ae4-16aeeb648020 None admin] RBAC: Authorizing `identity:get_project(project_id=f79334203c0a4279909fbe5e93cc441c)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:41.477282 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6dd3f1-57cf-47a3-9ae4-16aeeb648020 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:41.479320 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 49/95] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:25:41 2022] GET /identity/v3/projects/f79334203c0a4279909fbe5e93cc441c => generated 298 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:41.486744 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6dd3f1-57cf-47a3-9ae4-16aeeb648020 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:41.523195 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90601c4-5684-43d9-a682-d7017b615015 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:41.619002 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb734fa-0c20-4ccb-8780-87415978c9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:41.619690 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb734fa-0c20-4ccb-8780-87415978c9ca None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:41.619983 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb734fa-0c20-4ccb-8780-87415978c9ca None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:41.620267 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb734fa-0c20-4ccb-8780-87415978c9ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:41.621121 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb734fa-0c20-4ccb-8780-87415978c9ca None admin] RBAC: Adding query filter params (role.id=a7a08ffb4e7f40f683e711c83a6186d0, scope.project.id=d3399a76e811441fab7a583158e440d0, user.id=2476d97d512545ff9b00e593487ef5fa) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:25:41.621440 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb734fa-0c20-4ccb-8780-87415978c9ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:41.622949 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb734fa-0c20-4ccb-8780-87415978c9ca None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:41.640438 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 47/96] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:25:41 2022] GET /identity/v3/role_assignments?user.id=2476d97d512545ff9b00e593487ef5fa&scope.project.id=d3399a76e811441fab7a583158e440d0&role.id=a7a08ffb4e7f40f683e711c83a6186d0 => generated 259 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:25:41.652623 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6dd3f1-57cf-47a3-9ae4-16aeeb648020 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:41.705892 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e79bc-97be-415e-af4a-fb0217627245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:41.707042 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e79bc-97be-415e-af4a-fb0217627245 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:41.707589 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e79bc-97be-415e-af4a-fb0217627245 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:41.708166 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e79bc-97be-415e-af4a-fb0217627245 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:41.709263 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49e79bc-97be-415e-af4a-fb0217627245 None admin] RBAC: Adding query filter params (role.id=6413bac7cc9a42cf83968dd26a3ccc34, scope.project.id=f79334203c0a4279909fbe5e93cc441c, user.id=2476d97d512545ff9b00e593487ef5fa) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:25:41.709808 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49e79bc-97be-415e-af4a-fb0217627245 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:41.711956 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49e79bc-97be-415e-af4a-fb0217627245 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:41.718746 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 50/97] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:25:41 2022] GET /identity/v3/role_assignments?user.id=2476d97d512545ff9b00e593487ef5fa&scope.project.id=f79334203c0a4279909fbe5e93cc441c&role.id=6413bac7cc9a42cf83968dd26a3ccc34 => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:43.283994 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e1f86-5d1f-4380-9934-276c4b81cffa None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:43.284573 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e1f86-5d1f-4380-9934-276c4b81cffa None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:43.284573 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e1f86-5d1f-4380-9934-276c4b81cffa None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:43.286279 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 48/98] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:25:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:25:43.296558 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736a8c6-481d-4e45-b1ff-013d1557bd98 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:43.297006 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736a8c6-481d-4e45-b1ff-013d1557bd98 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:43.297189 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736a8c6-481d-4e45-b1ff-013d1557bd98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:43.306516 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:43.319046 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-e736a8c6-481d-4e45-b1ff-013d1557bd98 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:25:43.320263 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-e736a8c6-481d-4e45-b1ff-013d1557bd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:25:43.412346 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 51/99] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:25:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:25:43.456517 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e1f86-5d1f-4380-9934-276c4b81cffa None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:43.494843 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:43.587468 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e1f86-5d1f-4380-9934-276c4b81cffa None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:43.647221 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17dd502-6447-43ed-876f-e7a0c8a2b37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:43.648036 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17dd502-6447-43ed-876f-e7a0c8a2b37c None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:43.648325 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17dd502-6447-43ed-876f-e7a0c8a2b37c None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:43.648661 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17dd502-6447-43ed-876f-e7a0c8a2b37c None admin] PATH_INFO: `/v3/roles/member` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:43.659990 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17dd502-6447-43ed-876f-e7a0c8a2b37c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:25:43.673938 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-c17dd502-6447-43ed-876f-e7a0c8a2b37c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:25:43.673938 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:25:43.673938 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:25:43.673938 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:25:43.673938 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:25:43.673938 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:25:43.673938 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:25:43.673938 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:25:43.673938 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:25:43.673938 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:25:43.673938 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:25:43.673938 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:25:43.673938 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:25:43.673938 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:25:43.673938 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:25:43.673938 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:25:43.675067 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:25:43.675067 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:25:43.675067 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:25:43.675067 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:25:43.675067 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:25:43.675067 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:25:43.675067 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:25:43.675067 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:25:43.675067 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:25:43.675067 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:25:43.675067 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:25:43.675067 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:25:43.675067 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:25:43.675067 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:25:43.675067 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:25:43.675067 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:25:43.675992 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:25:43.675992 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:25:43.675992 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:25:43.675992 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:25:43.675992 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:25:43.675992 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:25:43.675992 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:25:43.675992 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:25:43.675992 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:25:43.675992 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:25:43.675992 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:25:43.675992 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:25:43.675992 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 49/100] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:25:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:25:43.687319 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736a8c6-481d-4e45-b1ff-013d1557bd98 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:43.779247 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf2660-2c48-4ddc-8eb0-d6f3a2760bc6 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:43.779912 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf2660-2c48-4ddc-8eb0-d6f3a2760bc6 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:43.780431 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf2660-2c48-4ddc-8eb0-d6f3a2760bc6 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:43.782041 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 50/101] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:25:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:25:43.787909 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64b056-c4da-458c-976f-c00379fc77c5 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:43.788495 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64b056-c4da-458c-976f-c00379fc77c5 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:43.789007 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64b056-c4da-458c-976f-c00379fc77c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:43.812015 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-de64b056-c4da-458c-976f-c00379fc77c5 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:25:43.813890 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-de64b056-c4da-458c-976f-c00379fc77c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:25:43.913939 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736a8c6-481d-4e45-b1ff-013d1557bd98 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:43.940791 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 51/102] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:25:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:25:43.965810 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c4295-9533-4b5f-b1ad-3ed6ba465ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:43.966949 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c4295-9533-4b5f-b1ad-3ed6ba465ebc None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:43.967478 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c4295-9533-4b5f-b1ad-3ed6ba465ebc None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:43.968009 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c4295-9533-4b5f-b1ad-3ed6ba465ebc None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:43.969005 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2c4295-9533-4b5f-b1ad-3ed6ba465ebc None admin] RBAC: Adding query filter params (name=member) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:25:43.969543 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2c4295-9533-4b5f-b1ad-3ed6ba465ebc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:43.973273 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2c4295-9533-4b5f-b1ad-3ed6ba465ebc None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:43.975116 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:43.989115 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 52/103] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:25:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:43.995722 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64b056-c4da-458c-976f-c00379fc77c5 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:44.004175 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c4295-9533-4b5f-b1ad-3ed6ba465ebc None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:44.027613 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:44.124587 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c4295-9533-4b5f-b1ad-3ed6ba465ebc None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:44.153985 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64b056-c4da-458c-976f-c00379fc77c5 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:44.162814 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0047a5c2-9906-4bfc-b76f-78bafd84c2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:44.164125 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047a5c2-9906-4bfc-b76f-78bafd84c2fe None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:44.164684 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047a5c2-9906-4bfc-b76f-78bafd84c2fe None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:44.165257 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047a5c2-9906-4bfc-b76f-78bafd84c2fe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:44.178194 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0047a5c2-9906-4bfc-b76f-78bafd84c2fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:25:44.189887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-0047a5c2-9906-4bfc-b76f-78bafd84c2fe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:25:44.189887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:25:44.189887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:25:44.189887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:25:44.189887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:25:44.189887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:25:44.189887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:25:44.189887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:25:44.189887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:25:44.189887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:25:44.189887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:25:44.189887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:25:44.189887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:25:44.189887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:25:44.189887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:25:44.189887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:25:44.191917 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:25:44.191917 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:25:44.191917 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:25:44.191917 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:25:44.191917 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:25:44.191917 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:25:44.191917 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:25:44.191917 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:25:44.191917 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:25:44.191917 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:25:44.191917 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:25:44.191917 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:25:44.191917 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:25:44.191917 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:25:44.191917 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:25:44.191917 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:25:44.194201 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:25:44.194201 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:25:44.194201 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:25:44.194201 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:25:44.194201 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:25:44.194201 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:25:44.194201 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:25:44.194201 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:25:44.194201 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:25:44.194201 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:25:44.194201 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:25:44.194201 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:25:44.194935 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 53/104] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:25:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:25:44.202693 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0047a5c2-9906-4bfc-b76f-78bafd84c2fe None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:44.204986 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be5710-7595-4e15-a459-a7b4e94fe0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:44.205937 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be5710-7595-4e15-a459-a7b4e94fe0d0 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:44.206237 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be5710-7595-4e15-a459-a7b4e94fe0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:44.206528 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be5710-7595-4e15-a459-a7b4e94fe0d0 None admin] PATH_INFO: `/v3/users/2476d97d512545ff9b00e593487ef5fa` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:44.208182 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be5710-7595-4e15-a459-a7b4e94fe0d0 None admin] RBAC: Authorizing `identity:get_user(user_id=2476d97d512545ff9b00e593487ef5fa)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:44.209682 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be5710-7595-4e15-a459-a7b4e94fe0d0 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:44.216898 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 52/105] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:25:43 2022] GET /identity/v3/users/2476d97d512545ff9b00e593487ef5fa => generated 275 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:44.222061 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be5710-7595-4e15-a459-a7b4e94fe0d0 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:44.394499 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:44.444717 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:44.466306 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be5710-7595-4e15-a459-a7b4e94fe0d0 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:44.488469 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0047a5c2-9906-4bfc-b76f-78bafd84c2fe None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:44.536112 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98878025-8189-48e5-93d9-58f7f093ea13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:44.536996 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98878025-8189-48e5-93d9-58f7f093ea13 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:44.537288 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98878025-8189-48e5-93d9-58f7f093ea13 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:44.537572 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98878025-8189-48e5-93d9-58f7f093ea13 None admin] PATH_INFO: `/v3/projects/f79334203c0a4279909fbe5e93cc441c` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:44.539690 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98878025-8189-48e5-93d9-58f7f093ea13 None admin] RBAC: Authorizing `identity:get_project(project_id=f79334203c0a4279909fbe5e93cc441c)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:44.541178 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98878025-8189-48e5-93d9-58f7f093ea13 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:44.543128 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 53/106] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:25:44 2022] GET /identity/v3/projects/f79334203c0a4279909fbe5e93cc441c => generated 298 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:25:44.544160 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364541d-9119-4d1d-9068-bf30ca6c518c None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:44.544507 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364541d-9119-4d1d-9068-bf30ca6c518c None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:44.544725 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364541d-9119-4d1d-9068-bf30ca6c518c None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:44.546093 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 54/107] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:25:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:25:44.549185 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8898e6-f010-4009-a7c9-17af4b3723e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:44.549876 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8898e6-f010-4009-a7c9-17af4b3723e2 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:44.550192 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8898e6-f010-4009-a7c9-17af4b3723e2 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:44.550483 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8898e6-f010-4009-a7c9-17af4b3723e2 None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:44.551257 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8898e6-f010-4009-a7c9-17af4b3723e2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:25:44.551572 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8898e6-f010-4009-a7c9-17af4b3723e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:44.552978 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8898e6-f010-4009-a7c9-17af4b3723e2 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:44.563744 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2543f-0a16-41db-9a64-fc051dd9d81d None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:44.563744 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2543f-0a16-41db-9a64-fc051dd9d81d None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:44.563744 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2543f-0a16-41db-9a64-fc051dd9d81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:44.567879 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 54/108] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:25:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:44.568564 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8898e6-f010-4009-a7c9-17af4b3723e2 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:44.592554 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-1cd2543f-0a16-41db-9a64-fc051dd9d81d None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:25:44.593768 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-1cd2543f-0a16-41db-9a64-fc051dd9d81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:25:44.693560 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 55/109] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:25:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:25:44.694503 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2543f-0a16-41db-9a64-fc051dd9d81d None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:44.756783 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8898e6-f010-4009-a7c9-17af4b3723e2 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:44.779956 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:44.799085 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:44.799399 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6739283a-6b9d-41f6-8fa6-4f2408645dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:44.800384 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739283a-6b9d-41f6-8fa6-4f2408645dad None admin] REQUEST_METHOD: `PUT` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:44.800592 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739283a-6b9d-41f6-8fa6-4f2408645dad None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:44.800869 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739283a-6b9d-41f6-8fa6-4f2408645dad None admin] PATH_INFO: `/v3/projects/f79334203c0a4279909fbe5e93cc441c/users/2476d97d512545ff9b00e593487ef5fa/roles/a7a08ffb4e7f40f683e711c83a6186d0` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:44.802944 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6739283a-6b9d-41f6-8fa6-4f2408645dad None admin] RBAC: Authorizing `identity:create_grant(project_id=f79334203c0a4279909fbe5e93cc441c, user_id=2476d97d512545ff9b00e593487ef5fa, role_id=a7a08ffb4e7f40f683e711c83a6186d0)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:44.804420 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6739283a-6b9d-41f6-8fa6-4f2408645dad None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:44.818898 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2543f-0a16-41db-9a64-fc051dd9d81d None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:44.856994 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b7ec5-4605-4b28-af97-4aa40553c1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:44.857894 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b7ec5-4605-4b28-af97-4aa40553c1ae None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:44.858201 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b7ec5-4605-4b28-af97-4aa40553c1ae None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:44.866937 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b7ec5-4605-4b28-af97-4aa40553c1ae None admin] PATH_INFO: `/v3/users/dd58280bd25a413090a44fb44307c117` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:44.867089 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 55/110] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:25:44 2022] PUT /identity/v3/projects/f79334203c0a4279909fbe5e93cc441c/users/2476d97d512545ff9b00e593487ef5fa/roles/a7a08ffb4e7f40f683e711c83a6186d0 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:25:44.867089 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea654b03-0cb3-4c32-9f61-cc78a18a6bd8 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:44.867089 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea654b03-0cb3-4c32-9f61-cc78a18a6bd8 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:44.867089 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea654b03-0cb3-4c32-9f61-cc78a18a6bd8 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:44.867089 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 56/111] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:25:44.867089 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea654b03-0cb3-4c32-9f61-cc78a18a6bd8 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:44.874937 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b7ec5-4605-4b28-af97-4aa40553c1ae None admin] RBAC: Authorizing `identity:get_user(user_id=dd58280bd25a413090a44fb44307c117)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:44.876839 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b7ec5-4605-4b28-af97-4aa40553c1ae None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:44.879028 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 56/112] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:25:44 2022] GET /identity/v3/users/dd58280bd25a413090a44fb44307c117 => generated 289 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:44.884455 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c26864-80a6-43e1-9314-d3aacad7f4f5 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:44.884455 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c26864-80a6-43e1-9314-d3aacad7f4f5 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:44.884455 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c26864-80a6-43e1-9314-d3aacad7f4f5 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:44.888887 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 57/113] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:25:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:25:44.890419 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1fc53-698a-4e4d-9c2b-4b0de7883ffd None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:44.890727 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1fc53-698a-4e4d-9c2b-4b0de7883ffd None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:44.891019 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1fc53-698a-4e4d-9c2b-4b0de7883ffd None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:44.892448 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 58/114] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:25:44.893597 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c61bc-fb98-40c4-8f2c-cb87e49c6219 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:44.893895 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c61bc-fb98-40c4-8f2c-cb87e49c6219 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:44.894215 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c61bc-fb98-40c4-8f2c-cb87e49c6219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:44.915268 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-811c61bc-fb98-40c4-8f2c-cb87e49c6219 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:25:44.916640 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-811c61bc-fb98-40c4-8f2c-cb87e49c6219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:25:44.998160 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 59/115] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:25:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:25:44.998160 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c61bc-fb98-40c4-8f2c-cb87e49c6219 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:45.013671 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea654b03-0cb3-4c32-9f61-cc78a18a6bd8 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:45.056526 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c8a49-3212-4908-aa93-d2a7472cafd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:45.057344 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c8a49-3212-4908-aa93-d2a7472cafd4 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:45.057640 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c8a49-3212-4908-aa93-d2a7472cafd4 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:45.057930 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c8a49-3212-4908-aa93-d2a7472cafd4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:45.059171 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928c8a49-3212-4908-aa93-d2a7472cafd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:45.060654 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928c8a49-3212-4908-aa93-d2a7472cafd4 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:45.062496 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 57/116] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:25:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:45.063536 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a4754-371c-42bb-9f30-aa0f4a2ddf54 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:45.063830 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a4754-371c-42bb-9f30-aa0f4a2ddf54 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:45.064119 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a4754-371c-42bb-9f30-aa0f4a2ddf54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:45.084141 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-822a4754-371c-42bb-9f30-aa0f4a2ddf54 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:25:45.085832 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-822a4754-371c-42bb-9f30-aa0f4a2ddf54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:25:45.098628 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:45.134494 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:45.135053 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c61bc-fb98-40c4-8f2c-cb87e49c6219 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:45.161832 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 58/117] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:25:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:25:45.171874 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4084d-3c25-43aa-ac0e-1774e6cbf7b3 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:45.172282 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4084d-3c25-43aa-ac0e-1774e6cbf7b3 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:45.172599 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4084d-3c25-43aa-ac0e-1774e6cbf7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:45.174048 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659b88e-bb39-4ed6-81bb-c52ef1cb2243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:45.174753 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659b88e-bb39-4ed6-81bb-c52ef1cb2243 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:45.175051 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659b88e-bb39-4ed6-81bb-c52ef1cb2243 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:45.175343 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659b88e-bb39-4ed6-81bb-c52ef1cb2243 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:45.201337 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-dbb4084d-3c25-43aa-ac0e-1774e6cbf7b3 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:25:45.202833 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-dbb4084d-3c25-43aa-ac0e-1774e6cbf7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:25:45.259368 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8659b88e-bb39-4ed6-81bb-c52ef1cb2243 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:45.261009 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8659b88e-bb39-4ed6-81bb-c52ef1cb2243 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:45.275391 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 59/118] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:25:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:25:45.276287 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb4084d-3c25-43aa-ac0e-1774e6cbf7b3 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:45.351092 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:45.388889 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb4084d-3c25-43aa-ac0e-1774e6cbf7b3 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:45.390561 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 60/119] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:25:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:25:45.391463 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659b88e-bb39-4ed6-81bb-c52ef1cb2243 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:45.403557 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:45.434638 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a4fd2-cbba-43ec-8c0a-f035c408b9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:45.435539 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a4fd2-cbba-43ec-8c0a-f035c408b9e0 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:45.435836 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a4fd2-cbba-43ec-8c0a-f035c408b9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:45.436124 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a4fd2-cbba-43ec-8c0a-f035c408b9e0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:45.449367 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a4fd2-cbba-43ec-8c0a-f035c408b9e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:25:45.457876 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-2e0a4fd2-cbba-43ec-8c0a-f035c408b9e0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:25:45.457876 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:25:45.457876 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:25:45.457876 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:25:45.457876 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:25:45.457876 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:25:45.457876 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:25:45.457876 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:25:45.457876 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:25:45.457876 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:25:45.457876 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:25:45.457876 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:25:45.457876 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:25:45.457876 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:25:45.457876 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:25:45.457876 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:25:45.459170 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:25:45.459170 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:25:45.459170 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:25:45.459170 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:25:45.459170 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:25:45.459170 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:25:45.459170 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:25:45.459170 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:25:45.459170 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:25:45.459170 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:25:45.459170 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:25:45.459170 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:25:45.459170 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:25:45.459170 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:25:45.459170 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:25:45.459170 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:25:45.460279 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:25:45.460279 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:25:45.460279 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:25:45.460279 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:25:45.460279 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:25:45.460279 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:25:45.460279 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:25:45.460279 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:25:45.460279 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:25:45.460279 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:25:45.460279 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:25:45.460279 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:25:45.460279 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 60/120] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:25:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:25:45.461947 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a4fd2-cbba-43ec-8c0a-f035c408b9e0 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:45.514624 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659b88e-bb39-4ed6-81bb-c52ef1cb2243 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:45.550015 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209180f2-93e3-4124-8252-19620dd84336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:45.550640 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209180f2-93e3-4124-8252-19620dd84336 None admin] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:45.550941 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209180f2-93e3-4124-8252-19620dd84336 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:45.551227 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209180f2-93e3-4124-8252-19620dd84336 None admin] PATH_INFO: `/v3/projects` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:45.551953 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209180f2-93e3-4124-8252-19620dd84336 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:45.553472 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209180f2-93e3-4124-8252-19620dd84336 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:45.588326 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a4fd2-cbba-43ec-8c0a-f035c408b9e0 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:45.621842 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69202d-1d00-42b6-8fdf-d20cb371b82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:45.622674 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69202d-1d00-42b6-8fdf-d20cb371b82f None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:45.622967 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69202d-1d00-42b6-8fdf-d20cb371b82f None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:45.623254 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69202d-1d00-42b6-8fdf-d20cb371b82f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:45.633987 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae69202d-1d00-42b6-8fdf-d20cb371b82f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:25:45.641777 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-ae69202d-1d00-42b6-8fdf-d20cb371b82f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:25:45.641777 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:25:45.641777 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:25:45.641777 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:25:45.641777 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:25:45.641777 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:25:45.641777 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:25:45.641777 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:25:45.641777 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:25:45.641777 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:25:45.641777 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:25:45.641777 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:25:45.641777 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:25:45.641777 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:25:45.641777 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:25:45.641777 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:25:45.642951 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:25:45.642951 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:25:45.642951 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:25:45.642951 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:25:45.642951 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:25:45.642951 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:25:45.642951 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:25:45.642951 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:25:45.642951 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:25:45.642951 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:25:45.642951 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:25:45.642951 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:25:45.642951 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:25:45.642951 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:25:45.642951 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:25:45.642951 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:25:45.644054 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:25:45.644054 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:25:45.644054 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:25:45.644054 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:25:45.644054 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:25:45.644054 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:25:45.644054 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:25:45.644054 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:25:45.644054 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:25:45.644054 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:25:45.644054 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:25:45.644054 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:25:45.644054 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 61/121] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:25:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:25:45.644054 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69202d-1d00-42b6-8fdf-d20cb371b82f None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:45.672195 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:45.714161 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 61/122] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Jul 5 21:25:45 2022] POST /identity/v3/projects => generated 302 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:25:45.714161 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209180f2-93e3-4124-8252-19620dd84336 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:45.742864 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:45.763332 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69202d-1d00-42b6-8fdf-d20cb371b82f None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:45.816894 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ed000-4ce2-4ca1-a242-b81162475c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:45.817985 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ed000-4ce2-4ca1-a242-b81162475c82 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:45.818304 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ed000-4ce2-4ca1-a242-b81162475c82 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:45.818593 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ed000-4ce2-4ca1-a242-b81162475c82 None admin] PATH_INFO: `/v3/roles/member` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:45.835034 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1ed000-4ce2-4ca1-a242-b81162475c82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:25:45.838203 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209180f2-93e3-4124-8252-19620dd84336 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:45.845393 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-8d1ed000-4ce2-4ca1-a242-b81162475c82 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:25:45.845393 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:25:45.845393 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:25:45.845393 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:25:45.845393 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:25:45.845393 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:25:45.845393 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:25:45.845393 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:25:45.845393 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:25:45.845393 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:25:45.845393 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:25:45.845393 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:25:45.845393 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:25:45.845393 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:25:45.845393 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:25:45.845393 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:25:45.846529 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:25:45.846529 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:25:45.846529 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:25:45.846529 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:25:45.846529 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:25:45.846529 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:25:45.846529 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:25:45.846529 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:25:45.846529 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:25:45.846529 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:25:45.846529 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:25:45.846529 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:25:45.846529 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:25:45.846529 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:25:45.846529 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:25:45.846529 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:25:45.847448 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:25:45.847448 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:25:45.847448 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:25:45.847448 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:25:45.847448 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:25:45.847448 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:25:45.847448 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:25:45.847448 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:25:45.847448 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:25:45.847448 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:25:45.847448 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:25:45.847448 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:25:45.847448 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 62/123] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:25:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:25:45.848198 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ed000-4ce2-4ca1-a242-b81162475c82 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:45.885405 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602063a7-0200-4365-9035-d4acec1c3583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:45.886327 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602063a7-0200-4365-9035-d4acec1c3583 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:45.886619 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602063a7-0200-4365-9035-d4acec1c3583 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:45.886902 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602063a7-0200-4365-9035-d4acec1c3583 None admin] PATH_INFO: `/v3/projects/f79334203c0a4279909fbe5e93cc441c` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:45.889053 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602063a7-0200-4365-9035-d4acec1c3583 None admin] RBAC: Authorizing `identity:get_project(project_id=f79334203c0a4279909fbe5e93cc441c)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:45.891010 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602063a7-0200-4365-9035-d4acec1c3583 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:45.893265 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 62/124] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:25:45 2022] GET /identity/v3/projects/f79334203c0a4279909fbe5e93cc441c => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:45.894163 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602063a7-0200-4365-9035-d4acec1c3583 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:45.969886 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:45.994422 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ed000-4ce2-4ca1-a242-b81162475c82 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:46.010558 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:46.021277 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602063a7-0200-4365-9035-d4acec1c3583 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:46.038691 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea861d9-bc61-4480-b2f6-529096a04251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:46.040185 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea861d9-bc61-4480-b2f6-529096a04251 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:46.040753 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea861d9-bc61-4480-b2f6-529096a04251 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:46.041172 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea861d9-bc61-4480-b2f6-529096a04251 None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:46.042397 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea861d9-bc61-4480-b2f6-529096a04251 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:25:46.042829 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea861d9-bc61-4480-b2f6-529096a04251 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:46.044817 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea861d9-bc61-4480-b2f6-529096a04251 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:46.058556 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 63/125] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:25:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:46.059625 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea861d9-bc61-4480-b2f6-529096a04251 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:46.060965 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb5a77-70ff-4f96-a79f-0922fa94ac08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:46.061662 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb5a77-70ff-4f96-a79f-0922fa94ac08 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:46.061961 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb5a77-70ff-4f96-a79f-0922fa94ac08 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:46.062284 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb5a77-70ff-4f96-a79f-0922fa94ac08 None admin] PATH_INFO: `/v3/roles` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:46.063394 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb5a77-70ff-4f96-a79f-0922fa94ac08 None admin] RBAC: Adding query filter params (name=admin) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:25:46.063729 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb5a77-70ff-4f96-a79f-0922fa94ac08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:46.065149 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb5a77-70ff-4f96-a79f-0922fa94ac08 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:46.075295 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 63/126] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:25:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:46.075868 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb5a77-70ff-4f96-a79f-0922fa94ac08 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:46.191316 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea861d9-bc61-4480-b2f6-529096a04251 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:46.191881 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb5a77-70ff-4f96-a79f-0922fa94ac08 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:46.232456 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5440d-7b67-430c-9cc5-f206864921a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:46.233131 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5440d-7b67-430c-9cc5-f206864921a3 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:46.233494 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5440d-7b67-430c-9cc5-f206864921a3 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:46.233792 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5440d-7b67-430c-9cc5-f206864921a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:46.234714 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5440d-7b67-430c-9cc5-f206864921a3 None admin] RBAC: Adding query filter params (role.id=8c6de83a2de94d0a93b23f7853c8a2c7, scope.project.id=f79334203c0a4279909fbe5e93cc441c, user.id=dd58280bd25a413090a44fb44307c117) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:25:46.235043 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5440d-7b67-430c-9cc5-f206864921a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:46.235571 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd60af2-c02d-4f7f-b09b-3cd51da3911d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:46.236255 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd60af2-c02d-4f7f-b09b-3cd51da3911d None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:46.236551 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd60af2-c02d-4f7f-b09b-3cd51da3911d None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:46.236668 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5440d-7b67-430c-9cc5-f206864921a3 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:46.236842 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd60af2-c02d-4f7f-b09b-3cd51da3911d None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:46.237771 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd60af2-c02d-4f7f-b09b-3cd51da3911d None admin] RBAC: Adding query filter params (name=member) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:25:46.238094 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd60af2-c02d-4f7f-b09b-3cd51da3911d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:46.240349 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd60af2-c02d-4f7f-b09b-3cd51da3911d None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:46.243710 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 64/127] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:25:46 2022] GET /identity/v3/role_assignments?user.id=dd58280bd25a413090a44fb44307c117&scope.project.id=f79334203c0a4279909fbe5e93cc441c&role.id=8c6de83a2de94d0a93b23f7853c8a2c7 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:46.247319 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5440d-7b67-430c-9cc5-f206864921a3 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:46.262026 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 64/128] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:25:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:46.262780 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd60af2-c02d-4f7f-b09b-3cd51da3911d None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:46.279338 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:46.292652 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:46.415573 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd60af2-c02d-4f7f-b09b-3cd51da3911d None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:46.444251 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5440d-7b67-430c-9cc5-f206864921a3 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:46.484562 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c96133d-9a88-415f-8393-6679cc689056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:46.485819 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96133d-9a88-415f-8393-6679cc689056 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:46.486295 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96133d-9a88-415f-8393-6679cc689056 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:46.486729 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96133d-9a88-415f-8393-6679cc689056 None admin] PATH_INFO: `/v3/users/8f7b68cdb43a4c0b96cd3cbfc39bee35` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:46.487366 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1d808-6538-470d-8e71-3f04cc21b16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:46.488301 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c96133d-9a88-415f-8393-6679cc689056 None admin] RBAC: Authorizing `identity:get_user(user_id=8f7b68cdb43a4c0b96cd3cbfc39bee35)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:46.488424 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1d808-6538-470d-8e71-3f04cc21b16f None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:46.488826 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1d808-6538-470d-8e71-3f04cc21b16f None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:46.489211 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1d808-6538-470d-8e71-3f04cc21b16f None admin] PATH_INFO: `/v3/users/2476d97d512545ff9b00e593487ef5fa` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:46.490462 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c96133d-9a88-415f-8393-6679cc689056 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:46.490662 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff1d808-6538-470d-8e71-3f04cc21b16f None admin] RBAC: Authorizing `identity:get_user(user_id=2476d97d512545ff9b00e593487ef5fa)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:46.492235 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff1d808-6538-470d-8e71-3f04cc21b16f None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:46.492680 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 65/129] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:25:46 2022] GET /identity/v3/users/8f7b68cdb43a4c0b96cd3cbfc39bee35 => generated 247 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:46.495873 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 65/130] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:25:46 2022] GET /identity/v3/users/2476d97d512545ff9b00e593487ef5fa => generated 275 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:46.495873 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1d808-6538-470d-8e71-3f04cc21b16f None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:46.499748 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c96133d-9a88-415f-8393-6679cc689056 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:46.602180 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:46.631487 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c96133d-9a88-415f-8393-6679cc689056 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:46.651831 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:46.674174 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f540d13-fd42-438c-8bb5-9397669a7046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:46.675312 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f540d13-fd42-438c-8bb5-9397669a7046 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:46.675767 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f540d13-fd42-438c-8bb5-9397669a7046 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:46.676264 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f540d13-fd42-438c-8bb5-9397669a7046 None admin] PATH_INFO: `/v3/projects/f79334203c0a4279909fbe5e93cc441c` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:46.677927 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f540d13-fd42-438c-8bb5-9397669a7046 None admin] RBAC: Authorizing `identity:get_project(project_id=f79334203c0a4279909fbe5e93cc441c)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:46.679841 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f540d13-fd42-438c-8bb5-9397669a7046 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:46.687433 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 66/131] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:25:46 2022] GET /identity/v3/projects/f79334203c0a4279909fbe5e93cc441c => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:46.688454 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f540d13-fd42-438c-8bb5-9397669a7046 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:46.704650 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1d808-6538-470d-8e71-3f04cc21b16f None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:46.798353 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79300b3e-cfaf-4317-b12e-1e9d138696d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:46.799169 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79300b3e-cfaf-4317-b12e-1e9d138696d2 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:46.799491 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79300b3e-cfaf-4317-b12e-1e9d138696d2 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:46.799743 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79300b3e-cfaf-4317-b12e-1e9d138696d2 None admin] PATH_INFO: `/v3/users/2476d97d512545ff9b00e593487ef5fa` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:46.800952 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79300b3e-cfaf-4317-b12e-1e9d138696d2 None admin] RBAC: Authorizing `identity:get_user(user_id=2476d97d512545ff9b00e593487ef5fa)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:46.806823 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f540d13-fd42-438c-8bb5-9397669a7046 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:46.810519 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79300b3e-cfaf-4317-b12e-1e9d138696d2 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:46.812234 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 66/132] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:25:46 2022] GET /identity/v3/users/2476d97d512545ff9b00e593487ef5fa => generated 275 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:46.815718 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79300b3e-cfaf-4317-b12e-1e9d138696d2 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:46.856324 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f27eb-b39e-4ec2-8d1d-f43b789cc265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:46.857089 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f27eb-b39e-4ec2-8d1d-f43b789cc265 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:46.857384 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f27eb-b39e-4ec2-8d1d-f43b789cc265 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:46.857669 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f27eb-b39e-4ec2-8d1d-f43b789cc265 None admin] PATH_INFO: `/v3/projects/f79334203c0a4279909fbe5e93cc441c` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:46.860282 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f27eb-b39e-4ec2-8d1d-f43b789cc265 None admin] RBAC: Authorizing `identity:get_project(project_id=f79334203c0a4279909fbe5e93cc441c)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:46.861752 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f27eb-b39e-4ec2-8d1d-f43b789cc265 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:46.864685 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 67/133] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:25:46 2022] GET /identity/v3/projects/f79334203c0a4279909fbe5e93cc441c => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:46.867031 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f27eb-b39e-4ec2-8d1d-f43b789cc265 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:46.890778 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:47.038937 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79300b3e-cfaf-4317-b12e-1e9d138696d2 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:47.047529 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f27eb-b39e-4ec2-8d1d-f43b789cc265 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:47.092578 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc16353-f02c-406a-a21d-32e3d5c26a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:47.093581 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc16353-f02c-406a-a21d-32e3d5c26a1e None admin] REQUEST_METHOD: `PUT` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:47.093878 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc16353-f02c-406a-a21d-32e3d5c26a1e None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:47.094202 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc16353-f02c-406a-a21d-32e3d5c26a1e None admin] PATH_INFO: `/v3/projects/f79334203c0a4279909fbe5e93cc441c/users/8f7b68cdb43a4c0b96cd3cbfc39bee35/roles/00090b1962654604b8e106a05d44d06a` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:47.096199 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc16353-f02c-406a-a21d-32e3d5c26a1e None admin] RBAC: Authorizing `identity:create_grant(project_id=f79334203c0a4279909fbe5e93cc441c, user_id=8f7b68cdb43a4c0b96cd3cbfc39bee35, role_id=00090b1962654604b8e106a05d44d06a)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:47.097672 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc16353-f02c-406a-a21d-32e3d5c26a1e None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:47.104850 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f394e4-d7ed-4279-9c31-8fd1faa428f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:47.105834 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f394e4-d7ed-4279-9c31-8fd1faa428f0 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:47.106246 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f394e4-d7ed-4279-9c31-8fd1faa428f0 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:47.106612 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f394e4-d7ed-4279-9c31-8fd1faa428f0 None admin] PATH_INFO: `/v3/projects/d3399a76e811441fab7a583158e440d0` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:47.107923 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f394e4-d7ed-4279-9c31-8fd1faa428f0 None admin] RBAC: Authorizing `identity:get_project(project_id=d3399a76e811441fab7a583158e440d0)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:47.109516 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f394e4-d7ed-4279-9c31-8fd1faa428f0 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:47.111727 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 68/134] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:25:46 2022] GET /identity/v3/projects/d3399a76e811441fab7a583158e440d0 => generated 312 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:47.117044 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f394e4-d7ed-4279-9c31-8fd1faa428f0 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:47.207271 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:47.214302 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 67/135] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:25:46 2022] PUT /identity/v3/projects/f79334203c0a4279909fbe5e93cc441c/users/8f7b68cdb43a4c0b96cd3cbfc39bee35/roles/00090b1962654604b8e106a05d44d06a => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:25:47.216054 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f400b-2133-4114-a4dc-db4f35e10bad None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:47.217062 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f400b-2133-4114-a4dc-db4f35e10bad None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:47.217062 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f400b-2133-4114-a4dc-db4f35e10bad None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:47.219935 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 68/136] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:25:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:25:47.222187 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f400b-2133-4114-a4dc-db4f35e10bad None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:47.237667 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f394e4-d7ed-4279-9c31-8fd1faa428f0 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:47.256680 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:47.285896 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac96bf-82c3-4ca7-a78b-34912f431fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:47.287039 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac96bf-82c3-4ca7-a78b-34912f431fe4 None admin] REQUEST_METHOD: `PUT` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:47.287343 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac96bf-82c3-4ca7-a78b-34912f431fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:47.287635 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac96bf-82c3-4ca7-a78b-34912f431fe4 None admin] PATH_INFO: `/v3/projects/f79334203c0a4279909fbe5e93cc441c/users/2476d97d512545ff9b00e593487ef5fa/roles/6413bac7cc9a42cf83968dd26a3ccc34` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:47.291537 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac96bf-82c3-4ca7-a78b-34912f431fe4 None admin] RBAC: Authorizing `identity:create_grant(project_id=f79334203c0a4279909fbe5e93cc441c, user_id=2476d97d512545ff9b00e593487ef5fa, role_id=6413bac7cc9a42cf83968dd26a3ccc34)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:47.293163 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac96bf-82c3-4ca7-a78b-34912f431fe4 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:47.389405 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 69/137] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:25:47 2022] PUT /identity/v3/projects/f79334203c0a4279909fbe5e93cc441c/users/2476d97d512545ff9b00e593487ef5fa/roles/6413bac7cc9a42cf83968dd26a3ccc34 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:25:47.390068 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f400b-2133-4114-a4dc-db4f35e10bad None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:47.390642 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f9740-ec91-4303-9cd1-a8744334c5eb None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:47.390946 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f9740-ec91-4303-9cd1-a8744334c5eb None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:47.391241 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f9740-ec91-4303-9cd1-a8744334c5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:47.436061 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9939745-7557-41b2-94f5-d4ee4c40578c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:47.437110 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9939745-7557-41b2-94f5-d4ee4c40578c None admin] REQUEST_METHOD: `PUT` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:47.437452 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9939745-7557-41b2-94f5-d4ee4c40578c None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:47.437747 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9939745-7557-41b2-94f5-d4ee4c40578c None admin] PATH_INFO: `/v3/projects/d3399a76e811441fab7a583158e440d0/users/2476d97d512545ff9b00e593487ef5fa/roles/a7a08ffb4e7f40f683e711c83a6186d0` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:47.447677 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-1d2f9740-ec91-4303-9cd1-a8744334c5eb None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:25:47.448949 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-1d2f9740-ec91-4303-9cd1-a8744334c5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:25:47.449089 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9939745-7557-41b2-94f5-d4ee4c40578c None admin] RBAC: Authorizing `identity:create_grant(project_id=d3399a76e811441fab7a583158e440d0, user_id=2476d97d512545ff9b00e593487ef5fa, role_id=a7a08ffb4e7f40f683e711c83a6186d0)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:47.450687 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9939745-7557-41b2-94f5-d4ee4c40578c None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:47.536605 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 69/138] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:25:47 2022] PUT /identity/v3/projects/d3399a76e811441fab7a583158e440d0/users/2476d97d512545ff9b00e593487ef5fa/roles/a7a08ffb4e7f40f683e711c83a6186d0 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:25:47.558319 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 70/139] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:25:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:25:47.584663 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9939745-7557-41b2-94f5-d4ee4c40578c None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:47.679528 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:47.719093 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9939745-7557-41b2-94f5-d4ee4c40578c None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:47.762605 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528292d-81de-4ead-9371-06a1f0848a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:47.763434 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528292d-81de-4ead-9371-06a1f0848a9a None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:47.763729 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528292d-81de-4ead-9371-06a1f0848a9a None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:47.764017 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528292d-81de-4ead-9371-06a1f0848a9a None admin] PATH_INFO: `/v3/roles/member` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:47.780509 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6528292d-81de-4ead-9371-06a1f0848a9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:25:47.788567 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-6528292d-81de-4ead-9371-06a1f0848a9a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:25:47.788567 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:25:47.788567 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:25:47.788567 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:25:47.788567 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:25:47.788567 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:25:47.788567 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:25:47.788567 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:25:47.788567 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:25:47.788567 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:25:47.788567 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:25:47.788567 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:25:47.788567 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:25:47.788567 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:25:47.788567 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:25:47.788567 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:25:47.790155 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:25:47.790155 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:25:47.790155 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:25:47.790155 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:25:47.790155 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:25:47.790155 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:25:47.790155 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:25:47.790155 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:25:47.790155 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:25:47.790155 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:25:47.790155 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:25:47.790155 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:25:47.790155 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:25:47.790155 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:25:47.790155 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:25:47.790155 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:25:47.791155 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:25:47.791155 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:25:47.791155 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:25:47.791155 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:25:47.791155 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:25:47.791155 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:25:47.791155 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:25:47.791155 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:25:47.791155 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:25:47.791155 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:25:47.791155 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:25:47.791155 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:25:47.791155 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 70/140] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:25:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:25:47.796347 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f9740-ec91-4303-9cd1-a8744334c5eb None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:47.879343 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:47.912502 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f9740-ec91-4303-9cd1-a8744334c5eb None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:47.949951 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ee8f1-b8a1-4701-9875-5d00ff286a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:47.950683 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ee8f1-b8a1-4701-9875-5d00ff286a05 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:47.950976 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ee8f1-b8a1-4701-9875-5d00ff286a05 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:47.951272 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ee8f1-b8a1-4701-9875-5d00ff286a05 None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:47.952051 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ee8f1-b8a1-4701-9875-5d00ff286a05 None admin] RBAC: Adding query filter params (name=member) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:25:47.952383 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ee8f1-b8a1-4701-9875-5d00ff286a05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:47.954065 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ee8f1-b8a1-4701-9875-5d00ff286a05 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:47.964192 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 71/141] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:25:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:47.969937 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528292d-81de-4ead-9371-06a1f0848a9a None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:48.093617 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528292d-81de-4ead-9371-06a1f0848a9a None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:48.125846 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:48.131353 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64680a9e-0284-4d14-8090-2a30e338a903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:48.132265 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64680a9e-0284-4d14-8090-2a30e338a903 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:48.132562 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64680a9e-0284-4d14-8090-2a30e338a903 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:48.132881 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64680a9e-0284-4d14-8090-2a30e338a903 None admin] PATH_INFO: `/v3/users/2476d97d512545ff9b00e593487ef5fa` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:48.134959 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64680a9e-0284-4d14-8090-2a30e338a903 None admin] RBAC: Authorizing `identity:get_user(user_id=2476d97d512545ff9b00e593487ef5fa)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:48.136696 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64680a9e-0284-4d14-8090-2a30e338a903 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:48.138411 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 71/142] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:25:47 2022] GET /identity/v3/users/2476d97d512545ff9b00e593487ef5fa => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:48.144020 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ee8f1-b8a1-4701-9875-5d00ff286a05 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:48.255754 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ee8f1-b8a1-4701-9875-5d00ff286a05 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:48.292615 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb5c902-5da4-45cb-a39f-58731e343f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:48.293359 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5c902-5da4-45cb-a39f-58731e343f49 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:48.293652 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5c902-5da4-45cb-a39f-58731e343f49 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:48.293943 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5c902-5da4-45cb-a39f-58731e343f49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:48.298443 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:48.309771 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef838aac-53fe-474c-aab7-9cb85dda83a6 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:48.310062 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef838aac-53fe-474c-aab7-9cb85dda83a6 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:48.310362 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef838aac-53fe-474c-aab7-9cb85dda83a6 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:48.311894 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 72/143] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:25:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:25:48.317070 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f52db-3957-4066-a53a-c8d92a2ce4e3 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:48.317426 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f52db-3957-4066-a53a-c8d92a2ce4e3 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:48.317722 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f52db-3957-4066-a53a-c8d92a2ce4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:48.339140 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-059f52db-3957-4066-a53a-c8d92a2ce4e3 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:25:48.340379 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-059f52db-3957-4066-a53a-c8d92a2ce4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:25:48.432868 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 73/144] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:25:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:25:48.436210 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb5c902-5da4-45cb-a39f-58731e343f49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:48.437935 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb5c902-5da4-45cb-a39f-58731e343f49 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:48.522412 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f52db-3957-4066-a53a-c8d92a2ce4e3 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:48.629127 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 72/145] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:25:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:25:48.634814 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb5c902-5da4-45cb-a39f-58731e343f49 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:48.689851 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:48.723209 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f52db-3957-4066-a53a-c8d92a2ce4e3 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:48.784828 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:48.795749 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea716ef-7ce4-4322-90d9-4c2a26c5f115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:48.796581 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea716ef-7ce4-4322-90d9-4c2a26c5f115 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:48.796924 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea716ef-7ce4-4322-90d9-4c2a26c5f115 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:48.797215 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea716ef-7ce4-4322-90d9-4c2a26c5f115 None admin] PATH_INFO: `/v3/domains/default` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:48.800577 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb5c902-5da4-45cb-a39f-58731e343f49 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:48.802954 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea716ef-7ce4-4322-90d9-4c2a26c5f115 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:48.804441 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea716ef-7ce4-4322-90d9-4c2a26c5f115 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:48.806615 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 74/146] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:25:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:25:48.812028 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea716ef-7ce4-4322-90d9-4c2a26c5f115 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:48.886865 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9a61e-32ce-4a76-a305-dbc57b159395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:48.887771 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9a61e-32ce-4a76-a305-dbc57b159395 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:48.888066 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9a61e-32ce-4a76-a305-dbc57b159395 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:48.888355 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9a61e-32ce-4a76-a305-dbc57b159395 None admin] PATH_INFO: `/v3/projects/f79334203c0a4279909fbe5e93cc441c` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:48.889618 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df9a61e-32ce-4a76-a305-dbc57b159395 None admin] RBAC: Authorizing `identity:get_project(project_id=f79334203c0a4279909fbe5e93cc441c)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:48.891113 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df9a61e-32ce-4a76-a305-dbc57b159395 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:48.892904 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 73/147] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:25:48 2022] GET /identity/v3/projects/f79334203c0a4279909fbe5e93cc441c => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:25:48.899381 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9a61e-32ce-4a76-a305-dbc57b159395 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:48.987459 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea716ef-7ce4-4322-90d9-4c2a26c5f115 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:49.044121 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a2b33d-075f-4b71-9e78-1cd9cd956a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:49.044852 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2b33d-075f-4b71-9e78-1cd9cd956a76 None admin] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:49.045148 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2b33d-075f-4b71-9e78-1cd9cd956a76 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:49.045431 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2b33d-075f-4b71-9e78-1cd9cd956a76 None admin] PATH_INFO: `/v3/users` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:49.046185 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a2b33d-075f-4b71-9e78-1cd9cd956a76 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:49.049450 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a2b33d-075f-4b71-9e78-1cd9cd956a76 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:49.098341 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9a61e-32ce-4a76-a305-dbc57b159395 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:49.106759 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:49.135669 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf397d3-ca41-4da6-9b3c-062bf316e91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:49.136491 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf397d3-ca41-4da6-9b3c-062bf316e91f None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:49.136836 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf397d3-ca41-4da6-9b3c-062bf316e91f None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:49.137125 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf397d3-ca41-4da6-9b3c-062bf316e91f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:49.137970 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf397d3-ca41-4da6-9b3c-062bf316e91f None admin] RBAC: Adding query filter params (role.id=a7a08ffb4e7f40f683e711c83a6186d0, scope.project.id=f79334203c0a4279909fbe5e93cc441c, user.id=2476d97d512545ff9b00e593487ef5fa) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:25:49.138372 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf397d3-ca41-4da6-9b3c-062bf316e91f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:49.139914 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf397d3-ca41-4da6-9b3c-062bf316e91f None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:49.146395 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 74/148] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:25:48 2022] GET /identity/v3/role_assignments?user.id=2476d97d512545ff9b00e593487ef5fa&scope.project.id=f79334203c0a4279909fbe5e93cc441c&role.id=a7a08ffb4e7f40f683e711c83a6186d0 => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:49.147565 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd50c9f-bbbc-4987-8303-308e7be5ac11 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:49.147795 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd50c9f-bbbc-4987-8303-308e7be5ac11 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:49.148081 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd50c9f-bbbc-4987-8303-308e7be5ac11 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:49.149877 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 75/149] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:25:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:25:49.162463 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 75/150] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:25:48 2022] POST /identity/v3/users => generated 283 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:25:49.163830 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2f31e-605c-4128-90ee-40dca4275b47 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:49.164931 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2f31e-605c-4128-90ee-40dca4275b47 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:49.166418 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2f31e-605c-4128-90ee-40dca4275b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:49.207167 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-6ef2f31e-605c-4128-90ee-40dca4275b47 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:25:49.208429 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-6ef2f31e-605c-4128-90ee-40dca4275b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:25:49.296783 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 76/151] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:25:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:25:49.324227 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a2b33d-075f-4b71-9e78-1cd9cd956a76 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:49.401884 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:49.458856 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a2b33d-075f-4b71-9e78-1cd9cd956a76 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:49.500602 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc27f4-9bb9-4225-9e2a-9bbdc83ba88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:49.501806 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc27f4-9bb9-4225-9e2a-9bbdc83ba88a None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:49.502483 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc27f4-9bb9-4225-9e2a-9bbdc83ba88a None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:49.503040 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc27f4-9bb9-4225-9e2a-9bbdc83ba88a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:49.517636 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc27f4-9bb9-4225-9e2a-9bbdc83ba88a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:25:49.526407 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-b4bc27f4-9bb9-4225-9e2a-9bbdc83ba88a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:25:49.526407 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:25:49.526407 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:25:49.526407 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:25:49.526407 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:25:49.526407 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:25:49.526407 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:25:49.526407 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:25:49.526407 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:25:49.526407 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:25:49.526407 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:25:49.526407 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:25:49.526407 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:25:49.526407 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:25:49.526407 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:25:49.526407 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:25:49.527445 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:25:49.527445 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:25:49.527445 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:25:49.527445 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:25:49.527445 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:25:49.527445 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:25:49.527445 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:25:49.527445 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:25:49.527445 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:25:49.527445 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:25:49.527445 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:25:49.527445 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:25:49.527445 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:25:49.527445 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:25:49.527445 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:25:49.527445 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:25:49.528337 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:25:49.528337 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:25:49.528337 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:25:49.528337 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:25:49.528337 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:25:49.528337 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:25:49.528337 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:25:49.528337 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:25:49.528337 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:25:49.528337 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:25:49.528337 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:25:49.528337 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:25:49.531155 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 76/152] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:25:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:25:49.536835 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2f31e-605c-4128-90ee-40dca4275b47 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:49.662025 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:49.669665 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2f31e-605c-4128-90ee-40dca4275b47 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:49.711678 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20543b62-9e3e-48cd-b14f-ceba272d1596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:49.712385 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20543b62-9e3e-48cd-b14f-ceba272d1596 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:49.712683 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20543b62-9e3e-48cd-b14f-ceba272d1596 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:49.712966 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20543b62-9e3e-48cd-b14f-ceba272d1596 None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:49.713734 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20543b62-9e3e-48cd-b14f-ceba272d1596 None admin] RBAC: Adding query filter params (name=reader) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:25:49.714048 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20543b62-9e3e-48cd-b14f-ceba272d1596 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:49.715487 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20543b62-9e3e-48cd-b14f-ceba272d1596 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:49.725825 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 77/153] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:25:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:49.731191 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc27f4-9bb9-4225-9e2a-9bbdc83ba88a None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:49.840176 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc27f4-9bb9-4225-9e2a-9bbdc83ba88a None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:49.856480 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:49.876356 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a589918-1467-45c1-a9c5-193bd2503482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:49.877289 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a589918-1467-45c1-a9c5-193bd2503482 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:49.877629 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a589918-1467-45c1-a9c5-193bd2503482 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:49.877916 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a589918-1467-45c1-a9c5-193bd2503482 None admin] PATH_INFO: `/v3/users/dd58280bd25a413090a44fb44307c117` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:49.879175 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a589918-1467-45c1-a9c5-193bd2503482 None admin] RBAC: Authorizing `identity:get_user(user_id=dd58280bd25a413090a44fb44307c117)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:49.880650 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a589918-1467-45c1-a9c5-193bd2503482 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:49.882658 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 77/154] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:25:49 2022] GET /identity/v3/users/dd58280bd25a413090a44fb44307c117 => generated 289 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:49.888376 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20543b62-9e3e-48cd-b14f-ceba272d1596 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:50.002509 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20543b62-9e3e-48cd-b14f-ceba272d1596 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:50.042217 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b0560-d4e6-4cc1-bf39-c9572d7fbf20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:50.043107 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b0560-d4e6-4cc1-bf39-c9572d7fbf20 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:50.043448 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b0560-d4e6-4cc1-bf39-c9572d7fbf20 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:50.043739 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b0560-d4e6-4cc1-bf39-c9572d7fbf20 None admin] PATH_INFO: `/v3/projects/f79334203c0a4279909fbe5e93cc441c` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:50.044979 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b0560-d4e6-4cc1-bf39-c9572d7fbf20 None admin] RBAC: Authorizing `identity:get_project(project_id=f79334203c0a4279909fbe5e93cc441c)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:50.046484 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b0560-d4e6-4cc1-bf39-c9572d7fbf20 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:50.048536 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 78/155] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:25:49 2022] GET /identity/v3/projects/f79334203c0a4279909fbe5e93cc441c => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:25:50.053865 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a589918-1467-45c1-a9c5-193bd2503482 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:50.163536 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a589918-1467-45c1-a9c5-193bd2503482 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:50.200174 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a43d51-c277-46ad-ba03-8d06ea36f9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:50.201082 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a43d51-c277-46ad-ba03-8d06ea36f9af None admin] REQUEST_METHOD: `PUT` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:50.201429 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a43d51-c277-46ad-ba03-8d06ea36f9af None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:50.201721 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a43d51-c277-46ad-ba03-8d06ea36f9af None admin] PATH_INFO: `/v3/projects/f79334203c0a4279909fbe5e93cc441c/users/dd58280bd25a413090a44fb44307c117/roles/8c6de83a2de94d0a93b23f7853c8a2c7` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:50.204157 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a43d51-c277-46ad-ba03-8d06ea36f9af None admin] RBAC: Authorizing `identity:create_grant(project_id=f79334203c0a4279909fbe5e93cc441c, user_id=dd58280bd25a413090a44fb44307c117, role_id=8c6de83a2de94d0a93b23f7853c8a2c7)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:50.205633 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a43d51-c277-46ad-ba03-8d06ea36f9af None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:50.289985 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 78/156] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:25:50 2022] PUT /identity/v3/projects/f79334203c0a4279909fbe5e93cc441c/users/dd58280bd25a413090a44fb44307c117/roles/8c6de83a2de94d0a93b23f7853c8a2c7 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:25:50.362210 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9697a-69a4-4a89-9d7e-478a2dae52dc None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:50.362587 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9697a-69a4-4a89-9d7e-478a2dae52dc None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:50.362791 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9697a-69a4-4a89-9d7e-478a2dae52dc None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:50.364265 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 79/157] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:25:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:25:50.370483 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86aa0c-06f1-4782-a9d2-1e99bc3808ca None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:50.370774 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86aa0c-06f1-4782-a9d2-1e99bc3808ca None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:50.371058 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86aa0c-06f1-4782-a9d2-1e99bc3808ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:50.399887 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-1a86aa0c-06f1-4782-a9d2-1e99bc3808ca None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:25:50.401298 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-1a86aa0c-06f1-4782-a9d2-1e99bc3808ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:25:50.447191 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:50.486455 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 79/158] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:25:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:25:50.526319 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be9697a-69a4-4a89-9d7e-478a2dae52dc None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:50.565894 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:50.619656 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fda342-4c43-433a-b98c-3c27336e8b88 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:50.620327 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fda342-4c43-433a-b98c-3c27336e8b88 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:50.620829 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fda342-4c43-433a-b98c-3c27336e8b88 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:50.626743 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 80/159] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:25:50 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:25:50.632819 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02522fb5-bd7e-4388-98a4-e106eccde4b1 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:50.633699 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02522fb5-bd7e-4388-98a4-e106eccde4b1 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:50.634295 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02522fb5-bd7e-4388-98a4-e106eccde4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:50.667220 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-02522fb5-bd7e-4388-98a4-e106eccde4b1 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:25:50.667449 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be9697a-69a4-4a89-9d7e-478a2dae52dc None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:50.669299 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-02522fb5-bd7e-4388-98a4-e106eccde4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:25:50.713301 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f0937-94f6-4d1b-807e-5bdb90662f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:50.714052 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f0937-94f6-4d1b-807e-5bdb90662f33 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:50.714927 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f0937-94f6-4d1b-807e-5bdb90662f33 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:50.715219 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f0937-94f6-4d1b-807e-5bdb90662f33 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:50.733598 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507f0937-94f6-4d1b-807e-5bdb90662f33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:25:50.753491 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-507f0937-94f6-4d1b-807e-5bdb90662f33 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:25:50.753491 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:25:50.753491 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:25:50.753491 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:25:50.753491 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:25:50.753491 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:25:50.753491 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:25:50.753491 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:25:50.753491 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:25:50.753491 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:25:50.753491 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:25:50.753491 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:25:50.753491 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:25:50.753491 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:25:50.753491 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:25:50.753491 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:25:50.754632 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:25:50.754632 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:25:50.754632 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:25:50.754632 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:25:50.754632 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:25:50.754632 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:25:50.754632 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:25:50.754632 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:25:50.754632 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:25:50.754632 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:25:50.754632 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:25:50.754632 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:25:50.754632 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:25:50.754632 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:25:50.754632 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:25:50.754632 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:25:50.755539 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:25:50.755539 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:25:50.755539 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:25:50.755539 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:25:50.755539 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:25:50.755539 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:25:50.755539 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:25:50.755539 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:25:50.755539 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:25:50.755539 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:25:50.755539 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:25:50.755539 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:25:50.762496 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 80/160] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:25:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:25:50.764248 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710cc78-83bd-4669-93fa-d286a7e4851f None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:50.765031 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710cc78-83bd-4669-93fa-d286a7e4851f None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:50.766386 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710cc78-83bd-4669-93fa-d286a7e4851f None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:50.768275 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 81/161] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:25:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:25:50.770984 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8710cc78-83bd-4669-93fa-d286a7e4851f None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:50.812020 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 81/162] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:25:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:25:50.814224 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8fe169-fe8c-4758-b672-a3a8b157932d None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:50.814834 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8fe169-fe8c-4758-b672-a3a8b157932d None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:50.815343 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8fe169-fe8c-4758-b672-a3a8b157932d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:50.846709 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-1d8fe169-fe8c-4758-b672-a3a8b157932d None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:25:50.854761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-1d8fe169-fe8c-4758-b672-a3a8b157932d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:25:50.947447 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:50.966157 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 82/163] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:25:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:25:50.966157 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8fe169-fe8c-4758-b672-a3a8b157932d None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:50.994187 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8710cc78-83bd-4669-93fa-d286a7e4851f None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:51.020876 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:51.080518 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd1e634-c1a3-417b-8dcc-aa9f0424fb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:51.081211 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1e634-c1a3-417b-8dcc-aa9f0424fb54 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:51.081501 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1e634-c1a3-417b-8dcc-aa9f0424fb54 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:51.081780 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1e634-c1a3-417b-8dcc-aa9f0424fb54 None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:51.082581 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd1e634-c1a3-417b-8dcc-aa9f0424fb54 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:25:51.082899 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd1e634-c1a3-417b-8dcc-aa9f0424fb54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:51.084326 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd1e634-c1a3-417b-8dcc-aa9f0424fb54 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:51.108352 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 82/164] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:25:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:51.109229 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd1e634-c1a3-417b-8dcc-aa9f0424fb54 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:51.171275 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8fe169-fe8c-4758-b672-a3a8b157932d None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:51.222995 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d4cae-4a5f-4152-beb7-be4ad6c8aeb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:51.223718 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d4cae-4a5f-4152-beb7-be4ad6c8aeb7 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:51.224002 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d4cae-4a5f-4152-beb7-be4ad6c8aeb7 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:51.224278 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d4cae-4a5f-4152-beb7-be4ad6c8aeb7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:51.235452 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0d4cae-4a5f-4152-beb7-be4ad6c8aeb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:25:51.243738 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-7e0d4cae-4a5f-4152-beb7-be4ad6c8aeb7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:25:51.243738 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:25:51.243738 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:25:51.243738 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:25:51.243738 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:25:51.243738 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:25:51.243738 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:25:51.243738 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:25:51.243738 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:25:51.243738 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:25:51.243738 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:25:51.243738 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:25:51.243738 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:25:51.243738 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:25:51.243738 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:25:51.243738 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:25:51.246481 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:25:51.246481 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:25:51.246481 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:25:51.246481 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:25:51.246481 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:25:51.246481 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:25:51.246481 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:25:51.246481 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:25:51.246481 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:25:51.246481 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:25:51.246481 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:25:51.246481 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:25:51.246481 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:25:51.246481 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:25:51.246481 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:25:51.246481 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:25:51.247518 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:25:51.247518 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:25:51.247518 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:25:51.247518 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:25:51.247518 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:25:51.247518 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:25:51.247518 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:25:51.247518 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:25:51.247518 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:25:51.247518 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:25:51.247518 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:25:51.247518 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:25:51.247518 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 83/165] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:25:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:25:51.247518 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d4cae-4a5f-4152-beb7-be4ad6c8aeb7 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:51.354675 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:51.358155 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd1e634-c1a3-417b-8dcc-aa9f0424fb54 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:51.364531 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d4cae-4a5f-4152-beb7-be4ad6c8aeb7 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:51.401143 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ce392-4231-49b3-b6b9-7ef9c9f13973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:51.402343 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ce392-4231-49b3-b6b9-7ef9c9f13973 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:51.402794 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ce392-4231-49b3-b6b9-7ef9c9f13973 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:51.403230 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ce392-4231-49b3-b6b9-7ef9c9f13973 None admin] PATH_INFO: `/v3/users/2476d97d512545ff9b00e593487ef5fa` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:51.404623 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ce392-4231-49b3-b6b9-7ef9c9f13973 None admin] RBAC: Authorizing `identity:get_user(user_id=2476d97d512545ff9b00e593487ef5fa)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:51.406288 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ce392-4231-49b3-b6b9-7ef9c9f13973 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:51.408091 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 84/166] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:25:51 2022] GET /identity/v3/users/2476d97d512545ff9b00e593487ef5fa => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:51.409008 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ce392-4231-49b3-b6b9-7ef9c9f13973 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:51.431298 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ecb25-aa70-486c-a4ae-2074bb7f5b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:51.432129 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ecb25-aa70-486c-a4ae-2074bb7f5b0b None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:51.432418 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ecb25-aa70-486c-a4ae-2074bb7f5b0b None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:51.432698 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ecb25-aa70-486c-a4ae-2074bb7f5b0b None admin] PATH_INFO: `/v3/roles/member` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:51.448249 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18ecb25-aa70-486c-a4ae-2074bb7f5b0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:25:51.464692 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-e18ecb25-aa70-486c-a4ae-2074bb7f5b0b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:25:51.464692 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:25:51.464692 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:25:51.464692 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:25:51.464692 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:25:51.464692 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:25:51.464692 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:25:51.464692 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:25:51.464692 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:25:51.464692 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:25:51.464692 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:25:51.464692 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:25:51.464692 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:25:51.464692 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:25:51.464692 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:25:51.464692 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:25:51.466010 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:25:51.466010 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:25:51.466010 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:25:51.466010 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:25:51.466010 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:25:51.466010 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:25:51.466010 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:25:51.466010 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:25:51.466010 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:25:51.466010 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:25:51.466010 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:25:51.466010 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:25:51.466010 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:25:51.466010 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:25:51.466010 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:25:51.466010 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:25:51.467047 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:25:51.467047 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:25:51.467047 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:25:51.467047 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:25:51.467047 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:25:51.467047 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:25:51.467047 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:25:51.467047 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:25:51.467047 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:25:51.467047 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:25:51.467047 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:25:51.467047 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:25:51.467047 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 83/167] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:25:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:25:51.467047 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ecb25-aa70-486c-a4ae-2074bb7f5b0b None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:51.490161 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:51.530586 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ce392-4231-49b3-b6b9-7ef9c9f13973 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:51.568113 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c8eac-b808-4c4b-a921-9017c800bd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:51.568797 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c8eac-b808-4c4b-a921-9017c800bd80 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:51.569084 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c8eac-b808-4c4b-a921-9017c800bd80 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:51.569363 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c8eac-b808-4c4b-a921-9017c800bd80 None admin] PATH_INFO: `/v3/roles` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:51.570120 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0c8eac-b808-4c4b-a921-9017c800bd80 None admin] RBAC: Adding query filter params (name=admin) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:25:51.570589 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0c8eac-b808-4c4b-a921-9017c800bd80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:51.578169 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0c8eac-b808-4c4b-a921-9017c800bd80 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:51.581472 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 85/168] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:25:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:51.582121 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c8eac-b808-4c4b-a921-9017c800bd80 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:51.610648 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:51.693208 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c8eac-b808-4c4b-a921-9017c800bd80 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:51.719764 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ecb25-aa70-486c-a4ae-2074bb7f5b0b None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:51.729504 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b72eb-412f-414c-a977-cfdd94dc07c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:51.730278 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b72eb-412f-414c-a977-cfdd94dc07c8 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:51.730568 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b72eb-412f-414c-a977-cfdd94dc07c8 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:51.730848 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b72eb-412f-414c-a977-cfdd94dc07c8 None admin] PATH_INFO: `/v3/roles` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:51.732001 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b72eb-412f-414c-a977-cfdd94dc07c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:25:51.732001 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b72eb-412f-414c-a977-cfdd94dc07c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:51.733290 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b72eb-412f-414c-a977-cfdd94dc07c8 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:51.746598 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 86/169] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:25:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:51.746598 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b72eb-412f-414c-a977-cfdd94dc07c8 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:51.795391 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969cc131-2e6a-4575-a976-2a2fbece1c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:51.796466 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cc131-2e6a-4575-a976-2a2fbece1c73 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:51.796982 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cc131-2e6a-4575-a976-2a2fbece1c73 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:51.797482 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cc131-2e6a-4575-a976-2a2fbece1c73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:51.859115 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:51.895787 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b72eb-412f-414c-a977-cfdd94dc07c8 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:51.966543 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c9148-494a-488a-aa0f-a7cafcaa70ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:51.968187 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c9148-494a-488a-aa0f-a7cafcaa70ce None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:51.968692 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c9148-494a-488a-aa0f-a7cafcaa70ce None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:51.969183 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c9148-494a-488a-aa0f-a7cafcaa70ce None admin] PATH_INFO: `/v3/users/8f7b68cdb43a4c0b96cd3cbfc39bee35` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:51.971581 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85c9148-494a-488a-aa0f-a7cafcaa70ce None admin] RBAC: Authorizing `identity:get_user(user_id=8f7b68cdb43a4c0b96cd3cbfc39bee35)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:51.973277 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85c9148-494a-488a-aa0f-a7cafcaa70ce None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:51.975333 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 87/170] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:25:51 2022] GET /identity/v3/users/8f7b68cdb43a4c0b96cd3cbfc39bee35 => generated 247 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:51.976334 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c9148-494a-488a-aa0f-a7cafcaa70ce None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:52.039711 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969cc131-2e6a-4575-a976-2a2fbece1c73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:52.041558 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969cc131-2e6a-4575-a976-2a2fbece1c73 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:52.068109 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:52.118270 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c9148-494a-488a-aa0f-a7cafcaa70ce None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:52.182382 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3943ddb-461f-4bb2-9120-81b38d0ecb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:52.182382 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3943ddb-461f-4bb2-9120-81b38d0ecb30 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:52.182382 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3943ddb-461f-4bb2-9120-81b38d0ecb30 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:52.182382 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3943ddb-461f-4bb2-9120-81b38d0ecb30 None admin] PATH_INFO: `/v3/users/2476d97d512545ff9b00e593487ef5fa` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:52.182938 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3943ddb-461f-4bb2-9120-81b38d0ecb30 None admin] RBAC: Authorizing `identity:get_user(user_id=2476d97d512545ff9b00e593487ef5fa)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:52.182938 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3943ddb-461f-4bb2-9120-81b38d0ecb30 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:52.182938 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 88/171] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:25:51 2022] GET /identity/v3/users/2476d97d512545ff9b00e593487ef5fa => generated 275 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:52.183730 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3943ddb-461f-4bb2-9120-81b38d0ecb30 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:52.223140 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:52.238161 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 84/172] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:25:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 772 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:25:52.246278 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969cc131-2e6a-4575-a976-2a2fbece1c73 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:52.376584 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3943ddb-461f-4bb2-9120-81b38d0ecb30 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:52.412945 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969cc131-2e6a-4575-a976-2a2fbece1c73 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:52.426719 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edfc0fb-498b-4e03-b777-4acba6aa28c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:52.427389 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edfc0fb-498b-4e03-b777-4acba6aa28c3 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:52.427737 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edfc0fb-498b-4e03-b777-4acba6aa28c3 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:52.428034 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edfc0fb-498b-4e03-b777-4acba6aa28c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:52.434811 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:52.491921 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204128b0-6519-4cfb-a628-049e747a43c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:52.493112 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204128b0-6519-4cfb-a628-049e747a43c3 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:52.493404 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204128b0-6519-4cfb-a628-049e747a43c3 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:52.493777 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204128b0-6519-4cfb-a628-049e747a43c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:52.557346 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edfc0fb-498b-4e03-b777-4acba6aa28c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:52.562032 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edfc0fb-498b-4e03-b777-4acba6aa28c3 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:52.583313 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:52.677127 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 89/173] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:25:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:25:52.677986 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edfc0fb-498b-4e03-b777-4acba6aa28c3 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:52.684256 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204128b0-6519-4cfb-a628-049e747a43c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:52.685752 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204128b0-6519-4cfb-a628-049e747a43c3 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:52.796231 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edfc0fb-498b-4e03-b777-4acba6aa28c3 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:52.818294 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:52.841834 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3081507d-0833-4e23-ac65-6d5b09104a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:52.843098 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081507d-0833-4e23-ac65-6d5b09104a77 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:52.843731 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081507d-0833-4e23-ac65-6d5b09104a77 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:52.844252 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081507d-0833-4e23-ac65-6d5b09104a77 None admin] PATH_INFO: `/v3/projects/f79334203c0a4279909fbe5e93cc441c` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:52.849454 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3081507d-0833-4e23-ac65-6d5b09104a77 None admin] RBAC: Authorizing `identity:get_project(project_id=f79334203c0a4279909fbe5e93cc441c)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:52.851352 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3081507d-0833-4e23-ac65-6d5b09104a77 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:52.853681 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 90/174] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:25:52 2022] GET /identity/v3/projects/f79334203c0a4279909fbe5e93cc441c => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:52.854733 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3081507d-0833-4e23-ac65-6d5b09104a77 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:52.871959 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 85/175] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:25:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:25:52.873484 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204128b0-6519-4cfb-a628-049e747a43c3 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:52.884816 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:52.999158 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204128b0-6519-4cfb-a628-049e747a43c3 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:53.064451 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3081507d-0833-4e23-ac65-6d5b09104a77 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:53.069548 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb6305-21aa-4c93-87e7-d429a614ed50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:53.070500 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb6305-21aa-4c93-87e7-d429a614ed50 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:53.070960 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb6305-21aa-4c93-87e7-d429a614ed50 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:53.076094 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb6305-21aa-4c93-87e7-d429a614ed50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:53.077127 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb6305-21aa-4c93-87e7-d429a614ed50 None admin] RBAC: Adding query filter params (role.id=6413bac7cc9a42cf83968dd26a3ccc34, scope.project.id=f79334203c0a4279909fbe5e93cc441c, user.id=2476d97d512545ff9b00e593487ef5fa) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:25:53.077602 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb6305-21aa-4c93-87e7-d429a614ed50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:53.079510 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb6305-21aa-4c93-87e7-d429a614ed50 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:53.089887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 86/176] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:25:52 2022] GET /identity/v3/role_assignments?user.id=2476d97d512545ff9b00e593487ef5fa&scope.project.id=f79334203c0a4279909fbe5e93cc441c&role.id=6413bac7cc9a42cf83968dd26a3ccc34 => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:53.091685 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb6305-21aa-4c93-87e7-d429a614ed50 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:53.175013 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d8faf-498a-4252-9d57-d91a187a99cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:53.176047 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d8faf-498a-4252-9d57-d91a187a99cc None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:53.176434 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d8faf-498a-4252-9d57-d91a187a99cc None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:53.176812 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d8faf-498a-4252-9d57-d91a187a99cc None admin] PATH_INFO: `/v3/projects/f79334203c0a4279909fbe5e93cc441c` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:53.178329 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d8faf-498a-4252-9d57-d91a187a99cc None admin] RBAC: Authorizing `identity:get_project(project_id=f79334203c0a4279909fbe5e93cc441c)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:53.180930 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d8faf-498a-4252-9d57-d91a187a99cc None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:53.182669 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 91/177] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:25:52 2022] GET /identity/v3/projects/f79334203c0a4279909fbe5e93cc441c => generated 298 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:53.184056 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237d2e5-06af-4590-8fcb-25d3dd68c2c5 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:53.184416 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237d2e5-06af-4590-8fcb-25d3dd68c2c5 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:53.184831 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237d2e5-06af-4590-8fcb-25d3dd68c2c5 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:53.187910 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:53.192020 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 92/178] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:25:53 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:25:53.193210 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237d2e5-06af-4590-8fcb-25d3dd68c2c5 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:53.222396 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb6305-21aa-4c93-87e7-d429a614ed50 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:53.262628 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9571c8b1-868c-422e-9691-567e46ad8977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:53.263876 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571c8b1-868c-422e-9691-567e46ad8977 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:53.264356 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571c8b1-868c-422e-9691-567e46ad8977 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:53.264866 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571c8b1-868c-422e-9691-567e46ad8977 None admin] PATH_INFO: `/v3/projects/d3399a76e811441fab7a583158e440d0` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:53.266568 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9571c8b1-868c-422e-9691-567e46ad8977 None admin] RBAC: Authorizing `identity:get_project(project_id=d3399a76e811441fab7a583158e440d0)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:53.268395 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9571c8b1-868c-422e-9691-567e46ad8977 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:53.270993 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 87/179] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:25:53 2022] GET /identity/v3/projects/d3399a76e811441fab7a583158e440d0 => generated 312 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:53.272462 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fd780-c22d-4ade-9e83-9ce892db3609 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:53.272961 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fd780-c22d-4ade-9e83-9ce892db3609 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:53.273421 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fd780-c22d-4ade-9e83-9ce892db3609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:53.292310 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-a65fd780-c22d-4ade-9e83-9ce892db3609 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:25:53.293879 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-a65fd780-c22d-4ade-9e83-9ce892db3609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:25:53.340098 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:53.404542 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 88/180] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:25:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:25:53.405422 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65fd780-c22d-4ade-9e83-9ce892db3609 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:53.408856 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237d2e5-06af-4590-8fcb-25d3dd68c2c5 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:53.456368 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa74921e-3d7f-4b68-a0ce-4c45b0ae10b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:53.457331 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74921e-3d7f-4b68-a0ce-4c45b0ae10b1 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:53.458045 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74921e-3d7f-4b68-a0ce-4c45b0ae10b1 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:53.459359 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74921e-3d7f-4b68-a0ce-4c45b0ae10b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:53.460492 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa74921e-3d7f-4b68-a0ce-4c45b0ae10b1 None admin] RBAC: Adding query filter params (role.id=00090b1962654604b8e106a05d44d06a, scope.project.id=f79334203c0a4279909fbe5e93cc441c, user.id=8f7b68cdb43a4c0b96cd3cbfc39bee35) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:25:53.460819 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa74921e-3d7f-4b68-a0ce-4c45b0ae10b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:53.462910 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa74921e-3d7f-4b68-a0ce-4c45b0ae10b1 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:53.471109 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 93/181] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:25:53 2022] GET /identity/v3/role_assignments?user.id=8f7b68cdb43a4c0b96cd3cbfc39bee35&scope.project.id=f79334203c0a4279909fbe5e93cc441c&role.id=00090b1962654604b8e106a05d44d06a => generated 608 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:53.471964 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa74921e-3d7f-4b68-a0ce-4c45b0ae10b1 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:53.565306 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:53.632659 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65fd780-c22d-4ade-9e83-9ce892db3609 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:53.666852 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa74921e-3d7f-4b68-a0ce-4c45b0ae10b1 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:53.694029 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:53.709818 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e4afc-008e-4eb4-b8a0-44099c782e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:53.710677 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e4afc-008e-4eb4-b8a0-44099c782e68 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:53.712284 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e4afc-008e-4eb4-b8a0-44099c782e68 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:53.712284 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e4afc-008e-4eb4-b8a0-44099c782e68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:53.724588 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e4afc-008e-4eb4-b8a0-44099c782e68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:25:53.725862 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5d2ce7-276a-4f7c-bb5c-10a24aca25da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:53.726907 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d2ce7-276a-4f7c-bb5c-10a24aca25da None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:53.727419 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d2ce7-276a-4f7c-bb5c-10a24aca25da None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:53.728000 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d2ce7-276a-4f7c-bb5c-10a24aca25da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:53.729061 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5d2ce7-276a-4f7c-bb5c-10a24aca25da None admin] RBAC: Adding query filter params (role.id=a7a08ffb4e7f40f683e711c83a6186d0, scope.project.id=d3399a76e811441fab7a583158e440d0, user.id=2476d97d512545ff9b00e593487ef5fa) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:25:53.729570 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5d2ce7-276a-4f7c-bb5c-10a24aca25da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:53.731304 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5d2ce7-276a-4f7c-bb5c-10a24aca25da None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:53.735526 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-157e4afc-008e-4eb4-b8a0-44099c782e68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:25:53.735526 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:25:53.735526 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:25:53.735526 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:25:53.735526 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:25:53.735526 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:25:53.735526 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:25:53.735526 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:25:53.735526 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:25:53.735526 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:25:53.735526 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:25:53.735526 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:25:53.735526 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:25:53.735526 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:25:53.735526 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:25:53.735526 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:25:53.736643 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:25:53.736643 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:25:53.736643 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:25:53.736643 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:25:53.736643 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:25:53.736643 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:25:53.736643 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:25:53.736643 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:25:53.736643 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:25:53.736643 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:25:53.736643 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:25:53.736643 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:25:53.736643 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:25:53.736643 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:25:53.736643 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:25:53.736643 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:25:53.737567 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:25:53.737567 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:25:53.737567 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:25:53.737567 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:25:53.737567 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:25:53.737567 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:25:53.737567 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:25:53.737567 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:25:53.737567 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:25:53.737567 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:25:53.737567 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:25:53.737567 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:25:53.737567 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 94/182] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:25:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:25:53.741476 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7e145-7f97-4da6-ba32-5589c8fe2321 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:53.741476 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7e145-7f97-4da6-ba32-5589c8fe2321 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:53.741705 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 89/183] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:25:53 2022] GET /identity/v3/role_assignments?user.id=2476d97d512545ff9b00e593487ef5fa&scope.project.id=d3399a76e811441fab7a583158e440d0&role.id=a7a08ffb4e7f40f683e711c83a6186d0 => generated 608 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:53.743149 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7e145-7f97-4da6-ba32-5589c8fe2321 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:53.743232 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7718fd-30af-45fc-891d-5486496afee9 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:53.743232 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7718fd-30af-45fc-891d-5486496afee9 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:53.743384 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 95/184] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:25:53.743467 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7718fd-30af-45fc-891d-5486496afee9 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:53.743467 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 90/185] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:25:53.751429 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1b1be-79fd-43c4-a6be-d93115a312e9 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:53.751429 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1b1be-79fd-43c4-a6be-d93115a312e9 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:53.751429 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1b1be-79fd-43c4-a6be-d93115a312e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:53.752149 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7718fd-30af-45fc-891d-5486496afee9 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:53.774834 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-9eb1b1be-79fd-43c4-a6be-d93115a312e9 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:25:53.776407 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-9eb1b1be-79fd-43c4-a6be-d93115a312e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:25:53.873084 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 96/186] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:25:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:25:53.875016 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d044e-b239-4cec-b1f0-cab2460a3aca None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:53.875312 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d044e-b239-4cec-b1f0-cab2460a3aca None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:53.875609 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d044e-b239-4cec-b1f0-cab2460a3aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:53.901603 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-9c4d044e-b239-4cec-b1f0-cab2460a3aca None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:25:53.902883 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-9c4d044e-b239-4cec-b1f0-cab2460a3aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:25:53.904042 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7718fd-30af-45fc-891d-5486496afee9 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:53.950803 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58744d-eb8c-438d-8b28-13cad847e2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:53.951906 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58744d-eb8c-438d-8b28-13cad847e2e8 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:53.951906 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58744d-eb8c-438d-8b28-13cad847e2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:53.952191 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58744d-eb8c-438d-8b28-13cad847e2e8 None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:53.953835 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b58744d-eb8c-438d-8b28-13cad847e2e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:25:53.953835 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b58744d-eb8c-438d-8b28-13cad847e2e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:53.957098 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b58744d-eb8c-438d-8b28-13cad847e2e8 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:53.957098 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:53.966291 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 91/187] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:25:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:25:53.968047 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec555e-cf01-4e6a-8b37-b7180962c00c None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:53.968514 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec555e-cf01-4e6a-8b37-b7180962c00c None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:53.969108 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec555e-cf01-4e6a-8b37-b7180962c00c None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:53.970301 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 92/188] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:25:53.971012 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec555e-cf01-4e6a-8b37-b7180962c00c None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:53.984136 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 97/189] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:25:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:25:53.985084 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d044e-b239-4cec-b1f0-cab2460a3aca None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:54.034661 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:54.087162 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec555e-cf01-4e6a-8b37-b7180962c00c None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:54.092696 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d044e-b239-4cec-b1f0-cab2460a3aca None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:54.121229 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe17257-0a84-4167-bfa8-cc4a1c5938dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:54.122049 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe17257-0a84-4167-bfa8-cc4a1c5938dd None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:54.122369 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe17257-0a84-4167-bfa8-cc4a1c5938dd None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:54.122654 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe17257-0a84-4167-bfa8-cc4a1c5938dd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:54.126592 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004a6b1-8747-436e-80ed-37d48bd2d80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:54.127416 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004a6b1-8747-436e-80ed-37d48bd2d80b None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:54.127706 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004a6b1-8747-436e-80ed-37d48bd2d80b None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:54.127987 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004a6b1-8747-436e-80ed-37d48bd2d80b None admin] PATH_INFO: `/v3/users/b59a9590b1494272b50de7862f1887dc` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:54.133176 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe17257-0a84-4167-bfa8-cc4a1c5938dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:25:54.141030 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9004a6b1-8747-436e-80ed-37d48bd2d80b None admin] RBAC: Authorizing `identity:get_user(user_id=b59a9590b1494272b50de7862f1887dc)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:54.141257 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-1fe17257-0a84-4167-bfa8-cc4a1c5938dd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:25:54.141257 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:25:54.141257 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:25:54.141257 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:25:54.141257 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:25:54.141257 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:25:54.141257 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:25:54.141257 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:25:54.141257 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:25:54.141257 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:25:54.141257 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:25:54.141257 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:25:54.141257 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:25:54.141257 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:25:54.141257 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:25:54.141257 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:25:54.142314 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:25:54.142314 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:25:54.142314 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:25:54.142314 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:25:54.142314 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:25:54.142314 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:25:54.142314 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:25:54.142314 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:25:54.142314 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:25:54.142314 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:25:54.142314 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:25:54.142314 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:25:54.142314 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:25:54.142314 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:25:54.142314 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:25:54.142314 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:25:54.143235 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:25:54.143235 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:25:54.143235 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:25:54.143235 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:25:54.143235 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:25:54.143235 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:25:54.143235 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:25:54.143235 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:25:54.143235 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:25:54.143235 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:25:54.143235 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:25:54.143235 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:25:54.143235 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 93/190] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:25:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:25:54.143993 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9004a6b1-8747-436e-80ed-37d48bd2d80b None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:54.144067 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cfc17e-46ba-47d9-aff3-c395ef456c51 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:54.144067 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cfc17e-46ba-47d9-aff3-c395ef456c51 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:54.144210 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cfc17e-46ba-47d9-aff3-c395ef456c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:54.144290 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 98/191] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:25:53 2022] GET /identity/v3/users/b59a9590b1494272b50de7862f1887dc => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:54.145067 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004a6b1-8747-436e-80ed-37d48bd2d80b None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:54.161079 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-27cfc17e-46ba-47d9-aff3-c395ef456c51 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:25:54.162319 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-27cfc17e-46ba-47d9-aff3-c395ef456c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:25:54.214744 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:54.231386 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 94/192] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:25:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:25:54.232308 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cfc17e-46ba-47d9-aff3-c395ef456c51 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:54.254684 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:54.258759 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004a6b1-8747-436e-80ed-37d48bd2d80b None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:54.292598 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ec392b-253a-4400-a632-2a7ae79db5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:54.293433 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec392b-253a-4400-a632-2a7ae79db5f8 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:54.293719 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec392b-253a-4400-a632-2a7ae79db5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:54.294010 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec392b-253a-4400-a632-2a7ae79db5f8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:54.305265 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ec392b-253a-4400-a632-2a7ae79db5f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:25:54.313301 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-31ec392b-253a-4400-a632-2a7ae79db5f8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:25:54.313301 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:25:54.313301 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:25:54.313301 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:25:54.313301 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:25:54.313301 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:25:54.313301 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:25:54.313301 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:25:54.313301 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:25:54.313301 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:25:54.313301 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:25:54.313301 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:25:54.313301 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:25:54.313301 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:25:54.313301 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:25:54.313301 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:25:54.314635 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:25:54.314635 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:25:54.314635 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:25:54.314635 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:25:54.314635 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:25:54.314635 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:25:54.314635 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:25:54.314635 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:25:54.314635 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:25:54.314635 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:25:54.314635 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:25:54.314635 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:25:54.314635 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:25:54.314635 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:25:54.314635 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:25:54.314635 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:25:54.315757 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:25:54.315757 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:25:54.315757 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:25:54.315757 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:25:54.315757 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:25:54.315757 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:25:54.315757 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:25:54.315757 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:25:54.315757 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:25:54.315757 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:25:54.315757 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:25:54.315757 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:25:54.315757 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 99/193] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:25:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:25:54.315757 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ec392b-253a-4400-a632-2a7ae79db5f8 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:54.337943 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cfc17e-46ba-47d9-aff3-c395ef456c51 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:54.372291 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b712ee-4d72-4e3a-aa54-26ec3f8151c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:54.372964 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b712ee-4d72-4e3a-aa54-26ec3f8151c8 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:54.373255 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b712ee-4d72-4e3a-aa54-26ec3f8151c8 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:54.373535 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b712ee-4d72-4e3a-aa54-26ec3f8151c8 None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:54.374323 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b712ee-4d72-4e3a-aa54-26ec3f8151c8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:25:54.374634 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b712ee-4d72-4e3a-aa54-26ec3f8151c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:54.376031 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b712ee-4d72-4e3a-aa54-26ec3f8151c8 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:54.384974 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 95/194] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:25:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:54.384974 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b712ee-4d72-4e3a-aa54-26ec3f8151c8 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:54.421360 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ec392b-253a-4400-a632-2a7ae79db5f8 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:54.433190 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:54.456065 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95907e1f-217e-4012-9a95-93c7262b94c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:54.456821 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95907e1f-217e-4012-9a95-93c7262b94c4 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:54.457184 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95907e1f-217e-4012-9a95-93c7262b94c4 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:54.457539 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95907e1f-217e-4012-9a95-93c7262b94c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:54.484010 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b712ee-4d72-4e3a-aa54-26ec3f8151c8 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:54.486586 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:54.518016 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58bb45c-96ef-41a5-b33f-984e413c3b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:54.518848 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58bb45c-96ef-41a5-b33f-984e413c3b33 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:54.519140 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58bb45c-96ef-41a5-b33f-984e413c3b33 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:54.519423 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58bb45c-96ef-41a5-b33f-984e413c3b33 None admin] PATH_INFO: `/v3/domains/default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:54.520602 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58bb45c-96ef-41a5-b33f-984e413c3b33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:54.522056 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58bb45c-96ef-41a5-b33f-984e413c3b33 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:54.523768 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 96/195] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:25:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:54.524541 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58bb45c-96ef-41a5-b33f-984e413c3b33 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:54.527830 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95907e1f-217e-4012-9a95-93c7262b94c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:54.529508 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95907e1f-217e-4012-9a95-93c7262b94c4 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:54.627369 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58bb45c-96ef-41a5-b33f-984e413c3b33 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:54.629312 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 100/196] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:25:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:25:54.630196 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95907e1f-217e-4012-9a95-93c7262b94c4 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:54.643428 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:54.661389 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27d253-0695-455d-8b9d-f40152c8542f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:54.662064 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27d253-0695-455d-8b9d-f40152c8542f None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:54.662397 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27d253-0695-455d-8b9d-f40152c8542f None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:54.662682 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27d253-0695-455d-8b9d-f40152c8542f None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:54.663434 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c27d253-0695-455d-8b9d-f40152c8542f None admin] RBAC: Adding query filter params (name=reader) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:25:54.663745 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c27d253-0695-455d-8b9d-f40152c8542f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:54.665734 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c27d253-0695-455d-8b9d-f40152c8542f None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:54.674100 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 97/197] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:25:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:54.674903 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27d253-0695-455d-8b9d-f40152c8542f None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:54.690491 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:54.731983 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95907e1f-217e-4012-9a95-93c7262b94c4 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:54.765532 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a7f9d1-db14-4994-af31-38b6e0a11fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:54.766446 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7f9d1-db14-4994-af31-38b6e0a11fda None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:54.766732 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7f9d1-db14-4994-af31-38b6e0a11fda None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:54.767011 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7f9d1-db14-4994-af31-38b6e0a11fda None admin] PATH_INFO: `/v3/users/b59a9590b1494272b50de7862f1887dc` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:54.768213 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a7f9d1-db14-4994-af31-38b6e0a11fda None admin] RBAC: Authorizing `identity:get_user(user_id=b59a9590b1494272b50de7862f1887dc)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:54.769676 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a7f9d1-db14-4994-af31-38b6e0a11fda None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:54.771361 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 101/198] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:25:54 2022] GET /identity/v3/users/b59a9590b1494272b50de7862f1887dc => generated 283 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:54.772127 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a7f9d1-db14-4994-af31-38b6e0a11fda None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:54.777570 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27d253-0695-455d-8b9d-f40152c8542f None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:54.812238 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea07c1d-47de-426c-951c-17dc4743d1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:54.812910 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea07c1d-47de-426c-951c-17dc4743d1d6 None admin] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:54.813199 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea07c1d-47de-426c-951c-17dc4743d1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:54.813481 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea07c1d-47de-426c-951c-17dc4743d1d6 None admin] PATH_INFO: `/v3/users` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:54.814228 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea07c1d-47de-426c-951c-17dc4743d1d6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:54.815714 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea07c1d-47de-426c-951c-17dc4743d1d6 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:54.876030 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a7f9d1-db14-4994-af31-38b6e0a11fda None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:54.903712 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:54.910811 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0202d-08ed-4374-bbc7-d3b37f0db6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:54.911707 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0202d-08ed-4374-bbc7-d3b37f0db6a9 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:54.911997 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0202d-08ed-4374-bbc7-d3b37f0db6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:54.912276 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0202d-08ed-4374-bbc7-d3b37f0db6a9 None admin] PATH_INFO: `/v3/projects/b74267c87cf54aeeb11de99a05473428` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:54.913475 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c0202d-08ed-4374-bbc7-d3b37f0db6a9 None admin] RBAC: Authorizing `identity:get_project(project_id=b74267c87cf54aeeb11de99a05473428)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:54.915941 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c0202d-08ed-4374-bbc7-d3b37f0db6a9 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:54.917659 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 102/199] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:25:54 2022] GET /identity/v3/projects/b74267c87cf54aeeb11de99a05473428 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:54.918543 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0202d-08ed-4374-bbc7-d3b37f0db6a9 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:54.942963 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 98/200] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:25:54 2022] POST /identity/v3/users => generated 297 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:25:54.942963 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea07c1d-47de-426c-951c-17dc4743d1d6 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:54.982030 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:55.037480 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0202d-08ed-4374-bbc7-d3b37f0db6a9 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:55.059189 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea07c1d-47de-426c-951c-17dc4743d1d6 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:55.075225 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc61993e-bd54-4ba6-8704-76ba47f16c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:55.076190 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61993e-bd54-4ba6-8704-76ba47f16c5b None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:55.076487 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61993e-bd54-4ba6-8704-76ba47f16c5b None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:55.076771 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61993e-bd54-4ba6-8704-76ba47f16c5b None admin] PATH_INFO: `/v3/users/dd58280bd25a413090a44fb44307c117` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:55.078169 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc61993e-bd54-4ba6-8704-76ba47f16c5b None admin] RBAC: Authorizing `identity:get_user(user_id=dd58280bd25a413090a44fb44307c117)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:55.079942 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc61993e-bd54-4ba6-8704-76ba47f16c5b None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:55.081785 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 103/201] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:25:54 2022] GET /identity/v3/users/dd58280bd25a413090a44fb44307c117 => generated 289 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:55.087632 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc61993e-bd54-4ba6-8704-76ba47f16c5b None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:55.100618 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d683869-739d-4f2f-b2f9-8e6b46913a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:55.101294 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d683869-739d-4f2f-b2f9-8e6b46913a04 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:55.101590 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d683869-739d-4f2f-b2f9-8e6b46913a04 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:55.102415 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d683869-739d-4f2f-b2f9-8e6b46913a04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:55.157171 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:55.195101 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d683869-739d-4f2f-b2f9-8e6b46913a04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:55.196764 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d683869-739d-4f2f-b2f9-8e6b46913a04 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:55.209345 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc61993e-bd54-4ba6-8704-76ba47f16c5b None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:55.238627 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:55.254718 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fab096-0d0d-4003-8a9d-5c8f2326d9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:55.255392 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fab096-0d0d-4003-8a9d-5c8f2326d9af None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:55.255685 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fab096-0d0d-4003-8a9d-5c8f2326d9af None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:55.255965 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fab096-0d0d-4003-8a9d-5c8f2326d9af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:55.256812 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fab096-0d0d-4003-8a9d-5c8f2326d9af None admin] RBAC: Adding query filter params (role.id=00090b1962654604b8e106a05d44d06a, scope.project.id=b74267c87cf54aeeb11de99a05473428, user.id=b59a9590b1494272b50de7862f1887dc) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:25:55.257129 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fab096-0d0d-4003-8a9d-5c8f2326d9af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:55.261337 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fab096-0d0d-4003-8a9d-5c8f2326d9af None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:55.266957 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 104/202] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:25:55 2022] GET /identity/v3/role_assignments?user.id=b59a9590b1494272b50de7862f1887dc&scope.project.id=b74267c87cf54aeeb11de99a05473428&role.id=00090b1962654604b8e106a05d44d06a => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:55.267332 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fab096-0d0d-4003-8a9d-5c8f2326d9af None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:55.338888 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 99/203] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:25:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:25:55.346896 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d683869-739d-4f2f-b2f9-8e6b46913a04 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:55.489668 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fab096-0d0d-4003-8a9d-5c8f2326d9af None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:55.521488 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:55.524306 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d683869-739d-4f2f-b2f9-8e6b46913a04 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:55.529145 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d069252-de11-46cf-a125-0f8dac86c37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:55.529933 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d069252-de11-46cf-a125-0f8dac86c37d None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:55.530343 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d069252-de11-46cf-a125-0f8dac86c37d None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:55.530721 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d069252-de11-46cf-a125-0f8dac86c37d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:55.597692 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9fb6e-9553-4a55-ba89-1dcc68551f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:55.598733 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9fb6e-9553-4a55-ba89-1dcc68551f02 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:55.599020 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9fb6e-9553-4a55-ba89-1dcc68551f02 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:55.599302 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9fb6e-9553-4a55-ba89-1dcc68551f02 None admin] PATH_INFO: `/v3/projects/b74267c87cf54aeeb11de99a05473428` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:55.600924 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f9fb6e-9553-4a55-ba89-1dcc68551f02 None admin] RBAC: Authorizing `identity:get_project(project_id=b74267c87cf54aeeb11de99a05473428)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:55.603065 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f9fb6e-9553-4a55-ba89-1dcc68551f02 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:55.605152 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 100/204] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:25:55 2022] GET /identity/v3/projects/b74267c87cf54aeeb11de99a05473428 => generated 302 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:55.611636 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9fb6e-9553-4a55-ba89-1dcc68551f02 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:55.615566 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:55.657762 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d069252-de11-46cf-a125-0f8dac86c37d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:55.659326 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d069252-de11-46cf-a125-0f8dac86c37d None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:55.774538 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 105/205] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:25:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:25:55.781203 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d069252-de11-46cf-a125-0f8dac86c37d None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:55.826565 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:55.836165 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9fb6e-9553-4a55-ba89-1dcc68551f02 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:55.892909 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d069252-de11-46cf-a125-0f8dac86c37d None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:55.921206 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30950f-27da-48f0-a1b1-a3293472c67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:55.921889 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30950f-27da-48f0-a1b1-a3293472c67b None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:55.922204 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30950f-27da-48f0-a1b1-a3293472c67b None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:55.922493 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30950f-27da-48f0-a1b1-a3293472c67b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:55.923526 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b30950f-27da-48f0-a1b1-a3293472c67b None admin] RBAC: Adding query filter params (role.id=6413bac7cc9a42cf83968dd26a3ccc34, scope.project.id=b74267c87cf54aeeb11de99a05473428, user.id=b59a9590b1494272b50de7862f1887dc) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:25:55.923851 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b30950f-27da-48f0-a1b1-a3293472c67b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:55.925984 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b30950f-27da-48f0-a1b1-a3293472c67b None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:55.935865 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 101/206] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:25:55 2022] GET /identity/v3/role_assignments?user.id=b59a9590b1494272b50de7862f1887dc&scope.project.id=b74267c87cf54aeeb11de99a05473428&role.id=6413bac7cc9a42cf83968dd26a3ccc34 => generated 259 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:25:55.947000 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36150f2b-4815-4f57-9a05-dde21e60567f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:55.948270 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36150f2b-4815-4f57-9a05-dde21e60567f None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:55.948803 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36150f2b-4815-4f57-9a05-dde21e60567f None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:55.949285 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36150f2b-4815-4f57-9a05-dde21e60567f None admin] PATH_INFO: `/v3/projects/f79334203c0a4279909fbe5e93cc441c` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:55.950771 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36150f2b-4815-4f57-9a05-dde21e60567f None admin] RBAC: Authorizing `identity:get_project(project_id=f79334203c0a4279909fbe5e93cc441c)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:55.958162 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36150f2b-4815-4f57-9a05-dde21e60567f None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:55.960659 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 106/207] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:25:55 2022] GET /identity/v3/projects/f79334203c0a4279909fbe5e93cc441c => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:25:55.967247 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30950f-27da-48f0-a1b1-a3293472c67b None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:56.043709 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:56.082587 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30950f-27da-48f0-a1b1-a3293472c67b None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:56.120293 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db86807-bb73-4b0e-a207-3002137bf031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:56.121391 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db86807-bb73-4b0e-a207-3002137bf031 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:56.121924 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db86807-bb73-4b0e-a207-3002137bf031 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:56.122426 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db86807-bb73-4b0e-a207-3002137bf031 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:56.123479 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db86807-bb73-4b0e-a207-3002137bf031 None admin] RBAC: Adding query filter params (role.id=8c6de83a2de94d0a93b23f7853c8a2c7, scope.project.id=f79334203c0a4279909fbe5e93cc441c, user.id=dd58280bd25a413090a44fb44307c117) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:25:56.124014 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db86807-bb73-4b0e-a207-3002137bf031 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:56.125694 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db86807-bb73-4b0e-a207-3002137bf031 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:56.133792 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 102/208] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:25:55 2022] GET /identity/v3/role_assignments?user.id=dd58280bd25a413090a44fb44307c117&scope.project.id=f79334203c0a4279909fbe5e93cc441c&role.id=8c6de83a2de94d0a93b23f7853c8a2c7 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:57.298293 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec333a3-fa36-49a5-bd9e-0d981a1956c1 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:57.299351 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec333a3-fa36-49a5-bd9e-0d981a1956c1 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:57.299851 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec333a3-fa36-49a5-bd9e-0d981a1956c1 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:57.301707 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 107/209] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:25:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:25:57.307935 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1ce18-447c-4827-aeab-cbe93fb7046a None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:57.308768 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1ce18-447c-4827-aeab-cbe93fb7046a None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:57.309300 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1ce18-447c-4827-aeab-cbe93fb7046a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:57.326887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-68c1ce18-447c-4827-aeab-cbe93fb7046a None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:25:57.328446 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-68c1ce18-447c-4827-aeab-cbe93fb7046a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:25:57.403485 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22053e4a-1cf8-4216-856d-3422050292cb None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:57.403818 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22053e4a-1cf8-4216-856d-3422050292cb None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:57.404052 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22053e4a-1cf8-4216-856d-3422050292cb None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:57.404831 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 103/210] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:25:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:25:57.409776 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 108/211] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:25:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:25:57.411403 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc7753-76ae-4702-a4e9-cc852684b879 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:57.411697 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc7753-76ae-4702-a4e9-cc852684b879 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:57.411979 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc7753-76ae-4702-a4e9-cc852684b879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:57.429247 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-ffbc7753-76ae-4702-a4e9-cc852684b879 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:25:57.431029 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-ffbc7753-76ae-4702-a4e9-cc852684b879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:25:57.433668 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22053e4a-1cf8-4216-856d-3422050292cb None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:57.508112 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:57.521814 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 104/212] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:25:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:25:57.527899 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf9380-010e-4ee3-9c61-b5c155e7e0cd None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:57.528254 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf9380-010e-4ee3-9c61-b5c155e7e0cd None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:57.528638 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf9380-010e-4ee3-9c61-b5c155e7e0cd None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:57.530239 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 105/213] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:25:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:25:57.535643 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101af64-57c1-46b5-a37f-bdd4fcdf5a66 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:57.536012 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101af64-57c1-46b5-a37f-bdd4fcdf5a66 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:57.536376 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101af64-57c1-46b5-a37f-bdd4fcdf5a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:57.544277 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:57.552367 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22053e4a-1cf8-4216-856d-3422050292cb None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:57.559823 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-b101af64-57c1-46b5-a37f-bdd4fcdf5a66 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:25:57.561033 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-b101af64-57c1-46b5-a37f-bdd4fcdf5a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:25:57.593148 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92757b4-cca1-46f8-820f-27867a8bb470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:57.594104 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92757b4-cca1-46f8-820f-27867a8bb470 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:57.594422 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92757b4-cca1-46f8-820f-27867a8bb470 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:57.595013 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92757b4-cca1-46f8-820f-27867a8bb470 None admin] PATH_INFO: `/v3/roles/member` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:57.607800 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92757b4-cca1-46f8-820f-27867a8bb470 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:25:57.618446 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-b92757b4-cca1-46f8-820f-27867a8bb470 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:25:57.618446 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:25:57.618446 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:25:57.618446 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:25:57.618446 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:25:57.618446 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:25:57.618446 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:25:57.618446 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:25:57.618446 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:25:57.618446 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:25:57.618446 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:25:57.618446 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:25:57.618446 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:25:57.618446 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:25:57.618446 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:25:57.618446 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:25:57.619677 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:25:57.619677 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:25:57.619677 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:25:57.619677 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:25:57.619677 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:25:57.619677 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:25:57.619677 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:25:57.619677 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:25:57.619677 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:25:57.619677 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:25:57.619677 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:25:57.619677 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:25:57.619677 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:25:57.619677 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:25:57.619677 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:25:57.619677 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:25:57.625926 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:25:57.625926 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:25:57.625926 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:25:57.625926 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:25:57.625926 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:25:57.625926 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:25:57.625926 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:25:57.625926 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:25:57.625926 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:25:57.625926 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:25:57.625926 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:25:57.625926 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:25:57.625926 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 109/214] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:25:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:25:57.625926 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92757b4-cca1-46f8-820f-27867a8bb470 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:57.631392 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 106/215] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:25:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:25:57.643061 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b101af64-57c1-46b5-a37f-bdd4fcdf5a66 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:57.735042 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92757b4-cca1-46f8-820f-27867a8bb470 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:57.754723 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b101af64-57c1-46b5-a37f-bdd4fcdf5a66 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:57.773423 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3156b0-131f-4711-9fc6-938c5fbeec80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:57.774294 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3156b0-131f-4711-9fc6-938c5fbeec80 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:57.774588 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3156b0-131f-4711-9fc6-938c5fbeec80 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:57.774869 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3156b0-131f-4711-9fc6-938c5fbeec80 None admin] PATH_INFO: `/v3/domains/default` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:57.775996 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:57.776507 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3156b0-131f-4711-9fc6-938c5fbeec80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:57.778178 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3156b0-131f-4711-9fc6-938c5fbeec80 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:57.779995 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 110/216] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:25:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:57.780602 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3156b0-131f-4711-9fc6-938c5fbeec80 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:57.795042 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c3f9df-e08d-4cc9-9b7d-0f68257c30f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:57.795738 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3f9df-e08d-4cc9-9b7d-0f68257c30f8 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:57.796032 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3f9df-e08d-4cc9-9b7d-0f68257c30f8 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:57.796317 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3f9df-e08d-4cc9-9b7d-0f68257c30f8 None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:57.797181 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c3f9df-e08d-4cc9-9b7d-0f68257c30f8 None admin] RBAC: Adding query filter params (name=member) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:25:57.797495 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c3f9df-e08d-4cc9-9b7d-0f68257c30f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:57.798942 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c3f9df-e08d-4cc9-9b7d-0f68257c30f8 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:57.806742 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:57.812374 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 107/217] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:25:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:57.812374 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c3f9df-e08d-4cc9-9b7d-0f68257c30f8 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:57.897797 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3156b0-131f-4711-9fc6-938c5fbeec80 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:57.915508 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c3f9df-e08d-4cc9-9b7d-0f68257c30f8 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:57.940352 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a7328-5d1b-4184-a8a4-38481f696c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:57.941485 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a7328-5d1b-4184-a8a4-38481f696c41 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:57.941779 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a7328-5d1b-4184-a8a4-38481f696c41 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:57.942089 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a7328-5d1b-4184-a8a4-38481f696c41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:57.950995 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cfaedf-fed6-4eef-ae11-cb3d866f6b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:57.951680 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfaedf-fed6-4eef-ae11-cb3d866f6b84 None admin] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:57.951971 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfaedf-fed6-4eef-ae11-cb3d866f6b84 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:57.952254 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfaedf-fed6-4eef-ae11-cb3d866f6b84 None admin] PATH_INFO: `/v3/users` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:57.952815 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a7328-5d1b-4184-a8a4-38481f696c41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:25:57.952997 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cfaedf-fed6-4eef-ae11-cb3d866f6b84 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:57.954729 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cfaedf-fed6-4eef-ae11-cb3d866f6b84 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:57.960761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-393a7328-5d1b-4184-a8a4-38481f696c41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:25:57.960761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:25:57.960761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:25:57.960761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:25:57.960761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:25:57.960761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:25:57.960761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:25:57.960761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:25:57.960761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:25:57.960761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:25:57.960761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:25:57.960761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:25:57.960761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:25:57.960761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:25:57.960761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:25:57.960761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:25:57.961795 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:25:57.961795 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:25:57.961795 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:25:57.961795 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:25:57.961795 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:25:57.961795 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:25:57.961795 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:25:57.961795 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:25:57.961795 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:25:57.961795 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:25:57.961795 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:25:57.961795 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:25:57.961795 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:25:57.961795 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:25:57.961795 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:25:57.961795 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:25:57.962776 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:25:57.962776 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:25:57.962776 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:25:57.962776 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:25:57.962776 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:25:57.962776 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:25:57.962776 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:25:57.962776 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:25:57.962776 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:25:57.962776 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:25:57.962776 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:25:57.962776 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:25:57.962776 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 111/218] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:25:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:25:57.964281 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a7328-5d1b-4184-a8a4-38481f696c41 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:58.046095 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:58.062230 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 108/219] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:25:57 2022] POST /identity/v3/users => generated 297 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:25:58.062230 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cfaedf-fed6-4eef-ae11-cb3d866f6b84 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:58.076579 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a7328-5d1b-4184-a8a4-38481f696c41 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:58.116860 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf559070-315b-4c96-bd06-52effeb3f4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:58.117233 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf559070-315b-4c96-bd06-52effeb3f4f7 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:58.117502 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf559070-315b-4c96-bd06-52effeb3f4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:58.117788 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf559070-315b-4c96-bd06-52effeb3f4f7 None admin] PATH_INFO: `/v3/users/9637551d214a4dcaa8eef8e2128e0e09` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:58.124399 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:58.136745 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf559070-315b-4c96-bd06-52effeb3f4f7 None admin] RBAC: Authorizing `identity:get_user(user_id=9637551d214a4dcaa8eef8e2128e0e09)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:58.138646 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf559070-315b-4c96-bd06-52effeb3f4f7 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:58.140658 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 112/220] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:25:57 2022] GET /identity/v3/users/9637551d214a4dcaa8eef8e2128e0e09 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:58.146304 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf559070-315b-4c96-bd06-52effeb3f4f7 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:58.217265 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cfaedf-fed6-4eef-ae11-cb3d866f6b84 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:58.261081 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846005f8-cf45-4ce0-805f-973ba7909e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:58.262035 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846005f8-cf45-4ce0-805f-973ba7909e0b None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:58.262408 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846005f8-cf45-4ce0-805f-973ba7909e0b None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:58.262635 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846005f8-cf45-4ce0-805f-973ba7909e0b None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:58.263404 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846005f8-cf45-4ce0-805f-973ba7909e0b None admin] RBAC: Adding query filter params (name=admin) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:25:58.263717 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846005f8-cf45-4ce0-805f-973ba7909e0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:58.265418 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846005f8-cf45-4ce0-805f-973ba7909e0b None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:58.273938 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf559070-315b-4c96-bd06-52effeb3f4f7 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:58.278214 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 109/221] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:25:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:58.280740 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846005f8-cf45-4ce0-805f-973ba7909e0b None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:58.330626 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e5fb0-2bab-4af1-aa53-29ee68e0f90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:58.330626 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e5fb0-2bab-4af1-aa53-29ee68e0f90c None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:58.330626 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e5fb0-2bab-4af1-aa53-29ee68e0f90c None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:58.330626 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e5fb0-2bab-4af1-aa53-29ee68e0f90c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:58.343052 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:58.419428 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:58.419952 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e5fb0-2bab-4af1-aa53-29ee68e0f90c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:58.421222 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e5fb0-2bab-4af1-aa53-29ee68e0f90c None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:58.423749 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846005f8-cf45-4ce0-805f-973ba7909e0b None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:58.474165 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7057a-e5bd-4f5c-92b4-30ba4456e214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:58.474165 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7057a-e5bd-4f5c-92b4-30ba4456e214 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:58.474165 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7057a-e5bd-4f5c-92b4-30ba4456e214 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:58.474165 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7057a-e5bd-4f5c-92b4-30ba4456e214 None admin] PATH_INFO: `/v3/users/b59a9590b1494272b50de7862f1887dc` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:58.474640 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc7057a-e5bd-4f5c-92b4-30ba4456e214 None admin] RBAC: Authorizing `identity:get_user(user_id=b59a9590b1494272b50de7862f1887dc)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:58.474640 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc7057a-e5bd-4f5c-92b4-30ba4456e214 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:58.474802 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 110/222] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:25:58 2022] GET /identity/v3/users/b59a9590b1494272b50de7862f1887dc => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:58.476045 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b7277-78e4-42c1-9bc1-8d478017997b None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:58.476347 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b7277-78e4-42c1-9bc1-8d478017997b None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:58.476699 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b7277-78e4-42c1-9bc1-8d478017997b None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:58.482836 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 111/223] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:25:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:25:58.483894 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b7277-78e4-42c1-9bc1-8d478017997b None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:58.569221 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 113/224] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:25:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 21:25:58.571055 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6d888-d884-4a40-a0aa-2a8a04849346 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:58.571361 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6d888-d884-4a40-a0aa-2a8a04849346 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:58.571643 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6d888-d884-4a40-a0aa-2a8a04849346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:58.605935 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b7277-78e4-42c1-9bc1-8d478017997b None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:58.684134 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-0ae6d888-d884-4a40-a0aa-2a8a04849346 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:25:58.686663 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-0ae6d888-d884-4a40-a0aa-2a8a04849346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:25:58.715647 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d12f6aa-d338-4050-aa21-123ed014987d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:58.716935 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12f6aa-d338-4050-aa21-123ed014987d None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:58.717225 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12f6aa-d338-4050-aa21-123ed014987d None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:58.717505 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12f6aa-d338-4050-aa21-123ed014987d None admin] PATH_INFO: `/v3/projects/b74267c87cf54aeeb11de99a05473428` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:58.718763 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d12f6aa-d338-4050-aa21-123ed014987d None admin] RBAC: Authorizing `identity:get_project(project_id=b74267c87cf54aeeb11de99a05473428)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:58.720856 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d12f6aa-d338-4050-aa21-123ed014987d None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:58.723093 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 112/225] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:25:58 2022] GET /identity/v3/projects/b74267c87cf54aeeb11de99a05473428 => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:58.724295 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d12f6aa-d338-4050-aa21-123ed014987d None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:58.742864 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:58.776943 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:58.789676 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 114/226] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:25:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:25:58.794316 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6d888-d884-4a40-a0aa-2a8a04849346 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:58.862667 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d12f6aa-d338-4050-aa21-123ed014987d None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:58.906681 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affaf0ac-6d47-4e8c-b7aa-7330b7a08a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:58.907566 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affaf0ac-6d47-4e8c-b7aa-7330b7a08a39 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:58.907859 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affaf0ac-6d47-4e8c-b7aa-7330b7a08a39 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:58.908144 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affaf0ac-6d47-4e8c-b7aa-7330b7a08a39 None admin] PATH_INFO: `/v3/projects/b74267c87cf54aeeb11de99a05473428` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:58.909780 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affaf0ac-6d47-4e8c-b7aa-7330b7a08a39 None admin] RBAC: Authorizing `identity:get_project(project_id=b74267c87cf54aeeb11de99a05473428)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:58.911563 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affaf0ac-6d47-4e8c-b7aa-7330b7a08a39 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:58.914081 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 113/227] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:25:58 2022] GET /identity/v3/projects/b74267c87cf54aeeb11de99a05473428 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:58.915036 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affaf0ac-6d47-4e8c-b7aa-7330b7a08a39 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:58.923739 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6d888-d884-4a40-a0aa-2a8a04849346 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:58.974762 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669384a-ba4c-4de0-bb61-8d158d041610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:58.976127 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669384a-ba4c-4de0-bb61-8d158d041610 None admin] REQUEST_METHOD: `PUT` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:58.976495 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669384a-ba4c-4de0-bb61-8d158d041610 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:58.977319 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669384a-ba4c-4de0-bb61-8d158d041610 None admin] PATH_INFO: `/v3/projects/b74267c87cf54aeeb11de99a05473428/users/b59a9590b1494272b50de7862f1887dc/roles/00090b1962654604b8e106a05d44d06a` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:58.979845 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a669384a-ba4c-4de0-bb61-8d158d041610 None admin] RBAC: Authorizing `identity:create_grant(project_id=b74267c87cf54aeeb11de99a05473428, user_id=b59a9590b1494272b50de7862f1887dc, role_id=00090b1962654604b8e106a05d44d06a)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:58.981904 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a669384a-ba4c-4de0-bb61-8d158d041610 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:59.033818 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affaf0ac-6d47-4e8c-b7aa-7330b7a08a39 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:59.037218 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:59.068474 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 115/228] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:25:58 2022] PUT /identity/v3/projects/b74267c87cf54aeeb11de99a05473428/users/b59a9590b1494272b50de7862f1887dc/roles/00090b1962654604b8e106a05d44d06a => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:25:59.069756 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669384a-ba4c-4de0-bb61-8d158d041610 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:59.080466 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2d47f-284c-4fc5-82a0-aa95d5c411c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:59.081877 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2d47f-284c-4fc5-82a0-aa95d5c411c0 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:59.087098 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2d47f-284c-4fc5-82a0-aa95d5c411c0 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:59.087782 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2d47f-284c-4fc5-82a0-aa95d5c411c0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:59.114851 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2d47f-284c-4fc5-82a0-aa95d5c411c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:25:59.136584 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-f0c2d47f-284c-4fc5-82a0-aa95d5c411c0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:25:59.136584 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:25:59.136584 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:25:59.136584 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:25:59.136584 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:25:59.136584 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:25:59.136584 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:25:59.136584 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:25:59.136584 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:25:59.136584 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:25:59.136584 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:25:59.136584 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:25:59.136584 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:25:59.136584 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:25:59.136584 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:25:59.136584 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:25:59.137693 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:25:59.137693 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:25:59.137693 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:25:59.137693 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:25:59.137693 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:25:59.137693 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:25:59.137693 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:25:59.137693 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:25:59.137693 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:25:59.137693 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:25:59.137693 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:25:59.137693 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:25:59.137693 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:25:59.137693 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:25:59.137693 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:25:59.137693 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:25:59.138635 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:25:59.138635 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:25:59.138635 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:25:59.138635 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:25:59.138635 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:25:59.138635 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:25:59.138635 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:25:59.138635 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:25:59.138635 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:25:59.138635 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:25:59.138635 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:25:59.138635 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:25:59.141310 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 114/229] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:25:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:25:59.147709 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2d47f-284c-4fc5-82a0-aa95d5c411c0 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:59.159324 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:59.280065 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669384a-ba4c-4de0-bb61-8d158d041610 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:59.328810 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fef3ea-0f2c-4777-a018-fef115ea7de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:59.330318 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fef3ea-0f2c-4777-a018-fef115ea7de1 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:59.330821 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fef3ea-0f2c-4777-a018-fef115ea7de1 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:59.331705 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fef3ea-0f2c-4777-a018-fef115ea7de1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:59.331830 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2d47f-284c-4fc5-82a0-aa95d5c411c0 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:59.332848 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fef3ea-0f2c-4777-a018-fef115ea7de1 None admin] RBAC: Adding query filter params (role.id=a7a08ffb4e7f40f683e711c83a6186d0, scope.project.id=b74267c87cf54aeeb11de99a05473428, user.id=9637551d214a4dcaa8eef8e2128e0e09) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:25:59.333517 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fef3ea-0f2c-4777-a018-fef115ea7de1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:59.336556 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fef3ea-0f2c-4777-a018-fef115ea7de1 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:59.343853 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 116/230] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:25:59 2022] GET /identity/v3/role_assignments?user.id=9637551d214a4dcaa8eef8e2128e0e09&scope.project.id=b74267c87cf54aeeb11de99a05473428&role.id=a7a08ffb4e7f40f683e711c83a6186d0 => generated 259 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:59.378203 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe31274-aad5-4723-8a61-97a606e8e396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:59.379232 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe31274-aad5-4723-8a61-97a606e8e396 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:59.379709 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe31274-aad5-4723-8a61-97a606e8e396 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:59.380205 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe31274-aad5-4723-8a61-97a606e8e396 None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:59.381443 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe31274-aad5-4723-8a61-97a606e8e396 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:25:59.381963 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe31274-aad5-4723-8a61-97a606e8e396 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:59.383854 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe31274-aad5-4723-8a61-97a606e8e396 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:59.393563 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 115/231] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:25:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:59.400318 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fef3ea-0f2c-4777-a018-fef115ea7de1 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:59.541380 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:59.549366 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fef3ea-0f2c-4777-a018-fef115ea7de1 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:59.605165 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c97613-6ac9-4b5f-876d-3782f6fe5a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:59.606060 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c97613-6ac9-4b5f-876d-3782f6fe5a41 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:59.606371 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c97613-6ac9-4b5f-876d-3782f6fe5a41 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:59.606651 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c97613-6ac9-4b5f-876d-3782f6fe5a41 None admin] PATH_INFO: `/v3/users/b59a9590b1494272b50de7862f1887dc` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:59.608082 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c97613-6ac9-4b5f-876d-3782f6fe5a41 None admin] RBAC: Authorizing `identity:get_user(user_id=b59a9590b1494272b50de7862f1887dc)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:59.609606 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c97613-6ac9-4b5f-876d-3782f6fe5a41 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:59.611631 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 117/232] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:25:59 2022] GET /identity/v3/users/b59a9590b1494272b50de7862f1887dc => generated 283 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:59.617229 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe31274-aad5-4723-8a61-97a606e8e396 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:59.649214 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:25:59.734402 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe31274-aad5-4723-8a61-97a606e8e396 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:59.782492 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016261e-20e0-4ca8-9def-32c39c9a0158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:59.783375 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016261e-20e0-4ca8-9def-32c39c9a0158 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:59.783659 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016261e-20e0-4ca8-9def-32c39c9a0158 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:59.783935 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016261e-20e0-4ca8-9def-32c39c9a0158 None admin] PATH_INFO: `/v3/projects/b74267c87cf54aeeb11de99a05473428` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:59.790866 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6016261e-20e0-4ca8-9def-32c39c9a0158 None admin] RBAC: Authorizing `identity:get_project(project_id=b74267c87cf54aeeb11de99a05473428)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:59.792361 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6016261e-20e0-4ca8-9def-32c39c9a0158 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:25:59.794406 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 116/233] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:25:59 2022] GET /identity/v3/projects/b74267c87cf54aeeb11de99a05473428 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:25:59.799891 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c97613-6ac9-4b5f-876d-3782f6fe5a41 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:25:59.919721 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c97613-6ac9-4b5f-876d-3782f6fe5a41 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:25:59.955888 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c97b69-15ff-4107-9f1f-d0b2e340f27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:25:59.956787 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c97b69-15ff-4107-9f1f-d0b2e340f27c None admin] REQUEST_METHOD: `PUT` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:25:59.957076 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c97b69-15ff-4107-9f1f-d0b2e340f27c None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:25:59.957356 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c97b69-15ff-4107-9f1f-d0b2e340f27c None admin] PATH_INFO: `/v3/projects/b74267c87cf54aeeb11de99a05473428/users/b59a9590b1494272b50de7862f1887dc/roles/6413bac7cc9a42cf83968dd26a3ccc34` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:25:59.959694 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c97b69-15ff-4107-9f1f-d0b2e340f27c None admin] RBAC: Authorizing `identity:create_grant(project_id=b74267c87cf54aeeb11de99a05473428, user_id=b59a9590b1494272b50de7862f1887dc, role_id=6413bac7cc9a42cf83968dd26a3ccc34)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:25:59.962013 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c97b69-15ff-4107-9f1f-d0b2e340f27c None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:00.090994 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 118/234] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:25:59 2022] PUT /identity/v3/projects/b74267c87cf54aeeb11de99a05473428/users/b59a9590b1494272b50de7862f1887dc/roles/6413bac7cc9a42cf83968dd26a3ccc34 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:26:00.436219 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15bc96-3f2f-4d32-9332-7efce9965f38 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:00.436931 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15bc96-3f2f-4d32-9332-7efce9965f38 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:00.437437 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15bc96-3f2f-4d32-9332-7efce9965f38 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:00.439365 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 117/235] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:00.444839 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8279fda-b0f0-4d89-98ef-b7acbbd25d9e None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:00.446383 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8279fda-b0f0-4d89-98ef-b7acbbd25d9e None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:00.446980 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8279fda-b0f0-4d89-98ef-b7acbbd25d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:00.466357 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-a8279fda-b0f0-4d89-98ef-b7acbbd25d9e None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:00.467875 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-a8279fda-b0f0-4d89-98ef-b7acbbd25d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:00.487252 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:00.546222 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 119/236] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:26:00.553825 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6231e49-ab38-48b6-b50d-74cb71da7982 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:00.554141 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6231e49-ab38-48b6-b50d-74cb71da7982 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:00.554448 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6231e49-ab38-48b6-b50d-74cb71da7982 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:00.556187 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 118/237] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:00.566019 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b07ed0-b38c-4985-aab6-8370f20ea874 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:00.566406 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b07ed0-b38c-4985-aab6-8370f20ea874 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:00.566693 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b07ed0-b38c-4985-aab6-8370f20ea874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:00.575720 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6231e49-ab38-48b6-b50d-74cb71da7982 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:00.588392 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-e9b07ed0-b38c-4985-aab6-8370f20ea874 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:00.589591 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-e9b07ed0-b38c-4985-aab6-8370f20ea874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:00.722503 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:00.727154 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 120/238] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:26:00.734940 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6231e49-ab38-48b6-b50d-74cb71da7982 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:00.770011 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b07ed0-b38c-4985-aab6-8370f20ea874 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:00.784351 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f218064-b7b4-4586-a659-c52c65180ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:00.785171 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f218064-b7b4-4586-a659-c52c65180ea2 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:00.785460 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f218064-b7b4-4586-a659-c52c65180ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:00.785744 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f218064-b7b4-4586-a659-c52c65180ea2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:00.808595 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f218064-b7b4-4586-a659-c52c65180ea2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:26:00.823633 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-9f218064-b7b4-4586-a659-c52c65180ea2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:26:00.823633 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:00.823633 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:00.823633 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:00.823633 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:00.823633 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:00.823633 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:00.823633 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:00.823633 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:00.823633 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:00.823633 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:00.823633 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:00.823633 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:26:00.823633 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:26:00.823633 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:26:00.823633 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:26:00.824661 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:26:00.824661 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:26:00.824661 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:26:00.824661 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:26:00.824661 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:00.824661 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:00.824661 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:00.824661 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:00.824661 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:00.824661 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:00.824661 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:00.824661 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:00.824661 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:00.824661 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:00.824661 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:00.824661 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:00.826284 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:00.826284 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:00.826284 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:00.826284 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:00.826284 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:26:00.826284 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:26:00.826284 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:26:00.826284 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:26:00.826284 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:26:00.826284 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:26:00.826284 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:26:00.826284 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:00.826284 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 119/239] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:26:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:00.834286 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f218064-b7b4-4586-a659-c52c65180ea2 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:00.893077 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:00.921707 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b07ed0-b38c-4985-aab6-8370f20ea874 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:00.993909 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f218064-b7b4-4586-a659-c52c65180ea2 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:00.997717 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb1cd88-cb53-4c71-a44e-0f8079c0b590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:00.998837 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1cd88-cb53-4c71-a44e-0f8079c0b590 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:00.999355 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1cd88-cb53-4c71-a44e-0f8079c0b590 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:00.999855 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1cd88-cb53-4c71-a44e-0f8079c0b590 None admin] PATH_INFO: `/v3/domains/default` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:01.006832 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb1cd88-cb53-4c71-a44e-0f8079c0b590 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:01.008601 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb1cd88-cb53-4c71-a44e-0f8079c0b590 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:01.010816 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 121/240] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:26:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:01.025374 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb1cd88-cb53-4c71-a44e-0f8079c0b590 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:01.042316 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd1f6b-4c91-4ee5-90fd-8e81c8b02ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:01.043061 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd1f6b-4c91-4ee5-90fd-8e81c8b02ab7 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:01.043350 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd1f6b-4c91-4ee5-90fd-8e81c8b02ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:01.043630 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd1f6b-4c91-4ee5-90fd-8e81c8b02ab7 None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:01.044455 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd1f6b-4c91-4ee5-90fd-8e81c8b02ab7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:01.044769 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd1f6b-4c91-4ee5-90fd-8e81c8b02ab7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:01.046235 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd1f6b-4c91-4ee5-90fd-8e81c8b02ab7 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:01.060730 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 120/241] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:26:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:01.066142 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd1f6b-4c91-4ee5-90fd-8e81c8b02ab7 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:01.107738 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:01.167526 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb1cd88-cb53-4c71-a44e-0f8079c0b590 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:01.232644 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f42bb-f0a8-4f60-bc45-e89c7eb5125e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:01.233339 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f42bb-f0a8-4f60-bc45-e89c7eb5125e None admin] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:01.233629 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f42bb-f0a8-4f60-bc45-e89c7eb5125e None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:01.233912 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f42bb-f0a8-4f60-bc45-e89c7eb5125e None admin] PATH_INFO: `/v3/users` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:01.234669 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547f42bb-f0a8-4f60-bc45-e89c7eb5125e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:01.236152 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547f42bb-f0a8-4f60-bc45-e89c7eb5125e None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:01.272178 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd1f6b-4c91-4ee5-90fd-8e81c8b02ab7 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:01.308797 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d3a5d-1de4-4105-a091-f80a5840344f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:01.309689 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d3a5d-1de4-4105-a091-f80a5840344f None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:01.309977 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d3a5d-1de4-4105-a091-f80a5840344f None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:01.310292 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d3a5d-1de4-4105-a091-f80a5840344f None admin] PATH_INFO: `/v3/users/6313a73dca80418c8a7fc9e8ca10d2d5` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:01.326776 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d3a5d-1de4-4105-a091-f80a5840344f None admin] RBAC: Authorizing `identity:get_user(user_id=6313a73dca80418c8a7fc9e8ca10d2d5)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:01.328265 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d3a5d-1de4-4105-a091-f80a5840344f None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:01.337446 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 122/242] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:26:01 2022] POST /identity/v3/users => generated 293 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:26:01.337903 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 121/243] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:26:01 2022] GET /identity/v3/users/6313a73dca80418c8a7fc9e8ca10d2d5 => generated 297 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:26:01.343514 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f42bb-f0a8-4f60-bc45-e89c7eb5125e None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:01.353922 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:01.493772 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f42bb-f0a8-4f60-bc45-e89c7eb5125e None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:01.544489 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a61d51-648c-4e99-b63b-a6484f204a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:01.545080 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a61d51-648c-4e99-b63b-a6484f204a52 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:01.545371 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a61d51-648c-4e99-b63b-a6484f204a52 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:01.545657 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a61d51-648c-4e99-b63b-a6484f204a52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:01.635655 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a61d51-648c-4e99-b63b-a6484f204a52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:01.637223 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a61d51-648c-4e99-b63b-a6484f204a52 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:01.645366 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:01.757753 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 123/244] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:26:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:26:01.763817 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d3a5d-1de4-4105-a091-f80a5840344f None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:01.770664 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e650bc3-31a4-4f91-8aea-84ffda0d23c2 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:01.770959 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e650bc3-31a4-4f91-8aea-84ffda0d23c2 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:01.771242 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e650bc3-31a4-4f91-8aea-84ffda0d23c2 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:01.772894 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 124/245] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:01.778846 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7aa6d4-99ef-4612-a9a5-fad3d858ac2d None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:01.779139 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7aa6d4-99ef-4612-a9a5-fad3d858ac2d None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:01.779421 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7aa6d4-99ef-4612-a9a5-fad3d858ac2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:01.799931 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-0f7aa6d4-99ef-4612-a9a5-fad3d858ac2d None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:01.801056 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-0f7aa6d4-99ef-4612-a9a5-fad3d858ac2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:01.868046 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:01.885071 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 125/246] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:26:01.901919 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d3a5d-1de4-4105-a091-f80a5840344f None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:01.909260 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7aa6d4-99ef-4612-a9a5-fad3d858ac2d None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:01.948857 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ded564-37f9-4a90-b325-d69fd96ca68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:01.949746 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ded564-37f9-4a90-b325-d69fd96ca68c None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:01.950038 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ded564-37f9-4a90-b325-d69fd96ca68c None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:01.950350 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ded564-37f9-4a90-b325-d69fd96ca68c None admin] PATH_INFO: `/v3/projects/b74267c87cf54aeeb11de99a05473428` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:01.951577 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ded564-37f9-4a90-b325-d69fd96ca68c None admin] RBAC: Authorizing `identity:get_project(project_id=b74267c87cf54aeeb11de99a05473428)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:01.953059 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ded564-37f9-4a90-b325-d69fd96ca68c None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:01.953637 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:01.955112 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 122/247] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:26:01 2022] GET /identity/v3/projects/b74267c87cf54aeeb11de99a05473428 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:01.956309 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa9bbc-6d29-4124-9100-19d5045060c2 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:01.956606 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa9bbc-6d29-4124-9100-19d5045060c2 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:01.956892 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa9bbc-6d29-4124-9100-19d5045060c2 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:01.958314 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 123/248] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:01.967110 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa9bbc-6d29-4124-9100-19d5045060c2 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:02.034758 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7aa6d4-99ef-4612-a9a5-fad3d858ac2d None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:02.079740 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b04f8-5e5f-4bb8-a6b8-8e3fdb6e051e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:02.080475 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b04f8-5e5f-4bb8-a6b8-8e3fdb6e051e None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:02.080912 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b04f8-5e5f-4bb8-a6b8-8e3fdb6e051e None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:02.081215 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b04f8-5e5f-4bb8-a6b8-8e3fdb6e051e None admin] PATH_INFO: `/v3/roles/member` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:02.087058 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa9bbc-6d29-4124-9100-19d5045060c2 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:02.096910 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b04f8-5e5f-4bb8-a6b8-8e3fdb6e051e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:26:02.107888 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-aa1b04f8-5e5f-4bb8-a6b8-8e3fdb6e051e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:26:02.107888 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:02.107888 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:02.107888 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:02.107888 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:02.107888 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:02.107888 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:02.107888 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:02.107888 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:02.107888 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:02.107888 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:02.107888 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:02.107888 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:26:02.107888 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:26:02.107888 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:26:02.107888 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:26:02.108959 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:26:02.108959 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:26:02.108959 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:26:02.108959 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:26:02.108959 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:02.108959 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:02.108959 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:02.108959 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:02.108959 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:02.108959 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:02.108959 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:02.108959 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:02.108959 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:02.108959 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:02.108959 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:02.108959 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:02.109964 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:02.109964 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:02.109964 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:02.109964 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:02.109964 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:26:02.109964 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:26:02.109964 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:26:02.109964 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:26:02.109964 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:26:02.109964 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:26:02.109964 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:26:02.109964 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:02.111501 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 126/249] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:26:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:26:02.113069 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0ea8f-676f-43f0-b36d-fd7187fb34c4 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:02.113363 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0ea8f-676f-43f0-b36d-fd7187fb34c4 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:02.113647 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0ea8f-676f-43f0-b36d-fd7187fb34c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:02.136915 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-bac0ea8f-676f-43f0-b36d-fd7187fb34c4 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:02.138283 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-bac0ea8f-676f-43f0-b36d-fd7187fb34c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:02.141518 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d45175-79b4-435c-bcdd-827c046a2028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:02.142887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d45175-79b4-435c-bcdd-827c046a2028 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:02.143183 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d45175-79b4-435c-bcdd-827c046a2028 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:02.143471 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d45175-79b4-435c-bcdd-827c046a2028 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:02.144324 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d45175-79b4-435c-bcdd-827c046a2028 None admin] RBAC: Adding query filter params (role.id=8c6de83a2de94d0a93b23f7853c8a2c7, scope.project.id=b74267c87cf54aeeb11de99a05473428, user.id=6313a73dca80418c8a7fc9e8ca10d2d5) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:02.144647 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d45175-79b4-435c-bcdd-827c046a2028 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:02.146115 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d45175-79b4-435c-bcdd-827c046a2028 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:02.153934 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 124/250] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:26:01 2022] GET /identity/v3/role_assignments?user.id=6313a73dca80418c8a7fc9e8ca10d2d5&scope.project.id=b74267c87cf54aeeb11de99a05473428&role.id=8c6de83a2de94d0a93b23f7853c8a2c7 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:02.155713 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d45175-79b4-435c-bcdd-827c046a2028 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:02.168745 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:02.287132 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 127/251] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:26:02.323368 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0ea8f-676f-43f0-b36d-fd7187fb34c4 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:02.373000 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:02.375728 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d45175-79b4-435c-bcdd-827c046a2028 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:02.426805 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981806cb-5c04-46ec-9482-203b459bd18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:02.428068 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981806cb-5c04-46ec-9482-203b459bd18a None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:02.428556 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981806cb-5c04-46ec-9482-203b459bd18a None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:02.429055 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981806cb-5c04-46ec-9482-203b459bd18a None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:02.430100 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981806cb-5c04-46ec-9482-203b459bd18a None admin] RBAC: Adding query filter params (name=member) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:02.430934 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981806cb-5c04-46ec-9482-203b459bd18a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:02.432609 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981806cb-5c04-46ec-9482-203b459bd18a None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:02.442863 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 125/252] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:26:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:02.449451 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981806cb-5c04-46ec-9482-203b459bd18a None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:02.465214 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0ea8f-676f-43f0-b36d-fd7187fb34c4 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:02.503689 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04dd66-cba8-49fc-8671-b58ed6522d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:02.504611 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04dd66-cba8-49fc-8671-b58ed6522d42 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:02.504965 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04dd66-cba8-49fc-8671-b58ed6522d42 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:02.505314 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04dd66-cba8-49fc-8671-b58ed6522d42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:02.530593 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a04dd66-cba8-49fc-8671-b58ed6522d42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:26:02.540914 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:02.553206 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-3a04dd66-cba8-49fc-8671-b58ed6522d42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:26:02.553206 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:02.553206 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:02.553206 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:02.553206 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:02.553206 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:02.553206 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:02.553206 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:02.553206 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:02.553206 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:02.553206 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:02.553206 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:02.553206 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:26:02.553206 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:26:02.553206 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:26:02.553206 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:26:02.560465 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:26:02.560465 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:26:02.560465 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:26:02.560465 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:26:02.560465 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:02.560465 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:02.560465 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:02.560465 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:02.560465 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:02.560465 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:02.560465 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:02.560465 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:02.560465 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:02.560465 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:02.560465 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:02.560465 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:02.561397 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:02.561397 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:02.561397 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:02.561397 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:02.561397 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:26:02.561397 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:26:02.561397 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:26:02.561397 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:26:02.561397 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:26:02.561397 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:26:02.561397 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:26:02.561397 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:02.561397 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 128/253] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:26:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:02.561397 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04dd66-cba8-49fc-8671-b58ed6522d42 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:02.610421 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981806cb-5c04-46ec-9482-203b459bd18a None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:02.681025 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea3ade-8de3-452e-869d-832293c940f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:02.681842 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea3ade-8de3-452e-869d-832293c940f9 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:02.682155 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea3ade-8de3-452e-869d-832293c940f9 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:02.682442 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea3ade-8de3-452e-869d-832293c940f9 None admin] PATH_INFO: `/v3/users/9637551d214a4dcaa8eef8e2128e0e09` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:02.684670 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea3ade-8de3-452e-869d-832293c940f9 None admin] RBAC: Authorizing `identity:get_user(user_id=9637551d214a4dcaa8eef8e2128e0e09)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:02.686160 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea3ade-8de3-452e-869d-832293c940f9 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:02.687843 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 126/254] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:26:02 2022] GET /identity/v3/users/9637551d214a4dcaa8eef8e2128e0e09 => generated 297 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:26:02.696175 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea3ade-8de3-452e-869d-832293c940f9 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:02.721538 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:02.751112 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04dd66-cba8-49fc-8671-b58ed6522d42 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:02.822486 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee3fc8-af6f-4559-99d6-598f1aeebc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:02.823174 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee3fc8-af6f-4559-99d6-598f1aeebc63 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:02.823466 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee3fc8-af6f-4559-99d6-598f1aeebc63 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:02.823750 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee3fc8-af6f-4559-99d6-598f1aeebc63 None admin] PATH_INFO: `/v3/roles` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:02.824524 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ee3fc8-af6f-4559-99d6-598f1aeebc63 None admin] RBAC: Adding query filter params (name=admin) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:02.824841 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ee3fc8-af6f-4559-99d6-598f1aeebc63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:02.830298 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ee3fc8-af6f-4559-99d6-598f1aeebc63 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:02.852470 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 129/255] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:26:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:02.857963 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee3fc8-af6f-4559-99d6-598f1aeebc63 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:02.900586 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea3ade-8de3-452e-869d-832293c940f9 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:02.969710 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f038a376-4b7c-46a1-a33b-8eff8c0ca559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:02.970630 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038a376-4b7c-46a1-a33b-8eff8c0ca559 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:02.970925 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038a376-4b7c-46a1-a33b-8eff8c0ca559 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:02.971209 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038a376-4b7c-46a1-a33b-8eff8c0ca559 None admin] PATH_INFO: `/v3/projects/b74267c87cf54aeeb11de99a05473428` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:02.974375 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f038a376-4b7c-46a1-a33b-8eff8c0ca559 None admin] RBAC: Authorizing `identity:get_project(project_id=b74267c87cf54aeeb11de99a05473428)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:02.975889 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f038a376-4b7c-46a1-a33b-8eff8c0ca559 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:02.981427 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 127/256] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:26:02 2022] GET /identity/v3/projects/b74267c87cf54aeeb11de99a05473428 => generated 302 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:02.982736 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352e16e-8efe-421b-97bd-9a0d22e3000b None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:02.983031 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352e16e-8efe-421b-97bd-9a0d22e3000b None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:02.983320 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352e16e-8efe-421b-97bd-9a0d22e3000b None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:02.984590 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 128/257] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:02.990147 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1260894-b422-4795-bd9d-3e02de34a0f7 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:02.991462 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1260894-b422-4795-bd9d-3e02de34a0f7 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:02.991762 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1260894-b422-4795-bd9d-3e02de34a0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:03.015156 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:03.017865 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-d1260894-b422-4795-bd9d-3e02de34a0f7 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:03.019125 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-d1260894-b422-4795-bd9d-3e02de34a0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:03.046231 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee3fc8-af6f-4559-99d6-598f1aeebc63 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:03.093876 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 129/258] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:26:03.094874 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1260894-b422-4795-bd9d-3e02de34a0f7 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:03.111106 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d38bf-dba1-4ccf-aee0-aa1769f40cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:03.112343 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d38bf-dba1-4ccf-aee0-aa1769f40cb6 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:03.112850 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d38bf-dba1-4ccf-aee0-aa1769f40cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:03.113425 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d38bf-dba1-4ccf-aee0-aa1769f40cb6 None admin] PATH_INFO: `/v3/users/b59a9590b1494272b50de7862f1887dc` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:03.114981 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d38bf-dba1-4ccf-aee0-aa1769f40cb6 None admin] RBAC: Authorizing `identity:get_user(user_id=b59a9590b1494272b50de7862f1887dc)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:03.116680 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d38bf-dba1-4ccf-aee0-aa1769f40cb6 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:03.126753 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 130/259] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:26:02 2022] GET /identity/v3/users/b59a9590b1494272b50de7862f1887dc => generated 283 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:03.130650 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d38bf-dba1-4ccf-aee0-aa1769f40cb6 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:03.162165 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:03.202834 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1260894-b422-4795-bd9d-3e02de34a0f7 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:03.240774 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98cfa99-0261-413d-a700-173541e535ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:03.241761 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cfa99-0261-413d-a700-173541e535ba None admin] REQUEST_METHOD: `PUT` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:03.242059 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cfa99-0261-413d-a700-173541e535ba None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:03.242434 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cfa99-0261-413d-a700-173541e535ba None admin] PATH_INFO: `/v3/projects/b74267c87cf54aeeb11de99a05473428/users/9637551d214a4dcaa8eef8e2128e0e09/roles/a7a08ffb4e7f40f683e711c83a6186d0` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:03.244904 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98cfa99-0261-413d-a700-173541e535ba None admin] RBAC: Authorizing `identity:create_grant(project_id=b74267c87cf54aeeb11de99a05473428, user_id=9637551d214a4dcaa8eef8e2128e0e09, role_id=a7a08ffb4e7f40f683e711c83a6186d0)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:03.248642 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98cfa99-0261-413d-a700-173541e535ba None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:03.249246 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:03.290864 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d38bf-dba1-4ccf-aee0-aa1769f40cb6 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:03.328244 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b8468-0299-4459-bbf6-a72cbc4181ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:03.329597 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b8468-0299-4459-bbf6-a72cbc4181ac None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:03.329890 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b8468-0299-4459-bbf6-a72cbc4181ac None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:03.330197 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b8468-0299-4459-bbf6-a72cbc4181ac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:03.342695 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0b8468-0299-4459-bbf6-a72cbc4181ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:26:03.351549 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-7b0b8468-0299-4459-bbf6-a72cbc4181ac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:26:03.351549 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:03.351549 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:03.351549 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:03.351549 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:03.351549 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:03.351549 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:03.351549 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:03.351549 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:03.351549 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:03.351549 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:03.351549 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:03.351549 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:26:03.351549 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:26:03.351549 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:26:03.351549 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:26:03.358773 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:26:03.358773 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:26:03.358773 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:26:03.358773 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:26:03.358773 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:03.358773 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:03.358773 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:03.358773 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:03.358773 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:03.358773 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:03.358773 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:03.358773 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:03.358773 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:03.358773 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:03.358773 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:03.358773 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:03.359706 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:03.359706 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:03.359706 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:03.359706 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:03.359706 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:26:03.359706 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:26:03.359706 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:26:03.359706 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:26:03.359706 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:26:03.359706 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:26:03.359706 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:26:03.359706 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:03.359706 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 131/260] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:26:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:03.359706 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b8468-0299-4459-bbf6-a72cbc4181ac None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:03.369675 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 130/261] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:26:03 2022] PUT /identity/v3/projects/b74267c87cf54aeeb11de99a05473428/users/9637551d214a4dcaa8eef8e2128e0e09/roles/a7a08ffb4e7f40f683e711c83a6186d0 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:26:03.370697 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98cfa99-0261-413d-a700-173541e535ba None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:03.564093 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:03.610335 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98cfa99-0261-413d-a700-173541e535ba None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:03.614555 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b8468-0299-4459-bbf6-a72cbc4181ac None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:03.678984 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8067f6-4f11-4504-ab90-55fb74aa8ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:03.679670 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8067f6-4f11-4504-ab90-55fb74aa8ffd None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:03.680501 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8067f6-4f11-4504-ab90-55fb74aa8ffd None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:03.680965 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8067f6-4f11-4504-ab90-55fb74aa8ffd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:03.682476 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa2604-420a-4a6c-8db4-e7dbbb16679f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:03.683177 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa2604-420a-4a6c-8db4-e7dbbb16679f None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:03.683467 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa2604-420a-4a6c-8db4-e7dbbb16679f None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:03.683749 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa2604-420a-4a6c-8db4-e7dbbb16679f None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:03.684537 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa2604-420a-4a6c-8db4-e7dbbb16679f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:03.684864 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa2604-420a-4a6c-8db4-e7dbbb16679f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:03.686351 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa2604-420a-4a6c-8db4-e7dbbb16679f None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:03.708313 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 131/262] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:26:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:03.716057 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa2604-420a-4a6c-8db4-e7dbbb16679f None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:03.810116 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:03.825518 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8067f6-4f11-4504-ab90-55fb74aa8ffd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:03.825518 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8067f6-4f11-4504-ab90-55fb74aa8ffd None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:03.896295 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa2604-420a-4a6c-8db4-e7dbbb16679f None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:03.958554 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:03.959716 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb4643-ff46-4a35-b157-24b319367fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:03.960619 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb4643-ff46-4a35-b157-24b319367fa4 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:03.960911 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb4643-ff46-4a35-b157-24b319367fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:03.961259 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb4643-ff46-4a35-b157-24b319367fa4 None admin] PATH_INFO: `/v3/users/b59a9590b1494272b50de7862f1887dc` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:03.963915 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb4643-ff46-4a35-b157-24b319367fa4 None admin] RBAC: Authorizing `identity:get_user(user_id=b59a9590b1494272b50de7862f1887dc)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:03.965402 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb4643-ff46-4a35-b157-24b319367fa4 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:03.968323 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 132/263] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:26:03 2022] GET /identity/v3/users/b59a9590b1494272b50de7862f1887dc => generated 283 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:03.974242 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb4643-ff46-4a35-b157-24b319367fa4 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:04.007450 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 132/264] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:26:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 653 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:26:04.015585 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8067f6-4f11-4504-ab90-55fb74aa8ffd None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:04.114423 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb4643-ff46-4a35-b157-24b319367fa4 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:04.141637 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:04.158763 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b455bc-2345-4b94-a119-28c828df293c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:04.159432 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b455bc-2345-4b94-a119-28c828df293c None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:04.159719 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b455bc-2345-4b94-a119-28c828df293c None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:04.159996 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b455bc-2345-4b94-a119-28c828df293c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:04.239456 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8067f6-4f11-4504-ab90-55fb74aa8ffd None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:04.296373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b455bc-2345-4b94-a119-28c828df293c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:04.298164 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b455bc-2345-4b94-a119-28c828df293c None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:04.331226 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c1bb6-c5a2-4dec-ae5a-7e820e941399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:04.332110 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c1bb6-c5a2-4dec-ae5a-7e820e941399 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:04.332401 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c1bb6-c5a2-4dec-ae5a-7e820e941399 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:04.332680 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c1bb6-c5a2-4dec-ae5a-7e820e941399 None admin] PATH_INFO: `/v3/projects/b74267c87cf54aeeb11de99a05473428` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:04.339121 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c1bb6-c5a2-4dec-ae5a-7e820e941399 None admin] RBAC: Authorizing `identity:get_project(project_id=b74267c87cf54aeeb11de99a05473428)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:04.340641 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c1bb6-c5a2-4dec-ae5a-7e820e941399 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:04.342824 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 133/265] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:26:04 2022] GET /identity/v3/projects/b74267c87cf54aeeb11de99a05473428 => generated 302 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:04.348480 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c1bb6-c5a2-4dec-ae5a-7e820e941399 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:04.418113 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 133/266] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:26:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:26:04.419324 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b455bc-2345-4b94-a119-28c828df293c None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:04.448432 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:04.458864 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:04.583742 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b455bc-2345-4b94-a119-28c828df293c None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:04.595586 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c1bb6-c5a2-4dec-ae5a-7e820e941399 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:04.646873 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1338645a-8843-48a4-83fb-9c646a3a6d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:04.647768 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338645a-8843-48a4-83fb-9c646a3a6d98 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:04.648058 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338645a-8843-48a4-83fb-9c646a3a6d98 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:04.648339 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338645a-8843-48a4-83fb-9c646a3a6d98 None admin] PATH_INFO: `/v3/projects/b74267c87cf54aeeb11de99a05473428` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:04.650223 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1338645a-8843-48a4-83fb-9c646a3a6d98 None admin] RBAC: Authorizing `identity:get_project(project_id=b74267c87cf54aeeb11de99a05473428)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:04.651704 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1338645a-8843-48a4-83fb-9c646a3a6d98 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:04.653441 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 134/267] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:26:04 2022] GET /identity/v3/projects/b74267c87cf54aeeb11de99a05473428 => generated 302 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:26:04.659240 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1338645a-8843-48a4-83fb-9c646a3a6d98 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:04.686962 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3545cb4-7cdf-4ad7-9240-5bbb56d61bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:04.687559 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3545cb4-7cdf-4ad7-9240-5bbb56d61bbd None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:04.687850 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3545cb4-7cdf-4ad7-9240-5bbb56d61bbd None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:04.688134 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3545cb4-7cdf-4ad7-9240-5bbb56d61bbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:04.688983 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3545cb4-7cdf-4ad7-9240-5bbb56d61bbd None admin] RBAC: Adding query filter params (role.id=00090b1962654604b8e106a05d44d06a, scope.project.id=b74267c87cf54aeeb11de99a05473428, user.id=b59a9590b1494272b50de7862f1887dc) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:04.689300 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3545cb4-7cdf-4ad7-9240-5bbb56d61bbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:04.690803 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3545cb4-7cdf-4ad7-9240-5bbb56d61bbd None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:04.708491 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 134/268] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:26:04 2022] GET /identity/v3/role_assignments?user.id=b59a9590b1494272b50de7862f1887dc&scope.project.id=b74267c87cf54aeeb11de99a05473428&role.id=00090b1962654604b8e106a05d44d06a => generated 608 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:26:04.713198 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92380d0-2486-484e-8220-94e681f1b91e None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:04.713483 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92380d0-2486-484e-8220-94e681f1b91e None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:04.713951 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92380d0-2486-484e-8220-94e681f1b91e None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:04.715843 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 135/269] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:26:04.721713 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee0b9b-0369-47b8-aa9f-8663f8e70556 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:04.722316 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee0b9b-0369-47b8-aa9f-8663f8e70556 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:04.722762 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee0b9b-0369-47b8-aa9f-8663f8e70556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:04.751810 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-08ee0b9b-0369-47b8-aa9f-8663f8e70556 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:04.753343 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-08ee0b9b-0369-47b8-aa9f-8663f8e70556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:04.843797 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:04.855308 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1338645a-8843-48a4-83fb-9c646a3a6d98 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:04.912283 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f453042-d177-476d-9fc4-2be0e353605b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:04.912964 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f453042-d177-476d-9fc4-2be0e353605b None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:04.913252 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f453042-d177-476d-9fc4-2be0e353605b None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:04.913532 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f453042-d177-476d-9fc4-2be0e353605b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:04.914961 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f453042-d177-476d-9fc4-2be0e353605b None admin] RBAC: Adding query filter params (role.id=6413bac7cc9a42cf83968dd26a3ccc34, scope.project.id=b74267c87cf54aeeb11de99a05473428, user.id=b59a9590b1494272b50de7862f1887dc) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:04.915277 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f453042-d177-476d-9fc4-2be0e353605b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:04.916791 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f453042-d177-476d-9fc4-2be0e353605b None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:04.931790 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 136/270] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:26:04.934396 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 135/271] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:26:04 2022] GET /identity/v3/role_assignments?user.id=b59a9590b1494272b50de7862f1887dc&scope.project.id=b74267c87cf54aeeb11de99a05473428&role.id=6413bac7cc9a42cf83968dd26a3ccc34 => generated 608 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:26:04.938646 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9698b-0233-4d94-9817-b1a6555fa022 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:04.938877 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9698b-0233-4d94-9817-b1a6555fa022 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:04.939163 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9698b-0233-4d94-9817-b1a6555fa022 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:04.940874 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 137/272] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:04.947429 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79d560-ce67-4d1b-8234-0348912819c2 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:04.947730 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79d560-ce67-4d1b-8234-0348912819c2 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:04.948023 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79d560-ce67-4d1b-8234-0348912819c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:04.962807 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9698b-0233-4d94-9817-b1a6555fa022 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:04.987284 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-2e79d560-ce67-4d1b-8234-0348912819c2 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:04.988536 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-2e79d560-ce67-4d1b-8234-0348912819c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:05.016358 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:05.084390 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9698b-0233-4d94-9817-b1a6555fa022 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:05.124231 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614cc6bf-01ea-427a-afaf-29c80aab78a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:05.125049 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614cc6bf-01ea-427a-afaf-29c80aab78a4 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:05.125333 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614cc6bf-01ea-427a-afaf-29c80aab78a4 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:05.125609 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614cc6bf-01ea-427a-afaf-29c80aab78a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:05.127324 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614cc6bf-01ea-427a-afaf-29c80aab78a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:05.128833 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614cc6bf-01ea-427a-afaf-29c80aab78a4 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:05.130940 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 138/273] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:26:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:05.132237 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3e42b-e274-46eb-88ae-77ba5de84b9e None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:05.132524 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3e42b-e274-46eb-88ae-77ba5de84b9e None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:05.132799 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3e42b-e274-46eb-88ae-77ba5de84b9e None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:05.138499 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 139/274] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:05.139702 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fbf77d-408c-457b-b890-5762a978d32c None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:05.139995 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fbf77d-408c-457b-b890-5762a978d32c None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:05.140278 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fbf77d-408c-457b-b890-5762a978d32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:05.161484 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-91fbf77d-408c-457b-b890-5762a978d32c None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:05.161705 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 136/275] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:26:05.162223 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e79d560-ce67-4d1b-8234-0348912819c2 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:05.167405 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-91fbf77d-408c-457b-b890-5762a978d32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:05.266299 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 140/276] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:26:05.267631 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fbf77d-408c-457b-b890-5762a978d32c None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:05.271924 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:05.293807 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e79d560-ce67-4d1b-8234-0348912819c2 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:05.306124 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:05.374453 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d192bc-c185-40f6-8875-d14a7c67bba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:05.375142 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d192bc-c185-40f6-8875-d14a7c67bba9 None admin] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:05.375432 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d192bc-c185-40f6-8875-d14a7c67bba9 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:05.375723 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d192bc-c185-40f6-8875-d14a7c67bba9 None admin] PATH_INFO: `/v3/users` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:05.376504 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d192bc-c185-40f6-8875-d14a7c67bba9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:05.377974 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d192bc-c185-40f6-8875-d14a7c67bba9 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:05.412512 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fbf77d-408c-457b-b890-5762a978d32c None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:05.446692 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a738f8da-7aa0-422e-9875-76abb3573e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:05.447474 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738f8da-7aa0-422e-9875-76abb3573e06 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:05.447760 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738f8da-7aa0-422e-9875-76abb3573e06 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:05.448036 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738f8da-7aa0-422e-9875-76abb3573e06 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:05.458236 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a738f8da-7aa0-422e-9875-76abb3573e06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:26:05.466936 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-a738f8da-7aa0-422e-9875-76abb3573e06 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:26:05.466936 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:05.466936 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:05.466936 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:05.466936 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:05.466936 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:05.466936 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:05.466936 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:05.466936 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:05.466936 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:05.466936 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:05.466936 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:05.466936 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:26:05.466936 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:26:05.466936 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:26:05.466936 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:26:05.467962 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:26:05.467962 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:26:05.467962 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:26:05.467962 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:26:05.467962 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:05.467962 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:05.467962 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:05.467962 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:05.467962 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:05.467962 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:05.467962 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:05.467962 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:05.467962 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:05.467962 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:05.467962 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:05.467962 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:05.468913 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:05.468913 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:05.468913 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:05.468913 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:05.468913 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:26:05.468913 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:26:05.468913 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:26:05.468913 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:26:05.468913 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:26:05.468913 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:26:05.468913 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:26:05.468913 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:05.468913 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 141/277] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:26:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:05.469715 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a738f8da-7aa0-422e-9875-76abb3573e06 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:05.479323 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 137/278] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:26:05 2022] POST /identity/v3/users => generated 293 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:26:05.480463 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d192bc-c185-40f6-8875-d14a7c67bba9 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:05.582264 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:05.590364 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a738f8da-7aa0-422e-9875-76abb3573e06 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:05.629279 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d192bc-c185-40f6-8875-d14a7c67bba9 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:05.631056 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18f226-8966-489d-a768-761a591d97f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:05.632592 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18f226-8966-489d-a768-761a591d97f2 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:05.633647 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18f226-8966-489d-a768-761a591d97f2 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:05.634189 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18f226-8966-489d-a768-761a591d97f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:05.647937 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18f226-8966-489d-a768-761a591d97f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:26:05.657350 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-1b18f226-8966-489d-a768-761a591d97f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:26:05.657350 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:05.657350 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:05.657350 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:05.657350 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:05.657350 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:05.657350 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:05.657350 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:05.657350 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:05.657350 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:05.657350 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:05.657350 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:05.657350 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:26:05.657350 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:26:05.657350 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:26:05.657350 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:26:05.658653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:26:05.658653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:26:05.658653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:26:05.658653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:26:05.658653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:05.658653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:05.658653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:05.658653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:05.658653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:05.658653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:05.658653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:05.658653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:05.658653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:05.658653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:05.658653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:05.658653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:05.659580 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:05.659580 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:05.659580 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:05.659580 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:05.659580 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:26:05.659580 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:26:05.659580 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:26:05.659580 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:26:05.659580 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:26:05.659580 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:26:05.659580 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:26:05.659580 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:05.665147 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 142/279] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:26:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:05.666072 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18f226-8966-489d-a768-761a591d97f2 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:05.676664 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417868d-f59f-4932-a067-a0af342eb8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:05.677647 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417868d-f59f-4932-a067-a0af342eb8d5 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:05.679128 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417868d-f59f-4932-a067-a0af342eb8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:05.679128 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417868d-f59f-4932-a067-a0af342eb8d5 None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:05.681502 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3417868d-f59f-4932-a067-a0af342eb8d5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:05.682522 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3417868d-f59f-4932-a067-a0af342eb8d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:05.683508 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3417868d-f59f-4932-a067-a0af342eb8d5 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:05.698164 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 138/280] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:26:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:05.701377 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417868d-f59f-4932-a067-a0af342eb8d5 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:05.707882 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:05.819013 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18f226-8966-489d-a768-761a591d97f2 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:05.852449 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417868d-f59f-4932-a067-a0af342eb8d5 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:05.863069 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee9be8-53d1-4118-a09a-00dc6a70d8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:05.863870 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee9be8-53d1-4118-a09a-00dc6a70d8ed None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:05.864062 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee9be8-53d1-4118-a09a-00dc6a70d8ed None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:05.864312 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee9be8-53d1-4118-a09a-00dc6a70d8ed None admin] PATH_INFO: `/v3/roles` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:05.865131 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee9be8-53d1-4118-a09a-00dc6a70d8ed None admin] RBAC: Adding query filter params (name=member) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:05.865455 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee9be8-53d1-4118-a09a-00dc6a70d8ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:05.866918 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee9be8-53d1-4118-a09a-00dc6a70d8ed None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:05.878913 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 143/281] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:26:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:05.884514 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee9be8-53d1-4118-a09a-00dc6a70d8ed None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:05.895944 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbf77e-d409-4640-b2df-dbfe5b77651e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:05.896866 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbf77e-d409-4640-b2df-dbfe5b77651e None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:05.897166 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbf77e-d409-4640-b2df-dbfe5b77651e None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:05.897452 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbf77e-d409-4640-b2df-dbfe5b77651e None admin] PATH_INFO: `/v3/users/6313a73dca80418c8a7fc9e8ca10d2d5` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:05.899689 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dbf77e-d409-4640-b2df-dbfe5b77651e None admin] RBAC: Authorizing `identity:get_user(user_id=6313a73dca80418c8a7fc9e8ca10d2d5)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:05.900818 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dbf77e-d409-4640-b2df-dbfe5b77651e None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:05.904459 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 139/282] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:26:05 2022] GET /identity/v3/users/6313a73dca80418c8a7fc9e8ca10d2d5 => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:26:05.909557 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:05.910555 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbf77e-d409-4640-b2df-dbfe5b77651e None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:06.015007 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee9be8-53d1-4118-a09a-00dc6a70d8ed None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:06.052266 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d2a42-d843-46eb-a3b8-2d32fc88bd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:06.053696 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d2a42-d843-46eb-a3b8-2d32fc88bd4c None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:06.054231 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d2a42-d843-46eb-a3b8-2d32fc88bd4c None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:06.054713 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d2a42-d843-46eb-a3b8-2d32fc88bd4c None admin] PATH_INFO: `/v3/users/511880e41e69460fb294dd874511856a` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:06.076014 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:06.087707 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d2a42-d843-46eb-a3b8-2d32fc88bd4c None admin] RBAC: Authorizing `identity:get_user(user_id=511880e41e69460fb294dd874511856a)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:06.089304 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d2a42-d843-46eb-a3b8-2d32fc88bd4c None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:06.096992 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 144/283] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:26:05 2022] GET /identity/v3/users/511880e41e69460fb294dd874511856a => generated 293 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:06.111781 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d2a42-d843-46eb-a3b8-2d32fc88bd4c None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:06.149579 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbf77e-d409-4640-b2df-dbfe5b77651e None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:06.209906 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f19eb2-58e6-4c16-8593-e94e6ccd3f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:06.210834 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f19eb2-58e6-4c16-8593-e94e6ccd3f46 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:06.211229 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f19eb2-58e6-4c16-8593-e94e6ccd3f46 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:06.211624 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f19eb2-58e6-4c16-8593-e94e6ccd3f46 None admin] PATH_INFO: `/v3/projects/b74267c87cf54aeeb11de99a05473428` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:06.222566 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f19eb2-58e6-4c16-8593-e94e6ccd3f46 None admin] RBAC: Authorizing `identity:get_project(project_id=b74267c87cf54aeeb11de99a05473428)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:06.224241 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f19eb2-58e6-4c16-8593-e94e6ccd3f46 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:06.226469 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 140/284] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:26:05 2022] GET /identity/v3/projects/b74267c87cf54aeeb11de99a05473428 => generated 302 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:26:06.228306 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a111fd-8008-4a7f-8812-4057d19219ce None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:06.228608 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a111fd-8008-4a7f-8812-4057d19219ce None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:06.228896 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a111fd-8008-4a7f-8812-4057d19219ce None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:06.230777 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 141/285] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:06.231947 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:06.235685 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a111fd-8008-4a7f-8812-4057d19219ce None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:06.258048 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d2a42-d843-46eb-a3b8-2d32fc88bd4c None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:06.297487 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653edfa7-53b8-482c-aa99-2e55d0374f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:06.298271 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653edfa7-53b8-482c-aa99-2e55d0374f5f None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:06.298584 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653edfa7-53b8-482c-aa99-2e55d0374f5f None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:06.298896 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653edfa7-53b8-482c-aa99-2e55d0374f5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:06.300041 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653edfa7-53b8-482c-aa99-2e55d0374f5f None admin] RBAC: Adding query filter params (role.id=a7a08ffb4e7f40f683e711c83a6186d0, user.id=511880e41e69460fb294dd874511856a, scope.system=all) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:06.300368 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653edfa7-53b8-482c-aa99-2e55d0374f5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:06.301960 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653edfa7-53b8-482c-aa99-2e55d0374f5f None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:06.308662 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 145/286] 10.222.0.30 () {56 vars in 1308 bytes} [Tue Jul 5 21:26:06 2022] GET /identity/v3/role_assignments?user.id=511880e41e69460fb294dd874511856a&scope.system=all&role.id=a7a08ffb4e7f40f683e711c83a6186d0 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:26:06.310149 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf26e9-0e43-4b99-9701-8abb5a82359d None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:06.310522 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf26e9-0e43-4b99-9701-8abb5a82359d None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:06.310866 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf26e9-0e43-4b99-9701-8abb5a82359d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:06.330037 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-92bf26e9-0e43-4b99-9701-8abb5a82359d None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:06.331264 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-92bf26e9-0e43-4b99-9701-8abb5a82359d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:06.386605 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a111fd-8008-4a7f-8812-4057d19219ce None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:06.421891 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 146/287] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:26:06.434552 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc97998-5330-4223-be1a-59bdbee81c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:06.435839 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc97998-5330-4223-be1a-59bdbee81c6b None admin] REQUEST_METHOD: `PUT` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:06.436414 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc97998-5330-4223-be1a-59bdbee81c6b None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:06.436912 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc97998-5330-4223-be1a-59bdbee81c6b None admin] PATH_INFO: `/v3/projects/b74267c87cf54aeeb11de99a05473428/users/6313a73dca80418c8a7fc9e8ca10d2d5/roles/8c6de83a2de94d0a93b23f7853c8a2c7` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:06.439494 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc97998-5330-4223-be1a-59bdbee81c6b None admin] RBAC: Authorizing `identity:create_grant(project_id=b74267c87cf54aeeb11de99a05473428, user_id=6313a73dca80418c8a7fc9e8ca10d2d5, role_id=8c6de83a2de94d0a93b23f7853c8a2c7)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:06.441349 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc97998-5330-4223-be1a-59bdbee81c6b None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:06.446535 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bf26e9-0e43-4b99-9701-8abb5a82359d None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:06.522515 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:06.529419 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 142/288] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:26:06 2022] PUT /identity/v3/projects/b74267c87cf54aeeb11de99a05473428/users/6313a73dca80418c8a7fc9e8ca10d2d5/roles/8c6de83a2de94d0a93b23f7853c8a2c7 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:26:06.531645 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:06.570055 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bf26e9-0e43-4b99-9701-8abb5a82359d None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:06.612061 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737fff9-8c79-497d-8107-5d6e6ba9109a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:06.612807 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737fff9-8c79-497d-8107-5d6e6ba9109a None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:06.613094 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737fff9-8c79-497d-8107-5d6e6ba9109a None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:06.613372 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737fff9-8c79-497d-8107-5d6e6ba9109a None admin] PATH_INFO: `/v3/roles/member` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:06.628073 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a737fff9-8c79-497d-8107-5d6e6ba9109a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:26:06.636947 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-a737fff9-8c79-497d-8107-5d6e6ba9109a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:26:06.636947 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:06.636947 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:06.636947 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:06.636947 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:06.636947 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:06.636947 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:06.636947 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:06.636947 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:06.636947 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:06.636947 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:06.636947 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:06.636947 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:26:06.636947 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:26:06.636947 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:26:06.636947 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:26:06.638872 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:26:06.638872 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:26:06.638872 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:26:06.638872 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:26:06.638872 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:06.638872 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:06.638872 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:06.638872 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:06.638872 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:06.638872 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:06.638872 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:06.638872 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:06.638872 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:06.638872 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:06.638872 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:06.638872 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:06.640097 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:06.640097 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:06.640097 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:06.640097 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:06.640097 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:26:06.640097 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:26:06.640097 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:26:06.640097 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:26:06.640097 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:26:06.640097 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:26:06.640097 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:26:06.640097 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:06.640097 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 147/289] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:26:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:06.647283 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc97998-5330-4223-be1a-59bdbee81c6b None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:06.769415 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc97998-5330-4223-be1a-59bdbee81c6b None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:06.806780 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6efe36-33a3-4856-912e-3399a13237d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:06.807803 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6efe36-33a3-4856-912e-3399a13237d4 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:06.808306 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6efe36-33a3-4856-912e-3399a13237d4 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:06.808785 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6efe36-33a3-4856-912e-3399a13237d4 None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:06.809741 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6efe36-33a3-4856-912e-3399a13237d4 None admin] RBAC: Adding query filter params (name=member) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:06.810270 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6efe36-33a3-4856-912e-3399a13237d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:06.812149 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6efe36-33a3-4856-912e-3399a13237d4 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:06.821857 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 143/290] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:26:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:06.827672 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737fff9-8c79-497d-8107-5d6e6ba9109a None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:06.935015 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737fff9-8c79-497d-8107-5d6e6ba9109a None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:06.966509 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:06.973065 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6117e-e2da-4f71-bdb0-431ea1911ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:06.973981 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6117e-e2da-4f71-bdb0-431ea1911ffd None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:06.974308 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6117e-e2da-4f71-bdb0-431ea1911ffd None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:06.974591 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6117e-e2da-4f71-bdb0-431ea1911ffd None admin] PATH_INFO: `/v3/users/9637551d214a4dcaa8eef8e2128e0e09` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:06.976059 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da6117e-e2da-4f71-bdb0-431ea1911ffd None admin] RBAC: Authorizing `identity:get_user(user_id=9637551d214a4dcaa8eef8e2128e0e09)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:06.977747 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da6117e-e2da-4f71-bdb0-431ea1911ffd None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:06.980120 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 148/291] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:26:06 2022] GET /identity/v3/users/9637551d214a4dcaa8eef8e2128e0e09 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:06.985780 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6efe36-33a3-4856-912e-3399a13237d4 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:07.066957 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:07.119575 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6efe36-33a3-4856-912e-3399a13237d4 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:07.156427 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d369fab3-6576-4bc9-a17f-abcb3e78ab58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:07.157480 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369fab3-6576-4bc9-a17f-abcb3e78ab58 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:07.157999 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369fab3-6576-4bc9-a17f-abcb3e78ab58 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:07.158522 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369fab3-6576-4bc9-a17f-abcb3e78ab58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:07.231962 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d369fab3-6576-4bc9-a17f-abcb3e78ab58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:07.233827 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d369fab3-6576-4bc9-a17f-abcb3e78ab58 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:07.301070 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:07.344784 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 144/292] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:26:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:26:07.350018 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6117e-e2da-4f71-bdb0-431ea1911ffd None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:07.493923 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6117e-e2da-4f71-bdb0-431ea1911ffd None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:07.541454 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9980ef-939c-4757-b5ba-d973be873103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:07.542361 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9980ef-939c-4757-b5ba-d973be873103 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:07.542652 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9980ef-939c-4757-b5ba-d973be873103 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:07.542936 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9980ef-939c-4757-b5ba-d973be873103 None admin] PATH_INFO: `/v3/projects/b74267c87cf54aeeb11de99a05473428` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:07.544146 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9980ef-939c-4757-b5ba-d973be873103 None admin] RBAC: Authorizing `identity:get_project(project_id=b74267c87cf54aeeb11de99a05473428)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:07.545607 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9980ef-939c-4757-b5ba-d973be873103 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:07.547676 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 149/293] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:26:07 2022] GET /identity/v3/projects/b74267c87cf54aeeb11de99a05473428 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:07.558987 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d369fab3-6576-4bc9-a17f-abcb3e78ab58 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:07.725926 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d369fab3-6576-4bc9-a17f-abcb3e78ab58 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:07.791869 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14d32f-7391-4ac4-9765-15512fe108eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:07.792916 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14d32f-7391-4ac4-9765-15512fe108eb None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:07.793427 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14d32f-7391-4ac4-9765-15512fe108eb None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:07.793928 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14d32f-7391-4ac4-9765-15512fe108eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:07.795023 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14d32f-7391-4ac4-9765-15512fe108eb None admin] RBAC: Adding query filter params (role.id=a7a08ffb4e7f40f683e711c83a6186d0, scope.project.id=b74267c87cf54aeeb11de99a05473428, user.id=9637551d214a4dcaa8eef8e2128e0e09) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:07.795550 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14d32f-7391-4ac4-9765-15512fe108eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:07.797263 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14d32f-7391-4ac4-9765-15512fe108eb None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:07.815190 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 145/294] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:26:07 2022] GET /identity/v3/role_assignments?user.id=9637551d214a4dcaa8eef8e2128e0e09&scope.project.id=b74267c87cf54aeeb11de99a05473428&role.id=a7a08ffb4e7f40f683e711c83a6186d0 => generated 608 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:08.199078 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42482d-33de-4c27-822e-e3cdeb7dfb4f None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:08.199607 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42482d-33de-4c27-822e-e3cdeb7dfb4f None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:08.199701 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42482d-33de-4c27-822e-e3cdeb7dfb4f None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:08.201299 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 150/295] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:08.207505 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fc372-e6bb-45e6-b99d-64b4c956e158 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:08.208391 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fc372-e6bb-45e6-b99d-64b4c956e158 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:08.208890 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fc372-e6bb-45e6-b99d-64b4c956e158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:08.221313 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d197dbc-75b5-4f13-a38c-54d97f1c5601 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:08.221643 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d197dbc-75b5-4f13-a38c-54d97f1c5601 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:08.221881 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d197dbc-75b5-4f13-a38c-54d97f1c5601 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:08.223543 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 151/296] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:08.229719 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e990c-97b8-485d-aa9f-b7c61f9bbfae None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:08.230017 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e990c-97b8-485d-aa9f-b7c61f9bbfae None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:08.230286 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-338fc372-e6bb-45e6-b99d-64b4c956e158 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:08.230416 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e990c-97b8-485d-aa9f-b7c61f9bbfae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:08.231914 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-338fc372-e6bb-45e6-b99d-64b4c956e158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:08.257966 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:08.261379 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-f81e990c-97b8-485d-aa9f-b7c61f9bbfae None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:08.263791 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-f81e990c-97b8-485d-aa9f-b7c61f9bbfae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:08.341016 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 146/297] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:26:08.348024 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:08.357355 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 152/298] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:26:08.370534 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338fc372-e6bb-45e6-b99d-64b4c956e158 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:08.389745 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e990c-97b8-485d-aa9f-b7c61f9bbfae None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:08.502365 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338fc372-e6bb-45e6-b99d-64b4c956e158 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:08.507748 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e990c-97b8-485d-aa9f-b7c61f9bbfae None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:08.542597 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31fd8c7-b09b-4089-83d8-e4c1ad4e3160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:08.543966 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31fd8c7-b09b-4089-83d8-e4c1ad4e3160 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:08.544765 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31fd8c7-b09b-4089-83d8-e4c1ad4e3160 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:08.545267 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31fd8c7-b09b-4089-83d8-e4c1ad4e3160 None admin] PATH_INFO: `/v3/domains/default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:08.547660 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31fd8c7-b09b-4089-83d8-e4c1ad4e3160 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:08.549913 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b18f397-8201-45da-b73a-c11d47d8d19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:08.550822 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18f397-8201-45da-b73a-c11d47d8d19a None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:08.551173 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18f397-8201-45da-b73a-c11d47d8d19a None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:08.551507 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18f397-8201-45da-b73a-c11d47d8d19a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:08.551859 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31fd8c7-b09b-4089-83d8-e4c1ad4e3160 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:08.554912 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 147/299] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:26:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:08.560954 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31fd8c7-b09b-4089-83d8-e4c1ad4e3160 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:08.569590 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b18f397-8201-45da-b73a-c11d47d8d19a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:26:08.578553 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-2b18f397-8201-45da-b73a-c11d47d8d19a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:26:08.578553 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:08.578553 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:08.578553 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:08.578553 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:08.578553 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:08.578553 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:08.578553 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:08.578553 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:08.578553 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:08.578553 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:08.578553 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:08.578553 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:26:08.578553 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:26:08.578553 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:26:08.578553 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:26:08.579895 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:26:08.579895 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:26:08.579895 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:26:08.579895 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:26:08.579895 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:08.579895 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:08.579895 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:08.579895 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:08.579895 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:08.579895 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:08.579895 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:08.579895 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:08.579895 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:08.579895 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:08.579895 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:08.579895 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:08.580816 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:08.580816 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:08.580816 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:08.580816 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:08.580816 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:26:08.580816 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:26:08.580816 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:26:08.580816 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:26:08.580816 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:26:08.580816 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:26:08.580816 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:26:08.580816 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:08.580816 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 153/300] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:26:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:26:08.586308 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b18f397-8201-45da-b73a-c11d47d8d19a None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:08.596836 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:08.654337 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:08.691612 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31fd8c7-b09b-4089-83d8-e4c1ad4e3160 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:08.707028 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b18f397-8201-45da-b73a-c11d47d8d19a None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:08.736178 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b358c7-ed06-41a8-9717-7b8286e9071c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:08.737123 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b358c7-ed06-41a8-9717-7b8286e9071c None admin] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:08.737515 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b358c7-ed06-41a8-9717-7b8286e9071c None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:08.737895 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b358c7-ed06-41a8-9717-7b8286e9071c None admin] PATH_INFO: `/v3/groups` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:08.738923 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b358c7-ed06-41a8-9717-7b8286e9071c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:08.740477 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b358c7-ed06-41a8-9717-7b8286e9071c None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:08.747607 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafd2600-80c7-4030-b646-135e06357b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:08.748297 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd2600-80c7-4030-b646-135e06357b40 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:08.748626 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd2600-80c7-4030-b646-135e06357b40 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:08.748909 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd2600-80c7-4030-b646-135e06357b40 None admin] PATH_INFO: `/v3/roles` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:08.749708 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafd2600-80c7-4030-b646-135e06357b40 None admin] RBAC: Adding query filter params (name=reader) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:08.750027 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafd2600-80c7-4030-b646-135e06357b40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:08.751505 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafd2600-80c7-4030-b646-135e06357b40 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:08.761892 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 154/301] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:26:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:26:08.767680 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafd2600-80c7-4030-b646-135e06357b40 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:08.812257 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 148/302] 10.222.0.30 () {60 vars in 1134 bytes} [Tue Jul 5 21:26:08 2022] POST /identity/v3/groups => generated 229 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:26:08.904251 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafd2600-80c7-4030-b646-135e06357b40 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:08.925704 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:08.952597 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da2966-caf1-46a9-9202-b2db982e23d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:08.954163 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da2966-caf1-46a9-9202-b2db982e23d0 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:08.955269 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da2966-caf1-46a9-9202-b2db982e23d0 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:08.955566 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da2966-caf1-46a9-9202-b2db982e23d0 None admin] PATH_INFO: `/v3/users/c268027bc8564a0981c49ccf84d269a6` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:08.974042 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03da2966-caf1-46a9-9202-b2db982e23d0 None admin] RBAC: Authorizing `identity:get_user(user_id=c268027bc8564a0981c49ccf84d269a6)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:08.975645 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03da2966-caf1-46a9-9202-b2db982e23d0 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:08.978513 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 155/303] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:26:08 2022] GET /identity/v3/users/c268027bc8564a0981c49ccf84d269a6 => generated 293 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:26:08.984542 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b358c7-ed06-41a8-9717-7b8286e9071c None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:09.037196 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dfe60-5feb-4338-90ea-722934872536 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:09.037518 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dfe60-5feb-4338-90ea-722934872536 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:09.037713 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dfe60-5feb-4338-90ea-722934872536 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:09.039308 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 156/304] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:09.045099 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41d913-1ad8-44f9-bc84-a67a277eb37f None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:09.045373 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41d913-1ad8-44f9-bc84-a67a277eb37f None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:09.045683 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41d913-1ad8-44f9-bc84-a67a277eb37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:09.074608 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-8f41d913-1ad8-44f9-bc84-a67a277eb37f None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:09.075886 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-8f41d913-1ad8-44f9-bc84-a67a277eb37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:09.105649 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:09.130284 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b358c7-ed06-41a8-9717-7b8286e9071c None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:09.182629 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3624cc2-c92b-4659-8a7a-8a741f8a4dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:09.182908 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 157/305] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:26:09.183550 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3624cc2-c92b-4659-8a7a-8a741f8a4dd2 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:09.183949 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3624cc2-c92b-4659-8a7a-8a741f8a4dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:09.184174 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477893ea-370f-4d3e-89cc-d249daeb5018 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:09.184427 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3624cc2-c92b-4659-8a7a-8a741f8a4dd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:09.184552 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477893ea-370f-4d3e-89cc-d249daeb5018 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:09.184739 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477893ea-370f-4d3e-89cc-d249daeb5018 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:09.185671 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3624cc2-c92b-4659-8a7a-8a741f8a4dd2 None admin] RBAC: Adding query filter params (role.id=8c6de83a2de94d0a93b23f7853c8a2c7, user.id=c268027bc8564a0981c49ccf84d269a6, scope.system=all) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:09.186095 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3624cc2-c92b-4659-8a7a-8a741f8a4dd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:09.187719 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3624cc2-c92b-4659-8a7a-8a741f8a4dd2 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:09.190317 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 158/306] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:09.191547 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5391b1-db2e-4591-9c5f-bf09873b268e None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:09.191842 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5391b1-db2e-4591-9c5f-bf09873b268e None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:09.192128 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5391b1-db2e-4591-9c5f-bf09873b268e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:09.197955 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 149/307] 10.222.0.30 () {56 vars in 1308 bytes} [Tue Jul 5 21:26:08 2022] GET /identity/v3/role_assignments?user.id=c268027bc8564a0981c49ccf84d269a6&scope.system=all&role.id=8c6de83a2de94d0a93b23f7853c8a2c7 => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:09.209325 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3624cc2-c92b-4659-8a7a-8a741f8a4dd2 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:09.219821 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-3a5391b1-db2e-4591-9c5f-bf09873b268e None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:09.221191 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-3a5391b1-db2e-4591-9c5f-bf09873b268e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:09.336318 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 159/308] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:26:09.362331 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3624cc2-c92b-4659-8a7a-8a741f8a4dd2 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:09.365957 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5391b1-db2e-4591-9c5f-bf09873b268e None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:09.406822 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:09.418812 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de881880-e6e0-4ca0-b6b3-c2fc39aeaf03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:09.421815 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de881880-e6e0-4ca0-b6b3-c2fc39aeaf03 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:09.421815 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de881880-e6e0-4ca0-b6b3-c2fc39aeaf03 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:09.421815 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de881880-e6e0-4ca0-b6b3-c2fc39aeaf03 None admin] PATH_INFO: `/v3/roles/member` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:09.436735 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de881880-e6e0-4ca0-b6b3-c2fc39aeaf03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:26:09.447574 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-de881880-e6e0-4ca0-b6b3-c2fc39aeaf03 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:26:09.447574 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:09.447574 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:09.447574 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:09.447574 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:09.447574 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:09.447574 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:09.447574 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:09.447574 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:09.447574 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:09.447574 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:09.447574 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:09.447574 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:26:09.447574 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:26:09.447574 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:26:09.447574 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:26:09.448908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:26:09.448908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:26:09.448908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:26:09.448908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:26:09.448908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:09.448908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:09.448908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:09.448908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:09.448908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:09.448908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:09.448908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:09.448908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:09.448908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:09.448908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:09.448908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:09.448908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:09.449939 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:09.449939 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:09.449939 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:09.449939 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:09.449939 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:26:09.449939 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:26:09.449939 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:26:09.449939 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:26:09.449939 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:26:09.449939 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:26:09.449939 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:26:09.449939 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:09.449939 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 150/309] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:26:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:26:09.458152 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de881880-e6e0-4ca0-b6b3-c2fc39aeaf03 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:09.474654 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:09.485916 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5391b1-db2e-4591-9c5f-bf09873b268e None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:09.536362 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82dd796-e6fb-4782-8fa4-cb2e8507ebea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:09.537423 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82dd796-e6fb-4782-8fa4-cb2e8507ebea None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:09.537808 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82dd796-e6fb-4782-8fa4-cb2e8507ebea None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:09.538300 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82dd796-e6fb-4782-8fa4-cb2e8507ebea None admin] PATH_INFO: `/v3/roles/reader` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:09.550371 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82dd796-e6fb-4782-8fa4-cb2e8507ebea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:26:09.563609 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-c82dd796-e6fb-4782-8fa4-cb2e8507ebea None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:26:09.563609 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:09.563609 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:09.563609 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:09.563609 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:09.563609 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:09.563609 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:09.563609 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:09.563609 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:09.563609 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:09.563609 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:09.563609 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:09.563609 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:26:09.563609 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:26:09.563609 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:26:09.563609 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:26:09.564928 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:26:09.564928 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:26:09.564928 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:26:09.564928 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:26:09.564928 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:09.564928 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:09.564928 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:09.564928 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:09.564928 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:09.564928 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:09.564928 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:09.564928 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:09.564928 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:09.564928 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:09.564928 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:09.564928 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:09.566769 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:09.566769 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:09.566769 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:09.566769 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:09.566769 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:26:09.566769 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:26:09.566769 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:26:09.566769 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:26:09.566769 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:26:09.566769 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:26:09.566769 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:26:09.566769 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:09.568136 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 160/310] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:26:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:26:09.574023 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82dd796-e6fb-4782-8fa4-cb2e8507ebea None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:09.584961 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de881880-e6e0-4ca0-b6b3-c2fc39aeaf03 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:09.623037 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec8f27e-fa68-42c6-8dba-14ef20d53674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:09.624094 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8f27e-fa68-42c6-8dba-14ef20d53674 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:09.624611 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8f27e-fa68-42c6-8dba-14ef20d53674 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:09.625127 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8f27e-fa68-42c6-8dba-14ef20d53674 None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:09.626105 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec8f27e-fa68-42c6-8dba-14ef20d53674 None admin] RBAC: Adding query filter params (name=member) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:09.626680 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec8f27e-fa68-42c6-8dba-14ef20d53674 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:09.628311 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec8f27e-fa68-42c6-8dba-14ef20d53674 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:09.637916 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 151/311] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:26:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:26:09.643580 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec8f27e-fa68-42c6-8dba-14ef20d53674 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:09.692735 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:09.702480 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82dd796-e6fb-4782-8fa4-cb2e8507ebea None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:09.733125 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:09.742107 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbadc5-1e9d-4ada-aeed-e847a2e33e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:09.743637 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbadc5-1e9d-4ada-aeed-e847a2e33e66 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:09.744156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbadc5-1e9d-4ada-aeed-e847a2e33e66 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:09.744651 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbadc5-1e9d-4ada-aeed-e847a2e33e66 None admin] PATH_INFO: `/v3/roles` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:09.745727 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bbadc5-1e9d-4ada-aeed-e847a2e33e66 None admin] RBAC: Adding query filter params (name=reader) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:09.746284 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bbadc5-1e9d-4ada-aeed-e847a2e33e66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:09.750095 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bbadc5-1e9d-4ada-aeed-e847a2e33e66 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:09.758926 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 161/312] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:26:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:09.764935 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbadc5-1e9d-4ada-aeed-e847a2e33e66 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:09.771526 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec8f27e-fa68-42c6-8dba-14ef20d53674 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:09.811226 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1114d1da-dc93-4173-9841-8f8a87e1793b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:09.812495 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114d1da-dc93-4173-9841-8f8a87e1793b None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:09.813001 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114d1da-dc93-4173-9841-8f8a87e1793b None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:09.813496 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114d1da-dc93-4173-9841-8f8a87e1793b None admin] PATH_INFO: `/v3/users/511880e41e69460fb294dd874511856a` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:09.814945 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1114d1da-dc93-4173-9841-8f8a87e1793b None admin] RBAC: Authorizing `identity:get_user(user_id=511880e41e69460fb294dd874511856a)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:09.816787 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1114d1da-dc93-4173-9841-8f8a87e1793b None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:09.823454 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 152/313] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:26:09 2022] GET /identity/v3/users/511880e41e69460fb294dd874511856a => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:09.825158 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1114d1da-dc93-4173-9841-8f8a87e1793b None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:09.881143 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbadc5-1e9d-4ada-aeed-e847a2e33e66 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:09.923382 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0122e-bd4b-4053-bd15-0cc2391d4cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:09.924868 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0122e-bd4b-4053-bd15-0cc2391d4cbb None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:09.925359 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0122e-bd4b-4053-bd15-0cc2391d4cbb None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:09.925958 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0122e-bd4b-4053-bd15-0cc2391d4cbb None admin] PATH_INFO: `/v3/users/6313a73dca80418c8a7fc9e8ca10d2d5` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:09.928049 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a0122e-bd4b-4053-bd15-0cc2391d4cbb None admin] RBAC: Authorizing `identity:get_user(user_id=6313a73dca80418c8a7fc9e8ca10d2d5)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:09.929952 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a0122e-bd4b-4053-bd15-0cc2391d4cbb None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:09.932676 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 162/314] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:26:09 2022] GET /identity/v3/users/6313a73dca80418c8a7fc9e8ca10d2d5 => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:26:09.939118 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0122e-bd4b-4053-bd15-0cc2391d4cbb None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:09.948971 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1114d1da-dc93-4173-9841-8f8a87e1793b None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:09.969526 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:09.991614 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7a2d6-0ff5-456e-b992-473daf589a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:09.993170 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7a2d6-0ff5-456e-b992-473daf589a44 None admin] REQUEST_METHOD: `PUT` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:09.993796 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7a2d6-0ff5-456e-b992-473daf589a44 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:09.994184 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7a2d6-0ff5-456e-b992-473daf589a44 None admin] PATH_INFO: `/v3/system/users/511880e41e69460fb294dd874511856a/roles/a7a08ffb4e7f40f683e711c83a6186d0` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:09.995909 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e7a2d6-0ff5-456e-b992-473daf589a44 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=511880e41e69460fb294dd874511856a, role_id=a7a08ffb4e7f40f683e711c83a6186d0)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:09.997664 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e7a2d6-0ff5-456e-b992-473daf589a44 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:10.056972 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0122e-bd4b-4053-bd15-0cc2391d4cbb None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:10.093094 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5cfd75-9e49-41f7-ad25-407944e4b584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:10.093765 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5cfd75-9e49-41f7-ad25-407944e4b584 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:10.094074 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5cfd75-9e49-41f7-ad25-407944e4b584 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:10.094386 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5cfd75-9e49-41f7-ad25-407944e4b584 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:10.102862 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 153/315] 10.222.0.30 () {58 vars in 1334 bytes} [Tue Jul 5 21:26:09 2022] PUT /identity/v3/system/users/511880e41e69460fb294dd874511856a/roles/a7a08ffb4e7f40f683e711c83a6186d0 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:26:10.179699 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5cfd75-9e49-41f7-ad25-407944e4b584 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:10.181329 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5cfd75-9e49-41f7-ad25-407944e4b584 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:10.216166 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:10.300644 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 163/316] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:26:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:26:10.307026 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7a2d6-0ff5-456e-b992-473daf589a44 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:10.311103 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:10.425283 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7a2d6-0ff5-456e-b992-473daf589a44 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:10.461829 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73422311-5581-4bbe-8fae-28c732356d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:10.462740 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73422311-5581-4bbe-8fae-28c732356d0f None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:10.463024 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73422311-5581-4bbe-8fae-28c732356d0f None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:10.463300 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73422311-5581-4bbe-8fae-28c732356d0f None admin] PATH_INFO: `/v3/projects/b74267c87cf54aeeb11de99a05473428` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:10.464909 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73422311-5581-4bbe-8fae-28c732356d0f None admin] RBAC: Authorizing `identity:get_project(project_id=b74267c87cf54aeeb11de99a05473428)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:10.466456 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73422311-5581-4bbe-8fae-28c732356d0f None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:10.473218 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 154/317] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:26:10 2022] GET /identity/v3/projects/b74267c87cf54aeeb11de99a05473428 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:10.474654 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5cfd75-9e49-41f7-ad25-407944e4b584 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:10.582369 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5cfd75-9e49-41f7-ad25-407944e4b584 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:10.610963 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:10.620311 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b50b4-4820-44d4-ae75-07c4da36dd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:10.620978 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b50b4-4820-44d4-ae75-07c4da36dd2a None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:10.621267 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b50b4-4820-44d4-ae75-07c4da36dd2a None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:10.621550 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b50b4-4820-44d4-ae75-07c4da36dd2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:10.622448 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b50b4-4820-44d4-ae75-07c4da36dd2a None admin] RBAC: Adding query filter params (role.id=8c6de83a2de94d0a93b23f7853c8a2c7, scope.project.id=b74267c87cf54aeeb11de99a05473428, user.id=6313a73dca80418c8a7fc9e8ca10d2d5) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:10.625659 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b50b4-4820-44d4-ae75-07c4da36dd2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:10.625659 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b50b4-4820-44d4-ae75-07c4da36dd2a None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:10.630702 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 164/318] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:26:10 2022] GET /identity/v3/role_assignments?user.id=6313a73dca80418c8a7fc9e8ca10d2d5&scope.project.id=b74267c87cf54aeeb11de99a05473428&role.id=8c6de83a2de94d0a93b23f7853c8a2c7 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:11.045988 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e644488-9fbc-46aa-98fd-cbeb02747b0f None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:11.046422 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e644488-9fbc-46aa-98fd-cbeb02747b0f None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:11.046604 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e644488-9fbc-46aa-98fd-cbeb02747b0f None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:11.048005 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 155/319] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:11.053073 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadee696-f6d5-4931-96ee-536c82e3ddec None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:11.053369 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadee696-f6d5-4931-96ee-536c82e3ddec None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:11.053651 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadee696-f6d5-4931-96ee-536c82e3ddec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:11.070942 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-aadee696-f6d5-4931-96ee-536c82e3ddec None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:11.072130 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-aadee696-f6d5-4931-96ee-536c82e3ddec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:11.140923 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 165/320] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:26:11.163482 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e644488-9fbc-46aa-98fd-cbeb02747b0f None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:11.236734 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:11.269989 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e644488-9fbc-46aa-98fd-cbeb02747b0f None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:11.311655 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a9361-a95d-47e0-9bf2-5ac4074c4c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:11.312475 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a9361-a95d-47e0-9bf2-5ac4074c4c72 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:11.312670 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a9361-a95d-47e0-9bf2-5ac4074c4c72 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:11.312953 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a9361-a95d-47e0-9bf2-5ac4074c4c72 None admin] PATH_INFO: `/v3/domains/default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:11.314163 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a9361-a95d-47e0-9bf2-5ac4074c4c72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:11.315685 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a9361-a95d-47e0-9bf2-5ac4074c4c72 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:11.316288 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f713ee6-d671-40f8-8eba-785e63575351 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:11.316747 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f713ee6-d671-40f8-8eba-785e63575351 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:11.316920 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f713ee6-d671-40f8-8eba-785e63575351 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:11.317450 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 156/321] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:26:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:11.318632 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 166/322] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:26:11.323718 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a9361-a95d-47e0-9bf2-5ac4074c4c72 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:11.324540 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdfdd2-a8ff-49e1-ba17-1226d18e09ec None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:11.324837 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdfdd2-a8ff-49e1-ba17-1226d18e09ec None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:11.325120 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdfdd2-a8ff-49e1-ba17-1226d18e09ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:11.342669 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-f5fdfdd2-a8ff-49e1-ba17-1226d18e09ec None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:11.343894 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-f5fdfdd2-a8ff-49e1-ba17-1226d18e09ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:11.420913 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 167/323] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:26:11.432194 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a9361-a95d-47e0-9bf2-5ac4074c4c72 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:11.443611 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fdfdd2-a8ff-49e1-ba17-1226d18e09ec None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:11.469995 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9c25e-8bf2-4e45-9469-383c6da62e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:11.470809 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9c25e-8bf2-4e45-9469-383c6da62e72 None admin] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:11.471222 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9c25e-8bf2-4e45-9469-383c6da62e72 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:11.471579 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9c25e-8bf2-4e45-9469-383c6da62e72 None admin] PATH_INFO: `/v3/groups` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:11.472234 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f9c25e-8bf2-4e45-9469-383c6da62e72 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:11.473789 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f9c25e-8bf2-4e45-9469-383c6da62e72 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:11.497666 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:11.545852 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fdfdd2-a8ff-49e1-ba17-1226d18e09ec None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:11.565785 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:11.571547 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 157/324] 10.222.0.30 () {60 vars in 1134 bytes} [Tue Jul 5 21:26:11 2022] POST /identity/v3/groups => generated 226 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:26:11.603089 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbea69a-86d7-4b27-922c-af548ab0ce7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:11.603923 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbea69a-86d7-4b27-922c-af548ab0ce7a None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:11.604210 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbea69a-86d7-4b27-922c-af548ab0ce7a None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:11.604487 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbea69a-86d7-4b27-922c-af548ab0ce7a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:11.624488 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbea69a-86d7-4b27-922c-af548ab0ce7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:26:11.632848 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-1dbea69a-86d7-4b27-922c-af548ab0ce7a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:26:11.632848 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:11.632848 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:11.632848 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:11.632848 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:11.632848 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:11.632848 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:11.632848 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:11.632848 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:11.632848 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:11.632848 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:11.632848 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:11.632848 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:26:11.632848 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:26:11.632848 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:26:11.632848 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:26:11.634209 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:26:11.634209 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:26:11.634209 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:26:11.634209 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:26:11.634209 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:11.634209 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:11.634209 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:11.634209 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:11.634209 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:11.634209 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:11.634209 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:11.634209 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:11.634209 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:11.634209 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:11.634209 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:11.634209 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:11.635316 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:11.635316 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:11.635316 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:11.635316 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:11.635316 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:26:11.635316 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:26:11.635316 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:26:11.635316 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:26:11.635316 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:26:11.635316 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:26:11.635316 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:26:11.635316 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:11.636684 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 168/325] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:26:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:11.640305 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9c25e-8bf2-4e45-9469-383c6da62e72 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:11.750950 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9c25e-8bf2-4e45-9469-383c6da62e72 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:11.785023 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fef052-a0a2-4fe1-a07a-94ba7600c4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:11.785704 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fef052-a0a2-4fe1-a07a-94ba7600c4aa None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:11.785997 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fef052-a0a2-4fe1-a07a-94ba7600c4aa None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:11.786313 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fef052-a0a2-4fe1-a07a-94ba7600c4aa None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:11.787082 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fef052-a0a2-4fe1-a07a-94ba7600c4aa None admin] RBAC: Adding query filter params (name=reader) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:11.787398 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fef052-a0a2-4fe1-a07a-94ba7600c4aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:11.788798 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fef052-a0a2-4fe1-a07a-94ba7600c4aa None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:11.797950 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 158/326] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:26:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:26:11.803565 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbea69a-86d7-4b27-922c-af548ab0ce7a None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:11.917366 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbea69a-86d7-4b27-922c-af548ab0ce7a None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:11.928389 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:11.955400 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2e128-abf6-4d04-9eff-cbddb4711f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:11.956302 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2e128-abf6-4d04-9eff-cbddb4711f6e None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:11.956586 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2e128-abf6-4d04-9eff-cbddb4711f6e None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:11.956868 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2e128-abf6-4d04-9eff-cbddb4711f6e None admin] PATH_INFO: `/v3/users/c268027bc8564a0981c49ccf84d269a6` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:11.958091 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2e128-abf6-4d04-9eff-cbddb4711f6e None admin] RBAC: Authorizing `identity:get_user(user_id=c268027bc8564a0981c49ccf84d269a6)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:11.959644 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2e128-abf6-4d04-9eff-cbddb4711f6e None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:11.961832 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 169/327] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:26:11 2022] GET /identity/v3/users/c268027bc8564a0981c49ccf84d269a6 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:11.967345 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fef052-a0a2-4fe1-a07a-94ba7600c4aa None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:12.044134 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:12.090978 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fef052-a0a2-4fe1-a07a-94ba7600c4aa None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:12.127132 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77ab12-a74b-4e3b-8b47-a62d505bbd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:12.128013 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77ab12-a74b-4e3b-8b47-a62d505bbd04 None admin] REQUEST_METHOD: `PUT` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:12.128304 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77ab12-a74b-4e3b-8b47-a62d505bbd04 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:12.128583 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77ab12-a74b-4e3b-8b47-a62d505bbd04 None admin] PATH_INFO: `/v3/system/users/c268027bc8564a0981c49ccf84d269a6/roles/8c6de83a2de94d0a93b23f7853c8a2c7` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:12.130093 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a77ab12-a74b-4e3b-8b47-a62d505bbd04 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c268027bc8564a0981c49ccf84d269a6, role_id=8c6de83a2de94d0a93b23f7853c8a2c7)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:12.131500 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a77ab12-a74b-4e3b-8b47-a62d505bbd04 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:12.237190 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54cb04-2d11-41f3-846d-52bd02a05719 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:12.237558 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54cb04-2d11-41f3-846d-52bd02a05719 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:12.237757 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54cb04-2d11-41f3-846d-52bd02a05719 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:12.239514 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 170/328] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:12.245406 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff12b6-1787-4cec-ae3e-db95db23d4c6 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:12.245803 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff12b6-1787-4cec-ae3e-db95db23d4c6 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:12.246079 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff12b6-1787-4cec-ae3e-db95db23d4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:12.252111 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 159/329] 10.222.0.30 () {58 vars in 1334 bytes} [Tue Jul 5 21:26:11 2022] PUT /identity/v3/system/users/c268027bc8564a0981c49ccf84d269a6/roles/8c6de83a2de94d0a93b23f7853c8a2c7 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:26:12.270089 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-f3ff12b6-1787-4cec-ae3e-db95db23d4c6 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:12.272183 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-f3ff12b6-1787-4cec-ae3e-db95db23d4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:12.360549 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 171/330] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:26:12.385572 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77ab12-a74b-4e3b-8b47-a62d505bbd04 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:12.498498 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77ab12-a74b-4e3b-8b47-a62d505bbd04 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:12.526467 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:12.535615 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517fb0ed-817a-46a7-a2eb-ea031c78ddc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:12.543769 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517fb0ed-817a-46a7-a2eb-ea031c78ddc0 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:12.543769 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517fb0ed-817a-46a7-a2eb-ea031c78ddc0 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:12.543769 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517fb0ed-817a-46a7-a2eb-ea031c78ddc0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:12.548783 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517fb0ed-817a-46a7-a2eb-ea031c78ddc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:26:12.556890 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-517fb0ed-817a-46a7-a2eb-ea031c78ddc0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:26:12.556890 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:12.556890 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:12.556890 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:12.556890 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:12.556890 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:12.556890 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:12.556890 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:12.556890 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:12.556890 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:12.556890 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:12.556890 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:12.556890 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:26:12.556890 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:26:12.556890 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:26:12.556890 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:26:12.557963 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:26:12.557963 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:26:12.557963 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:26:12.557963 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:26:12.557963 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:12.557963 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:12.557963 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:12.557963 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:12.557963 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:12.557963 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:12.557963 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:12.557963 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:12.557963 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:12.557963 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:12.557963 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:12.557963 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:12.558965 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:12.558965 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:12.558965 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:12.558965 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:12.558965 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:26:12.558965 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:26:12.558965 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:26:12.558965 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:26:12.558965 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:26:12.558965 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:26:12.558965 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:26:12.558965 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:12.558965 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 160/331] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:26:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:12.564475 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff12b6-1787-4cec-ae3e-db95db23d4c6 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:12.684468 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff12b6-1787-4cec-ae3e-db95db23d4c6 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:12.704353 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:12.731459 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d46d11-cc1a-4b2b-b8f9-2cdde515ad3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:12.732140 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d46d11-cc1a-4b2b-b8f9-2cdde515ad3a None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:12.732425 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d46d11-cc1a-4b2b-b8f9-2cdde515ad3a None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:12.732702 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d46d11-cc1a-4b2b-b8f9-2cdde515ad3a None admin] PATH_INFO: `/v3/roles` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:12.733457 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d46d11-cc1a-4b2b-b8f9-2cdde515ad3a None admin] RBAC: Adding query filter params (name=member) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:12.733765 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d46d11-cc1a-4b2b-b8f9-2cdde515ad3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:12.735197 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d46d11-cc1a-4b2b-b8f9-2cdde515ad3a None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:12.749670 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 172/332] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:26:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:12.751538 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517fb0ed-817a-46a7-a2eb-ea031c78ddc0 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:12.882597 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517fb0ed-817a-46a7-a2eb-ea031c78ddc0 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:12.922414 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56685b-e2a7-42c7-ac44-6c3cba64479d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:12.923721 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56685b-e2a7-42c7-ac44-6c3cba64479d None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:12.924215 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56685b-e2a7-42c7-ac44-6c3cba64479d None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:12.924707 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56685b-e2a7-42c7-ac44-6c3cba64479d None admin] PATH_INFO: `/v3/users/511880e41e69460fb294dd874511856a` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:12.929261 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f56685b-e2a7-42c7-ac44-6c3cba64479d None admin] RBAC: Authorizing `identity:get_user(user_id=511880e41e69460fb294dd874511856a)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:12.931108 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f56685b-e2a7-42c7-ac44-6c3cba64479d None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:12.933314 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 161/333] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:26:12 2022] GET /identity/v3/users/511880e41e69460fb294dd874511856a => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:12.938899 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d46d11-cc1a-4b2b-b8f9-2cdde515ad3a None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:13.085700 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d46d11-cc1a-4b2b-b8f9-2cdde515ad3a None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:13.126066 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfba00f-3d93-4f1e-a792-93ccd9fded49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:13.127170 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfba00f-3d93-4f1e-a792-93ccd9fded49 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:13.127666 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfba00f-3d93-4f1e-a792-93ccd9fded49 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:13.128149 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfba00f-3d93-4f1e-a792-93ccd9fded49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:13.129188 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfba00f-3d93-4f1e-a792-93ccd9fded49 None admin] RBAC: Adding query filter params (role.id=a7a08ffb4e7f40f683e711c83a6186d0, user.id=511880e41e69460fb294dd874511856a, scope.system=all) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:13.129708 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfba00f-3d93-4f1e-a792-93ccd9fded49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:13.131410 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfba00f-3d93-4f1e-a792-93ccd9fded49 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:13.149839 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 173/334] 10.222.0.30 () {56 vars in 1308 bytes} [Tue Jul 5 21:26:12 2022] GET /identity/v3/role_assignments?user.id=511880e41e69460fb294dd874511856a&scope.system=all&role.id=a7a08ffb4e7f40f683e711c83a6186d0 => generated 510 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:14.680628 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f598bf-bed4-4361-9f42-7c007e5e8a9d None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:14.681688 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f598bf-bed4-4361-9f42-7c007e5e8a9d None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:14.682233 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f598bf-bed4-4361-9f42-7c007e5e8a9d None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:14.684074 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 162/335] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:14.689912 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a7ac4-7f0c-4917-9bdb-8ff225dd3dcd None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:14.690791 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a7ac4-7f0c-4917-9bdb-8ff225dd3dcd None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:14.691299 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a7ac4-7f0c-4917-9bdb-8ff225dd3dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:14.722560 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-570a7ac4-7f0c-4917-9bdb-8ff225dd3dcd None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:14.724115 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-570a7ac4-7f0c-4917-9bdb-8ff225dd3dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:14.770489 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:14.827844 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556a216-2216-4362-bf18-5b9ad7ed15c5 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:14.828497 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556a216-2216-4362-bf18-5b9ad7ed15c5 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:14.829027 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556a216-2216-4362-bf18-5b9ad7ed15c5 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:14.830924 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 163/336] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:14.839618 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 174/337] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:26:14.842535 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba75f5-7777-44aa-a3b1-eac5d38aebdf None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:14.843009 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba75f5-7777-44aa-a3b1-eac5d38aebdf None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:14.843444 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba75f5-7777-44aa-a3b1-eac5d38aebdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:14.855685 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2bd8d-dfe2-451c-b341-edc6e84ee556 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:14.856211 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2bd8d-dfe2-451c-b341-edc6e84ee556 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:14.856662 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2bd8d-dfe2-451c-b341-edc6e84ee556 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:14.858436 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 175/338] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:14.866913 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c31076-c59f-4bc7-9df1-6a0bbe48c303 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:14.868095 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c31076-c59f-4bc7-9df1-6a0bbe48c303 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:14.868591 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c31076-c59f-4bc7-9df1-6a0bbe48c303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:14.888559 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-cfba75f5-7777-44aa-a3b1-eac5d38aebdf None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:14.890152 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-cfba75f5-7777-44aa-a3b1-eac5d38aebdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:14.920121 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-21c31076-c59f-4bc7-9df1-6a0bbe48c303 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:14.920375 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-21c31076-c59f-4bc7-9df1-6a0bbe48c303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:15.002156 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:15.054776 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 164/339] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:26:15.056664 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfba75f5-7777-44aa-a3b1-eac5d38aebdf None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:15.081576 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 176/340] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:26:15.109484 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c31076-c59f-4bc7-9df1-6a0bbe48c303 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:15.363967 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:15.380969 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfba75f5-7777-44aa-a3b1-eac5d38aebdf None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:15.398264 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c31076-c59f-4bc7-9df1-6a0bbe48c303 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:15.438710 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751410c6-e3e1-4ff3-8084-738026cb4c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:15.439528 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751410c6-e3e1-4ff3-8084-738026cb4c1c None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:15.439816 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751410c6-e3e1-4ff3-8084-738026cb4c1c None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:15.440095 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751410c6-e3e1-4ff3-8084-738026cb4c1c None admin] PATH_INFO: `/v3/roles/member` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:15.458854 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751410c6-e3e1-4ff3-8084-738026cb4c1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:26:15.467653 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-751410c6-e3e1-4ff3-8084-738026cb4c1c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:26:15.467653 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:15.467653 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:15.467653 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:15.467653 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:15.467653 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:15.467653 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:15.467653 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:15.467653 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:15.467653 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:15.467653 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:15.467653 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:15.467653 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:26:15.467653 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:26:15.467653 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:26:15.467653 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:26:15.468702 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:26:15.468702 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:26:15.468702 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:26:15.468702 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:26:15.468702 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:15.468702 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:15.468702 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:15.468702 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:15.468702 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:15.468702 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:15.468702 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:15.468702 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:15.468702 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:15.468702 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:15.468702 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:15.468702 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:15.470309 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:15.470309 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:15.470309 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:15.470309 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:15.470309 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:26:15.470309 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:26:15.470309 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:26:15.470309 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:26:15.470309 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:26:15.470309 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:26:15.470309 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:26:15.470309 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:15.470309 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 165/341] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:26:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 414 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:15.470309 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751410c6-e3e1-4ff3-8084-738026cb4c1c None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:15.475438 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60648f98-81b9-4134-bdf6-b9677fbc98b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:15.476286 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60648f98-81b9-4134-bdf6-b9677fbc98b4 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:15.476577 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60648f98-81b9-4134-bdf6-b9677fbc98b4 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:15.477513 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60648f98-81b9-4134-bdf6-b9677fbc98b4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:15.505311 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60648f98-81b9-4134-bdf6-b9677fbc98b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:26:15.518449 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-60648f98-81b9-4134-bdf6-b9677fbc98b4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:26:15.518449 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:15.518449 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:15.518449 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:15.518449 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:15.518449 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:15.518449 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:15.518449 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:15.518449 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:15.518449 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:15.518449 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:15.518449 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:15.518449 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:26:15.518449 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:26:15.518449 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:26:15.518449 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:26:15.519527 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:26:15.519527 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:26:15.519527 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:26:15.519527 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:26:15.519527 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:15.519527 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:15.519527 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:15.519527 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:15.519527 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:15.519527 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:15.519527 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:15.519527 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:15.519527 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:15.519527 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:15.519527 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:15.519527 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:15.520459 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:15.520459 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:15.520459 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:15.520459 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:15.520459 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:26:15.520459 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:26:15.520459 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:26:15.520459 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:26:15.520459 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:26:15.520459 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:26:15.520459 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:26:15.520459 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:15.520459 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 177/342] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:26:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 411 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:15.521241 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60648f98-81b9-4134-bdf6-b9677fbc98b4 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:15.528359 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:15.629586 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751410c6-e3e1-4ff3-8084-738026cb4c1c None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:15.694185 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c141db-b48b-42e4-9aac-ddb5da1df61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:15.694997 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c141db-b48b-42e4-9aac-ddb5da1df61b None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:15.695284 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c141db-b48b-42e4-9aac-ddb5da1df61b None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:15.695631 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c141db-b48b-42e4-9aac-ddb5da1df61b None admin] PATH_INFO: `/v3/roles/member` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:15.714879 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c141db-b48b-42e4-9aac-ddb5da1df61b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:26:15.724095 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60648f98-81b9-4134-bdf6-b9677fbc98b4 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:15.727144 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-a9c141db-b48b-42e4-9aac-ddb5da1df61b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:26:15.727144 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:15.727144 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:15.727144 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:15.727144 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:15.727144 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:15.727144 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:15.727144 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:15.727144 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:15.727144 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:15.727144 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:15.727144 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:15.727144 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:26:15.727144 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:26:15.727144 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:26:15.727144 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:26:15.728163 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:26:15.728163 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:26:15.728163 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:26:15.728163 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:26:15.728163 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:15.728163 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:15.728163 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:15.728163 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:15.728163 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:15.728163 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:15.728163 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:15.728163 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:15.728163 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:15.728163 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:15.728163 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:15.728163 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:15.729095 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:15.729095 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:15.729095 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:15.729095 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:15.729095 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:26:15.729095 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:26:15.729095 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:26:15.729095 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:26:15.729095 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:26:15.729095 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:26:15.729095 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:26:15.729095 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:15.729095 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 166/343] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:26:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:15.729846 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c141db-b48b-42e4-9aac-ddb5da1df61b None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:15.783167 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac2dd1-9998-4cf2-9e36-7b78381915b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:15.783848 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac2dd1-9998-4cf2-9e36-7b78381915b0 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:15.784139 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac2dd1-9998-4cf2-9e36-7b78381915b0 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:15.784419 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac2dd1-9998-4cf2-9e36-7b78381915b0 None admin] PATH_INFO: `/v3/roles` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:15.785178 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac2dd1-9998-4cf2-9e36-7b78381915b0 None admin] RBAC: Adding query filter params (name=member) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:15.785492 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac2dd1-9998-4cf2-9e36-7b78381915b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:15.786914 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac2dd1-9998-4cf2-9e36-7b78381915b0 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:15.798004 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 178/344] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:26:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:15.798896 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac2dd1-9998-4cf2-9e36-7b78381915b0 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:15.820239 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:15.891974 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c141db-b48b-42e4-9aac-ddb5da1df61b None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:15.910513 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:15.937673 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab678f7-0307-49ef-b338-30974a707614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:15.938405 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab678f7-0307-49ef-b338-30974a707614 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:15.938695 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab678f7-0307-49ef-b338-30974a707614 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:15.939006 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab678f7-0307-49ef-b338-30974a707614 None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:15.939746 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab678f7-0307-49ef-b338-30974a707614 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:15.940059 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab678f7-0307-49ef-b338-30974a707614 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:15.941753 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab678f7-0307-49ef-b338-30974a707614 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:15.945890 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac2dd1-9998-4cf2-9e36-7b78381915b0 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:15.951438 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 167/345] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:26:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:15.953900 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7dac81-0350-4fd9-9856-749c260d39e7 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:15.954295 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7dac81-0350-4fd9-9856-749c260d39e7 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:15.954666 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7dac81-0350-4fd9-9856-749c260d39e7 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:15.956543 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 168/346] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:15.958402 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7dac81-0350-4fd9-9856-749c260d39e7 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:15.997982 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6944d3-a337-42a1-a5da-7117610e3940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:15.998729 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6944d3-a337-42a1-a5da-7117610e3940 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:15.999007 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6944d3-a337-42a1-a5da-7117610e3940 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:15.999290 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6944d3-a337-42a1-a5da-7117610e3940 None admin] PATH_INFO: `/v3/roles` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:16.000053 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6944d3-a337-42a1-a5da-7117610e3940 None admin] RBAC: Adding query filter params (name=member) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:16.000371 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6944d3-a337-42a1-a5da-7117610e3940 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:16.001783 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6944d3-a337-42a1-a5da-7117610e3940 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:16.011450 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 179/347] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:26:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:16.012699 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd6614-9207-4073-810c-9e1c4d32f4c8 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:16.014105 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd6614-9207-4073-810c-9e1c4d32f4c8 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:16.014105 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd6614-9207-4073-810c-9e1c4d32f4c8 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:16.014673 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 180/348] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:16.015378 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd6614-9207-4073-810c-9e1c4d32f4c8 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:16.087911 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7dac81-0350-4fd9-9856-749c260d39e7 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:16.108094 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:16.137349 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bae8ff9-d3c0-453d-b18f-e9973889a8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:16.138013 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae8ff9-d3c0-453d-b18f-e9973889a8ad None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:16.138404 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae8ff9-d3c0-453d-b18f-e9973889a8ad None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:16.138690 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae8ff9-d3c0-453d-b18f-e9973889a8ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:16.152111 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd6614-9207-4073-810c-9e1c4d32f4c8 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:16.181652 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:16.198084 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3bd053-3b3e-49a5-a641-041229dadd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:16.198888 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bd053-3b3e-49a5-a641-041229dadd74 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:16.199184 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bd053-3b3e-49a5-a641-041229dadd74 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:16.199631 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bd053-3b3e-49a5-a641-041229dadd74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:16.237081 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bae8ff9-d3c0-453d-b18f-e9973889a8ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:16.238601 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bae8ff9-d3c0-453d-b18f-e9973889a8ad None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:16.277922 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3bd053-3b3e-49a5-a641-041229dadd74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:16.279750 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3bd053-3b3e-49a5-a641-041229dadd74 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:16.366619 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 169/349] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:26:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:26:16.368791 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0e85a-8739-492e-9be6-020ce92c7936 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:16.368791 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0e85a-8739-492e-9be6-020ce92c7936 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:16.369137 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0e85a-8739-492e-9be6-020ce92c7936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:16.388408 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:16.388978 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-41f0e85a-8739-492e-9be6-020ce92c7936 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:16.390241 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-41f0e85a-8739-492e-9be6-020ce92c7936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:16.430425 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 181/350] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:26:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:26:16.430425 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38dee51-644a-4d94-8127-911916810019 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:16.430425 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38dee51-644a-4d94-8127-911916810019 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:16.430425 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38dee51-644a-4d94-8127-911916810019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:16.448302 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-b38dee51-644a-4d94-8127-911916810019 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:16.449494 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-b38dee51-644a-4d94-8127-911916810019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:16.467105 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:16.476997 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 170/351] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:26:16.478461 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0e85a-8739-492e-9be6-020ce92c7936 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:16.539473 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 182/352] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:26:16.539473 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38dee51-644a-4d94-8127-911916810019 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:16.619705 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0e85a-8739-492e-9be6-020ce92c7936 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:16.656641 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38dee51-644a-4d94-8127-911916810019 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:16.658222 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:16.658525 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3e7aa-d713-466b-973a-d389287b233c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:16.659515 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3e7aa-d713-466b-973a-d389287b233c None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:16.659515 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3e7aa-d713-466b-973a-d389287b233c None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:16.659813 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3e7aa-d713-466b-973a-d389287b233c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:16.701507 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f2ceb-07ae-45f3-b6ad-a8778b70cb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:16.702414 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f2ceb-07ae-45f3-b6ad-a8778b70cb47 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:16.702727 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f2ceb-07ae-45f3-b6ad-a8778b70cb47 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:16.703242 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f2ceb-07ae-45f3-b6ad-a8778b70cb47 None admin] PATH_INFO: `/v3/projects/f79334203c0a4279909fbe5e93cc441c` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:16.705516 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105f2ceb-07ae-45f3-b6ad-a8778b70cb47 None admin] RBAC: Authorizing `identity:get_project(project_id=f79334203c0a4279909fbe5e93cc441c)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:16.707033 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105f2ceb-07ae-45f3-b6ad-a8778b70cb47 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:16.708924 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 183/353] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:26:16 2022] GET /identity/v3/projects/f79334203c0a4279909fbe5e93cc441c => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:16.709949 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4525e-d6a6-46ec-938a-c7e05a088058 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:16.710258 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4525e-d6a6-46ec-938a-c7e05a088058 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:16.710542 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4525e-d6a6-46ec-938a-c7e05a088058 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:16.712415 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 184/354] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:16.713116 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be4525e-d6a6-46ec-938a-c7e05a088058 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:16.739985 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:16.749700 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd3e7aa-d713-466b-973a-d389287b233c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:16.752354 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd3e7aa-d713-466b-973a-d389287b233c None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:16.833930 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be4525e-d6a6-46ec-938a-c7e05a088058 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:16.873344 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 171/355] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:26:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:26:16.874272 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3e7aa-d713-466b-973a-d389287b233c None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:16.874411 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f76fd5-7a75-44a6-8d7c-881c48173c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:16.875203 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f76fd5-7a75-44a6-8d7c-881c48173c83 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:16.875485 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f76fd5-7a75-44a6-8d7c-881c48173c83 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:16.875765 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f76fd5-7a75-44a6-8d7c-881c48173c83 None admin] PATH_INFO: `/v3/projects/f79334203c0a4279909fbe5e93cc441c` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:16.877964 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f76fd5-7a75-44a6-8d7c-881c48173c83 None admin] RBAC: Authorizing `identity:get_project(project_id=f79334203c0a4279909fbe5e93cc441c)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:16.879562 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f76fd5-7a75-44a6-8d7c-881c48173c83 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:16.881437 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 185/356] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:26:16 2022] GET /identity/v3/projects/f79334203c0a4279909fbe5e93cc441c => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:16.882246 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f76fd5-7a75-44a6-8d7c-881c48173c83 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:16.930971 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:16.995141 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:16.999739 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f76fd5-7a75-44a6-8d7c-881c48173c83 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:17.002491 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3e7aa-d713-466b-973a-d389287b233c None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:17.041850 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf4c49-180f-46e6-9927-b26f594d93f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:17.043033 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf4c49-180f-46e6-9927-b26f594d93f6 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:17.043323 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf4c49-180f-46e6-9927-b26f594d93f6 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:17.043605 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf4c49-180f-46e6-9927-b26f594d93f6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:17.050654 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e343ec3-d129-4e47-9df6-9d7c7ae37742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:17.051461 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e343ec3-d129-4e47-9df6-9d7c7ae37742 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:17.051755 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e343ec3-d129-4e47-9df6-9d7c7ae37742 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:17.052038 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e343ec3-d129-4e47-9df6-9d7c7ae37742 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:17.059462 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf4c49-180f-46e6-9927-b26f594d93f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:26:17.064822 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e343ec3-d129-4e47-9df6-9d7c7ae37742 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:26:17.068883 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-7ecf4c49-180f-46e6-9927-b26f594d93f6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:26:17.068883 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:17.068883 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:17.068883 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:17.068883 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:17.068883 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:17.068883 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:17.068883 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:17.068883 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:17.068883 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:17.068883 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:17.068883 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:17.068883 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:26:17.068883 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:26:17.068883 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:26:17.068883 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:26:17.069973 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:26:17.069973 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:26:17.069973 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:26:17.069973 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:26:17.069973 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:17.069973 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:17.069973 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:17.069973 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:17.069973 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:17.069973 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:17.069973 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:17.069973 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:17.069973 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:17.069973 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:17.069973 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:17.069973 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:17.071439 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:17.071439 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:17.071439 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:17.071439 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:17.071439 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:26:17.071439 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:26:17.071439 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:26:17.071439 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:26:17.071439 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:26:17.071439 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:26:17.071439 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:26:17.071439 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:17.071439 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 172/357] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:26:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:17.071439 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf4c49-180f-46e6-9927-b26f594d93f6 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:17.077493 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-9e343ec3-d129-4e47-9df6-9d7c7ae37742 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:26:17.077493 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:17.077493 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:17.077493 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:17.077493 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:17.077493 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:17.077493 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:17.077493 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:17.077493 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:17.077493 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:17.077493 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:17.077493 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:17.077493 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:26:17.077493 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:26:17.077493 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:26:17.077493 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:26:17.078583 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:26:17.078583 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:26:17.078583 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:26:17.078583 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:26:17.078583 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:17.078583 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:17.078583 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:17.078583 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:17.078583 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:17.078583 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:17.078583 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:17.078583 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:17.078583 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:17.078583 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:17.078583 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:17.078583 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:17.081242 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:17.081242 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:17.081242 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:17.081242 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:17.081242 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:26:17.081242 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:26:17.081242 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:26:17.081242 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:26:17.081242 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:26:17.081242 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:26:17.081242 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:26:17.081242 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:17.081242 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 186/358] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:26:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:17.081242 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5a8b1-80db-45e3-be69-914357f9aae5 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:17.082072 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5a8b1-80db-45e3-be69-914357f9aae5 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:17.082510 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5a8b1-80db-45e3-be69-914357f9aae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:17.103369 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-ddd5a8b1-80db-45e3-be69-914357f9aae5 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:17.104632 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-ddd5a8b1-80db-45e3-be69-914357f9aae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:17.187552 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 187/359] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:26:17.188430 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5a8b1-80db-45e3-be69-914357f9aae5 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:17.194296 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf4c49-180f-46e6-9927-b26f594d93f6 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:17.219942 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:17.236310 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd1283-4b65-401b-8b32-96049ba3645d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:17.237198 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd1283-4b65-401b-8b32-96049ba3645d None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:17.237865 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd1283-4b65-401b-8b32-96049ba3645d None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:17.238234 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd1283-4b65-401b-8b32-96049ba3645d None admin] PATH_INFO: `/v3/groups/0c892847831c4d6487c3838fcac36aa5` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:17.248622 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd1283-4b65-401b-8b32-96049ba3645d None admin] RBAC: Authorizing `identity:get_group(group_id=0c892847831c4d6487c3838fcac36aa5)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:17.250174 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd1283-4b65-401b-8b32-96049ba3645d None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:17.251857 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 173/360] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Jul 5 21:26:17 2022] GET /identity/v3/groups/0c892847831c4d6487c3838fcac36aa5 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:17.252652 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd1283-4b65-401b-8b32-96049ba3645d None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:17.276095 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:17.313591 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5a8b1-80db-45e3-be69-914357f9aae5 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:17.353537 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d5524-2b1b-40d5-8f1d-3e0289141522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:17.354504 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d5524-2b1b-40d5-8f1d-3e0289141522 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:17.354791 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d5524-2b1b-40d5-8f1d-3e0289141522 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:17.355069 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d5524-2b1b-40d5-8f1d-3e0289141522 None admin] PATH_INFO: `/v3/projects/b74267c87cf54aeeb11de99a05473428` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:17.357233 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6d5524-2b1b-40d5-8f1d-3e0289141522 None admin] RBAC: Authorizing `identity:get_project(project_id=b74267c87cf54aeeb11de99a05473428)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:17.358744 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6d5524-2b1b-40d5-8f1d-3e0289141522 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:17.360443 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 188/361] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:26:17 2022] GET /identity/v3/projects/b74267c87cf54aeeb11de99a05473428 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:17.361854 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d5524-2b1b-40d5-8f1d-3e0289141522 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:17.374788 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd1283-4b65-401b-8b32-96049ba3645d None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:17.416094 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54992fc0-5c2e-40ea-b7e1-a93444aba44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:17.416970 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54992fc0-5c2e-40ea-b7e1-a93444aba44b None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:17.417259 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54992fc0-5c2e-40ea-b7e1-a93444aba44b None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:17.417542 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54992fc0-5c2e-40ea-b7e1-a93444aba44b None admin] PATH_INFO: `/v3/groups/0c892847831c4d6487c3838fcac36aa5` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:17.418842 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54992fc0-5c2e-40ea-b7e1-a93444aba44b None admin] RBAC: Authorizing `identity:get_group(group_id=0c892847831c4d6487c3838fcac36aa5)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:17.420304 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54992fc0-5c2e-40ea-b7e1-a93444aba44b None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:17.422004 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 174/362] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Jul 5 21:26:17 2022] GET /identity/v3/groups/0c892847831c4d6487c3838fcac36aa5 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:17.422803 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54992fc0-5c2e-40ea-b7e1-a93444aba44b None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:17.475789 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:17.482169 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d5524-2b1b-40d5-8f1d-3e0289141522 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:17.517425 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281ed09-a2aa-4f7a-a167-bf1466870bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:17.517610 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:17.518030 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281ed09-a2aa-4f7a-a167-bf1466870bb0 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:17.518349 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281ed09-a2aa-4f7a-a167-bf1466870bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:17.518640 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281ed09-a2aa-4f7a-a167-bf1466870bb0 None admin] PATH_INFO: `/v3/roles` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:17.519388 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c281ed09-a2aa-4f7a-a167-bf1466870bb0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:17.519700 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c281ed09-a2aa-4f7a-a167-bf1466870bb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:17.521084 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c281ed09-a2aa-4f7a-a167-bf1466870bb0 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:17.529201 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 189/363] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:26:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:17.534009 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281ed09-a2aa-4f7a-a167-bf1466870bb0 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:17.534115 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54992fc0-5c2e-40ea-b7e1-a93444aba44b None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:17.573373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6e193-6756-41a6-a819-1590731b99c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:17.574049 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6e193-6756-41a6-a819-1590731b99c8 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:17.574404 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6e193-6756-41a6-a819-1590731b99c8 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:17.574683 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6e193-6756-41a6-a819-1590731b99c8 None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:17.575440 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c6e193-6756-41a6-a819-1590731b99c8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:17.575758 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c6e193-6756-41a6-a819-1590731b99c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:17.577157 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c6e193-6756-41a6-a819-1590731b99c8 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:17.585516 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 175/364] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:26:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:17.586369 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6e193-6756-41a6-a819-1590731b99c8 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:17.641301 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281ed09-a2aa-4f7a-a167-bf1466870bb0 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:17.674194 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116be0c-1f0d-4265-bd11-c49851834a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:17.674994 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116be0c-1f0d-4265-bd11-c49851834a06 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:17.675280 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116be0c-1f0d-4265-bd11-c49851834a06 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:17.675554 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116be0c-1f0d-4265-bd11-c49851834a06 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:17.686306 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8116be0c-1f0d-4265-bd11-c49851834a06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:26:17.691803 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6e193-6756-41a6-a819-1590731b99c8 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:17.693961 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-8116be0c-1f0d-4265-bd11-c49851834a06 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:26:17.693961 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:17.693961 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:17.693961 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:17.693961 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:17.693961 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:17.693961 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:17.693961 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:17.693961 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:17.693961 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:17.693961 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:17.693961 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:17.693961 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:26:17.693961 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:26:17.693961 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:26:17.693961 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:26:17.695109 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:26:17.695109 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:26:17.695109 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:26:17.695109 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:26:17.695109 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:17.695109 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:17.695109 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:17.695109 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:17.695109 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:17.695109 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:17.695109 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:17.695109 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:17.695109 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:17.695109 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:17.695109 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:17.695109 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:17.696272 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:17.696272 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:17.696272 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:17.696272 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:17.696272 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:26:17.696272 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:26:17.696272 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:26:17.696272 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:26:17.696272 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:26:17.696272 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:26:17.696272 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:26:17.696272 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:17.696272 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 190/365] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:26:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:17.696272 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116be0c-1f0d-4265-bd11-c49851834a06 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:17.718276 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:17.728437 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a11f0a8-348e-44d8-bcb3-88fc980bcc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:17.729103 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11f0a8-348e-44d8-bcb3-88fc980bcc91 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:17.729438 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11f0a8-348e-44d8-bcb3-88fc980bcc91 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:17.729670 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11f0a8-348e-44d8-bcb3-88fc980bcc91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:17.730546 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a11f0a8-348e-44d8-bcb3-88fc980bcc91 None admin] RBAC: Adding query filter params (group.id=0c892847831c4d6487c3838fcac36aa5, role.id=a7a08ffb4e7f40f683e711c83a6186d0, scope.project.id=f79334203c0a4279909fbe5e93cc441c) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:17.734276 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a11f0a8-348e-44d8-bcb3-88fc980bcc91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:17.734276 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a11f0a8-348e-44d8-bcb3-88fc980bcc91 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:17.737843 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 176/366] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Jul 5 21:26:17 2022] GET /identity/v3/role_assignments?group.id=0c892847831c4d6487c3838fcac36aa5&scope.project.id=f79334203c0a4279909fbe5e93cc441c&role.id=a7a08ffb4e7f40f683e711c83a6186d0 => generated 260 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:17.738668 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a11f0a8-348e-44d8-bcb3-88fc980bcc91 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:17.764343 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:17.812922 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116be0c-1f0d-4265-bd11-c49851834a06 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:17.851941 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caeebbc-85c3-4709-b586-825ce385accc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:17.852832 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caeebbc-85c3-4709-b586-825ce385accc None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:17.853123 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caeebbc-85c3-4709-b586-825ce385accc None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:17.853407 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caeebbc-85c3-4709-b586-825ce385accc None admin] PATH_INFO: `/v3/groups/0c892847831c4d6487c3838fcac36aa5` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:17.854687 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caeebbc-85c3-4709-b586-825ce385accc None admin] RBAC: Authorizing `identity:get_group(group_id=0c892847831c4d6487c3838fcac36aa5)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:17.856267 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caeebbc-85c3-4709-b586-825ce385accc None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:17.858000 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 191/367] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Jul 5 21:26:17 2022] GET /identity/v3/groups/0c892847831c4d6487c3838fcac36aa5 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:17.858847 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caeebbc-85c3-4709-b586-825ce385accc None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:17.872279 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a11f0a8-348e-44d8-bcb3-88fc980bcc91 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:17.913676 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d01c5-d055-4ec7-9c17-2c0301f1efa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:17.914436 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d01c5-d055-4ec7-9c17-2c0301f1efa5 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:17.914740 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d01c5-d055-4ec7-9c17-2c0301f1efa5 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:17.915010 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d01c5-d055-4ec7-9c17-2c0301f1efa5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:17.915863 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d01c5-d055-4ec7-9c17-2c0301f1efa5 None admin] RBAC: Adding query filter params (group.id=0c892847831c4d6487c3838fcac36aa5, role.id=6413bac7cc9a42cf83968dd26a3ccc34, scope.project.id=f79334203c0a4279909fbe5e93cc441c) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:17.916187 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d01c5-d055-4ec7-9c17-2c0301f1efa5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:17.917655 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d01c5-d055-4ec7-9c17-2c0301f1efa5 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:17.923822 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 177/368] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Jul 5 21:26:17 2022] GET /identity/v3/role_assignments?group.id=0c892847831c4d6487c3838fcac36aa5&scope.project.id=f79334203c0a4279909fbe5e93cc441c&role.id=6413bac7cc9a42cf83968dd26a3ccc34 => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:17.924454 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d01c5-d055-4ec7-9c17-2c0301f1efa5 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:17.963850 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:17.982092 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caeebbc-85c3-4709-b586-825ce385accc None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:18.022919 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c3f61b-822c-4fcf-9887-f943f92bd69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:18.023588 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3f61b-822c-4fcf-9887-f943f92bd69f None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:18.024396 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3f61b-822c-4fcf-9887-f943f92bd69f None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:18.024677 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3f61b-822c-4fcf-9887-f943f92bd69f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:18.025283 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:18.052491 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d01c5-d055-4ec7-9c17-2c0301f1efa5 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:18.096261 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d7c62-07de-4194-bf1c-0757da77bd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:18.097074 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d7c62-07de-4194-bf1c-0757da77bd0b None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:18.097365 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d7c62-07de-4194-bf1c-0757da77bd0b None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:18.097646 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d7c62-07de-4194-bf1c-0757da77bd0b None admin] PATH_INFO: `/v3/users/c268027bc8564a0981c49ccf84d269a6` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:18.098900 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d7c62-07de-4194-bf1c-0757da77bd0b None admin] RBAC: Authorizing `identity:get_user(user_id=c268027bc8564a0981c49ccf84d269a6)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:18.100364 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d7c62-07de-4194-bf1c-0757da77bd0b None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:18.106640 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 178/369] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:26:17 2022] GET /identity/v3/users/c268027bc8564a0981c49ccf84d269a6 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:18.107593 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d7c62-07de-4194-bf1c-0757da77bd0b None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:18.115656 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c3f61b-822c-4fcf-9887-f943f92bd69f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:18.117986 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c3f61b-822c-4fcf-9887-f943f92bd69f None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:18.215265 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d7c62-07de-4194-bf1c-0757da77bd0b None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:18.217687 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:18.237388 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 192/370] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:26:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:26:18.243353 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c3f61b-822c-4fcf-9887-f943f92bd69f None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:18.263225 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e300e41-d138-46fd-bd2f-45dbdcba7a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:18.264223 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e300e41-d138-46fd-bd2f-45dbdcba7a73 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:18.264721 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e300e41-d138-46fd-bd2f-45dbdcba7a73 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:18.265205 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e300e41-d138-46fd-bd2f-45dbdcba7a73 None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:18.266732 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e300e41-d138-46fd-bd2f-45dbdcba7a73 None admin] RBAC: Adding query filter params (name=admin) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:18.267514 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e300e41-d138-46fd-bd2f-45dbdcba7a73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:18.269761 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e300e41-d138-46fd-bd2f-45dbdcba7a73 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:18.282341 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 179/371] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:26:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:18.283548 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e300e41-d138-46fd-bd2f-45dbdcba7a73 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:18.302511 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:18.356562 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c3f61b-822c-4fcf-9887-f943f92bd69f None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:18.394345 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e300e41-d138-46fd-bd2f-45dbdcba7a73 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:18.395111 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb337d1-5b4a-4fae-8b53-c3949e1af327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:18.396123 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb337d1-5b4a-4fae-8b53-c3949e1af327 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:18.396732 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb337d1-5b4a-4fae-8b53-c3949e1af327 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:18.397216 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb337d1-5b4a-4fae-8b53-c3949e1af327 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:18.398356 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb337d1-5b4a-4fae-8b53-c3949e1af327 None admin] RBAC: Adding query filter params (group.id=0c892847831c4d6487c3838fcac36aa5, role.id=a7a08ffb4e7f40f683e711c83a6186d0, scope.project.id=b74267c87cf54aeeb11de99a05473428) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:18.399176 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb337d1-5b4a-4fae-8b53-c3949e1af327 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:18.400865 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb337d1-5b4a-4fae-8b53-c3949e1af327 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:18.407609 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 193/372] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Jul 5 21:26:18 2022] GET /identity/v3/role_assignments?group.id=0c892847831c4d6487c3838fcac36aa5&scope.project.id=b74267c87cf54aeeb11de99a05473428&role.id=a7a08ffb4e7f40f683e711c83a6186d0 => generated 260 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:18.408867 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb337d1-5b4a-4fae-8b53-c3949e1af327 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:18.433721 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c5de9e-7546-469c-b7d1-e832abe9e297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:18.434421 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5de9e-7546-469c-b7d1-e832abe9e297 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:18.434714 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5de9e-7546-469c-b7d1-e832abe9e297 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:18.434999 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5de9e-7546-469c-b7d1-e832abe9e297 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:18.435960 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c5de9e-7546-469c-b7d1-e832abe9e297 None admin] RBAC: Adding query filter params (role.id=8c6de83a2de94d0a93b23f7853c8a2c7, user.id=c268027bc8564a0981c49ccf84d269a6, scope.system=all) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:18.436507 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c5de9e-7546-469c-b7d1-e832abe9e297 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:18.438072 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c5de9e-7546-469c-b7d1-e832abe9e297 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:18.453196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 180/373] 10.222.0.30 () {56 vars in 1308 bytes} [Tue Jul 5 21:26:18 2022] GET /identity/v3/role_assignments?user.id=c268027bc8564a0981c49ccf84d269a6&scope.system=all&role.id=8c6de83a2de94d0a93b23f7853c8a2c7 => generated 510 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:18.453551 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c5de9e-7546-469c-b7d1-e832abe9e297 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:18.522669 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:18.585311 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:18.614571 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb337d1-5b4a-4fae-8b53-c3949e1af327 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:18.624541 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c5de9e-7546-469c-b7d1-e832abe9e297 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:18.663956 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3787fc02-b6bc-4714-9d91-91b336899c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:18.664744 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787fc02-b6bc-4714-9d91-91b336899c01 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:18.665049 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787fc02-b6bc-4714-9d91-91b336899c01 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:18.665328 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787fc02-b6bc-4714-9d91-91b336899c01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:18.683463 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6967f7-fc47-4ff9-ae3f-8e82ea6d0828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:18.684349 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6967f7-fc47-4ff9-ae3f-8e82ea6d0828 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:18.684634 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6967f7-fc47-4ff9-ae3f-8e82ea6d0828 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:18.684910 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6967f7-fc47-4ff9-ae3f-8e82ea6d0828 None admin] PATH_INFO: `/v3/projects/b74267c87cf54aeeb11de99a05473428` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:18.691003 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6967f7-fc47-4ff9-ae3f-8e82ea6d0828 None admin] RBAC: Authorizing `identity:get_project(project_id=b74267c87cf54aeeb11de99a05473428)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:18.692517 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6967f7-fc47-4ff9-ae3f-8e82ea6d0828 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:18.694718 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 194/374] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:26:18 2022] GET /identity/v3/projects/b74267c87cf54aeeb11de99a05473428 => generated 302 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:18.700133 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6967f7-fc47-4ff9-ae3f-8e82ea6d0828 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:18.745839 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3787fc02-b6bc-4714-9d91-91b336899c01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:18.747438 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3787fc02-b6bc-4714-9d91-91b336899c01 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:18.820055 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:18.860621 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6967f7-fc47-4ff9-ae3f-8e82ea6d0828 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:18.863589 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 181/375] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:26:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:26:18.869818 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3787fc02-b6bc-4714-9d91-91b336899c01 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:18.880965 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:18.901848 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5cc51-9a6e-48bf-9b2a-e76e43ca707b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:18.902757 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5cc51-9a6e-48bf-9b2a-e76e43ca707b None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:18.903046 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5cc51-9a6e-48bf-9b2a-e76e43ca707b None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:18.903322 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5cc51-9a6e-48bf-9b2a-e76e43ca707b None admin] PATH_INFO: `/v3/groups/0c892847831c4d6487c3838fcac36aa5` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:18.904718 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca5cc51-9a6e-48bf-9b2a-e76e43ca707b None admin] RBAC: Authorizing `identity:get_group(group_id=0c892847831c4d6487c3838fcac36aa5)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:18.906218 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca5cc51-9a6e-48bf-9b2a-e76e43ca707b None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:18.908170 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 195/376] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Jul 5 21:26:18 2022] GET /identity/v3/groups/0c892847831c4d6487c3838fcac36aa5 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:26:18.913598 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5cc51-9a6e-48bf-9b2a-e76e43ca707b None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:18.983254 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3787fc02-b6bc-4714-9d91-91b336899c01 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:19.022970 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31587716-88dc-4d23-944b-cfc7d183dc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:19.023896 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31587716-88dc-4d23-944b-cfc7d183dc1c None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:19.024243 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31587716-88dc-4d23-944b-cfc7d183dc1c None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:19.024626 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31587716-88dc-4d23-944b-cfc7d183dc1c None admin] PATH_INFO: `/v3/projects/9675d05c7a01416aae7c5c400d679f19` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:19.025881 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31587716-88dc-4d23-944b-cfc7d183dc1c None admin] RBAC: Authorizing `identity:get_project(project_id=9675d05c7a01416aae7c5c400d679f19)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:19.027387 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31587716-88dc-4d23-944b-cfc7d183dc1c None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:19.030165 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 182/377] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:26:18 2022] GET /identity/v3/projects/9675d05c7a01416aae7c5c400d679f19 => generated 344 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:26:19.035689 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31587716-88dc-4d23-944b-cfc7d183dc1c None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:19.072572 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:19.161176 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31587716-88dc-4d23-944b-cfc7d183dc1c None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:19.168160 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5cc51-9a6e-48bf-9b2a-e76e43ca707b None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:19.210610 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627571c-3c05-4db8-aece-7e366a06121c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:19.212101 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627571c-3c05-4db8-aece-7e366a06121c None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:19.212394 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627571c-3c05-4db8-aece-7e366a06121c None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:19.212671 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627571c-3c05-4db8-aece-7e366a06121c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:19.213523 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8627571c-3c05-4db8-aece-7e366a06121c None admin] RBAC: Adding query filter params (group.id=0c892847831c4d6487c3838fcac36aa5, role.id=6413bac7cc9a42cf83968dd26a3ccc34, scope.project.id=b74267c87cf54aeeb11de99a05473428) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:19.213832 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8627571c-3c05-4db8-aece-7e366a06121c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:19.215649 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8627571c-3c05-4db8-aece-7e366a06121c None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:19.220727 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00626e3f-3c53-4e52-b28b-9b10df5044c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:19.221607 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00626e3f-3c53-4e52-b28b-9b10df5044c0 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:19.221895 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00626e3f-3c53-4e52-b28b-9b10df5044c0 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:19.222206 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00626e3f-3c53-4e52-b28b-9b10df5044c0 None admin] PATH_INFO: `/v3/groups/4549837e332a4e07a0635c12b4556b7f` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:19.223468 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 196/378] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Jul 5 21:26:18 2022] GET /identity/v3/role_assignments?group.id=0c892847831c4d6487c3838fcac36aa5&scope.project.id=b74267c87cf54aeeb11de99a05473428&role.id=6413bac7cc9a42cf83968dd26a3ccc34 => generated 260 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:19.238339 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00626e3f-3c53-4e52-b28b-9b10df5044c0 None admin] RBAC: Authorizing `identity:get_group(group_id=4549837e332a4e07a0635c12b4556b7f)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:19.239974 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00626e3f-3c53-4e52-b28b-9b10df5044c0 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:19.242330 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 183/379] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Jul 5 21:26:19 2022] GET /identity/v3/groups/4549837e332a4e07a0635c12b4556b7f => generated 229 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:19.248049 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627571c-3c05-4db8-aece-7e366a06121c None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:19.322665 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:19.388537 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627571c-3c05-4db8-aece-7e366a06121c None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:19.431106 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10126fdd-2760-4f09-b55f-4f14715ac2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:19.431674 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10126fdd-2760-4f09-b55f-4f14715ac2b6 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:19.431960 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10126fdd-2760-4f09-b55f-4f14715ac2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:19.432237 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10126fdd-2760-4f09-b55f-4f14715ac2b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:19.433071 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10126fdd-2760-4f09-b55f-4f14715ac2b6 None admin] RBAC: Adding query filter params (group.id=4549837e332a4e07a0635c12b4556b7f, role.id=00090b1962654604b8e106a05d44d06a, scope.project.id=9675d05c7a01416aae7c5c400d679f19) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:19.433388 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10126fdd-2760-4f09-b55f-4f14715ac2b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:19.435006 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10126fdd-2760-4f09-b55f-4f14715ac2b6 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:19.441495 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 197/380] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Jul 5 21:26:19 2022] GET /identity/v3/role_assignments?group.id=4549837e332a4e07a0635c12b4556b7f&scope.project.id=9675d05c7a01416aae7c5c400d679f19&role.id=00090b1962654604b8e106a05d44d06a => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:20.134863 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6454880-927a-477f-9093-0c0df8a054ed None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:20.135911 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6454880-927a-477f-9093-0c0df8a054ed None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:20.136429 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6454880-927a-477f-9093-0c0df8a054ed None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:20.138361 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 184/381] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:26:20.143896 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6f0c6-a8a8-45a5-94d5-0849e8e96f0e None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:20.144339 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6f0c6-a8a8-45a5-94d5-0849e8e96f0e None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:20.144520 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6f0c6-a8a8-45a5-94d5-0849e8e96f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:20.162342 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-9ae6f0c6-a8a8-45a5-94d5-0849e8e96f0e None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:20.163550 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-9ae6f0c6-a8a8-45a5-94d5-0849e8e96f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:20.259246 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 198/382] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:26:20.293863 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6454880-927a-477f-9093-0c0df8a054ed None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:20.404931 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:20.412510 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6454880-927a-477f-9093-0c0df8a054ed None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:20.449105 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a454f65-b37e-4c3b-a267-490c2dee52e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:20.449912 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a454f65-b37e-4c3b-a267-490c2dee52e2 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:20.450225 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a454f65-b37e-4c3b-a267-490c2dee52e2 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:20.450511 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a454f65-b37e-4c3b-a267-490c2dee52e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:20.461002 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a454f65-b37e-4c3b-a267-490c2dee52e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:26:20.468876 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-3a454f65-b37e-4c3b-a267-490c2dee52e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:26:20.468876 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:20.468876 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:20.468876 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:20.468876 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:20.468876 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:20.468876 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:20.468876 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:20.468876 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:20.468876 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:20.468876 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:20.468876 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:20.468876 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:26:20.468876 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:26:20.468876 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:26:20.468876 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:26:20.469878 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:26:20.469878 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:26:20.469878 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:26:20.469878 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:26:20.469878 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:20.469878 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:20.469878 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:20.469878 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:20.469878 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:20.469878 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:20.469878 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:20.469878 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:20.469878 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:20.469878 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:20.469878 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:20.469878 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:20.470818 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:20.470818 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:20.470818 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:20.470818 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:20.470818 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:26:20.470818 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:26:20.470818 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:26:20.470818 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:26:20.470818 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:26:20.470818 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:26:20.470818 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:26:20.470818 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:20.470818 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 185/383] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:26:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:20.478072 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6f0c6-a8a8-45a5-94d5-0849e8e96f0e None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:20.545196 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:20.618555 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6f0c6-a8a8-45a5-94d5-0849e8e96f0e None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:20.653208 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bfd388-5ebb-4196-a44e-c2e281df5ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:20.653886 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bfd388-5ebb-4196-a44e-c2e281df5ade None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:20.654224 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bfd388-5ebb-4196-a44e-c2e281df5ade None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:20.654507 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bfd388-5ebb-4196-a44e-c2e281df5ade None admin] PATH_INFO: `/v3/roles` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:20.655311 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bfd388-5ebb-4196-a44e-c2e281df5ade None admin] RBAC: Adding query filter params (name=member) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:20.655564 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bfd388-5ebb-4196-a44e-c2e281df5ade None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:20.657084 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bfd388-5ebb-4196-a44e-c2e281df5ade None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:20.666443 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 199/384] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:26:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:20.675407 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a454f65-b37e-4c3b-a267-490c2dee52e2 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:20.694299 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5db12-a92a-4a86-94c3-7e77d900af6d None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:20.694631 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5db12-a92a-4a86-94c3-7e77d900af6d None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:20.694875 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5db12-a92a-4a86-94c3-7e77d900af6d None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:20.697216 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 200/385] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:20.729275 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf4752-8649-46ca-815c-83d18a4ad0ce None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:20.729623 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf4752-8649-46ca-815c-83d18a4ad0ce None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:20.729843 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf4752-8649-46ca-815c-83d18a4ad0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:20.749646 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-69bf4752-8649-46ca-815c-83d18a4ad0ce None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:20.751394 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-69bf4752-8649-46ca-815c-83d18a4ad0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:20.849379 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 201/386] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:26:20.859277 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a454f65-b37e-4c3b-a267-490c2dee52e2 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:20.892223 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf4752-8649-46ca-815c-83d18a4ad0ce None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:20.909558 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce1994-a5d0-41d2-910d-0ae42c6f392d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:20.910420 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce1994-a5d0-41d2-910d-0ae42c6f392d None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:20.910707 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce1994-a5d0-41d2-910d-0ae42c6f392d None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:20.910987 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce1994-a5d0-41d2-910d-0ae42c6f392d None admin] PATH_INFO: `/v3/groups/0c892847831c4d6487c3838fcac36aa5` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:20.912889 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce1994-a5d0-41d2-910d-0ae42c6f392d None admin] RBAC: Authorizing `identity:get_group(group_id=0c892847831c4d6487c3838fcac36aa5)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:20.915100 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce1994-a5d0-41d2-910d-0ae42c6f392d None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:20.917264 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 186/387] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Jul 5 21:26:20 2022] GET /identity/v3/groups/0c892847831c4d6487c3838fcac36aa5 => generated 226 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:20.929280 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce1994-a5d0-41d2-910d-0ae42c6f392d None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:20.940912 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:20.973081 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:21.007968 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf4752-8649-46ca-815c-83d18a4ad0ce None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:21.048336 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e42bc21-b1d0-41f8-813a-d6bbc03e4968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:21.049904 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42bc21-b1d0-41f8-813a-d6bbc03e4968 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:21.051159 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42bc21-b1d0-41f8-813a-d6bbc03e4968 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:21.051825 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42bc21-b1d0-41f8-813a-d6bbc03e4968 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:21.071444 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e42bc21-b1d0-41f8-813a-d6bbc03e4968 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:26:21.081005 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-1e42bc21-b1d0-41f8-813a-d6bbc03e4968 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:26:21.081005 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:21.081005 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:21.081005 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:21.081005 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:21.081005 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:21.081005 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:21.081005 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:21.081005 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:21.081005 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:21.081005 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:21.081005 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:21.081005 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:26:21.081005 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:26:21.081005 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:26:21.081005 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:26:21.082095 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:26:21.082095 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:26:21.082095 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:26:21.082095 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:26:21.082095 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:21.082095 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:21.082095 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:21.082095 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:21.082095 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:21.082095 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:21.082095 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:21.082095 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:21.082095 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:21.082095 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:21.082095 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:21.082095 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:21.083070 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:21.083070 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:21.083070 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:21.083070 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:21.083070 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:26:21.083070 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:26:21.083070 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:26:21.083070 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:26:21.083070 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:26:21.083070 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:26:21.083070 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:26:21.083070 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:21.086798 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 202/388] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:26:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:26:21.093022 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e42bc21-b1d0-41f8-813a-d6bbc03e4968 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:21.120324 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce1994-a5d0-41d2-910d-0ae42c6f392d None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:21.209251 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5f226-bae9-4a98-8ee9-ccdb4e49a14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:21.210153 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5f226-bae9-4a98-8ee9-ccdb4e49a14f None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:21.210442 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5f226-bae9-4a98-8ee9-ccdb4e49a14f None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:21.210722 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5f226-bae9-4a98-8ee9-ccdb4e49a14f None admin] PATH_INFO: `/v3/projects/f79334203c0a4279909fbe5e93cc441c` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:21.212577 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5f226-bae9-4a98-8ee9-ccdb4e49a14f None admin] RBAC: Authorizing `identity:get_project(project_id=f79334203c0a4279909fbe5e93cc441c)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:21.214811 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5f226-bae9-4a98-8ee9-ccdb4e49a14f None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:21.216547 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 187/389] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:26:20 2022] GET /identity/v3/projects/f79334203c0a4279909fbe5e93cc441c => generated 298 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:21.224363 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5f226-bae9-4a98-8ee9-ccdb4e49a14f None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:21.230597 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:21.241853 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e42bc21-b1d0-41f8-813a-d6bbc03e4968 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:21.299349 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f62c205-3f2b-4b3f-b115-d5b9b27ca987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:21.300874 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62c205-3f2b-4b3f-b115-d5b9b27ca987 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:21.301167 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62c205-3f2b-4b3f-b115-d5b9b27ca987 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:21.301451 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62c205-3f2b-4b3f-b115-d5b9b27ca987 None admin] PATH_INFO: `/v3/roles` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:21.302241 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f62c205-3f2b-4b3f-b115-d5b9b27ca987 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:21.303473 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f62c205-3f2b-4b3f-b115-d5b9b27ca987 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:21.304929 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f62c205-3f2b-4b3f-b115-d5b9b27ca987 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:21.315533 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 203/390] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:26:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:21.322308 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f62c205-3f2b-4b3f-b115-d5b9b27ca987 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:21.389162 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:21.397903 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5f226-bae9-4a98-8ee9-ccdb4e49a14f None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:21.432701 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be4c0c-c5ee-4ab0-9780-df962960b7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:21.433866 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be4c0c-c5ee-4ab0-9780-df962960b7ef None admin] REQUEST_METHOD: `PUT` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:21.434373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be4c0c-c5ee-4ab0-9780-df962960b7ef None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:21.434835 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be4c0c-c5ee-4ab0-9780-df962960b7ef None admin] PATH_INFO: `/v3/projects/f79334203c0a4279909fbe5e93cc441c/groups/0c892847831c4d6487c3838fcac36aa5/roles/a7a08ffb4e7f40f683e711c83a6186d0` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:21.436976 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be4c0c-c5ee-4ab0-9780-df962960b7ef None admin] RBAC: Authorizing `identity:create_grant(project_id=f79334203c0a4279909fbe5e93cc441c, group_id=0c892847831c4d6487c3838fcac36aa5, role_id=a7a08ffb4e7f40f683e711c83a6186d0)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:21.438761 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be4c0c-c5ee-4ab0-9780-df962960b7ef None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:21.462458 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f62c205-3f2b-4b3f-b115-d5b9b27ca987 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:21.497295 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3403043f-f975-4a70-b47d-d52b42ccd5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:21.498246 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403043f-f975-4a70-b47d-d52b42ccd5c3 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:21.498540 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403043f-f975-4a70-b47d-d52b42ccd5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:21.498822 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403043f-f975-4a70-b47d-d52b42ccd5c3 None admin] PATH_INFO: `/v3/groups/0c892847831c4d6487c3838fcac36aa5` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:21.500019 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3403043f-f975-4a70-b47d-d52b42ccd5c3 None admin] RBAC: Authorizing `identity:get_group(group_id=0c892847831c4d6487c3838fcac36aa5)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:21.501473 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3403043f-f975-4a70-b47d-d52b42ccd5c3 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:21.507674 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 204/391] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Jul 5 21:26:21 2022] GET /identity/v3/groups/0c892847831c4d6487c3838fcac36aa5 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:21.507674 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601fb91-cab8-4da7-94d3-8540e2b81463 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:21.507674 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601fb91-cab8-4da7-94d3-8540e2b81463 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:21.507674 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601fb91-cab8-4da7-94d3-8540e2b81463 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:21.510861 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 205/392] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:21.511765 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601fb91-cab8-4da7-94d3-8540e2b81463 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:21.518434 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 188/393] 10.222.0.30 () {58 vars in 1442 bytes} [Tue Jul 5 21:26:21 2022] PUT /identity/v3/projects/f79334203c0a4279909fbe5e93cc441c/groups/0c892847831c4d6487c3838fcac36aa5/roles/a7a08ffb4e7f40f683e711c83a6186d0 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:26:21.530053 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4649cd-30bb-4a14-ac13-3b56c4f5d966 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:21.531564 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4649cd-30bb-4a14-ac13-3b56c4f5d966 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:21.531870 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4649cd-30bb-4a14-ac13-3b56c4f5d966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:21.581066 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-9e4649cd-30bb-4a14-ac13-3b56c4f5d966 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:21.581998 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:21.586782 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-9e4649cd-30bb-4a14-ac13-3b56c4f5d966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:21.726250 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601fb91-cab8-4da7-94d3-8540e2b81463 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:21.730447 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 189/394] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:26:21.732042 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b135781-45cf-4db1-889b-3a8658789c51 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:21.733255 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b135781-45cf-4db1-889b-3a8658789c51 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:21.733755 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b135781-45cf-4db1-889b-3a8658789c51 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:21.735270 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 190/395] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:21.742052 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9c8f9-79c5-4c7a-8780-6658dfa36b84 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:21.742467 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9c8f9-79c5-4c7a-8780-6658dfa36b84 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:21.742881 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9c8f9-79c5-4c7a-8780-6658dfa36b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:21.771402 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde672b9-411e-4d0a-b795-b97761812515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:21.771653 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-b2d9c8f9-79c5-4c7a-8780-6658dfa36b84 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:21.772271 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde672b9-411e-4d0a-b795-b97761812515 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:21.772558 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde672b9-411e-4d0a-b795-b97761812515 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:21.772831 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde672b9-411e-4d0a-b795-b97761812515 None admin] PATH_INFO: `/v3/projects/f79334203c0a4279909fbe5e93cc441c` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:21.772951 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-b2d9c8f9-79c5-4c7a-8780-6658dfa36b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:21.774564 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde672b9-411e-4d0a-b795-b97761812515 None admin] RBAC: Authorizing `identity:get_project(project_id=f79334203c0a4279909fbe5e93cc441c)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:21.776210 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde672b9-411e-4d0a-b795-b97761812515 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:21.778988 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 206/396] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:26:21 2022] GET /identity/v3/projects/f79334203c0a4279909fbe5e93cc441c => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:21.790416 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde672b9-411e-4d0a-b795-b97761812515 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:21.847225 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 191/397] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:26:21.848102 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d9c8f9-79c5-4c7a-8780-6658dfa36b84 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:21.862964 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:21.921319 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:21.928065 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde672b9-411e-4d0a-b795-b97761812515 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:21.955589 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d9c8f9-79c5-4c7a-8780-6658dfa36b84 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:21.963833 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f07f7-6fc8-4cf9-ac9c-4987ab58fc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:21.964503 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f07f7-6fc8-4cf9-ac9c-4987ab58fc4e None admin] REQUEST_METHOD: `PUT` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:21.964789 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f07f7-6fc8-4cf9-ac9c-4987ab58fc4e None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:21.965062 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f07f7-6fc8-4cf9-ac9c-4987ab58fc4e None admin] PATH_INFO: `/v3/projects/f79334203c0a4279909fbe5e93cc441c/groups/0c892847831c4d6487c3838fcac36aa5/roles/6413bac7cc9a42cf83968dd26a3ccc34` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:21.967327 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74f07f7-6fc8-4cf9-ac9c-4987ab58fc4e None admin] RBAC: Authorizing `identity:create_grant(project_id=f79334203c0a4279909fbe5e93cc441c, group_id=0c892847831c4d6487c3838fcac36aa5, role_id=6413bac7cc9a42cf83968dd26a3ccc34)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:21.968898 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74f07f7-6fc8-4cf9-ac9c-4987ab58fc4e None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:21.993446 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a3ccd-ca19-4522-bdd8-7a7a2ffbf419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:21.994542 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a3ccd-ca19-4522-bdd8-7a7a2ffbf419 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:21.994998 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a3ccd-ca19-4522-bdd8-7a7a2ffbf419 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:21.995442 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a3ccd-ca19-4522-bdd8-7a7a2ffbf419 None admin] PATH_INFO: `/v3/roles/member` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:22.006520 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981a3ccd-ca19-4522-bdd8-7a7a2ffbf419 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:26:22.016169 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-981a3ccd-ca19-4522-bdd8-7a7a2ffbf419 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:26:22.016169 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:22.016169 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:22.016169 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:22.016169 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:22.016169 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:22.016169 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:22.016169 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:22.016169 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:22.016169 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:22.016169 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:22.016169 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:22.016169 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:26:22.016169 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:26:22.016169 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:26:22.016169 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:26:22.017546 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:26:22.017546 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:26:22.017546 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:26:22.017546 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:26:22.017546 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:22.017546 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:22.017546 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:22.017546 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:22.017546 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:22.017546 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:22.017546 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:22.017546 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:22.017546 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:22.017546 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:22.017546 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:22.017546 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:22.018682 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:22.018682 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:22.018682 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:22.018682 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:22.018682 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:26:22.018682 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:26:22.018682 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:26:22.018682 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:26:22.018682 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:26:22.018682 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:26:22.018682 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:26:22.018682 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:22.020908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 192/398] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:26:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:22.021866 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a3ccd-ca19-4522-bdd8-7a7a2ffbf419 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:22.042775 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 207/399] 10.222.0.30 () {58 vars in 1442 bytes} [Tue Jul 5 21:26:21 2022] PUT /identity/v3/projects/f79334203c0a4279909fbe5e93cc441c/groups/0c892847831c4d6487c3838fcac36aa5/roles/6413bac7cc9a42cf83968dd26a3ccc34 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:26:22.043895 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f07f7-6fc8-4cf9-ac9c-4987ab58fc4e None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:22.103726 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:22.136188 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a3ccd-ca19-4522-bdd8-7a7a2ffbf419 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:22.177823 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db0a29-7505-40b1-b654-0a8d3815b4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:22.179340 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db0a29-7505-40b1-b654-0a8d3815b4a9 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:22.179830 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db0a29-7505-40b1-b654-0a8d3815b4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:22.180617 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db0a29-7505-40b1-b654-0a8d3815b4a9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:22.201427 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db0a29-7505-40b1-b654-0a8d3815b4a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:26:22.210987 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-d5db0a29-7505-40b1-b654-0a8d3815b4a9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:26:22.210987 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:22.210987 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:22.210987 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:22.210987 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:22.210987 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:22.210987 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:22.210987 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:22.210987 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:22.210987 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:22.210987 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:22.210987 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:22.210987 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:26:22.210987 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:26:22.210987 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:26:22.210987 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:26:22.212785 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:26:22.212785 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:26:22.212785 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:26:22.212785 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:26:22.212785 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:22.212785 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:22.212785 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:22.212785 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:22.212785 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:22.212785 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:22.212785 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:22.212785 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:22.212785 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:22.212785 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:22.212785 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:22.212785 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:22.213698 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:22.213698 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:22.213698 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:22.213698 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:22.213698 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:26:22.213698 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:26:22.213698 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:26:22.213698 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:26:22.213698 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:26:22.213698 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:26:22.213698 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:26:22.213698 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:22.213698 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 193/400] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:26:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:22.214543 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d55ec-2e8e-4bef-bc17-4d09c6b39e4c None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:22.214870 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d55ec-2e8e-4bef-bc17-4d09c6b39e4c None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:22.215341 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d55ec-2e8e-4bef-bc17-4d09c6b39e4c None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:22.220204 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 194/401] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:22.221418 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d55ec-2e8e-4bef-bc17-4d09c6b39e4c None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:22.225940 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f07f7-6fc8-4cf9-ac9c-4987ab58fc4e None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:22.273765 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e83ed-afc4-41a5-9fc7-2ae64ab6258a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:22.274541 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e83ed-afc4-41a5-9fc7-2ae64ab6258a None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:22.274701 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e83ed-afc4-41a5-9fc7-2ae64ab6258a None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:22.274981 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e83ed-afc4-41a5-9fc7-2ae64ab6258a None admin] PATH_INFO: `/v3/roles` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:22.276740 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e83ed-afc4-41a5-9fc7-2ae64ab6258a None admin] RBAC: Adding query filter params (name=member) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:22.277065 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e83ed-afc4-41a5-9fc7-2ae64ab6258a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:22.278552 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e83ed-afc4-41a5-9fc7-2ae64ab6258a None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:22.292080 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 208/402] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:26:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:22.293292 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86d135-cb7d-4282-9ac4-357e7c170478 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:22.293585 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86d135-cb7d-4282-9ac4-357e7c170478 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:22.293869 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86d135-cb7d-4282-9ac4-357e7c170478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:22.314101 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-2c86d135-cb7d-4282-9ac4-357e7c170478 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:22.315368 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-2c86d135-cb7d-4282-9ac4-357e7c170478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:22.341470 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:22.372716 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d55ec-2e8e-4bef-bc17-4d09c6b39e4c None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:22.407971 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 209/403] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:26:22.407971 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86d135-cb7d-4282-9ac4-357e7c170478 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:22.426490 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:22.431865 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26f3e5-89b9-4c5a-829f-a8a7ed4319a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:22.433025 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26f3e5-89b9-4c5a-829f-a8a7ed4319a0 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:22.433550 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26f3e5-89b9-4c5a-829f-a8a7ed4319a0 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:22.434064 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26f3e5-89b9-4c5a-829f-a8a7ed4319a0 None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:22.438220 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc26f3e5-89b9-4c5a-829f-a8a7ed4319a0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:22.438220 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc26f3e5-89b9-4c5a-829f-a8a7ed4319a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:22.438220 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc26f3e5-89b9-4c5a-829f-a8a7ed4319a0 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:22.447877 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 195/404] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:26:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:22.449270 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26f3e5-89b9-4c5a-829f-a8a7ed4319a0 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:22.520254 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86d135-cb7d-4282-9ac4-357e7c170478 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:22.557743 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d81157-b1bb-487b-b4b5-322766c2d17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:22.561491 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d81157-b1bb-487b-b4b5-322766c2d17b None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:22.565427 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26f3e5-89b9-4c5a-829f-a8a7ed4319a0 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:22.566474 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d81157-b1bb-487b-b4b5-322766c2d17b None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:22.566786 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d81157-b1bb-487b-b4b5-322766c2d17b None admin] PATH_INFO: `/v3/groups/0c892847831c4d6487c3838fcac36aa5` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:22.568328 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d81157-b1bb-487b-b4b5-322766c2d17b None admin] RBAC: Authorizing `identity:get_group(group_id=0c892847831c4d6487c3838fcac36aa5)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:22.570997 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d81157-b1bb-487b-b4b5-322766c2d17b None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:22.577370 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 210/405] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Jul 5 21:26:22 2022] GET /identity/v3/groups/0c892847831c4d6487c3838fcac36aa5 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:22.577370 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d81157-b1bb-487b-b4b5-322766c2d17b None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:22.593013 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:22.614884 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66c30a-34d4-49b6-a87b-b27be17fc21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:22.616013 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66c30a-34d4-49b6-a87b-b27be17fc21a None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:22.616335 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66c30a-34d4-49b6-a87b-b27be17fc21a None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:22.616619 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66c30a-34d4-49b6-a87b-b27be17fc21a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:22.631613 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d66c30a-34d4-49b6-a87b-b27be17fc21a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:26:22.642903 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-1d66c30a-34d4-49b6-a87b-b27be17fc21a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:26:22.642903 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:22.642903 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:22.642903 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:22.642903 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:22.642903 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:22.642903 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:22.642903 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:22.642903 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:22.642903 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:22.642903 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:22.642903 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:22.642903 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:26:22.642903 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:26:22.642903 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:26:22.642903 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:26:22.643999 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:26:22.643999 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:26:22.643999 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:26:22.643999 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:26:22.643999 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:22.643999 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:22.643999 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:22.643999 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:22.643999 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:22.643999 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:22.643999 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:22.643999 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:22.643999 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:22.643999 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:22.643999 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:22.643999 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:22.645083 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:22.645083 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:22.645083 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:22.645083 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:22.645083 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:26:22.645083 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:26:22.645083 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:26:22.645083 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:26:22.645083 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:26:22.645083 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:26:22.645083 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:26:22.645083 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:22.645083 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 196/406] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:26:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:22.645885 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66c30a-34d4-49b6-a87b-b27be17fc21a None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:22.713599 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d81157-b1bb-487b-b4b5-322766c2d17b None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:22.734268 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:22.761670 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd59c5-f19b-44fb-9a88-9799d92cdb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:22.762951 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd59c5-f19b-44fb-9a88-9799d92cdb33 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:22.763468 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd59c5-f19b-44fb-9a88-9799d92cdb33 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:22.763983 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd59c5-f19b-44fb-9a88-9799d92cdb33 None admin] PATH_INFO: `/v3/groups/0c892847831c4d6487c3838fcac36aa5` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:22.765417 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd59c5-f19b-44fb-9a88-9799d92cdb33 None admin] RBAC: Authorizing `identity:get_group(group_id=0c892847831c4d6487c3838fcac36aa5)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:22.767176 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd59c5-f19b-44fb-9a88-9799d92cdb33 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:22.769426 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 211/407] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Jul 5 21:26:22 2022] GET /identity/v3/groups/0c892847831c4d6487c3838fcac36aa5 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:22.771000 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd59c5-f19b-44fb-9a88-9799d92cdb33 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:22.813446 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66c30a-34d4-49b6-a87b-b27be17fc21a None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:22.873406 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26043db4-1ee8-47b6-bf14-2dc492ed1761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:22.874036 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:22.875001 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26043db4-1ee8-47b6-bf14-2dc492ed1761 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:22.875867 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26043db4-1ee8-47b6-bf14-2dc492ed1761 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:22.876050 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26043db4-1ee8-47b6-bf14-2dc492ed1761 None admin] PATH_INFO: `/v3/projects/b74267c87cf54aeeb11de99a05473428` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:22.878283 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26043db4-1ee8-47b6-bf14-2dc492ed1761 None admin] RBAC: Authorizing `identity:get_project(project_id=b74267c87cf54aeeb11de99a05473428)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:22.881096 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26043db4-1ee8-47b6-bf14-2dc492ed1761 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:22.885088 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 197/408] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:26:22 2022] GET /identity/v3/projects/b74267c87cf54aeeb11de99a05473428 => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:22.891250 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26043db4-1ee8-47b6-bf14-2dc492ed1761 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:22.898045 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd59c5-f19b-44fb-9a88-9799d92cdb33 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:22.956855 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf7cf91-b282-4965-b98c-33a505837a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:22.957802 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7cf91-b282-4965-b98c-33a505837a3a None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:22.958363 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7cf91-b282-4965-b98c-33a505837a3a None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:22.958928 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7cf91-b282-4965-b98c-33a505837a3a None admin] PATH_INFO: `/v3/roles` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:22.960485 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf7cf91-b282-4965-b98c-33a505837a3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:22.960955 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf7cf91-b282-4965-b98c-33a505837a3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:22.964306 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf7cf91-b282-4965-b98c-33a505837a3a None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:22.986584 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 212/409] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:26:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:22.988117 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf7cf91-b282-4965-b98c-33a505837a3a None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:23.027067 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26043db4-1ee8-47b6-bf14-2dc492ed1761 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:23.054228 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:23.073004 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ae43a-d88d-42df-9a24-512e2ac4850c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:23.073004 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ae43a-d88d-42df-9a24-512e2ac4850c None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:23.073004 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ae43a-d88d-42df-9a24-512e2ac4850c None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:23.073004 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ae43a-d88d-42df-9a24-512e2ac4850c None admin] PATH_INFO: `/v3/projects/b74267c87cf54aeeb11de99a05473428` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:23.073392 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0ae43a-d88d-42df-9a24-512e2ac4850c None admin] RBAC: Authorizing `identity:get_project(project_id=b74267c87cf54aeeb11de99a05473428)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:23.073392 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0ae43a-d88d-42df-9a24-512e2ac4850c None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:23.076252 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 198/410] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:26:22 2022] GET /identity/v3/projects/b74267c87cf54aeeb11de99a05473428 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:23.077239 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ae43a-d88d-42df-9a24-512e2ac4850c None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:23.145399 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf7cf91-b282-4965-b98c-33a505837a3a None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:23.189816 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bdc4a6-f2dd-4a03-9d28-7c4c0eb4d0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:23.191138 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bdc4a6-f2dd-4a03-9d28-7c4c0eb4d0a0 None admin] REQUEST_METHOD: `PUT` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:23.191679 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bdc4a6-f2dd-4a03-9d28-7c4c0eb4d0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:23.192163 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bdc4a6-f2dd-4a03-9d28-7c4c0eb4d0a0 None admin] PATH_INFO: `/v3/projects/b74267c87cf54aeeb11de99a05473428/groups/0c892847831c4d6487c3838fcac36aa5/roles/a7a08ffb4e7f40f683e711c83a6186d0` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:23.194632 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bdc4a6-f2dd-4a03-9d28-7c4c0eb4d0a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=b74267c87cf54aeeb11de99a05473428, group_id=0c892847831c4d6487c3838fcac36aa5, role_id=a7a08ffb4e7f40f683e711c83a6186d0)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:23.197059 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bdc4a6-f2dd-4a03-9d28-7c4c0eb4d0a0 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:23.256784 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ae43a-d88d-42df-9a24-512e2ac4850c None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:23.309878 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 213/411] 10.222.0.30 () {58 vars in 1442 bytes} [Tue Jul 5 21:26:22 2022] PUT /identity/v3/projects/b74267c87cf54aeeb11de99a05473428/groups/0c892847831c4d6487c3838fcac36aa5/roles/a7a08ffb4e7f40f683e711c83a6186d0 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:26:23.311521 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bdc4a6-f2dd-4a03-9d28-7c4c0eb4d0a0 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:23.329423 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936bb095-54c4-4582-92bb-459a90fa76b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:23.330449 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:23.330572 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936bb095-54c4-4582-92bb-459a90fa76b1 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:23.330802 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936bb095-54c4-4582-92bb-459a90fa76b1 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:23.331154 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936bb095-54c4-4582-92bb-459a90fa76b1 None admin] PATH_INFO: `/v3/groups/4549837e332a4e07a0635c12b4556b7f` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:23.333289 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936bb095-54c4-4582-92bb-459a90fa76b1 None admin] RBAC: Authorizing `identity:get_group(group_id=4549837e332a4e07a0635c12b4556b7f)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:23.337749 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936bb095-54c4-4582-92bb-459a90fa76b1 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:23.346328 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 199/412] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Jul 5 21:26:23 2022] GET /identity/v3/groups/4549837e332a4e07a0635c12b4556b7f => generated 229 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:23.347350 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936bb095-54c4-4582-92bb-459a90fa76b1 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:23.484856 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:23.494251 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bdc4a6-f2dd-4a03-9d28-7c4c0eb4d0a0 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:23.561217 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936bb095-54c4-4582-92bb-459a90fa76b1 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:23.568289 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23467b97-63b8-459e-9645-0cb05f7bc1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:23.569450 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23467b97-63b8-459e-9645-0cb05f7bc1bf None admin] REQUEST_METHOD: `PUT` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:23.569950 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23467b97-63b8-459e-9645-0cb05f7bc1bf None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:23.571067 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23467b97-63b8-459e-9645-0cb05f7bc1bf None admin] PATH_INFO: `/v3/projects/b74267c87cf54aeeb11de99a05473428/groups/0c892847831c4d6487c3838fcac36aa5/roles/6413bac7cc9a42cf83968dd26a3ccc34` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:23.573613 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23467b97-63b8-459e-9645-0cb05f7bc1bf None admin] RBAC: Authorizing `identity:create_grant(project_id=b74267c87cf54aeeb11de99a05473428, group_id=0c892847831c4d6487c3838fcac36aa5, role_id=6413bac7cc9a42cf83968dd26a3ccc34)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:23.575371 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23467b97-63b8-459e-9645-0cb05f7bc1bf None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:23.600621 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c8a3a-5565-43ea-b313-a9951299f6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:23.601409 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c8a3a-5565-43ea-b313-a9951299f6ec None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:23.602275 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c8a3a-5565-43ea-b313-a9951299f6ec None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:23.602578 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c8a3a-5565-43ea-b313-a9951299f6ec None admin] PATH_INFO: `/v3/projects/9675d05c7a01416aae7c5c400d679f19` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:23.605592 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c8a3a-5565-43ea-b313-a9951299f6ec None admin] RBAC: Authorizing `identity:get_project(project_id=9675d05c7a01416aae7c5c400d679f19)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:23.606971 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c8a3a-5565-43ea-b313-a9951299f6ec None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:23.608887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 200/413] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:26:23 2022] GET /identity/v3/projects/9675d05c7a01416aae7c5c400d679f19 => generated 344 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:23.615104 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c8a3a-5565-43ea-b313-a9951299f6ec None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:23.644370 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 214/414] 10.222.0.30 () {58 vars in 1442 bytes} [Tue Jul 5 21:26:23 2022] PUT /identity/v3/projects/b74267c87cf54aeeb11de99a05473428/groups/0c892847831c4d6487c3838fcac36aa5/roles/6413bac7cc9a42cf83968dd26a3ccc34 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:26:23.742477 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c8a3a-5565-43ea-b313-a9951299f6ec None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:23.774073 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:23.784348 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1127354-ac73-4bd7-b90f-ad2db181b588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:23.785676 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1127354-ac73-4bd7-b90f-ad2db181b588 None admin] REQUEST_METHOD: `PUT` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:23.786235 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1127354-ac73-4bd7-b90f-ad2db181b588 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:23.786695 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1127354-ac73-4bd7-b90f-ad2db181b588 None admin] PATH_INFO: `/v3/projects/9675d05c7a01416aae7c5c400d679f19/groups/4549837e332a4e07a0635c12b4556b7f/roles/00090b1962654604b8e106a05d44d06a` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:23.789107 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1127354-ac73-4bd7-b90f-ad2db181b588 None admin] RBAC: Authorizing `identity:create_grant(project_id=9675d05c7a01416aae7c5c400d679f19, group_id=4549837e332a4e07a0635c12b4556b7f, role_id=00090b1962654604b8e106a05d44d06a)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:23.791580 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1127354-ac73-4bd7-b90f-ad2db181b588 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:23.884641 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 201/415] 10.222.0.30 () {58 vars in 1442 bytes} [Tue Jul 5 21:26:23 2022] PUT /identity/v3/projects/9675d05c7a01416aae7c5c400d679f19/groups/4549837e332a4e07a0635c12b4556b7f/roles/00090b1962654604b8e106a05d44d06a => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:26:24.021399 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25536da-2f7b-421a-9990-fa8c3a33ca89 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:24.021866 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25536da-2f7b-421a-9990-fa8c3a33ca89 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:24.022286 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25536da-2f7b-421a-9990-fa8c3a33ca89 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:24.024713 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 215/416] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:24.030597 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e2d17-9ac8-4244-bbca-51be98569875 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:24.030920 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e2d17-9ac8-4244-bbca-51be98569875 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:24.031178 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e2d17-9ac8-4244-bbca-51be98569875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:24.059595 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-428e2d17-9ac8-4244-bbca-51be98569875 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:24.060842 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-428e2d17-9ac8-4244-bbca-51be98569875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:24.137107 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 202/417] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:26:24.163273 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25536da-2f7b-421a-9990-fa8c3a33ca89 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:24.245543 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:24.302847 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25536da-2f7b-421a-9990-fa8c3a33ca89 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:24.347299 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5215162-aacd-451b-9622-8d3a1468ded5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:24.348110 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5215162-aacd-451b-9622-8d3a1468ded5 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:24.348386 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5215162-aacd-451b-9622-8d3a1468ded5 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:24.348673 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5215162-aacd-451b-9622-8d3a1468ded5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:24.365092 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5215162-aacd-451b-9622-8d3a1468ded5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:26:24.373761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-c5215162-aacd-451b-9622-8d3a1468ded5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:26:24.373761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:24.373761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:24.373761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:24.373761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:24.373761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:24.373761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:24.373761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:24.373761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:24.373761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:24.373761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:24.373761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:24.373761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:26:24.373761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:26:24.373761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:26:24.373761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:26:24.374852 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:26:24.374852 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:26:24.374852 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:26:24.374852 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:26:24.374852 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:24.374852 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:24.374852 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:24.374852 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:24.374852 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:24.374852 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:24.374852 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:24.374852 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:24.374852 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:24.374852 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:24.374852 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:24.374852 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:24.376171 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:24.376171 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:24.376171 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:24.376171 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:24.376171 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:26:24.376171 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:26:24.376171 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:26:24.376171 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:26:24.376171 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:26:24.376171 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:26:24.376171 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:26:24.376171 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:24.376171 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 216/418] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:26:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:24.383042 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e2d17-9ac8-4244-bbca-51be98569875 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:24.408240 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aabb18-54e8-41ec-9a07-14bd901895f2 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:24.408432 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aabb18-54e8-41ec-9a07-14bd901895f2 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:24.408715 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aabb18-54e8-41ec-9a07-14bd901895f2 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:24.410361 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 217/419] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:24.416222 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545cda1-8b25-40be-9c55-c0f2bcf95a5f None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:24.416516 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545cda1-8b25-40be-9c55-c0f2bcf95a5f None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:24.416803 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545cda1-8b25-40be-9c55-c0f2bcf95a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:24.434465 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-d545cda1-8b25-40be-9c55-c0f2bcf95a5f None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:24.435742 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-d545cda1-8b25-40be-9c55-c0f2bcf95a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:24.529029 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 218/420] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:26:24.538643 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e2d17-9ac8-4244-bbca-51be98569875 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:24.558220 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:24.564701 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d545cda1-8b25-40be-9c55-c0f2bcf95a5f None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:24.583413 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101b1ad-f4af-4951-8738-67d96ba522f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:24.584203 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101b1ad-f4af-4951-8738-67d96ba522f2 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:24.584496 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101b1ad-f4af-4951-8738-67d96ba522f2 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:24.584776 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101b1ad-f4af-4951-8738-67d96ba522f2 None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:24.585531 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101b1ad-f4af-4951-8738-67d96ba522f2 None admin] RBAC: Adding query filter params (name=member) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:24.585841 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101b1ad-f4af-4951-8738-67d96ba522f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:24.587808 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101b1ad-f4af-4951-8738-67d96ba522f2 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:24.607604 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 203/421] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:26:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:24.616747 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101b1ad-f4af-4951-8738-67d96ba522f2 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:24.714621 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:24.749561 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101b1ad-f4af-4951-8738-67d96ba522f2 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:24.763947 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d545cda1-8b25-40be-9c55-c0f2bcf95a5f None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:24.801225 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905a5cd-0253-42d6-9183-cfa8b4663235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:24.802448 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905a5cd-0253-42d6-9183-cfa8b4663235 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:24.802855 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a6055-68ed-47d0-8170-79a57f23ba43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:24.803234 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905a5cd-0253-42d6-9183-cfa8b4663235 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:24.803521 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a6055-68ed-47d0-8170-79a57f23ba43 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:24.803811 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a6055-68ed-47d0-8170-79a57f23ba43 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:24.804154 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a6055-68ed-47d0-8170-79a57f23ba43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:24.804415 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905a5cd-0253-42d6-9183-cfa8b4663235 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:24.816554 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1905a5cd-0253-42d6-9183-cfa8b4663235 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:26:24.825567 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-1905a5cd-0253-42d6-9183-cfa8b4663235 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:26:24.825567 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:24.825567 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:24.825567 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:24.825567 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:24.825567 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:24.825567 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:24.825567 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:24.825567 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:24.825567 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:24.825567 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:24.825567 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:24.825567 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:26:24.825567 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:26:24.825567 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:26:24.825567 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:26:24.826766 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:26:24.826766 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:26:24.826766 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:26:24.826766 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:26:24.826766 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:24.826766 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:24.826766 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:24.826766 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:24.826766 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:24.826766 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:24.826766 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:24.826766 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:24.826766 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:24.826766 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:24.826766 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:24.826766 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:24.827736 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:24.827736 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:24.827736 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:24.827736 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:24.827736 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:26:24.827736 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:26:24.827736 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:26:24.827736 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:26:24.827736 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:26:24.827736 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:26:24.827736 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:26:24.827736 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:24.830802 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 219/422] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:26:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:26:24.836719 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905a5cd-0253-42d6-9183-cfa8b4663235 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:24.881465 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:24.907334 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2a6055-68ed-47d0-8170-79a57f23ba43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:24.909183 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2a6055-68ed-47d0-8170-79a57f23ba43 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:25.084250 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905a5cd-0253-42d6-9183-cfa8b4663235 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:25.104993 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 204/423] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:26:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:26:25.110499 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:25.111872 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a6055-68ed-47d0-8170-79a57f23ba43 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:25.160991 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10124867-6ec5-47cf-8137-8a18c4446f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:25.161626 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10124867-6ec5-47cf-8137-8a18c4446f2f None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:25.161871 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10124867-6ec5-47cf-8137-8a18c4446f2f None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:25.162175 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10124867-6ec5-47cf-8137-8a18c4446f2f None admin] PATH_INFO: `/v3/roles` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:25.162958 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10124867-6ec5-47cf-8137-8a18c4446f2f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:25.163272 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10124867-6ec5-47cf-8137-8a18c4446f2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:25.165078 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10124867-6ec5-47cf-8137-8a18c4446f2f None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:25.184555 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 220/424] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:26:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:25.189813 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10124867-6ec5-47cf-8137-8a18c4446f2f None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:25.200207 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:25.222559 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a6055-68ed-47d0-8170-79a57f23ba43 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:25.279960 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b92b0d3-03d8-4518-a6cb-e00229dfa9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:25.280844 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92b0d3-03d8-4518-a6cb-e00229dfa9c1 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:25.281136 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92b0d3-03d8-4518-a6cb-e00229dfa9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:25.281415 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92b0d3-03d8-4518-a6cb-e00229dfa9c1 None admin] PATH_INFO: `/v3/projects/f79334203c0a4279909fbe5e93cc441c` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:25.282698 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b92b0d3-03d8-4518-a6cb-e00229dfa9c1 None admin] RBAC: Authorizing `identity:get_project(project_id=f79334203c0a4279909fbe5e93cc441c)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:25.284157 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b92b0d3-03d8-4518-a6cb-e00229dfa9c1 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:25.285887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 205/425] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:26:25 2022] GET /identity/v3/projects/f79334203c0a4279909fbe5e93cc441c => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:26:25.295103 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b92b0d3-03d8-4518-a6cb-e00229dfa9c1 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:25.382520 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10124867-6ec5-47cf-8137-8a18c4446f2f None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:25.441498 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b92b0d3-03d8-4518-a6cb-e00229dfa9c1 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:25.459956 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408ef5b-8e9d-4dd3-b3ea-08062a9a0bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:25.460617 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408ef5b-8e9d-4dd3-b3ea-08062a9a0bf2 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:25.460909 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408ef5b-8e9d-4dd3-b3ea-08062a9a0bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:25.461738 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408ef5b-8e9d-4dd3-b3ea-08062a9a0bf2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:25.516406 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338b32b-84c5-47e7-a574-a34ea8f648d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:25.517286 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338b32b-84c5-47e7-a574-a34ea8f648d0 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:25.517574 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338b32b-84c5-47e7-a574-a34ea8f648d0 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:25.517856 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338b32b-84c5-47e7-a574-a34ea8f648d0 None admin] PATH_INFO: `/v3/groups/0c892847831c4d6487c3838fcac36aa5` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:25.519101 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338b32b-84c5-47e7-a574-a34ea8f648d0 None admin] RBAC: Authorizing `identity:get_group(group_id=0c892847831c4d6487c3838fcac36aa5)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:25.520576 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338b32b-84c5-47e7-a574-a34ea8f648d0 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:25.522527 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 206/426] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Jul 5 21:26:25 2022] GET /identity/v3/groups/0c892847831c4d6487c3838fcac36aa5 => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:25.528358 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338b32b-84c5-47e7-a574-a34ea8f648d0 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:25.530274 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:25.557176 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408ef5b-8e9d-4dd3-b3ea-08062a9a0bf2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:25.558551 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408ef5b-8e9d-4dd3-b3ea-08062a9a0bf2 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:25.559506 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:25.670769 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 221/427] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:26:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 21:26:25.676185 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408ef5b-8e9d-4dd3-b3ea-08062a9a0bf2 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:25.748029 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338b32b-84c5-47e7-a574-a34ea8f648d0 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:25.803906 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed965503-5447-4077-9abd-786575e3f7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:25.804581 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed965503-5447-4077-9abd-786575e3f7a0 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:25.804905 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed965503-5447-4077-9abd-786575e3f7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:25.805233 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed965503-5447-4077-9abd-786575e3f7a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:25.806090 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed965503-5447-4077-9abd-786575e3f7a0 None admin] RBAC: Adding query filter params (group.id=0c892847831c4d6487c3838fcac36aa5, role.id=a7a08ffb4e7f40f683e711c83a6186d0, scope.project.id=f79334203c0a4279909fbe5e93cc441c) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:25.806438 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed965503-5447-4077-9abd-786575e3f7a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:25.807917 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed965503-5447-4077-9abd-786575e3f7a0 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:25.825847 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 207/428] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Jul 5 21:26:25 2022] GET /identity/v3/role_assignments?group.id=0c892847831c4d6487c3838fcac36aa5&scope.project.id=f79334203c0a4279909fbe5e93cc441c&role.id=a7a08ffb4e7f40f683e711c83a6186d0 => generated 611 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:26:25.840234 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acb6b2-dc9f-437d-9bdb-b12873420ac1 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:25.840597 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acb6b2-dc9f-437d-9bdb-b12873420ac1 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:25.840811 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acb6b2-dc9f-437d-9bdb-b12873420ac1 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:25.842351 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 208/429] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:25.843507 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:25.847898 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1fda2c-aa8b-4d9d-97ff-6dc0a5cded22 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:25.848195 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1fda2c-aa8b-4d9d-97ff-6dc0a5cded22 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:25.848484 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1fda2c-aa8b-4d9d-97ff-6dc0a5cded22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:25.872142 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-ad1fda2c-aa8b-4d9d-97ff-6dc0a5cded22 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:25.874381 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-ad1fda2c-aa8b-4d9d-97ff-6dc0a5cded22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:25.884984 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408ef5b-8e9d-4dd3-b3ea-08062a9a0bf2 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:25.954751 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb971ba4-ad92-429e-8ff0-85c10f072960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:25.955903 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb971ba4-ad92-429e-8ff0-85c10f072960 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:25.956191 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb971ba4-ad92-429e-8ff0-85c10f072960 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:25.956474 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb971ba4-ad92-429e-8ff0-85c10f072960 None admin] PATH_INFO: `/v3/projects/f79334203c0a4279909fbe5e93cc441c` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:25.959019 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb971ba4-ad92-429e-8ff0-85c10f072960 None admin] RBAC: Authorizing `identity:get_project(project_id=f79334203c0a4279909fbe5e93cc441c)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:25.960523 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb971ba4-ad92-429e-8ff0-85c10f072960 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:25.962629 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 222/430] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:26:25 2022] GET /identity/v3/projects/f79334203c0a4279909fbe5e93cc441c => generated 298 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:25.969724 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb971ba4-ad92-429e-8ff0-85c10f072960 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:25.985563 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 209/431] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:26:26.017918 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1fda2c-aa8b-4d9d-97ff-6dc0a5cded22 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:26.041304 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:26.099784 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb971ba4-ad92-429e-8ff0-85c10f072960 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:26.138661 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c6767c-2984-414f-af55-99e4ca90771f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:26.139900 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6767c-2984-414f-af55-99e4ca90771f None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:26.140421 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6767c-2984-414f-af55-99e4ca90771f None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:26.140964 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6767c-2984-414f-af55-99e4ca90771f None admin] PATH_INFO: `/v3/groups/0c892847831c4d6487c3838fcac36aa5` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:26.142455 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c6767c-2984-414f-af55-99e4ca90771f None admin] RBAC: Authorizing `identity:get_group(group_id=0c892847831c4d6487c3838fcac36aa5)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:26.144185 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c6767c-2984-414f-af55-99e4ca90771f None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:26.146408 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 223/432] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Jul 5 21:26:25 2022] GET /identity/v3/groups/0c892847831c4d6487c3838fcac36aa5 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:26.152609 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c6767c-2984-414f-af55-99e4ca90771f None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:26.168365 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:26.179108 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1fda2c-aa8b-4d9d-97ff-6dc0a5cded22 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:26.220837 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a501f21-9283-454d-9cd0-e72060b7a693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:26.221999 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a501f21-9283-454d-9cd0-e72060b7a693 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:26.222477 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a501f21-9283-454d-9cd0-e72060b7a693 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:26.223024 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a501f21-9283-454d-9cd0-e72060b7a693 None admin] PATH_INFO: `/v3/roles/member` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:26.234814 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a501f21-9283-454d-9cd0-e72060b7a693 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:26:26.246609 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-3a501f21-9283-454d-9cd0-e72060b7a693 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:26:26.246609 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:26.246609 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:26.246609 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:26.246609 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:26.246609 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:26.246609 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:26.246609 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:26.246609 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:26.246609 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:26.246609 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:26.246609 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:26.246609 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:26:26.246609 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:26:26.246609 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:26:26.246609 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:26:26.247698 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:26:26.247698 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:26:26.247698 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:26:26.247698 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:26:26.247698 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:26.247698 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:26.247698 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:26.247698 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:26.247698 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:26.247698 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:26.247698 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:26.247698 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:26.247698 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:26.247698 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:26.247698 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:26.247698 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:26.248664 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:26.248664 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:26.248664 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:26.248664 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:26.248664 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:26:26.248664 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:26:26.248664 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:26:26.248664 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:26:26.248664 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:26:26.248664 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:26:26.248664 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:26:26.248664 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:26.251854 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 210/433] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:26:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:26:26.261138 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a501f21-9283-454d-9cd0-e72060b7a693 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:26.282992 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c6767c-2984-414f-af55-99e4ca90771f None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:26.325000 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1b52a-3041-43ed-8e9d-e84d42ea62e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:26.325667 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1b52a-3041-43ed-8e9d-e84d42ea62e1 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:26.325952 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1b52a-3041-43ed-8e9d-e84d42ea62e1 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:26.326272 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1b52a-3041-43ed-8e9d-e84d42ea62e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:26.327162 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e1b52a-3041-43ed-8e9d-e84d42ea62e1 None admin] RBAC: Adding query filter params (group.id=0c892847831c4d6487c3838fcac36aa5, role.id=6413bac7cc9a42cf83968dd26a3ccc34, scope.project.id=f79334203c0a4279909fbe5e93cc441c) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:26.327786 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e1b52a-3041-43ed-8e9d-e84d42ea62e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:26.328935 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e1b52a-3041-43ed-8e9d-e84d42ea62e1 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:26.339234 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 224/434] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Jul 5 21:26:26 2022] GET /identity/v3/role_assignments?group.id=0c892847831c4d6487c3838fcac36aa5&scope.project.id=f79334203c0a4279909fbe5e93cc441c&role.id=6413bac7cc9a42cf83968dd26a3ccc34 => generated 611 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:26.341259 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f370eb7-042d-4b7f-9087-937d14b71770 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:26.341777 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f370eb7-042d-4b7f-9087-937d14b71770 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:26.342622 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f370eb7-042d-4b7f-9087-937d14b71770 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:26.345401 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 225/435] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:26.350647 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4c31c-1d25-4674-8885-3e73688d5ccf None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:26.351537 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4c31c-1d25-4674-8885-3e73688d5ccf None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:26.352343 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4c31c-1d25-4674-8885-3e73688d5ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:26.353478 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:26.378955 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-a0e4c31c-1d25-4674-8885-3e73688d5ccf None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:26.380796 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-a0e4c31c-1d25-4674-8885-3e73688d5ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:26.399572 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a501f21-9283-454d-9cd0-e72060b7a693 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:26.440333 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c13ef5-5727-4153-b1ce-d702f9c79e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:26.441061 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c13ef5-5727-4153-b1ce-d702f9c79e7c None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:26.441349 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c13ef5-5727-4153-b1ce-d702f9c79e7c None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:26.441632 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c13ef5-5727-4153-b1ce-d702f9c79e7c None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:26.442437 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c13ef5-5727-4153-b1ce-d702f9c79e7c None admin] RBAC: Adding query filter params (name=member) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:26.442749 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c13ef5-5727-4153-b1ce-d702f9c79e7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:26.444837 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c13ef5-5727-4153-b1ce-d702f9c79e7c None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:26.468836 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 211/436] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:26:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:26.470443 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c13ef5-5727-4153-b1ce-d702f9c79e7c None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:26.480402 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 226/437] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:26:26.481713 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e56e6-4d67-4350-b119-b42f092cb6f3 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:26.482008 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e56e6-4d67-4350-b119-b42f092cb6f3 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:26.486577 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e56e6-4d67-4350-b119-b42f092cb6f3 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:26.488283 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 227/438] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:26.499744 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe8a2f-480d-4b53-9df9-a94f4d5c6aff None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:26.500032 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe8a2f-480d-4b53-9df9-a94f4d5c6aff None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:26.500311 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe8a2f-480d-4b53-9df9-a94f4d5c6aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:26.516304 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:26.529696 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-17fe8a2f-480d-4b53-9df9-a94f4d5c6aff None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:26.530980 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-17fe8a2f-480d-4b53-9df9-a94f4d5c6aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:26.612320 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c13ef5-5727-4153-b1ce-d702f9c79e7c None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:26.624108 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 228/439] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:26:26.625111 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe8a2f-480d-4b53-9df9-a94f4d5c6aff None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:26.645053 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:26.652296 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5930cd-9760-4e2c-a299-1250ae656fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:26.652777 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5930cd-9760-4e2c-a299-1250ae656fec None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:26.653071 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5930cd-9760-4e2c-a299-1250ae656fec None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:26.653351 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5930cd-9760-4e2c-a299-1250ae656fec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:26.736027 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5930cd-9760-4e2c-a299-1250ae656fec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:26.737898 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5930cd-9760-4e2c-a299-1250ae656fec None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:26.741318 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe8a2f-480d-4b53-9df9-a94f4d5c6aff None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:26.780478 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64a533-1c55-4ee5-81e4-4baf8edb9afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:26.781294 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64a533-1c55-4ee5-81e4-4baf8edb9afa None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:26.781577 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64a533-1c55-4ee5-81e4-4baf8edb9afa None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:26.781854 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64a533-1c55-4ee5-81e4-4baf8edb9afa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:26.785796 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:26.795182 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b64a533-1c55-4ee5-81e4-4baf8edb9afa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:26:26.803626 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-6b64a533-1c55-4ee5-81e4-4baf8edb9afa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:26:26.803626 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:26.803626 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:26.803626 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:26.803626 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:26.803626 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:26.803626 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:26.803626 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:26.803626 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:26.803626 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:26.803626 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:26.803626 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:26.803626 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:26:26.803626 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:26:26.803626 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:26:26.803626 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:26:26.804889 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:26:26.804889 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:26:26.804889 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:26:26.804889 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:26:26.804889 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:26.804889 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:26.804889 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:26.804889 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:26.804889 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:26.804889 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:26.804889 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:26.804889 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:26.804889 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:26.804889 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:26.804889 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:26.804889 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:26.805952 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:26.805952 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:26.805952 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:26.805952 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:26.805952 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:26:26.805952 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:26:26.805952 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:26:26.805952 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:26:26.805952 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:26:26.805952 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:26:26.805952 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:26:26.805952 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:26.806773 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 229/440] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:26:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:26.807003 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64a533-1c55-4ee5-81e4-4baf8edb9afa None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:26.863327 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 212/441] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:26:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 21:26:26.864193 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5930cd-9760-4e2c-a299-1250ae656fec None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:26.893787 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:26.913303 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64a533-1c55-4ee5-81e4-4baf8edb9afa None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:26.947610 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29bb6a3-b374-4733-a3d6-a33f79a92611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:26.948393 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bb6a3-b374-4733-a3d6-a33f79a92611 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:26.948680 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bb6a3-b374-4733-a3d6-a33f79a92611 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:26.948963 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bb6a3-b374-4733-a3d6-a33f79a92611 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:26.959536 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29bb6a3-b374-4733-a3d6-a33f79a92611 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:26:26.962494 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5930cd-9760-4e2c-a299-1250ae656fec None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:26.967781 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-e29bb6a3-b374-4733-a3d6-a33f79a92611 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:26:26.967781 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:26.967781 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:26.967781 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:26.967781 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:26.967781 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:26.967781 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:26.967781 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:26.967781 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:26.967781 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:26.967781 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:26.967781 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:26.967781 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:26:26.967781 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:26:26.967781 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:26:26.967781 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:26:26.968778 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:26:26.968778 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:26:26.968778 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:26:26.968778 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:26:26.968778 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:26.968778 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:26.968778 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:26.968778 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:26.968778 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:26.968778 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:26.968778 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:26.968778 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:26.968778 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:26.968778 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:26.968778 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:26.968778 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:26.969711 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:26.969711 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:26.969711 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:26.969711 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:26.969711 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:26:26.969711 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:26:26.969711 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:26:26.969711 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:26:26.969711 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:26:26.969711 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:26:26.969711 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:26:26.969711 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:26.969711 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 230/442] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:26:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:26.969711 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29bb6a3-b374-4733-a3d6-a33f79a92611 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:27.001975 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1efcf3-6123-46ec-8229-b9fe53f3f672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:27.002601 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1efcf3-6123-46ec-8229-b9fe53f3f672 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:27.002892 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1efcf3-6123-46ec-8229-b9fe53f3f672 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:27.003171 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1efcf3-6123-46ec-8229-b9fe53f3f672 None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:27.003919 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1efcf3-6123-46ec-8229-b9fe53f3f672 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:27.004231 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1efcf3-6123-46ec-8229-b9fe53f3f672 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:27.005635 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1efcf3-6123-46ec-8229-b9fe53f3f672 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:27.014117 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 213/443] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:26:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:27.014951 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1efcf3-6123-46ec-8229-b9fe53f3f672 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:27.032234 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:27.075685 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29bb6a3-b374-4733-a3d6-a33f79a92611 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:27.108071 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:27.110984 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83628f2-0d6d-4f3d-9c9b-4acd992e5277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:27.111847 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83628f2-0d6d-4f3d-9c9b-4acd992e5277 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:27.112131 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83628f2-0d6d-4f3d-9c9b-4acd992e5277 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:27.112408 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83628f2-0d6d-4f3d-9c9b-4acd992e5277 None admin] PATH_INFO: `/v3/projects/b74267c87cf54aeeb11de99a05473428` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:27.113652 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83628f2-0d6d-4f3d-9c9b-4acd992e5277 None admin] RBAC: Authorizing `identity:get_project(project_id=b74267c87cf54aeeb11de99a05473428)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:27.115159 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83628f2-0d6d-4f3d-9c9b-4acd992e5277 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:27.116745 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1efcf3-6123-46ec-8229-b9fe53f3f672 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:27.117138 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 231/444] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:26:26 2022] GET /identity/v3/projects/b74267c87cf54aeeb11de99a05473428 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:27.117954 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83628f2-0d6d-4f3d-9c9b-4acd992e5277 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:27.155961 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456033d9-833c-4b36-a381-930198116f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:27.156628 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456033d9-833c-4b36-a381-930198116f57 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:27.156917 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456033d9-833c-4b36-a381-930198116f57 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:27.157199 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456033d9-833c-4b36-a381-930198116f57 None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:27.157946 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456033d9-833c-4b36-a381-930198116f57 None admin] RBAC: Adding query filter params (name=admin) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:27.158396 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456033d9-833c-4b36-a381-930198116f57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:27.159777 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456033d9-833c-4b36-a381-930198116f57 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:27.168731 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 214/445] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:26:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:27.169800 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456033d9-833c-4b36-a381-930198116f57 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:27.226029 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83628f2-0d6d-4f3d-9c9b-4acd992e5277 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:27.248405 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:27.259206 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d614049-cfb4-4b7b-961e-305564236b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:27.259836 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d614049-cfb4-4b7b-961e-305564236b56 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:27.260116 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d614049-cfb4-4b7b-961e-305564236b56 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:27.260393 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d614049-cfb4-4b7b-961e-305564236b56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:27.270487 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456033d9-833c-4b36-a381-930198116f57 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:27.304490 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d61ad0-6187-4688-be6a-1558c16b9eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:27.305650 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d61ad0-6187-4688-be6a-1558c16b9eca None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:27.305948 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d61ad0-6187-4688-be6a-1558c16b9eca None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:27.306266 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d61ad0-6187-4688-be6a-1558c16b9eca None admin] PATH_INFO: `/v3/groups/0c892847831c4d6487c3838fcac36aa5` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:27.307458 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d61ad0-6187-4688-be6a-1558c16b9eca None admin] RBAC: Authorizing `identity:get_group(group_id=0c892847831c4d6487c3838fcac36aa5)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:27.308942 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d61ad0-6187-4688-be6a-1558c16b9eca None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:27.310670 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 215/446] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Jul 5 21:26:27 2022] GET /identity/v3/groups/0c892847831c4d6487c3838fcac36aa5 => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:27.311442 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d61ad0-6187-4688-be6a-1558c16b9eca None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:27.334888 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d614049-cfb4-4b7b-961e-305564236b56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:27.335789 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:27.336944 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d614049-cfb4-4b7b-961e-305564236b56 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:27.412318 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d61ad0-6187-4688-be6a-1558c16b9eca None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:27.435331 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 232/447] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:26:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:26:27.436172 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d614049-cfb4-4b7b-961e-305564236b56 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:27.446999 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c9bd79-9c71-4de8-850f-d77e4e30737c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:27.447654 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9bd79-9c71-4de8-850f-d77e4e30737c None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:27.447947 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9bd79-9c71-4de8-850f-d77e4e30737c None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:27.448230 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9bd79-9c71-4de8-850f-d77e4e30737c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:27.460924 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:27.516442 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c9bd79-9c71-4de8-850f-d77e4e30737c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:27.517834 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c9bd79-9c71-4de8-850f-d77e4e30737c None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:27.535256 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d614049-cfb4-4b7b-961e-305564236b56 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:27.540883 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:27.571795 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe6527-c26c-4de8-a2f5-9191dc5e3d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:27.572641 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe6527-c26c-4de8-a2f5-9191dc5e3d7d None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:27.572927 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe6527-c26c-4de8-a2f5-9191dc5e3d7d None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:27.573207 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe6527-c26c-4de8-a2f5-9191dc5e3d7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:27.574038 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fe6527-c26c-4de8-a2f5-9191dc5e3d7d None admin] RBAC: Adding query filter params (group.id=0c892847831c4d6487c3838fcac36aa5, role.id=a7a08ffb4e7f40f683e711c83a6186d0, scope.project.id=b74267c87cf54aeeb11de99a05473428) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:27.574432 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fe6527-c26c-4de8-a2f5-9191dc5e3d7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:27.576107 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fe6527-c26c-4de8-a2f5-9191dc5e3d7d None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:27.581876 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 233/448] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Jul 5 21:26:27 2022] GET /identity/v3/role_assignments?group.id=0c892847831c4d6487c3838fcac36aa5&scope.project.id=b74267c87cf54aeeb11de99a05473428&role.id=a7a08ffb4e7f40f683e711c83a6186d0 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:27.582681 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe6527-c26c-4de8-a2f5-9191dc5e3d7d None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:27.653842 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 216/449] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:26:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:26:27.655202 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c9bd79-9c71-4de8-850f-d77e4e30737c None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:27.688649 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:27.702279 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe6527-c26c-4de8-a2f5-9191dc5e3d7d None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:27.742166 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40146c1-5ce9-4de4-b536-40fd0951d551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:27.743763 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40146c1-5ce9-4de4-b536-40fd0951d551 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:27.744045 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40146c1-5ce9-4de4-b536-40fd0951d551 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:27.744319 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40146c1-5ce9-4de4-b536-40fd0951d551 None admin] PATH_INFO: `/v3/projects/b74267c87cf54aeeb11de99a05473428` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:27.746231 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40146c1-5ce9-4de4-b536-40fd0951d551 None admin] RBAC: Authorizing `identity:get_project(project_id=b74267c87cf54aeeb11de99a05473428)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:27.747020 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40146c1-5ce9-4de4-b536-40fd0951d551 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:27.748726 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 234/450] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:26:27 2022] GET /identity/v3/projects/b74267c87cf54aeeb11de99a05473428 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:27.754428 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40146c1-5ce9-4de4-b536-40fd0951d551 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:27.776079 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c9bd79-9c71-4de8-850f-d77e4e30737c None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:27.801781 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:27.814421 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed251e93-aa08-492c-a6e3-c5c7dd1fff2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:27.823858 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed251e93-aa08-492c-a6e3-c5c7dd1fff2c None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:27.823858 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed251e93-aa08-492c-a6e3-c5c7dd1fff2c None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:27.823858 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed251e93-aa08-492c-a6e3-c5c7dd1fff2c None admin] PATH_INFO: `/v3/projects/9675d05c7a01416aae7c5c400d679f19` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:27.823858 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed251e93-aa08-492c-a6e3-c5c7dd1fff2c None admin] RBAC: Authorizing `identity:get_project(project_id=9675d05c7a01416aae7c5c400d679f19)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:27.823858 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed251e93-aa08-492c-a6e3-c5c7dd1fff2c None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:27.823858 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 217/451] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:26:27 2022] GET /identity/v3/projects/9675d05c7a01416aae7c5c400d679f19 => generated 344 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:27.826101 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed251e93-aa08-492c-a6e3-c5c7dd1fff2c None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:27.872969 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40146c1-5ce9-4de4-b536-40fd0951d551 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:27.916955 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be1fb09-ec82-4837-af33-4b1ca478ec51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:27.917829 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1fb09-ec82-4837-af33-4b1ca478ec51 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:27.918120 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1fb09-ec82-4837-af33-4b1ca478ec51 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:27.918426 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1fb09-ec82-4837-af33-4b1ca478ec51 None admin] PATH_INFO: `/v3/groups/0c892847831c4d6487c3838fcac36aa5` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:27.919641 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be1fb09-ec82-4837-af33-4b1ca478ec51 None admin] RBAC: Authorizing `identity:get_group(group_id=0c892847831c4d6487c3838fcac36aa5)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:27.921104 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be1fb09-ec82-4837-af33-4b1ca478ec51 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:27.922790 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 235/452] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Jul 5 21:26:27 2022] GET /identity/v3/groups/0c892847831c4d6487c3838fcac36aa5 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:26:27.928812 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be1fb09-ec82-4837-af33-4b1ca478ec51 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:27.952787 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed251e93-aa08-492c-a6e3-c5c7dd1fff2c None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:27.962047 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:27.991108 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41cc02-a7dc-4baa-84e8-b9cec3ba208d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:27.992052 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41cc02-a7dc-4baa-84e8-b9cec3ba208d None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:27.992449 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41cc02-a7dc-4baa-84e8-b9cec3ba208d None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:27.992804 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41cc02-a7dc-4baa-84e8-b9cec3ba208d None admin] PATH_INFO: `/v3/groups/4549837e332a4e07a0635c12b4556b7f` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:27.994071 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e41cc02-a7dc-4baa-84e8-b9cec3ba208d None admin] RBAC: Authorizing `identity:get_group(group_id=4549837e332a4e07a0635c12b4556b7f)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:27.995552 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e41cc02-a7dc-4baa-84e8-b9cec3ba208d None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:27.997167 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 218/453] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Jul 5 21:26:27 2022] GET /identity/v3/groups/4549837e332a4e07a0635c12b4556b7f => generated 229 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:26:28.002989 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41cc02-a7dc-4baa-84e8-b9cec3ba208d None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:28.038490 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be1fb09-ec82-4837-af33-4b1ca478ec51 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:28.060218 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:28.073263 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ce16d4-b366-447a-8afe-eee9bd793b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:28.073916 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce16d4-b366-447a-8afe-eee9bd793b92 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:28.074244 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce16d4-b366-447a-8afe-eee9bd793b92 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:28.074530 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce16d4-b366-447a-8afe-eee9bd793b92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:28.075372 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ce16d4-b366-447a-8afe-eee9bd793b92 None admin] RBAC: Adding query filter params (group.id=0c892847831c4d6487c3838fcac36aa5, role.id=6413bac7cc9a42cf83968dd26a3ccc34, scope.project.id=b74267c87cf54aeeb11de99a05473428) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:28.075689 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ce16d4-b366-447a-8afe-eee9bd793b92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:28.077156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ce16d4-b366-447a-8afe-eee9bd793b92 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:28.083437 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 236/454] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Jul 5 21:26:27 2022] GET /identity/v3/role_assignments?group.id=0c892847831c4d6487c3838fcac36aa5&scope.project.id=b74267c87cf54aeeb11de99a05473428&role.id=6413bac7cc9a42cf83968dd26a3ccc34 => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:26:28.104854 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41cc02-a7dc-4baa-84e8-b9cec3ba208d None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:28.140893 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec9f1a9-a5b9-4952-a34d-1c93c37f5c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:28.141572 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9f1a9-a5b9-4952-a34d-1c93c37f5c47 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:28.141857 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9f1a9-a5b9-4952-a34d-1c93c37f5c47 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:28.142166 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9f1a9-a5b9-4952-a34d-1c93c37f5c47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:28.143026 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec9f1a9-a5b9-4952-a34d-1c93c37f5c47 None admin] RBAC: Adding query filter params (group.id=4549837e332a4e07a0635c12b4556b7f, role.id=00090b1962654604b8e106a05d44d06a, scope.project.id=9675d05c7a01416aae7c5c400d679f19) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:28.143344 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec9f1a9-a5b9-4952-a34d-1c93c37f5c47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:28.144842 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec9f1a9-a5b9-4952-a34d-1c93c37f5c47 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:28.152377 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 219/455] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Jul 5 21:26:28 2022] GET /identity/v3/role_assignments?group.id=4549837e332a4e07a0635c12b4556b7f&scope.project.id=9675d05c7a01416aae7c5c400d679f19&role.id=00090b1962654604b8e106a05d44d06a => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:26:30.702456 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a84eb8-e8e9-4c47-b3d1-eef9fbfdbf96 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:30.703010 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a84eb8-e8e9-4c47-b3d1-eef9fbfdbf96 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:30.703010 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a84eb8-e8e9-4c47-b3d1-eef9fbfdbf96 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:30.704695 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 237/456] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:30.709961 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea8da5-13b0-4fe4-944b-5d7e5908df11 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:30.710402 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea8da5-13b0-4fe4-944b-5d7e5908df11 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:30.710579 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea8da5-13b0-4fe4-944b-5d7e5908df11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:30.734923 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-b6ea8da5-13b0-4fe4-944b-5d7e5908df11 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:30.736158 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-b6ea8da5-13b0-4fe4-944b-5d7e5908df11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:30.837704 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 220/457] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:26:30.875659 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a84eb8-e8e9-4c47-b3d1-eef9fbfdbf96 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:31.006165 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:31.014162 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb055ce9-f3bb-469c-92fe-1d0a42f1b420 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:31.014162 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb055ce9-f3bb-469c-92fe-1d0a42f1b420 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:31.014162 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb055ce9-f3bb-469c-92fe-1d0a42f1b420 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:31.014506 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 221/458] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:26:31.019844 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc833a-1940-48f5-900d-59380eab15ff None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:31.020389 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc833a-1940-48f5-900d-59380eab15ff None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:31.020886 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc833a-1940-48f5-900d-59380eab15ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:31.029109 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a84eb8-e8e9-4c47-b3d1-eef9fbfdbf96 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:31.047745 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-88dc833a-1940-48f5-900d-59380eab15ff None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:31.048958 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-88dc833a-1940-48f5-900d-59380eab15ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:31.099067 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac2065-d0a7-4ccc-a1c1-008cdb5a107a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:31.099801 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac2065-d0a7-4ccc-a1c1-008cdb5a107a None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:31.101263 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac2065-d0a7-4ccc-a1c1-008cdb5a107a None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:31.101549 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac2065-d0a7-4ccc-a1c1-008cdb5a107a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:31.124589 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aac2065-d0a7-4ccc-a1c1-008cdb5a107a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:31.125178 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:31.126082 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aac2065-d0a7-4ccc-a1c1-008cdb5a107a None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:31.157989 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-9aac2065-d0a7-4ccc-a1c1-008cdb5a107a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:31.157989 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:31.157989 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:31.157989 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:31.157989 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:31.157989 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:31.157989 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:31.157989 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:31.157989 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:31.157989 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:31.157989 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:31.157989 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:31.157989 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:26:31.157989 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:26:31.157989 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:26:31.159160 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:26:31.159160 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:31.159160 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:31.159160 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:31.159160 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:31.159160 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:31.159160 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:31.159160 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:31.159160 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:31.159160 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:31.159160 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:31.159160 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:31.159160 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:31.159160 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:31.159160 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:31.159160 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:31.159160 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:31.160162 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:26:31.160162 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:26:31.160162 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:31.160162 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:31.160422 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 238/459] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:26:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:31.172445 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 222/460] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:26:31.172817 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac2065-d0a7-4ccc-a1c1-008cdb5a107a None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:31.209739 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc833a-1940-48f5-900d-59380eab15ff None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:31.354684 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac2065-d0a7-4ccc-a1c1-008cdb5a107a None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:31.376558 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc833a-1940-48f5-900d-59380eab15ff None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:31.393723 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e2b1a-9496-48b9-91ac-8ca7b827c09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:31.394419 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e2b1a-9496-48b9-91ac-8ca7b827c09b None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:31.394704 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e2b1a-9496-48b9-91ac-8ca7b827c09b None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:31.395009 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e2b1a-9496-48b9-91ac-8ca7b827c09b None admin] PATH_INFO: `/v3/domains` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:31.396208 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9e2b1a-9496-48b9-91ac-8ca7b827c09b None admin] RBAC: Adding query filter params (name=Default) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:31.396539 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9e2b1a-9496-48b9-91ac-8ca7b827c09b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:31.398462 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9e2b1a-9496-48b9-91ac-8ca7b827c09b None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:31.410097 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:31.414611 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 239/461] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:31.419284 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ed63e-a559-4478-a898-f00cf2263523 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:31.419951 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ed63e-a559-4478-a898-f00cf2263523 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:31.420235 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ed63e-a559-4478-a898-f00cf2263523 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:31.424091 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 240/462] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:31.424091 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ed63e-a559-4478-a898-f00cf2263523 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:31.431784 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dae3f8-194e-4f42-8e61-a071f9ba7629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:31.432595 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dae3f8-194e-4f42-8e61-a071f9ba7629 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:31.432888 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dae3f8-194e-4f42-8e61-a071f9ba7629 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:31.433187 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dae3f8-194e-4f42-8e61-a071f9ba7629 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:31.445180 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dae3f8-194e-4f42-8e61-a071f9ba7629 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:31.447661 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dae3f8-194e-4f42-8e61-a071f9ba7629 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:31.468421 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-32dae3f8-194e-4f42-8e61-a071f9ba7629 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:31.468421 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:31.468421 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:31.468421 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:31.468421 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:31.468421 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:31.468421 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:31.468421 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:31.468421 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:31.468421 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:31.468421 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:31.468421 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:31.468421 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:26:31.468421 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:26:31.468421 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:26:31.469743 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:26:31.469743 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:31.469743 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:31.469743 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:31.469743 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:31.469743 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:31.469743 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:31.469743 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:31.469743 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:31.469743 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:31.469743 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:31.469743 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:31.469743 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:31.469743 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:31.469743 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:31.469743 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:31.469743 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:31.471063 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:26:31.471063 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:26:31.471063 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:31.471063 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:31.471063 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 223/463] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:26:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:26:31.471409 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4b9f6-f420-4fd0-bf0a-9821d9b9d4a5 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:31.471495 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4b9f6-f420-4fd0-bf0a-9821d9b9d4a5 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:31.471780 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4b9f6-f420-4fd0-bf0a-9821d9b9d4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:31.489330 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-b7e4b9f6-f420-4fd0-bf0a-9821d9b9d4a5 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:31.490562 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-b7e4b9f6-f420-4fd0-bf0a-9821d9b9d4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:31.518241 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:31.548805 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ed63e-a559-4478-a898-f00cf2263523 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:31.565310 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 224/464] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:26:31.566909 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14224efc-7254-4674-8068-43c28ec95f0c None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:31.567274 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14224efc-7254-4674-8068-43c28ec95f0c None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:31.567632 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14224efc-7254-4674-8068-43c28ec95f0c None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:31.573608 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 225/465] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:31.573608 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14224efc-7254-4674-8068-43c28ec95f0c None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:31.601435 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4fac2f-67c1-4910-b59c-626297a592ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:31.603982 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4fac2f-67c1-4910-b59c-626297a592ce None admin] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:31.603982 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4fac2f-67c1-4910-b59c-626297a592ce None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:31.603982 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4fac2f-67c1-4910-b59c-626297a592ce None admin] PATH_INFO: `/v3/users` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:31.603982 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4fac2f-67c1-4910-b59c-626297a592ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:31.605493 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4fac2f-67c1-4910-b59c-626297a592ce None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:31.678511 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14224efc-7254-4674-8068-43c28ec95f0c None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:31.707438 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 241/466] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:26:31 2022] POST /identity/v3/users => generated 246 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:26:31.709713 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db88ce-a810-4eb2-8f55-2e20849eb379 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:31.710250 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db88ce-a810-4eb2-8f55-2e20849eb379 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:31.712359 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db88ce-a810-4eb2-8f55-2e20849eb379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:31.728354 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b813bbb-febc-449f-8997-1d928518c7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:31.729158 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b813bbb-febc-449f-8997-1d928518c7f6 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:31.729453 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b813bbb-febc-449f-8997-1d928518c7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:31.729738 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b813bbb-febc-449f-8997-1d928518c7f6 None admin] PATH_INFO: `/v3/domains` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:31.730599 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b813bbb-febc-449f-8997-1d928518c7f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:31.730928 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b813bbb-febc-449f-8997-1d928518c7f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:31.732520 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b813bbb-febc-449f-8997-1d928518c7f6 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:31.738042 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-a8db88ce-a810-4eb2-8f55-2e20849eb379 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:31.739799 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-a8db88ce-a810-4eb2-8f55-2e20849eb379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:31.752300 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 226/467] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:31.752300 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b813bbb-febc-449f-8997-1d928518c7f6 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:31.780631 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:31.820761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:31.851714 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 242/468] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:26:31.851714 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db88ce-a810-4eb2-8f55-2e20849eb379 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:31.892312 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b813bbb-febc-449f-8997-1d928518c7f6 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:31.950465 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f52f18-987b-4b2c-b924-830a01c4f0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:31.951297 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f52f18-987b-4b2c-b924-830a01c4f0fd None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:31.951591 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f52f18-987b-4b2c-b924-830a01c4f0fd None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:31.951877 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f52f18-987b-4b2c-b924-830a01c4f0fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:31.967386 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f52f18-987b-4b2c-b924-830a01c4f0fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:31.968887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f52f18-987b-4b2c-b924-830a01c4f0fd None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:31.987109 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-d5f52f18-987b-4b2c-b924-830a01c4f0fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:31.987109 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:31.987109 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:31.987109 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:31.987109 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:31.987109 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:31.987109 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:31.987109 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:31.987109 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:31.987109 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:31.987109 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:31.987109 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:31.987109 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:26:31.987109 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:26:31.987109 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:26:31.988333 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:26:31.988333 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:31.988333 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:31.988333 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:31.988333 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:31.988333 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:31.988333 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:31.988333 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:31.988333 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:31.988333 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:31.988333 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:31.988333 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:31.988333 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:31.988333 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:31.988333 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:31.988333 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:31.988333 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:31.989604 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:26:31.989604 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:26:31.989604 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:31.989604 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:31.989604 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 227/469] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:26:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:31.989604 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f52f18-987b-4b2c-b924-830a01c4f0fd None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:31.993910 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db88ce-a810-4eb2-8f55-2e20849eb379 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:32.033166 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44eff3-f79c-4d61-9628-4da5de8c64b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:32.034198 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44eff3-f79c-4d61-9628-4da5de8c64b8 None admin] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:32.034681 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44eff3-f79c-4d61-9628-4da5de8c64b8 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:32.035117 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44eff3-f79c-4d61-9628-4da5de8c64b8 None admin] PATH_INFO: `/v3/users` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:32.035995 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e44eff3-f79c-4d61-9628-4da5de8c64b8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:32.037461 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e44eff3-f79c-4d61-9628-4da5de8c64b8 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:32.077221 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:32.100309 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f52f18-987b-4b2c-b924-830a01c4f0fd None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:32.116444 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 243/470] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:26:31 2022] POST /identity/v3/users => generated 248 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:26:32.117600 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44eff3-f79c-4d61-9628-4da5de8c64b8 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:32.154684 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fff213-2fcd-42de-8d53-303d94339e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:32.156099 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fff213-2fcd-42de-8d53-303d94339e1b None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:32.157094 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fff213-2fcd-42de-8d53-303d94339e1b None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:32.157556 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fff213-2fcd-42de-8d53-303d94339e1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:32.175735 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fff213-2fcd-42de-8d53-303d94339e1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:32.178514 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:32.179440 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fff213-2fcd-42de-8d53-303d94339e1b None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:32.203544 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-a3fff213-2fcd-42de-8d53-303d94339e1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:32.203544 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:32.203544 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:32.203544 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:32.203544 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:32.203544 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:32.203544 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:32.203544 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:32.203544 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:32.203544 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:32.203544 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:32.203544 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:32.203544 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:26:32.203544 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:26:32.203544 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:26:32.204875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:26:32.204875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:32.204875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:32.204875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:32.204875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:32.204875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:32.204875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:32.204875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:32.204875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:32.204875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:32.204875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:32.204875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:32.204875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:32.204875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:32.204875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:32.204875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:32.204875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:32.206345 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:26:32.206345 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:26:32.206345 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:32.206345 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:32.208420 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 228/471] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:26:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:32.209954 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949bfee1-9661-458d-bcff-3a7ac542ae40 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:32.210705 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949bfee1-9661-458d-bcff-3a7ac542ae40 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:32.211780 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949bfee1-9661-458d-bcff-3a7ac542ae40 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:32.219587 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 229/472] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:32.219587 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949bfee1-9661-458d-bcff-3a7ac542ae40 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:32.259153 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44eff3-f79c-4d61-9628-4da5de8c64b8 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:32.301866 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c481aa4-29db-4c9e-a884-c5b57c9e3046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:32.302634 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c481aa4-29db-4c9e-a884-c5b57c9e3046 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:32.302945 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c481aa4-29db-4c9e-a884-c5b57c9e3046 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:32.303257 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c481aa4-29db-4c9e-a884-c5b57c9e3046 None admin] PATH_INFO: `/v3/domains` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:32.303991 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c481aa4-29db-4c9e-a884-c5b57c9e3046 None admin] RBAC: Adding query filter params (name=Default) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:32.304301 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c481aa4-29db-4c9e-a884-c5b57c9e3046 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:32.305845 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c481aa4-29db-4c9e-a884-c5b57c9e3046 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:32.320539 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 244/473] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:26:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:32.321736 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f912d27-2ca8-43b4-9d47-fe7363719386 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:32.322182 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f912d27-2ca8-43b4-9d47-fe7363719386 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:32.322401 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f912d27-2ca8-43b4-9d47-fe7363719386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:32.341321 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-8f912d27-2ca8-43b4-9d47-fe7363719386 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:32.342566 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-8f912d27-2ca8-43b4-9d47-fe7363719386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:32.351043 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949bfee1-9661-458d-bcff-3a7ac542ae40 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:32.384477 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:32.394365 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8dde0e-1e13-4eae-b7f0-dc6e57e332ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:32.396473 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8dde0e-1e13-4eae-b7f0-dc6e57e332ff None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:32.396473 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8dde0e-1e13-4eae-b7f0-dc6e57e332ff None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:32.396473 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8dde0e-1e13-4eae-b7f0-dc6e57e332ff None admin] PATH_INFO: `/v3/domains` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:32.396473 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8dde0e-1e13-4eae-b7f0-dc6e57e332ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:32.396782 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8dde0e-1e13-4eae-b7f0-dc6e57e332ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:32.399164 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8dde0e-1e13-4eae-b7f0-dc6e57e332ff None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:32.413322 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 230/474] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:26:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:32.413923 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8dde0e-1e13-4eae-b7f0-dc6e57e332ff None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:32.440306 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 245/475] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:26:32.441522 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f912d27-2ca8-43b4-9d47-fe7363719386 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:32.480249 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:32.564993 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8dde0e-1e13-4eae-b7f0-dc6e57e332ff None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:32.573551 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f912d27-2ca8-43b4-9d47-fe7363719386 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:32.608002 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86356829-0e68-4e6d-892c-9b3e77e74180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:32.608844 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86356829-0e68-4e6d-892c-9b3e77e74180 None admin] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:32.609231 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86356829-0e68-4e6d-892c-9b3e77e74180 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:32.609608 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86356829-0e68-4e6d-892c-9b3e77e74180 None admin] PATH_INFO: `/v3/users` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:32.610465 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86356829-0e68-4e6d-892c-9b3e77e74180 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:32.611991 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86356829-0e68-4e6d-892c-9b3e77e74180 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:32.612290 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b38ba46-d96c-4faa-b57d-aa245c376f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:32.613121 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38ba46-d96c-4faa-b57d-aa245c376f8a None admin] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:32.613577 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38ba46-d96c-4faa-b57d-aa245c376f8a None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:32.613999 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38ba46-d96c-4faa-b57d-aa245c376f8a None admin] PATH_INFO: `/v3/users` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:32.614916 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b38ba46-d96c-4faa-b57d-aa245c376f8a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:32.616492 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b38ba46-d96c-4faa-b57d-aa245c376f8a None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:32.702154 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 231/476] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:26:32 2022] POST /identity/v3/users => generated 248 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:26:32.702154 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86356829-0e68-4e6d-892c-9b3e77e74180 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:32.733064 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 246/477] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:26:32 2022] POST /identity/v3/users => generated 249 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:26:32.809704 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:32.927982 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86356829-0e68-4e6d-892c-9b3e77e74180 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:32.991292 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17115d55-aca1-4e09-be76-116cef35b5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:32.992257 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17115d55-aca1-4e09-be76-116cef35b5fe None admin] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:32.993325 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17115d55-aca1-4e09-be76-116cef35b5fe None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:32.993815 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17115d55-aca1-4e09-be76-116cef35b5fe None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:32.995249 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17115d55-aca1-4e09-be76-116cef35b5fe None admin] RBAC: Authorizing `identity:create_role()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:32.997572 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17115d55-aca1-4e09-be76-116cef35b5fe None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:33.064838 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.sql.core [None req-17115d55-aca1-4e09-be76-116cef35b5fe None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 05 21:26:33.064838 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 05 21:26:33.064838 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [parameters: {'id': '105ac3e2f1344d3ea5bc7107f4b45d98', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 05 21:26:33.064838 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=172889) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 05 21:26:33.081809 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-17115d55-aca1-4e09-be76-116cef35b5fe None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 05 21:26:33.081809 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:33.081809 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 21:26:33.081809 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 21:26:33.081809 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 21:26:33.081809 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 21:26:33.081809 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 21:26:33.081809 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 21:26:33.081809 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 21:26:33.081809 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application conn.query(q) Jul 05 21:26:33.081809 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 21:26:33.081809 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 21:26:33.081809 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 21:26:33.081809 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application result.read() Jul 05 21:26:33.081809 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 21:26:33.082951 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 21:26:33.082951 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 21:26:33.082951 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 21:26:33.082951 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 21:26:33.082951 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 21:26:33.082951 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 21:26:33.082951 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 21:26:33.082951 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 05 21:26:33.082951 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:33.082951 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 05 21:26:33.082951 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:33.082951 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:33.082951 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 05 21:26:33.082951 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 05 21:26:33.082951 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 05 21:26:33.082951 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return ref.to_dict() Jul 05 21:26:33.082951 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 21:26:33.082951 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application next(self.gen) Jul 05 21:26:33.084025 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 05 21:26:33.084025 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application yield resource Jul 05 21:26:33.084025 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 21:26:33.084025 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application next(self.gen) Jul 05 21:26:33.084025 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 05 21:26:33.084025 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application self.session.rollback() Jul 05 21:26:33.084025 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 05 21:26:33.084025 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application self.force_reraise() Jul 05 21:26:33.084025 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 05 21:26:33.084025 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise self.value Jul 05 21:26:33.084025 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 05 21:26:33.084025 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 05 21:26:33.084025 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 05 21:26:33.084025 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application session.commit() Jul 05 21:26:33.084025 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 05 21:26:33.084025 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 05 21:26:33.084025 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 05 21:26:33.085027 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application self._prepare_impl() Jul 05 21:26:33.085027 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 05 21:26:33.085027 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application self.session.flush() Jul 05 21:26:33.085027 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 05 21:26:33.085027 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application self._flush(objects) Jul 05 21:26:33.085027 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 05 21:26:33.085027 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 05 21:26:33.085027 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 05 21:26:33.085027 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application compat.raise_( Jul 05 21:26:33.085027 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 21:26:33.085027 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception Jul 05 21:26:33.085027 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 05 21:26:33.085027 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application flush_context.execute() Jul 05 21:26:33.085027 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 05 21:26:33.085027 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rec.execute(self) Jul 05 21:26:33.085027 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 05 21:26:33.085027 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 05 21:26:33.086023 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 05 21:26:33.086023 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 05 21:26:33.086023 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 05 21:26:33.086023 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 05 21:26:33.086023 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 05 21:26:33.086023 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 05 21:26:33.086023 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 05 21:26:33.086023 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 05 21:26:33.086023 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 05 21:26:33.086023 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 05 21:26:33.086023 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 05 21:26:33.086023 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 05 21:26:33.086023 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 05 21:26:33.086023 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 05 21:26:33.086023 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 21:26:33.086023 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception Jul 05 21:26:33.087772 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 21:26:33.087772 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 21:26:33.087772 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 21:26:33.087772 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 21:26:33.087772 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 21:26:33.087772 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 21:26:33.087772 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 21:26:33.087772 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application conn.query(q) Jul 05 21:26:33.087772 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 21:26:33.087772 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 21:26:33.087772 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 21:26:33.087772 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application result.read() Jul 05 21:26:33.087772 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 21:26:33.087772 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 21:26:33.087772 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 21:26:33.087772 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 21:26:33.089881 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 21:26:33.089881 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 21:26:33.089881 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 21:26:33.089881 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 21:26:33.089881 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 05 21:26:33.089881 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 05 21:26:33.089881 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [parameters: {'id': '105ac3e2f1344d3ea5bc7107f4b45d98', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 05 21:26:33.089881 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 05 21:26:33.089881 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:33.089881 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:26:33.089881 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:33.089881 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:33.089881 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:33.089881 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:33.089881 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:33.089881 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:33.092109 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:33.092109 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:33.092109 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:33.092109 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:33.092109 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:33.092109 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:33.092109 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 05 21:26:33.092109 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 05 21:26:33.092109 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:33.092109 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:33.092109 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 05 21:26:33.092109 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 05 21:26:33.092109 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 05 21:26:33.092109 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 05 21:26:33.092109 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 05 21:26:33.092109 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:33.095006 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 232/478] 10.222.0.30 () {60 vars in 1131 bytes} [Tue Jul 5 21:26:32 2022] POST /identity/v3/roles => generated 144 bytes in 387 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:33.095085 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b38ba46-d96c-4faa-b57d-aa245c376f8a None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:33.192867 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:33.206577 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b38ba46-d96c-4faa-b57d-aa245c376f8a None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:33.256374 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459dc763-08d8-4d4f-a425-6844bbe55d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:33.256374 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459dc763-08d8-4d4f-a425-6844bbe55d19 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:33.256374 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459dc763-08d8-4d4f-a425-6844bbe55d19 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:33.256374 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459dc763-08d8-4d4f-a425-6844bbe55d19 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:33.267722 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459dc763-08d8-4d4f-a425-6844bbe55d19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:26:33.279987 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-459dc763-08d8-4d4f-a425-6844bbe55d19 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:26:33.279987 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:33.279987 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:33.279987 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:33.279987 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:33.279987 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:33.279987 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:33.279987 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:33.279987 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:33.279987 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:33.279987 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:33.279987 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:33.279987 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:26:33.279987 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:26:33.279987 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:26:33.279987 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:26:33.281069 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:26:33.281069 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:26:33.281069 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:26:33.281069 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:26:33.281069 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:33.281069 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:33.281069 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:33.281069 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:33.281069 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:33.281069 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:33.281069 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:33.281069 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:33.281069 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:33.281069 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:33.281069 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:33.281069 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:33.282017 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:33.282017 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:33.282017 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:33.282017 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:33.282017 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:26:33.282017 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:26:33.282017 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:26:33.282017 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:26:33.282017 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:26:33.282017 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:26:33.282017 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:26:33.282017 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:33.282017 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 247/479] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:26:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:33.289433 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17115d55-aca1-4e09-be76-116cef35b5fe None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:33.441933 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17115d55-aca1-4e09-be76-116cef35b5fe None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:33.451375 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:33.482417 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf9e84-8bcc-41be-ba0a-176be8666c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:33.483105 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf9e84-8bcc-41be-ba0a-176be8666c07 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:33.483398 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf9e84-8bcc-41be-ba0a-176be8666c07 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:33.483685 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf9e84-8bcc-41be-ba0a-176be8666c07 None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:33.484441 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf9e84-8bcc-41be-ba0a-176be8666c07 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:33.484757 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf9e84-8bcc-41be-ba0a-176be8666c07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:33.486159 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf9e84-8bcc-41be-ba0a-176be8666c07 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:33.502327 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 233/480] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:26:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:34.124443 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cd3b0-fa47-4cb3-8e27-76e9e89d75b6 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:34.125025 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cd3b0-fa47-4cb3-8e27-76e9e89d75b6 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:34.125025 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cd3b0-fa47-4cb3-8e27-76e9e89d75b6 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:34.126783 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 248/481] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:34.132908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bda6ab-14e1-4711-a986-ca9da3c0b781 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:34.133970 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bda6ab-14e1-4711-a986-ca9da3c0b781 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:34.134076 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bda6ab-14e1-4711-a986-ca9da3c0b781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:34.159120 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-52bda6ab-14e1-4711-a986-ca9da3c0b781 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:34.160325 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-52bda6ab-14e1-4711-a986-ca9da3c0b781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:34.260138 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 234/482] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:26:34.300347 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117cd3b0-fa47-4cb3-8e27-76e9e89d75b6 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:34.423893 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117cd3b0-fa47-4cb3-8e27-76e9e89d75b6 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:34.473626 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aea49b-ac9d-4890-8ec5-d09867953e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:34.474833 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aea49b-ac9d-4890-8ec5-d09867953e12 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:34.475334 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aea49b-ac9d-4890-8ec5-d09867953e12 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:34.475821 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aea49b-ac9d-4890-8ec5-d09867953e12 None admin] PATH_INFO: `/v3/roles/service` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:34.491064 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aea49b-ac9d-4890-8ec5-d09867953e12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:26:34.499381 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-72aea49b-ac9d-4890-8ec5-d09867953e12 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:26:34.499381 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:34.499381 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:34.499381 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:34.499381 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:34.499381 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:34.499381 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:34.499381 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:34.499381 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:34.499381 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:34.499381 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:34.499381 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:34.499381 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:26:34.499381 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:26:34.499381 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:26:34.499381 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:26:34.500415 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:26:34.500415 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:26:34.500415 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:26:34.500415 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:26:34.500415 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:34.500415 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:34.500415 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:34.500415 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:34.500415 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:34.500415 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:34.500415 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:34.500415 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:34.500415 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:34.500415 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:34.500415 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:34.500415 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:34.501348 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:34.501348 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:34.501348 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:34.501348 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:34.501348 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:26:34.501348 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:26:34.501348 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:26:34.501348 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:26:34.501348 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:26:34.501348 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:26:34.501348 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:26:34.501348 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:34.509445 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 249/483] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:26:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:34.511178 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bda6ab-14e1-4711-a986-ca9da3c0b781 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:34.657199 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:34.662697 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bda6ab-14e1-4711-a986-ca9da3c0b781 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:34.709913 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac3623b-bfe6-4e77-a760-4f8ab85dcdd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:34.710984 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3623b-bfe6-4e77-a760-4f8ab85dcdd8 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:34.711705 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3623b-bfe6-4e77-a760-4f8ab85dcdd8 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:34.712248 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3623b-bfe6-4e77-a760-4f8ab85dcdd8 None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:34.713247 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac3623b-bfe6-4e77-a760-4f8ab85dcdd8 None admin] RBAC: Adding query filter params (name=service) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:34.713804 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac3623b-bfe6-4e77-a760-4f8ab85dcdd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:34.715460 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac3623b-bfe6-4e77-a760-4f8ab85dcdd8 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:34.725545 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 235/484] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:26:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:34.732156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aea49b-ac9d-4890-8ec5-d09867953e12 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:34.749587 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:34.828841 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf83a66-b4a2-4370-bbd6-f71aff30f53d None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:34.829206 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf83a66-b4a2-4370-bbd6-f71aff30f53d None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:34.829427 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf83a66-b4a2-4370-bbd6-f71aff30f53d None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:34.831477 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 236/485] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:34.836834 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd205f9d-1956-4b8f-92dc-04d8dc69a559 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:34.837122 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd205f9d-1956-4b8f-92dc-04d8dc69a559 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:34.837404 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd205f9d-1956-4b8f-92dc-04d8dc69a559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:34.854846 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-fd205f9d-1956-4b8f-92dc-04d8dc69a559 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:34.856047 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-fd205f9d-1956-4b8f-92dc-04d8dc69a559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:34.886204 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aea49b-ac9d-4890-8ec5-d09867953e12 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:34.937381 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e716c2-3a48-49f3-b1dc-a37bd8652230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:34.938210 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e716c2-3a48-49f3-b1dc-a37bd8652230 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:34.938496 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e716c2-3a48-49f3-b1dc-a37bd8652230 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:34.938772 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e716c2-3a48-49f3-b1dc-a37bd8652230 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:34.962762 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e716c2-3a48-49f3-b1dc-a37bd8652230 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:34.966241 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e716c2-3a48-49f3-b1dc-a37bd8652230 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:34.987540 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-10e716c2-3a48-49f3-b1dc-a37bd8652230 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:34.987540 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:34.987540 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:34.987540 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:34.987540 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:34.987540 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:34.987540 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:34.987540 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:34.987540 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:34.987540 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:34.987540 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:34.987540 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:34.987540 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:26:34.987540 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:26:34.987540 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:26:34.988808 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:26:34.988808 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:34.988808 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:34.988808 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:34.988808 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:34.988808 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:34.988808 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:34.988808 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:34.988808 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:34.988808 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:34.988808 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:34.988808 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:34.988808 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:34.988808 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:34.988808 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:34.988808 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:34.988808 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:34.990243 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:26:34.990243 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:26:34.990243 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:34.990243 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:34.990504 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 237/486] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:26:34.994598 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 250/487] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:26:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:34.999165 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd205f9d-1956-4b8f-92dc-04d8dc69a559 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:35.020821 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e716c2-3a48-49f3-b1dc-a37bd8652230 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:35.135767 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:35.147613 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd205f9d-1956-4b8f-92dc-04d8dc69a559 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:35.150341 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:35.186105 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c1151-39c1-46f8-b8be-5a84a56b2051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:35.187101 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c1151-39c1-46f8-b8be-5a84a56b2051 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:35.187675 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c1151-39c1-46f8-b8be-5a84a56b2051 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:35.188121 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c1151-39c1-46f8-b8be-5a84a56b2051 None admin] PATH_INFO: `/v3/domains` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:35.189041 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c1151-39c1-46f8-b8be-5a84a56b2051 None admin] RBAC: Adding query filter params (name=Default) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:35.189501 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c1151-39c1-46f8-b8be-5a84a56b2051 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:35.191129 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c1151-39c1-46f8-b8be-5a84a56b2051 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:35.203565 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 238/488] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:26:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:35.209517 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c1151-39c1-46f8-b8be-5a84a56b2051 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:35.254502 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e716c2-3a48-49f3-b1dc-a37bd8652230 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:35.293550 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ab765-1a88-467a-9efa-8e61699c7830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:35.294415 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ab765-1a88-467a-9efa-8e61699c7830 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:35.294702 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ab765-1a88-467a-9efa-8e61699c7830 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:35.294975 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ab765-1a88-467a-9efa-8e61699c7830 None admin] PATH_INFO: `/v3/roles/service` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:35.307473 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726ab765-1a88-467a-9efa-8e61699c7830 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:26:35.315406 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-726ab765-1a88-467a-9efa-8e61699c7830 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:26:35.315406 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:35.315406 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:35.315406 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:35.315406 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:35.315406 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:35.315406 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:35.315406 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:35.315406 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:35.315406 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:35.315406 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:35.315406 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:35.315406 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:26:35.315406 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:26:35.315406 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:26:35.315406 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:26:35.316534 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:26:35.316534 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:26:35.316534 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:26:35.316534 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:26:35.316534 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:35.316534 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:35.316534 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:35.316534 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:35.316534 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:35.316534 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:35.316534 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:35.316534 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:35.316534 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:35.316534 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:35.316534 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:35.316534 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:35.317485 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:35.317485 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:35.317485 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:35.317485 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:35.317485 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:26:35.317485 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:26:35.317485 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:26:35.317485 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:26:35.317485 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:26:35.317485 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:26:35.317485 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:26:35.317485 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:35.317485 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 251/489] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:26:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:35.323455 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c56fd-276f-4403-a943-8ff2eca453bd None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:35.323455 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c56fd-276f-4403-a943-8ff2eca453bd None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:35.323455 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c56fd-276f-4403-a943-8ff2eca453bd None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:35.324590 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 252/490] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:35.325847 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb7e54-42a6-4b5a-b9f5-23fb77de3ece None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:35.326162 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb7e54-42a6-4b5a-b9f5-23fb77de3ece None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:35.326450 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb7e54-42a6-4b5a-b9f5-23fb77de3ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:35.350148 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-f8cb7e54-42a6-4b5a-b9f5-23fb77de3ece None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:35.351640 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-f8cb7e54-42a6-4b5a-b9f5-23fb77de3ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:35.364222 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c1151-39c1-46f8-b8be-5a84a56b2051 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:35.410639 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb14d0d-6c8f-4d6a-92c9-69c38a67efd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:35.411545 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb14d0d-6c8f-4d6a-92c9-69c38a67efd0 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:35.412300 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb14d0d-6c8f-4d6a-92c9-69c38a67efd0 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:35.412590 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb14d0d-6c8f-4d6a-92c9-69c38a67efd0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:35.423708 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb14d0d-6c8f-4d6a-92c9-69c38a67efd0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:35.425793 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb14d0d-6c8f-4d6a-92c9-69c38a67efd0 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:35.445076 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-2eb14d0d-6c8f-4d6a-92c9-69c38a67efd0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:26:35.445076 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:35.445076 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:35.445076 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:35.445076 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:35.445076 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:35.445076 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:35.445076 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:35.445076 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:35.445076 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:35.445076 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:35.445076 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:35.445076 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:26:35.445076 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:26:35.445076 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:26:35.445076 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:26:35.446845 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:35.446845 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:35.446845 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:26:35.446845 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:26:35.446845 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:26:35.446845 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:26:35.446845 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:35.446845 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:35.446845 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:35.446845 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:35.446845 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:35.446845 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:35.446845 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:35.446845 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:35.446845 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:35.446845 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:35.446845 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:35.446845 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:35.447934 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:35.447934 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:35.447934 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:26:35.447934 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:26:35.447934 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:26:35.447934 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:26:35.447934 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:26:35.447934 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:26:35.447934 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:26:35.447934 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:35.447934 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 239/492] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Jul 5 21:26:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:35.447934 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb14d0d-6c8f-4d6a-92c9-69c38a67efd0 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:35.454000 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 253/492] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:26:35.455919 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cb7e54-42a6-4b5a-b9f5-23fb77de3ece None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:35.467021 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:35.521031 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:35.563735 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb14d0d-6c8f-4d6a-92c9-69c38a67efd0 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:35.578343 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cb7e54-42a6-4b5a-b9f5-23fb77de3ece None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:35.604369 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07791786-4222-4668-841e-17b38d927d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:35.605265 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07791786-4222-4668-841e-17b38d927d6e None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:35.605569 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07791786-4222-4668-841e-17b38d927d6e None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:35.606212 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07791786-4222-4668-841e-17b38d927d6e None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:35.607272 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07791786-4222-4668-841e-17b38d927d6e None admin] RBAC: Adding query filter params (name=service) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:35.607593 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07791786-4222-4668-841e-17b38d927d6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:35.609769 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07791786-4222-4668-841e-17b38d927d6e None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:35.618381 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c2dd4-7872-4dd1-a9ff-dce79d887589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:35.623840 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 240/493] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:26:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:35.623982 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c2dd4-7872-4dd1-a9ff-dce79d887589 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:35.623982 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c2dd4-7872-4dd1-a9ff-dce79d887589 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:35.623982 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c2dd4-7872-4dd1-a9ff-dce79d887589 None admin] PATH_INFO: `/v3/users` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:35.624216 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69ba39-584e-449d-acf4-ae39f8ef673b None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:35.624216 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69ba39-584e-449d-acf4-ae39f8ef673b None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:35.624374 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4c2dd4-7872-4dd1-a9ff-dce79d887589 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:35.624458 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69ba39-584e-449d-acf4-ae39f8ef673b None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:35.624541 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4c2dd4-7872-4dd1-a9ff-dce79d887589 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:35.624622 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 241/494] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:35.624622 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad69ba39-584e-449d-acf4-ae39f8ef673b None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:35.626098 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4c2dd4-7872-4dd1-a9ff-dce79d887589 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:35.676059 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 254/495] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Jul 5 21:26:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:35.678247 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c2dd4-7872-4dd1-a9ff-dce79d887589 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:35.707423 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:35.735806 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad69ba39-584e-449d-acf4-ae39f8ef673b None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:35.775149 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667b165-a6de-4dc0-992d-e8ed523a8b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:35.775876 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667b165-a6de-4dc0-992d-e8ed523a8b26 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:35.776164 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667b165-a6de-4dc0-992d-e8ed523a8b26 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:35.776442 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667b165-a6de-4dc0-992d-e8ed523a8b26 None admin] PATH_INFO: `/v3/roles/service` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:35.789267 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667b165-a6de-4dc0-992d-e8ed523a8b26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:26:35.792978 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c2dd4-7872-4dd1-a9ff-dce79d887589 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:35.797845 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-9667b165-a6de-4dc0-992d-e8ed523a8b26 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:26:35.797845 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:35.797845 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:35.797845 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:35.797845 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:35.797845 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:35.797845 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:35.797845 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:35.797845 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:35.797845 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:35.797845 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:35.797845 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:35.797845 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:26:35.797845 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:26:35.797845 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:26:35.797845 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:26:35.798902 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:26:35.798902 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:26:35.798902 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:26:35.798902 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:26:35.798902 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:35.798902 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:35.798902 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:35.798902 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:35.798902 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:35.798902 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:35.798902 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:35.798902 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:35.798902 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:35.798902 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:35.798902 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:35.798902 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:35.799818 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:35.799818 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:35.799818 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:35.799818 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:35.799818 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:26:35.799818 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:26:35.799818 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:26:35.799818 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:26:35.799818 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:26:35.799818 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:26:35.799818 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:26:35.799818 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:35.799818 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 242/496] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:26:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:35.800573 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416d81a-56d7-4c76-a2a1-9a3e2acf6a2c None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:35.800573 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416d81a-56d7-4c76-a2a1-9a3e2acf6a2c None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:35.801758 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416d81a-56d7-4c76-a2a1-9a3e2acf6a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:35.809122 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:35.817941 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-d416d81a-56d7-4c76-a2a1-9a3e2acf6a2c None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:35.821360 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-d416d81a-56d7-4c76-a2a1-9a3e2acf6a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:35.837420 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf59e966-d5c2-4359-ac84-816e1539b95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:35.838268 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59e966-d5c2-4359-ac84-816e1539b95f None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:35.839009 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59e966-d5c2-4359-ac84-816e1539b95f None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:35.839657 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59e966-d5c2-4359-ac84-816e1539b95f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:35.851142 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf59e966-d5c2-4359-ac84-816e1539b95f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:35.852909 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf59e966-d5c2-4359-ac84-816e1539b95f None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:35.871990 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-cf59e966-d5c2-4359-ac84-816e1539b95f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:35.871990 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:35.871990 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:35.871990 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:35.871990 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:35.871990 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:35.871990 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:35.871990 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:35.871990 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:35.871990 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:35.871990 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:35.871990 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:35.871990 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:26:35.871990 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:26:35.871990 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:26:35.873009 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:26:35.873009 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:35.873009 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:35.873009 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:35.873009 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:35.873009 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:35.873009 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:35.873009 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:35.873009 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:35.873009 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:35.873009 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:35.873009 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:35.873009 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:35.873009 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:35.873009 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:35.873009 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:35.873009 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:35.874011 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:26:35.874011 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:26:35.874011 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:35.874011 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:35.874011 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 255/497] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:26:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:35.874011 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf59e966-d5c2-4359-ac84-816e1539b95f None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:35.902642 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 243/498] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:26:35.902642 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d416d81a-56d7-4c76-a2a1-9a3e2acf6a2c None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:35.970230 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:35.991142 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf59e966-d5c2-4359-ac84-816e1539b95f None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:36.011092 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d416d81a-56d7-4c76-a2a1-9a3e2acf6a2c None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:36.029983 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c123ba4-535b-4619-8856-804039d870d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:36.030596 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c123ba4-535b-4619-8856-804039d870d0 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:36.030885 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c123ba4-535b-4619-8856-804039d870d0 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:36.031168 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c123ba4-535b-4619-8856-804039d870d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:36.050841 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf9635-3c77-46bd-ba93-094ed337e639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:36.051517 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf9635-3c77-46bd-ba93-094ed337e639 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:36.051806 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf9635-3c77-46bd-ba93-094ed337e639 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:36.052086 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf9635-3c77-46bd-ba93-094ed337e639 None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:36.052893 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbf9635-3c77-46bd-ba93-094ed337e639 None admin] RBAC: Adding query filter params (name=service) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:36.053210 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbf9635-3c77-46bd-ba93-094ed337e639 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:36.054663 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbf9635-3c77-46bd-ba93-094ed337e639 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:36.060782 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:36.065416 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 244/499] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:26:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:36.066067 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf9635-3c77-46bd-ba93-094ed337e639 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:36.108981 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c123ba4-535b-4619-8856-804039d870d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:36.110528 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c123ba4-535b-4619-8856-804039d870d0 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:36.177601 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf9635-3c77-46bd-ba93-094ed337e639 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:36.206635 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:36.215664 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a5fab-ff10-41ee-ab55-7b8de18fbca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:36.216256 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a5fab-ff10-41ee-ab55-7b8de18fbca7 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:36.219347 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a5fab-ff10-41ee-ab55-7b8de18fbca7 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:36.219347 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a5fab-ff10-41ee-ab55-7b8de18fbca7 None admin] PATH_INFO: `/v3/domains` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:36.219347 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641a5fab-ff10-41ee-ab55-7b8de18fbca7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:36.219347 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641a5fab-ff10-41ee-ab55-7b8de18fbca7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:36.219670 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641a5fab-ff10-41ee-ab55-7b8de18fbca7 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:36.219762 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 256/500] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:26:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:26:36.220599 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c123ba4-535b-4619-8856-804039d870d0 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:36.241122 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 245/501] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:36.241122 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a5fab-ff10-41ee-ab55-7b8de18fbca7 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:36.288871 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:36.330447 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c123ba4-535b-4619-8856-804039d870d0 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:36.341156 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a5fab-ff10-41ee-ab55-7b8de18fbca7 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:36.365016 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85a0fe-1b15-44fb-b82a-e7c8c540897d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:36.365896 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85a0fe-1b15-44fb-b82a-e7c8c540897d None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:36.366226 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85a0fe-1b15-44fb-b82a-e7c8c540897d None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:36.366514 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85a0fe-1b15-44fb-b82a-e7c8c540897d None admin] PATH_INFO: `/v3/roles/service` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:36.376224 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02bfe6-622d-4340-9993-93e896df01f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:36.377026 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02bfe6-622d-4340-9993-93e896df01f2 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:36.377320 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02bfe6-622d-4340-9993-93e896df01f2 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:36.377611 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02bfe6-622d-4340-9993-93e896df01f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:36.377750 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c85a0fe-1b15-44fb-b82a-e7c8c540897d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:26:36.385653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-0c85a0fe-1b15-44fb-b82a-e7c8c540897d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:26:36.385653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:36.385653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:36.385653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:36.385653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:36.385653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:36.385653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:36.385653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:36.385653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:36.385653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:36.385653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:36.385653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:36.385653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:26:36.385653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:26:36.385653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:26:36.385653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:26:36.386863 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:26:36.386863 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:26:36.386863 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:26:36.386863 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:26:36.386863 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:36.386863 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:36.386863 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:36.386863 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:36.386863 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:36.386863 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:36.386863 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:36.386863 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:36.386863 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:36.386863 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:36.386863 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:36.386863 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:36.387808 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:36.387808 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:36.387808 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:36.387808 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:36.387808 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:26:36.387808 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:26:36.387808 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:26:36.387808 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:26:36.387808 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:26:36.387808 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:26:36.387808 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:26:36.387808 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:36.387808 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 257/502] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:26:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:36.387808 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85a0fe-1b15-44fb-b82a-e7c8c540897d None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:36.392015 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02bfe6-622d-4340-9993-93e896df01f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:36.393503 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02bfe6-622d-4340-9993-93e896df01f2 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:36.412603 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-6b02bfe6-622d-4340-9993-93e896df01f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:36.412603 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:36.412603 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:36.412603 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:36.412603 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:36.412603 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:36.412603 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:36.412603 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:36.412603 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:36.412603 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:36.412603 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:36.412603 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:36.412603 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:26:36.412603 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:26:36.412603 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:26:36.413611 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:26:36.413611 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:36.413611 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:36.413611 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:36.413611 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:36.413611 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:36.413611 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:36.413611 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:36.413611 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:36.413611 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:36.413611 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:36.413611 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:36.413611 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:36.413611 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:36.413611 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:36.413611 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:36.413611 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:36.415161 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:26:36.415161 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:26:36.415161 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:36.415161 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:36.415161 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 246/503] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:26:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:36.415864 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02bfe6-622d-4340-9993-93e896df01f2 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:36.455428 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:36.493786 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85a0fe-1b15-44fb-b82a-e7c8c540897d None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:36.513474 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:36.514646 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02bfe6-622d-4340-9993-93e896df01f2 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:36.528090 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3041ace-e794-47ba-9196-aecefaed848a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:36.528885 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3041ace-e794-47ba-9196-aecefaed848a None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:36.529175 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3041ace-e794-47ba-9196-aecefaed848a None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:36.529455 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3041ace-e794-47ba-9196-aecefaed848a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:36.540559 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3041ace-e794-47ba-9196-aecefaed848a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:36.542456 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3041ace-e794-47ba-9196-aecefaed848a None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:36.549286 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614eb714-7d28-43f9-9ab8-7742a68a2bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:36.550083 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614eb714-7d28-43f9-9ab8-7742a68a2bae None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:36.550437 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614eb714-7d28-43f9-9ab8-7742a68a2bae None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:36.550718 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614eb714-7d28-43f9-9ab8-7742a68a2bae None admin] PATH_INFO: `/v3/users/cinder` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:36.558830 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614eb714-7d28-43f9-9ab8-7742a68a2bae None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:36.560314 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614eb714-7d28-43f9-9ab8-7742a68a2bae None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:36.561303 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-c3041ace-e794-47ba-9196-aecefaed848a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:36.561303 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:36.561303 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:36.561303 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:36.561303 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:36.561303 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:36.561303 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:36.561303 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:36.561303 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:36.561303 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:36.561303 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:36.561303 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:36.561303 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:26:36.561303 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:26:36.561303 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:26:36.562559 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:26:36.562559 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:36.562559 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:36.562559 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:36.562559 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:36.562559 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:36.562559 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:36.562559 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:36.562559 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:36.562559 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:36.562559 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:36.562559 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:36.562559 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:36.562559 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:36.562559 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:36.562559 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:36.562559 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:36.563568 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:26:36.563568 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:26:36.563568 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:36.563568 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:36.563568 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 258/504] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:26:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:36.564095 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be1f97-3992-4522-a261-a90bcc40e862 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:36.564386 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be1f97-3992-4522-a261-a90bcc40e862 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:36.564663 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be1f97-3992-4522-a261-a90bcc40e862 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:36.570148 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 259/505] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:36.570148 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be1f97-3992-4522-a261-a90bcc40e862 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:36.583549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-614eb714-7d28-43f9-9ab8-7742a68a2bae None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 21:26:36.583549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:36.583549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:36.583549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:36.583549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:36.583549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:36.583549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:36.583549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:36.583549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:36.583549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:36.583549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:36.583549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:36.583549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:26:36.583549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:26:36.583549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:26:36.583549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:26:36.584875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:36.584875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:36.584875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:26:36.584875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:26:36.584875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:26:36.584875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:26:36.584875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:36.584875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:36.584875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:36.584875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:36.584875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:36.584875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:36.584875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:36.584875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:36.584875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:36.584875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:36.584875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:36.584875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:36.587068 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:36.587068 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:36.587068 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:26:36.587068 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:26:36.587068 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:26:36.587068 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:26:36.587068 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:26:36.587068 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:26:36.587068 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 21:26:36.587068 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:36.587068 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 247/506] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:26:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:36.587068 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614eb714-7d28-43f9-9ab8-7742a68a2bae None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:36.674284 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be1f97-3992-4522-a261-a90bcc40e862 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:36.684114 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:36.688041 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614eb714-7d28-43f9-9ab8-7742a68a2bae None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:36.708979 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e43939-422c-4047-9fdf-2f4e11d1fedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:36.709637 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e43939-422c-4047-9fdf-2f4e11d1fedb None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:36.709977 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e43939-422c-4047-9fdf-2f4e11d1fedb None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:36.710282 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e43939-422c-4047-9fdf-2f4e11d1fedb None admin] PATH_INFO: `/v3/roles` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:36.711025 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e43939-422c-4047-9fdf-2f4e11d1fedb None admin] RBAC: Adding query filter params (name=service) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:36.711387 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e43939-422c-4047-9fdf-2f4e11d1fedb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:36.712772 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e43939-422c-4047-9fdf-2f4e11d1fedb None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:36.720742 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 260/507] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:26:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:36.721524 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e43939-422c-4047-9fdf-2f4e11d1fedb None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:36.729029 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae857f8-f369-4cf1-843a-9aa92d2336e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:36.729710 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae857f8-f369-4cf1-843a-9aa92d2336e6 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:36.730004 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae857f8-f369-4cf1-843a-9aa92d2336e6 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:36.730323 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae857f8-f369-4cf1-843a-9aa92d2336e6 None admin] PATH_INFO: `/v3/domains` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:36.731068 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae857f8-f369-4cf1-843a-9aa92d2336e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:36.731385 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae857f8-f369-4cf1-843a-9aa92d2336e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:36.732776 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae857f8-f369-4cf1-843a-9aa92d2336e6 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:36.745589 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 248/508] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:36.746870 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489de01-e5a2-436f-82ab-f79355a5cda5 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:36.747146 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489de01-e5a2-436f-82ab-f79355a5cda5 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:36.747433 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489de01-e5a2-436f-82ab-f79355a5cda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:36.754851 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:36.763660 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-2489de01-e5a2-436f-82ab-f79355a5cda5 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:36.767193 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-2489de01-e5a2-436f-82ab-f79355a5cda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:36.820416 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e43939-422c-4047-9fdf-2f4e11d1fedb None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:36.833499 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 249/509] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:26:36.834393 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489de01-e5a2-436f-82ab-f79355a5cda5 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:36.855336 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e265cc0-a497-426b-b354-680db8db0cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:36.856007 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e265cc0-a497-426b-b354-680db8db0cc0 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:36.856301 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e265cc0-a497-426b-b354-680db8db0cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:36.856670 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e265cc0-a497-426b-b354-680db8db0cc0 None admin] PATH_INFO: `/v3/domains` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:36.857308 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e265cc0-a497-426b-b354-680db8db0cc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:36.857629 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e265cc0-a497-426b-b354-680db8db0cc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:36.859140 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e265cc0-a497-426b-b354-680db8db0cc0 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:36.871122 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 261/510] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:36.871924 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e265cc0-a497-426b-b354-680db8db0cc0 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:36.932396 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:36.944274 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489de01-e5a2-436f-82ab-f79355a5cda5 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:36.966376 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:36.972541 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e265cc0-a497-426b-b354-680db8db0cc0 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:36.980792 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83584ad4-d41b-4a7a-b2bd-528c514c4508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:36.981473 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83584ad4-d41b-4a7a-b2bd-528c514c4508 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:36.981765 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83584ad4-d41b-4a7a-b2bd-528c514c4508 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:36.982049 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83584ad4-d41b-4a7a-b2bd-528c514c4508 None admin] PATH_INFO: `/v3/users` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:36.982928 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83584ad4-d41b-4a7a-b2bd-528c514c4508 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:36.983251 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83584ad4-d41b-4a7a-b2bd-528c514c4508 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:36.984699 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83584ad4-d41b-4a7a-b2bd-528c514c4508 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:37.007286 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8676e8e-b446-47b9-b19c-04523f1f934b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:37.008095 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8676e8e-b446-47b9-b19c-04523f1f934b None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:37.008382 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8676e8e-b446-47b9-b19c-04523f1f934b None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:37.008652 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8676e8e-b446-47b9-b19c-04523f1f934b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:37.018529 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8676e8e-b446-47b9-b19c-04523f1f934b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:37.019973 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8676e8e-b446-47b9-b19c-04523f1f934b None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:37.021542 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 250/511] 10.222.0.30 () {56 vars in 1137 bytes} [Tue Jul 5 21:26:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:37.022413 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83584ad4-d41b-4a7a-b2bd-528c514c4508 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:37.038084 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-a8676e8e-b446-47b9-b19c-04523f1f934b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:37.038084 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:37.038084 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:37.038084 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:37.038084 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:37.038084 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:37.038084 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:37.038084 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:37.038084 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:37.038084 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:37.038084 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:37.038084 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:37.038084 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:26:37.038084 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:26:37.038084 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:26:37.039873 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:26:37.039873 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:37.039873 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:37.039873 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:37.039873 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:37.039873 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:37.039873 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:37.039873 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:37.039873 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:37.039873 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:37.039873 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:37.039873 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:37.039873 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:37.039873 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:37.039873 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:37.039873 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:37.039873 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:37.041178 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:26:37.041178 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:26:37.041178 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:37.041178 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:37.041178 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 262/512] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:26:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:37.041178 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8676e8e-b446-47b9-b19c-04523f1f934b None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:37.169516 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83584ad4-d41b-4a7a-b2bd-528c514c4508 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:37.169737 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8676e8e-b446-47b9-b19c-04523f1f934b None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:37.175973 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c48bc-3691-4e80-b8a0-03d48c1bea8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:37.176798 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c48bc-3691-4e80-b8a0-03d48c1bea8f None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:37.177091 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c48bc-3691-4e80-b8a0-03d48c1bea8f None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:37.177373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c48bc-3691-4e80-b8a0-03d48c1bea8f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:37.185360 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb46ad-2b68-4433-acd9-8825b6d26200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:37.186274 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb46ad-2b68-4433-acd9-8825b6d26200 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:37.186438 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c48bc-3691-4e80-b8a0-03d48c1bea8f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:37.186939 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb46ad-2b68-4433-acd9-8825b6d26200 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:37.187019 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb46ad-2b68-4433-acd9-8825b6d26200 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:37.187964 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c48bc-3691-4e80-b8a0-03d48c1bea8f None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:37.200321 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb46ad-2b68-4433-acd9-8825b6d26200 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:37.202548 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb46ad-2b68-4433-acd9-8825b6d26200 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:37.204274 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-7c2c48bc-3691-4e80-b8a0-03d48c1bea8f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 21:26:37.204274 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:37.204274 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:37.204274 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:37.204274 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:37.204274 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:37.204274 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:37.204274 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:37.204274 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:37.204274 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:37.204274 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:37.204274 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:37.204274 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:26:37.204274 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:26:37.204274 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:26:37.204274 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:26:37.205426 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:37.205426 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:37.205426 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:26:37.205426 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:26:37.205426 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:26:37.205426 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:26:37.205426 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:37.205426 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:37.205426 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:37.205426 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:37.205426 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:37.205426 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:37.205426 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:37.205426 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:37.205426 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:37.205426 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:37.205426 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:37.205426 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:37.206932 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:37.206932 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:37.206932 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:26:37.206932 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:26:37.206932 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:26:37.206932 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:26:37.206932 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:26:37.206932 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:26:37.206932 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 21:26:37.206932 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:37.206932 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 251/513] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:26:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:37.206932 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c48bc-3691-4e80-b8a0-03d48c1bea8f None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:37.214184 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:37.218241 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:37.226024 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-3fcb46ad-2b68-4433-acd9-8825b6d26200 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:37.226024 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:37.226024 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:37.226024 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:37.226024 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:37.226024 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:37.226024 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:37.226024 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:37.226024 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:37.226024 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:37.226024 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:37.226024 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:37.226024 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:26:37.226024 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:26:37.226024 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:26:37.248259 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:26:37.248259 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:37.248259 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:37.248259 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:37.248259 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:37.248259 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:37.248259 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:37.248259 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:37.248259 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:37.248259 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:37.248259 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:37.248259 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:37.248259 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:37.248259 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:37.248259 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:37.248259 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:37.248259 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:37.249573 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:26:37.249573 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:26:37.249573 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:37.249573 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:37.249573 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 263/514] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:26:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:37.249573 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb46ad-2b68-4433-acd9-8825b6d26200 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:37.322099 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c48bc-3691-4e80-b8a0-03d48c1bea8f None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:37.333071 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb46ad-2b68-4433-acd9-8825b6d26200 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:37.357983 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce8f79-1eea-4831-97c7-daa120117fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:37.358878 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce8f79-1eea-4831-97c7-daa120117fc2 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:37.359165 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce8f79-1eea-4831-97c7-daa120117fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:37.359446 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce8f79-1eea-4831-97c7-daa120117fc2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:37.366165 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce8f79-1eea-4831-97c7-daa120117fc2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:37.367899 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce8f79-1eea-4831-97c7-daa120117fc2 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:37.369178 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d814b-4f06-4f75-b015-952dcc926ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:37.369825 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d814b-4f06-4f75-b015-952dcc926ba5 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:37.370109 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d814b-4f06-4f75-b015-952dcc926ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:37.370420 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d814b-4f06-4f75-b015-952dcc926ba5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:37.383373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-ecce8f79-1eea-4831-97c7-daa120117fc2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:26:37.383373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:37.383373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:37.383373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:37.383373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:37.383373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:37.383373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:37.383373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:37.383373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:37.383373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:37.383373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:37.383373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:37.383373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:26:37.383373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:26:37.383373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:26:37.384297 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:26:37.384297 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:37.384297 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:37.384297 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:37.384297 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:37.384297 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:37.384297 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:37.384297 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:37.384297 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:37.384297 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:37.384297 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:37.384297 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:37.384297 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:37.384297 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:37.384297 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:37.384297 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:37.384297 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:37.385252 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:26:37.385252 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:26:37.385252 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:26:37.385252 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:26:37.385252 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:26:37.385252 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:26:37.385252 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:26:37.385252 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:37.385252 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 252/515] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:26:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:37.385785 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce8f79-1eea-4831-97c7-daa120117fc2 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:37.441326 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:37.445095 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592d814b-4f06-4f75-b015-952dcc926ba5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:37.446743 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592d814b-4f06-4f75-b015-952dcc926ba5 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:37.451900 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:37.486812 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce8f79-1eea-4831-97c7-daa120117fc2 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:37.520516 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17476ca6-3356-4ad6-a8e5-935de916e91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:37.521176 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17476ca6-3356-4ad6-a8e5-935de916e91e None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:37.521464 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17476ca6-3356-4ad6-a8e5-935de916e91e None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:37.521747 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17476ca6-3356-4ad6-a8e5-935de916e91e None admin] PATH_INFO: `/v3/domains` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:37.522501 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17476ca6-3356-4ad6-a8e5-935de916e91e None admin] RBAC: Adding query filter params (name=Default) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:37.522809 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17476ca6-3356-4ad6-a8e5-935de916e91e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:37.524845 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17476ca6-3356-4ad6-a8e5-935de916e91e None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:37.536511 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 253/516] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:26:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:37.537302 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17476ca6-3356-4ad6-a8e5-935de916e91e None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:37.550402 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 264/517] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:26:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:26:37.551251 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d814b-4f06-4f75-b015-952dcc926ba5 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:37.640661 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17476ca6-3356-4ad6-a8e5-935de916e91e None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:37.647950 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:37.653245 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d814b-4f06-4f75-b015-952dcc926ba5 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:37.668221 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:37.676813 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28988940-0e29-4308-885c-8abf74cb89c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:37.677495 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28988940-0e29-4308-885c-8abf74cb89c5 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:37.677791 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28988940-0e29-4308-885c-8abf74cb89c5 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:37.678078 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28988940-0e29-4308-885c-8abf74cb89c5 None admin] PATH_INFO: `/v3/users` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:37.678960 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28988940-0e29-4308-885c-8abf74cb89c5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:37.679279 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28988940-0e29-4308-885c-8abf74cb89c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:37.680842 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28988940-0e29-4308-885c-8abf74cb89c5 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:37.688068 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53987f7e-af38-4c03-86f4-ea8c92fd72e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:37.688729 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53987f7e-af38-4c03-86f4-ea8c92fd72e7 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:37.689018 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53987f7e-af38-4c03-86f4-ea8c92fd72e7 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:37.691293 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53987f7e-af38-4c03-86f4-ea8c92fd72e7 None admin] PATH_INFO: `/v3/domains` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:37.691293 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53987f7e-af38-4c03-86f4-ea8c92fd72e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:37.691293 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53987f7e-af38-4c03-86f4-ea8c92fd72e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:37.691724 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53987f7e-af38-4c03-86f4-ea8c92fd72e7 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:37.699541 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 254/518] 10.222.0.30 () {56 vars in 1139 bytes} [Tue Jul 5 21:26:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:37.700250 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28988940-0e29-4308-885c-8abf74cb89c5 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:37.704997 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 265/519] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:26:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:37.706958 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53987f7e-af38-4c03-86f4-ea8c92fd72e7 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:37.801375 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28988940-0e29-4308-885c-8abf74cb89c5 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:37.806516 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53987f7e-af38-4c03-86f4-ea8c92fd72e7 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:37.837019 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d8176-25e1-40c7-87ec-d15cefcf942a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:37.837682 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d8176-25e1-40c7-87ec-d15cefcf942a None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:37.837969 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d8176-25e1-40c7-87ec-d15cefcf942a None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:37.838279 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d8176-25e1-40c7-87ec-d15cefcf942a None admin] PATH_INFO: `/v3/projects` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:37.839066 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d8176-25e1-40c7-87ec-d15cefcf942a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:37.839375 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d8176-25e1-40c7-87ec-d15cefcf942a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:37.840808 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d8176-25e1-40c7-87ec-d15cefcf942a None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:37.840924 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593ab3a-b1b1-4526-8fd7-e7eaf9a8f3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:37.841751 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593ab3a-b1b1-4526-8fd7-e7eaf9a8f3ee None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:37.842042 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593ab3a-b1b1-4526-8fd7-e7eaf9a8f3ee None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:37.842361 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593ab3a-b1b1-4526-8fd7-e7eaf9a8f3ee None admin] PATH_INFO: `/v3/users/glance` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:37.849760 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f593ab3a-b1b1-4526-8fd7-e7eaf9a8f3ee None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:37.851232 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f593ab3a-b1b1-4526-8fd7-e7eaf9a8f3ee None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:37.857969 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 255/520] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:26:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:37.858807 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d8176-25e1-40c7-87ec-d15cefcf942a None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:37.866834 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-f593ab3a-b1b1-4526-8fd7-e7eaf9a8f3ee None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 05 21:26:37.866834 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:37.866834 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:37.866834 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:37.866834 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:37.866834 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:37.866834 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:37.866834 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:37.866834 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:37.866834 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:37.866834 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:37.866834 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:37.866834 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:26:37.866834 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:26:37.866834 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:26:37.866834 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:26:37.867943 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:37.867943 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:37.867943 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:26:37.867943 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:26:37.867943 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:26:37.867943 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:26:37.867943 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:37.867943 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:37.867943 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:37.867943 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:37.867943 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:37.867943 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:37.867943 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:37.867943 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:37.867943 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:37.867943 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:37.867943 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:37.867943 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:37.868931 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:37.868931 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:37.868931 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:26:37.868931 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:26:37.868931 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:26:37.868931 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:26:37.868931 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:26:37.868931 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:26:37.868931 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 05 21:26:37.868931 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:37.868931 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 266/521] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:26:37 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:37.868931 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593ab3a-b1b1-4526-8fd7-e7eaf9a8f3ee None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:37.892035 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:37.908061 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:37.962574 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d8176-25e1-40c7-87ec-d15cefcf942a None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:37.974370 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593ab3a-b1b1-4526-8fd7-e7eaf9a8f3ee None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:37.997363 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fca287-12e8-4f9c-b83f-16875ea61a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:37.998229 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fca287-12e8-4f9c-b83f-16875ea61a7e None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:37.998520 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fca287-12e8-4f9c-b83f-16875ea61a7e None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:37.998800 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fca287-12e8-4f9c-b83f-16875ea61a7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:38.008501 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a336cc6-7732-4a1a-9efd-7fd2eba43275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:38.009397 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a336cc6-7732-4a1a-9efd-7fd2eba43275 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:38.009574 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a336cc6-7732-4a1a-9efd-7fd2eba43275 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:38.009852 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a336cc6-7732-4a1a-9efd-7fd2eba43275 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:38.010915 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fca287-12e8-4f9c-b83f-16875ea61a7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:38.012403 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fca287-12e8-4f9c-b83f-16875ea61a7e None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:38.029694 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-69fca287-12e8-4f9c-b83f-16875ea61a7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:38.029694 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:38.029694 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:38.029694 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:38.029694 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:38.029694 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:38.029694 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:38.029694 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:38.029694 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:38.029694 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:38.029694 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:38.029694 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:38.029694 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:26:38.029694 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:26:38.029694 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:26:38.030547 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:26:38.030547 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:38.030547 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:38.030547 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:38.030547 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:38.030547 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:38.030547 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:38.030547 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:38.030547 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:38.030547 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:38.030547 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:38.030547 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:38.030547 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:38.030547 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:38.030547 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:38.030547 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:38.030547 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:38.031293 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:26:38.031293 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:26:38.031293 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:38.031293 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:38.035460 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 256/522] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:26:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:38.035460 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fca287-12e8-4f9c-b83f-16875ea61a7e None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:38.079647 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a336cc6-7732-4a1a-9efd-7fd2eba43275 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:38.081384 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a336cc6-7732-4a1a-9efd-7fd2eba43275 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:38.099507 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:38.131494 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:38.137141 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fca287-12e8-4f9c-b83f-16875ea61a7e None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:38.171361 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449c3e6-0f16-42b6-a339-e82d0bb4762e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:38.171966 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449c3e6-0f16-42b6-a339-e82d0bb4762e None admin] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:38.172261 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449c3e6-0f16-42b6-a339-e82d0bb4762e None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:38.172546 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449c3e6-0f16-42b6-a339-e82d0bb4762e None admin] PATH_INFO: `/v3/users` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:38.173253 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7449c3e6-0f16-42b6-a339-e82d0bb4762e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:38.174769 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7449c3e6-0f16-42b6-a339-e82d0bb4762e None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:38.184082 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 267/523] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:26:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:26:38.184925 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a336cc6-7732-4a1a-9efd-7fd2eba43275 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:38.252950 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 257/524] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:26:38 2022] POST /identity/v3/users => generated 247 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:26:38.254289 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449c3e6-0f16-42b6-a339-e82d0bb4762e None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:38.289050 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a336cc6-7732-4a1a-9efd-7fd2eba43275 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:38.315839 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:38.340736 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9548f-fe4b-4062-83ec-68071028f3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:38.341787 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9548f-fe4b-4062-83ec-68071028f3df None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:38.342392 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9548f-fe4b-4062-83ec-68071028f3df None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:38.342854 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9548f-fe4b-4062-83ec-68071028f3df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:38.344446 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff9548f-fe4b-4062-83ec-68071028f3df None admin] RBAC: Adding query filter params (role.id=1cb72e4884a744f99a3df0dc628f7493, scope.project.id=7fe768315f5c43f487f71f043f11b8b8, user.id=941ed10dfafc4bd48896843da26c9175) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:38.344971 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff9548f-fe4b-4062-83ec-68071028f3df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:38.347274 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff9548f-fe4b-4062-83ec-68071028f3df None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:38.366599 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 268/525] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:26:38 2022] GET /identity/v3/role_assignments?user.id=941ed10dfafc4bd48896843da26c9175&scope.project.id=7fe768315f5c43f487f71f043f11b8b8&role.id=1cb72e4884a744f99a3df0dc628f7493 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:38.368335 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9548f-fe4b-4062-83ec-68071028f3df None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:38.379042 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449c3e6-0f16-42b6-a339-e82d0bb4762e None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:38.424594 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135da9e3-f94d-4d1b-8067-01fc923031c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:38.425204 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135da9e3-f94d-4d1b-8067-01fc923031c8 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:38.425491 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135da9e3-f94d-4d1b-8067-01fc923031c8 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:38.425773 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135da9e3-f94d-4d1b-8067-01fc923031c8 None admin] PATH_INFO: `/v3/users` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:38.426741 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135da9e3-f94d-4d1b-8067-01fc923031c8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:38.427057 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135da9e3-f94d-4d1b-8067-01fc923031c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:38.428548 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135da9e3-f94d-4d1b-8067-01fc923031c8 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:38.451709 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 258/526] 10.222.0.30 () {56 vars in 1137 bytes} [Tue Jul 5 21:26:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:38.452680 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135da9e3-f94d-4d1b-8067-01fc923031c8 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:38.468735 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:38.515390 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9548f-fe4b-4062-83ec-68071028f3df None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:38.571086 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af09d9-1e62-42eb-aeda-a595462b94d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:38.572373 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af09d9-1e62-42eb-aeda-a595462b94d9 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:38.572853 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af09d9-1e62-42eb-aeda-a595462b94d9 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:38.573512 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af09d9-1e62-42eb-aeda-a595462b94d9 None admin] PATH_INFO: `/v3/domains` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:38.574923 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af09d9-1e62-42eb-aeda-a595462b94d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:38.575714 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af09d9-1e62-42eb-aeda-a595462b94d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:38.577866 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af09d9-1e62-42eb-aeda-a595462b94d9 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:38.593548 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135da9e3-f94d-4d1b-8067-01fc923031c8 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:38.594056 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 269/527] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:26:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:38.595378 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af09d9-1e62-42eb-aeda-a595462b94d9 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:38.642975 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9e441-943c-4d50-8181-6928e7df99fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:38.644122 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9e441-943c-4d50-8181-6928e7df99fc None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:38.645138 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9e441-943c-4d50-8181-6928e7df99fc None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:38.645592 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9e441-943c-4d50-8181-6928e7df99fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:38.648840 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:38.660843 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9e441-943c-4d50-8181-6928e7df99fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:38.663328 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9e441-943c-4d50-8181-6928e7df99fc None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:38.689980 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-57e9e441-943c-4d50-8181-6928e7df99fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:38.689980 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:38.689980 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:38.689980 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:38.689980 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:38.689980 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:38.689980 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:38.689980 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:38.689980 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:38.689980 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:38.689980 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:38.689980 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:38.689980 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:26:38.689980 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:26:38.689980 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:26:38.690814 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:26:38.690814 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:38.690814 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:38.690814 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:38.690814 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:38.690814 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:38.690814 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:38.690814 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:38.690814 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:38.690814 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:38.690814 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:38.690814 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:38.690814 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:38.690814 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:38.690814 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:38.690814 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:38.690814 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:38.691585 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:26:38.691585 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:26:38.691585 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:38.691585 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:38.694388 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 259/528] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:26:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:38.695396 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9e441-943c-4d50-8181-6928e7df99fc None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:38.718784 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af09d9-1e62-42eb-aeda-a595462b94d9 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:38.757930 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f0990f-f9c4-433d-a591-5630e391741c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:38.758829 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0990f-f9c4-433d-a591-5630e391741c None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:38.759216 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0990f-f9c4-433d-a591-5630e391741c None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:38.759593 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0990f-f9c4-433d-a591-5630e391741c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:38.780462 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:38.829333 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9e441-943c-4d50-8181-6928e7df99fc None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:38.849451 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f0990f-f9c4-433d-a591-5630e391741c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:38.851121 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f0990f-f9c4-433d-a591-5630e391741c None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:38.872713 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f6a14-292f-46c3-8a14-db2ba555c7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:38.873666 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f6a14-292f-46c3-8a14-db2ba555c7d2 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:38.874055 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f6a14-292f-46c3-8a14-db2ba555c7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:38.874457 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f6a14-292f-46c3-8a14-db2ba555c7d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:38.884352 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6f6a14-292f-46c3-8a14-db2ba555c7d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:38.886587 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6f6a14-292f-46c3-8a14-db2ba555c7d2 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:38.897392 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:38.905882 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-8c6f6a14-292f-46c3-8a14-db2ba555c7d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:26:38.905882 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:38.905882 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:38.905882 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:38.905882 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:38.905882 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:38.905882 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:38.905882 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:38.905882 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:38.905882 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:38.905882 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:38.905882 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:38.905882 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:26:38.905882 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:26:38.905882 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:26:38.911373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:26:38.911373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:38.911373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:38.911373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:38.911373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:38.911373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:38.911373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:38.911373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:38.911373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:38.911373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:38.911373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:38.911373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:38.911373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:38.911373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:38.911373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:38.911373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:38.911373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:38.912408 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:26:38.912408 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:26:38.912408 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:26:38.912408 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:26:38.912408 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:26:38.912408 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:26:38.912408 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:26:38.912408 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:38.912408 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 260/529] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:26:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:38.912408 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f6a14-292f-46c3-8a14-db2ba555c7d2 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:38.965149 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 270/530] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:26:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:26:38.966468 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f0990f-f9c4-433d-a591-5630e391741c None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:39.041094 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f6a14-292f-46c3-8a14-db2ba555c7d2 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:39.071109 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:39.073899 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f0990f-f9c4-433d-a591-5630e391741c None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:39.085800 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e543f7bc-f44c-4229-bfaf-affd62a90b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:39.087511 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543f7bc-f44c-4229-bfaf-affd62a90b30 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:39.087952 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543f7bc-f44c-4229-bfaf-affd62a90b30 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:39.088117 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543f7bc-f44c-4229-bfaf-affd62a90b30 None admin] PATH_INFO: `/v3/domains` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:39.088991 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e543f7bc-f44c-4229-bfaf-affd62a90b30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:39.089321 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e543f7bc-f44c-4229-bfaf-affd62a90b30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:39.090903 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e543f7bc-f44c-4229-bfaf-affd62a90b30 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:39.110295 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 261/531] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:26:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:39.111978 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e543f7bc-f44c-4229-bfaf-affd62a90b30 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:39.120111 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373eb23d-40bf-4873-86c0-8162f4b5eb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:39.120983 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373eb23d-40bf-4873-86c0-8162f4b5eb09 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:39.121367 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373eb23d-40bf-4873-86c0-8162f4b5eb09 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:39.121794 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373eb23d-40bf-4873-86c0-8162f4b5eb09 None admin] PATH_INFO: `/v3/projects` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:39.122728 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373eb23d-40bf-4873-86c0-8162f4b5eb09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:39.123219 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373eb23d-40bf-4873-86c0-8162f4b5eb09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:39.124812 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373eb23d-40bf-4873-86c0-8162f4b5eb09 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:39.145196 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 271/532] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:26:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:39.146401 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373eb23d-40bf-4873-86c0-8162f4b5eb09 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:39.149834 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:39.236890 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e543f7bc-f44c-4229-bfaf-affd62a90b30 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:39.270346 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373eb23d-40bf-4873-86c0-8162f4b5eb09 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:39.276428 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c818863-993f-4f0f-afbc-f3effb6dcb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:39.277780 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c818863-993f-4f0f-afbc-f3effb6dcb33 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:39.278259 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c818863-993f-4f0f-afbc-f3effb6dcb33 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:39.279158 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c818863-993f-4f0f-afbc-f3effb6dcb33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:39.294407 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c818863-993f-4f0f-afbc-f3effb6dcb33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:39.296590 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c818863-993f-4f0f-afbc-f3effb6dcb33 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:39.315899 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc218e6-3479-4947-9490-ade049387a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:39.317269 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc218e6-3479-4947-9490-ade049387a3f None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:39.317717 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc218e6-3479-4947-9490-ade049387a3f None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:39.318201 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc218e6-3479-4947-9490-ade049387a3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:39.320912 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-0c818863-993f-4f0f-afbc-f3effb6dcb33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:39.320912 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:39.320912 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:39.320912 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:39.320912 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:39.320912 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:39.320912 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:39.320912 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:39.320912 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:39.320912 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:39.320912 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:39.320912 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:39.320912 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:26:39.320912 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:26:39.320912 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:26:39.322022 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:26:39.322022 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:39.322022 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:39.322022 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:39.322022 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:39.322022 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:39.322022 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:39.322022 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:39.322022 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:39.322022 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:39.322022 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:39.322022 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:39.322022 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:39.322022 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:39.322022 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:39.322022 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:39.322022 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:39.322976 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:26:39.322976 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:26:39.322976 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:39.322976 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:39.324565 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 262/533] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:26:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:39.325522 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c818863-993f-4f0f-afbc-f3effb6dcb33 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:39.329056 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc218e6-3479-4947-9490-ade049387a3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:39.331941 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc218e6-3479-4947-9490-ade049387a3f None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:39.348042 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-1dc218e6-3479-4947-9490-ade049387a3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:26:39.348042 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:39.348042 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:39.348042 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:39.348042 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:39.348042 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:39.348042 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:39.348042 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:39.348042 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:39.348042 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:39.348042 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:39.348042 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:39.348042 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:26:39.348042 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:26:39.348042 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:26:39.349026 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:26:39.349026 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:39.349026 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:39.349026 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:39.349026 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:39.349026 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:39.349026 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:39.349026 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:39.349026 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:39.349026 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:39.349026 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:39.349026 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:39.349026 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:39.349026 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:39.349026 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:39.349026 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:39.349026 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:39.349988 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:26:39.349988 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:26:39.349988 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:26:39.349988 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:26:39.349988 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:26:39.349988 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:26:39.349988 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:26:39.349988 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:39.357246 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 272/534] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:26:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:39.357246 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc218e6-3479-4947-9490-ade049387a3f None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:39.375390 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:39.425550 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:39.458472 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c818863-993f-4f0f-afbc-f3effb6dcb33 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:39.473448 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc218e6-3479-4947-9490-ade049387a3f None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:39.496843 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9336dba-3158-4e99-a4ec-0345fb713ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:39.497442 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9336dba-3158-4e99-a4ec-0345fb713ef0 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:39.497734 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9336dba-3158-4e99-a4ec-0345fb713ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:39.498018 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9336dba-3158-4e99-a4ec-0345fb713ef0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:39.498940 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9336dba-3158-4e99-a4ec-0345fb713ef0 None admin] RBAC: Adding query filter params (role.id=1cb72e4884a744f99a3df0dc628f7493, scope.project.id=7fe768315f5c43f487f71f043f11b8b8, user.id=8e88abf44b444872ad688677ddb437ac) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:39.499263 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9336dba-3158-4e99-a4ec-0345fb713ef0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:39.500764 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9336dba-3158-4e99-a4ec-0345fb713ef0 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:39.514464 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 263/535] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:26:39 2022] GET /identity/v3/role_assignments?user.id=8e88abf44b444872ad688677ddb437ac&scope.project.id=7fe768315f5c43f487f71f043f11b8b8&role.id=1cb72e4884a744f99a3df0dc628f7493 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:39.515523 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9336dba-3158-4e99-a4ec-0345fb713ef0 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:39.522572 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd01d90-ef4c-4108-87ef-5f4c66c6bb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:39.523637 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd01d90-ef4c-4108-87ef-5f4c66c6bb4c None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:39.524223 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd01d90-ef4c-4108-87ef-5f4c66c6bb4c None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:39.524743 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd01d90-ef4c-4108-87ef-5f4c66c6bb4c None admin] PATH_INFO: `/v3/domains` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:39.525763 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd01d90-ef4c-4108-87ef-5f4c66c6bb4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:39.526325 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd01d90-ef4c-4108-87ef-5f4c66c6bb4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:39.529169 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd01d90-ef4c-4108-87ef-5f4c66c6bb4c None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:39.545160 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 273/536] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:39.557581 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd01d90-ef4c-4108-87ef-5f4c66c6bb4c None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:39.716478 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:39.720396 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9336dba-3158-4e99-a4ec-0345fb713ef0 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:39.760793 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35573f-a465-4e44-8261-398bcf024387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:39.762028 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35573f-a465-4e44-8261-398bcf024387 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:39.762566 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35573f-a465-4e44-8261-398bcf024387 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:39.763040 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35573f-a465-4e44-8261-398bcf024387 None admin] PATH_INFO: `/v3/projects` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:39.764017 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e35573f-a465-4e44-8261-398bcf024387 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:39.764523 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e35573f-a465-4e44-8261-398bcf024387 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:39.764862 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd01d90-ef4c-4108-87ef-5f4c66c6bb4c None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:39.766618 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e35573f-a465-4e44-8261-398bcf024387 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:39.780296 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 264/537] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:26:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:39.786315 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35573f-a465-4e44-8261-398bcf024387 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:39.789026 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:39.814850 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e00fde-0056-45ea-871e-d05961778a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:39.815654 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e00fde-0056-45ea-871e-d05961778a76 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:39.815949 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e00fde-0056-45ea-871e-d05961778a76 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:39.816235 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e00fde-0056-45ea-871e-d05961778a76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:39.823840 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e00fde-0056-45ea-871e-d05961778a76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:39.825300 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e00fde-0056-45ea-871e-d05961778a76 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:39.867106 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-f2e00fde-0056-45ea-871e-d05961778a76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:26:39.867106 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:39.867106 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:39.867106 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:39.867106 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:39.867106 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:39.867106 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:39.867106 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:39.867106 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:39.867106 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:39.867106 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:39.867106 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:39.867106 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:26:39.867106 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:26:39.867106 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:26:39.868613 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:26:39.868613 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:39.868613 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:39.868613 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:39.868613 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:39.868613 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:39.868613 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:39.868613 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:39.868613 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:39.868613 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:39.868613 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:39.868613 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:39.868613 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:39.868613 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:39.868613 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:39.868613 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:39.868613 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:39.869372 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:26:39.869372 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:26:39.869372 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:26:39.869372 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:26:39.869372 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:26:39.869372 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:26:39.869372 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:26:39.869372 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:39.869372 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 274/538] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:26:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:39.874641 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e00fde-0056-45ea-871e-d05961778a76 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:39.900281 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35573f-a465-4e44-8261-398bcf024387 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:39.945343 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d26fc5-2993-41fc-8092-9aa8163c0c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:39.946593 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d26fc5-2993-41fc-8092-9aa8163c0c84 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:39.946863 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d26fc5-2993-41fc-8092-9aa8163c0c84 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:39.947254 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d26fc5-2993-41fc-8092-9aa8163c0c84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:39.948004 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d26fc5-2993-41fc-8092-9aa8163c0c84 None admin] RBAC: Adding query filter params (role.id=1cb72e4884a744f99a3df0dc628f7493, scope.project.id=7fe768315f5c43f487f71f043f11b8b8, user.id=5eefecdea1014aedad4c2a49686a7a89) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:39.948327 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d26fc5-2993-41fc-8092-9aa8163c0c84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:39.949797 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d26fc5-2993-41fc-8092-9aa8163c0c84 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:39.960490 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 265/539] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:26:39 2022] GET /identity/v3/role_assignments?user.id=5eefecdea1014aedad4c2a49686a7a89&scope.project.id=7fe768315f5c43f487f71f043f11b8b8&role.id=1cb72e4884a744f99a3df0dc628f7493 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:26:40.063961 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e00fde-0056-45ea-871e-d05961778a76 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:40.123033 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0994d4-bbd0-4c34-b5b1-126890303b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:40.124092 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0994d4-bbd0-4c34-b5b1-126890303b97 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:40.124575 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0994d4-bbd0-4c34-b5b1-126890303b97 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:40.125076 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0994d4-bbd0-4c34-b5b1-126890303b97 None admin] PATH_INFO: `/v3/projects` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:40.126091 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0994d4-bbd0-4c34-b5b1-126890303b97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:40.126632 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0994d4-bbd0-4c34-b5b1-126890303b97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:40.128300 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0994d4-bbd0-4c34-b5b1-126890303b97 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:40.145586 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 275/540] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:26:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:26:40.155331 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d26fc5-2993-41fc-8092-9aa8163c0c84 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:40.205312 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:40.293870 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d26fc5-2993-41fc-8092-9aa8163c0c84 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:40.339652 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27868c7f-b52a-4cc1-bcae-1c6f97e00a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:40.340242 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27868c7f-b52a-4cc1-bcae-1c6f97e00a00 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:40.340537 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27868c7f-b52a-4cc1-bcae-1c6f97e00a00 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:40.340824 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27868c7f-b52a-4cc1-bcae-1c6f97e00a00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:40.341668 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27868c7f-b52a-4cc1-bcae-1c6f97e00a00 None admin] RBAC: Adding query filter params (role.id=1cb72e4884a744f99a3df0dc628f7493, scope.project.id=7fe768315f5c43f487f71f043f11b8b8, user.id=9fab25f2362e4043a83964e177bbcb3e) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:40.341987 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27868c7f-b52a-4cc1-bcae-1c6f97e00a00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:40.343495 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27868c7f-b52a-4cc1-bcae-1c6f97e00a00 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:40.355276 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 266/541] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:26:40 2022] GET /identity/v3/role_assignments?user.id=9fab25f2362e4043a83964e177bbcb3e&scope.project.id=7fe768315f5c43f487f71f043f11b8b8&role.id=1cb72e4884a744f99a3df0dc628f7493 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:40.528939 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079734f7-5b10-4e77-9fc7-cae842670ebe None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:40.529437 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079734f7-5b10-4e77-9fc7-cae842670ebe None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:40.529506 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079734f7-5b10-4e77-9fc7-cae842670ebe None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:40.531185 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 276/542] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:40.536745 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb5d5c-a7f2-4205-84b3-8c3dfc6bafab None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:40.537044 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb5d5c-a7f2-4205-84b3-8c3dfc6bafab None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:40.537343 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb5d5c-a7f2-4205-84b3-8c3dfc6bafab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:40.565641 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-7cfb5d5c-a7f2-4205-84b3-8c3dfc6bafab None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:40.566926 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-7cfb5d5c-a7f2-4205-84b3-8c3dfc6bafab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:40.662304 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 267/543] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:26:40.667008 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35ca92-5f90-4823-a40c-3934c01c92e3 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:40.667523 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35ca92-5f90-4823-a40c-3934c01c92e3 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:40.667992 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35ca92-5f90-4823-a40c-3934c01c92e3 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:40.669546 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 277/544] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:40.674917 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f1470-b574-4406-a2bf-16c305c4157b None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:40.675213 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f1470-b574-4406-a2bf-16c305c4157b None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:40.675498 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f1470-b574-4406-a2bf-16c305c4157b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:40.692656 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-936f1470-b574-4406-a2bf-16c305c4157b None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:40.693854 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-936f1470-b574-4406-a2bf-16c305c4157b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:40.705655 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:40.715384 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb35ca92-5f90-4823-a40c-3934c01c92e3 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:40.792275 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:40.812909 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 268/545] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:26:40.855375 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f1470-b574-4406-a2bf-16c305c4157b None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:40.908620 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb35ca92-5f90-4823-a40c-3934c01c92e3 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:40.984916 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587cbaa9-7883-4ef3-b1a5-687c5a33a974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:40.985730 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587cbaa9-7883-4ef3-b1a5-687c5a33a974 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:40.986013 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587cbaa9-7883-4ef3-b1a5-687c5a33a974 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:40.986312 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587cbaa9-7883-4ef3-b1a5-687c5a33a974 None admin] PATH_INFO: `/v3/roles/service` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:41.009176 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587cbaa9-7883-4ef3-b1a5-687c5a33a974 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:26:41.030500 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-587cbaa9-7883-4ef3-b1a5-687c5a33a974 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:26:41.030500 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:41.030500 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:41.030500 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:41.030500 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:41.030500 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:41.030500 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:41.030500 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:41.030500 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:41.030500 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:41.030500 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:41.030500 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:41.030500 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:26:41.030500 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:26:41.030500 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:26:41.030500 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:26:41.031365 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:26:41.031365 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:26:41.031365 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:26:41.031365 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:26:41.031365 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:41.031365 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:41.031365 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:41.031365 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:41.031365 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:41.031365 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:41.031365 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:41.031365 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:41.031365 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:41.031365 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:41.031365 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:41.031365 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:41.032090 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:41.032090 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:41.032090 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:41.032090 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:41.032090 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:26:41.032090 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:26:41.032090 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:26:41.032090 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:26:41.032090 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:26:41.032090 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:26:41.032090 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:26:41.032090 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:41.034463 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 278/546] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:26:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:26:41.040718 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587cbaa9-7883-4ef3-b1a5-687c5a33a974 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:41.057364 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f1470-b574-4406-a2bf-16c305c4157b None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:41.127042 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f09e0-e738-41a6-a143-d68ad7fb9e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:41.128331 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f09e0-e738-41a6-a143-d68ad7fb9e17 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:41.130050 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f09e0-e738-41a6-a143-d68ad7fb9e17 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:41.130765 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f09e0-e738-41a6-a143-d68ad7fb9e17 None admin] PATH_INFO: `/v3/roles/service` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:41.144269 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f09e0-e738-41a6-a143-d68ad7fb9e17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:26:41.153602 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-549f09e0-e738-41a6-a143-d68ad7fb9e17 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:26:41.153602 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:41.153602 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:41.153602 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:41.153602 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:41.153602 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:41.153602 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:41.153602 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:41.153602 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:41.153602 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:41.153602 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:41.153602 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:41.153602 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:26:41.153602 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:26:41.153602 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:26:41.153602 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:26:41.154456 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:26:41.154456 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:26:41.154456 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:26:41.154456 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:26:41.154456 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:41.154456 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:41.154456 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:41.154456 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:41.154456 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:41.154456 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:41.154456 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:41.154456 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:41.154456 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:41.154456 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:41.154456 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:41.154456 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:41.155180 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:41.155180 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:41.155180 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:41.155180 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:41.155180 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:26:41.155180 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:26:41.155180 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:26:41.155180 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:26:41.155180 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:26:41.155180 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:26:41.155180 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:26:41.155180 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:41.158001 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 269/547] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:26:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:26:41.166446 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f09e0-e738-41a6-a143-d68ad7fb9e17 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:41.176357 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:41.208330 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587cbaa9-7883-4ef3-b1a5-687c5a33a974 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:41.209887 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:41.275982 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa3567-7693-40f4-bded-c1dae69a33ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:41.276768 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa3567-7693-40f4-bded-c1dae69a33ae None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:41.276872 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa3567-7693-40f4-bded-c1dae69a33ae None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:41.277113 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa3567-7693-40f4-bded-c1dae69a33ae None admin] PATH_INFO: `/v3/roles` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:41.277873 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa3567-7693-40f4-bded-c1dae69a33ae None admin] RBAC: Adding query filter params (name=service) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:41.278216 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa3567-7693-40f4-bded-c1dae69a33ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:41.279622 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa3567-7693-40f4-bded-c1dae69a33ae None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:41.288576 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 279/548] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:26:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:41.291842 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f09e0-e738-41a6-a143-d68ad7fb9e17 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:41.299117 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa3567-7693-40f4-bded-c1dae69a33ae None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:41.368707 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f158e-5c3e-4671-ae65-8dbad28de05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:41.370714 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f158e-5c3e-4671-ae65-8dbad28de05b None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:41.372868 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f158e-5c3e-4671-ae65-8dbad28de05b None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:41.373348 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f158e-5c3e-4671-ae65-8dbad28de05b None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:41.375521 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f158e-5c3e-4671-ae65-8dbad28de05b None admin] RBAC: Adding query filter params (name=service) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:41.376036 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f158e-5c3e-4671-ae65-8dbad28de05b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:41.379129 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f158e-5c3e-4671-ae65-8dbad28de05b None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:41.391205 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 270/549] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:26:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:41.399915 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f158e-5c3e-4671-ae65-8dbad28de05b None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:41.469251 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa3567-7693-40f4-bded-c1dae69a33ae None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:41.505578 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab70e676-b0a0-4fb9-8d07-e25982e11401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:41.506156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab70e676-b0a0-4fb9-8d07-e25982e11401 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:41.506464 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab70e676-b0a0-4fb9-8d07-e25982e11401 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:41.506746 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab70e676-b0a0-4fb9-8d07-e25982e11401 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:41.518530 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab70e676-b0a0-4fb9-8d07-e25982e11401 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:41.520005 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab70e676-b0a0-4fb9-8d07-e25982e11401 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:41.525099 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:41.546937 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-ab70e676-b0a0-4fb9-8d07-e25982e11401 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:41.546937 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:41.546937 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:41.546937 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:41.546937 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:41.546937 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:41.546937 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:41.546937 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:41.546937 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:41.546937 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:41.546937 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:41.546937 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:41.546937 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:26:41.546937 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:26:41.546937 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:26:41.548065 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:26:41.548065 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:41.548065 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:41.548065 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:41.548065 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:41.548065 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:41.548065 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:41.548065 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:41.548065 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:41.548065 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:41.548065 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:41.548065 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:41.548065 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:41.548065 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:41.548065 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:41.548065 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:41.548065 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:41.549599 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:26:41.549599 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:26:41.549599 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:41.549599 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:41.549599 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 280/550] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:26:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:41.553983 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab70e676-b0a0-4fb9-8d07-e25982e11401 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:41.566835 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f158e-5c3e-4671-ae65-8dbad28de05b None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:41.574772 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:41.605641 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b489cd-0491-443f-a87a-8f94bb973811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:41.606832 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b489cd-0491-443f-a87a-8f94bb973811 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:41.607313 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b489cd-0491-443f-a87a-8f94bb973811 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:41.607783 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b489cd-0491-443f-a87a-8f94bb973811 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:41.620421 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b489cd-0491-443f-a87a-8f94bb973811 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:41.622179 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b489cd-0491-443f-a87a-8f94bb973811 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:41.640974 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-96b489cd-0491-443f-a87a-8f94bb973811 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:41.640974 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:41.640974 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:41.640974 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:41.640974 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:41.640974 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:41.640974 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:41.640974 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:41.640974 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:41.640974 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:41.640974 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:41.640974 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:41.640974 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:26:41.640974 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:26:41.640974 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:26:41.641813 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:26:41.641813 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:41.641813 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:41.641813 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:41.641813 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:41.641813 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:41.641813 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:41.641813 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:41.641813 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:41.641813 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:41.641813 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:41.641813 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:41.641813 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:41.641813 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:41.641813 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:41.641813 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:41.641813 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:41.642650 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:26:41.642650 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:26:41.642650 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:41.642650 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:41.645040 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 271/551] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:26:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:41.650842 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b489cd-0491-443f-a87a-8f94bb973811 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:41.664934 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab70e676-b0a0-4fb9-8d07-e25982e11401 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:41.702773 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d94bc-7c42-48df-bb02-854d5733255c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:41.703462 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d94bc-7c42-48df-bb02-854d5733255c None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:41.703754 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d94bc-7c42-48df-bb02-854d5733255c None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:41.704091 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d94bc-7c42-48df-bb02-854d5733255c None admin] PATH_INFO: `/v3/domains` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:41.705092 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919d94bc-7c42-48df-bb02-854d5733255c None admin] RBAC: Adding query filter params (name=Default) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:41.705196 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919d94bc-7c42-48df-bb02-854d5733255c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:41.706938 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919d94bc-7c42-48df-bb02-854d5733255c None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:41.721067 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 281/552] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:26:41.726448 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d94bc-7c42-48df-bb02-854d5733255c None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:41.763763 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b489cd-0491-443f-a87a-8f94bb973811 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:41.785142 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:41.800612 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7e472-f94a-4cab-b63b-b7dc0ec5dfac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:41.801593 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7e472-f94a-4cab-b63b-b7dc0ec5dfac None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:41.802073 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7e472-f94a-4cab-b63b-b7dc0ec5dfac None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:41.802565 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7e472-f94a-4cab-b63b-b7dc0ec5dfac None admin] PATH_INFO: `/v3/domains` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:41.803528 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea7e472-f94a-4cab-b63b-b7dc0ec5dfac None admin] RBAC: Adding query filter params (name=Default) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:41.804049 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea7e472-f94a-4cab-b63b-b7dc0ec5dfac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:41.806198 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea7e472-f94a-4cab-b63b-b7dc0ec5dfac None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:41.817275 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:41.822945 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 272/553] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:41.831543 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7e472-f94a-4cab-b63b-b7dc0ec5dfac None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:41.846151 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d94bc-7c42-48df-bb02-854d5733255c None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:41.879986 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8015937a-27a2-4d06-afb0-a545857f8abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:41.880786 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015937a-27a2-4d06-afb0-a545857f8abe None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:41.881072 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015937a-27a2-4d06-afb0-a545857f8abe None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:41.881350 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015937a-27a2-4d06-afb0-a545857f8abe None admin] PATH_INFO: `/v3/users/swift` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:41.891015 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8015937a-27a2-4d06-afb0-a545857f8abe None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:41.891015 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8015937a-27a2-4d06-afb0-a545857f8abe None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:41.907269 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-8015937a-27a2-4d06-afb0-a545857f8abe None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 21:26:41.907269 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:41.907269 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:41.907269 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:41.907269 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:41.907269 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:41.907269 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:41.907269 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:41.907269 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:41.907269 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:41.907269 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:41.907269 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:41.907269 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:26:41.907269 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:26:41.907269 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:26:41.907269 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:26:41.908136 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:41.908136 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:41.908136 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:26:41.908136 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:26:41.908136 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:26:41.908136 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:26:41.908136 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:41.908136 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:41.908136 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:41.908136 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:41.908136 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:41.908136 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:41.908136 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:41.908136 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:41.908136 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:41.908136 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:41.908136 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:41.908136 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:41.909556 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:41.909556 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:41.909556 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:26:41.909556 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:26:41.909556 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:26:41.909556 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:26:41.909556 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:26:41.909556 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:26:41.909556 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 21:26:41.909556 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:41.909556 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 282/554] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:26:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:41.913820 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8015937a-27a2-4d06-afb0-a545857f8abe None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:42.018556 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7e472-f94a-4cab-b63b-b7dc0ec5dfac None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:42.025368 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8015937a-27a2-4d06-afb0-a545857f8abe None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:42.057624 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000528b8-75fa-4770-83e4-43c2072789ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:42.057800 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000528b8-75fa-4770-83e4-43c2072789ce None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:42.058027 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000528b8-75fa-4770-83e4-43c2072789ce None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:42.058579 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000528b8-75fa-4770-83e4-43c2072789ce None admin] PATH_INFO: `/v3/users/nova` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:42.062444 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4803f583-82ef-4fa7-9dde-a030194dcb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:42.063241 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803f583-82ef-4fa7-9dde-a030194dcb78 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:42.063623 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803f583-82ef-4fa7-9dde-a030194dcb78 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:42.064000 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803f583-82ef-4fa7-9dde-a030194dcb78 None admin] PATH_INFO: `/v3/users` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:42.064938 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4803f583-82ef-4fa7-9dde-a030194dcb78 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:42.065317 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4803f583-82ef-4fa7-9dde-a030194dcb78 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:42.066308 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000528b8-75fa-4770-83e4-43c2072789ce None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:42.066952 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4803f583-82ef-4fa7-9dde-a030194dcb78 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:42.067951 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000528b8-75fa-4770-83e4-43c2072789ce None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:42.070673 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:42.087714 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-000528b8-75fa-4770-83e4-43c2072789ce None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:26:42.087714 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:42.087714 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:42.087714 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:42.087714 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:42.087714 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:42.087714 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:42.087714 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:42.087714 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:42.087714 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:42.087714 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:42.087714 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:42.087714 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:26:42.087714 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:26:42.087714 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:26:42.087714 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:26:42.090855 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:42.090855 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:42.090855 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:26:42.090855 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:26:42.090855 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:26:42.090855 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:26:42.090855 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:42.090855 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:42.090855 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:42.090855 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:42.090855 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:42.090855 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:42.090855 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:42.090855 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:42.090855 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:42.090855 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:42.090855 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:42.090855 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:42.091901 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:42.091901 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:42.091901 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:26:42.091901 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:26:42.091901 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:26:42.091901 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:26:42.091901 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:26:42.091901 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:26:42.091901 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:26:42.091901 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:42.092548 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 283/555] 10.222.0.30 () {56 vars in 1135 bytes} [Tue Jul 5 21:26:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:26:42.092548 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94c424-16c4-4841-969c-a0e32c2442c7 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:42.092548 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94c424-16c4-4841-969c-a0e32c2442c7 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:42.092548 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94c424-16c4-4841-969c-a0e32c2442c7 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:42.094818 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 273/557] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Jul 5 21:26:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:42.095825 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000528b8-75fa-4770-83e4-43c2072789ce None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:42.098352 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 284/557] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:42.099794 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d94c424-16c4-4841-969c-a0e32c2442c7 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:42.148078 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:42.211929 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000528b8-75fa-4770-83e4-43c2072789ce None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:42.231022 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d94c424-16c4-4841-969c-a0e32c2442c7 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:42.248438 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08f8de-5fa5-4242-b363-987701da681b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:42.249100 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08f8de-5fa5-4242-b363-987701da681b None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:42.249632 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08f8de-5fa5-4242-b363-987701da681b None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:42.249921 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08f8de-5fa5-4242-b363-987701da681b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:42.277921 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfebb0-2793-475e-8557-17218bccd180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:42.279146 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfebb0-2793-475e-8557-17218bccd180 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:42.279982 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfebb0-2793-475e-8557-17218bccd180 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:42.280647 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfebb0-2793-475e-8557-17218bccd180 None admin] PATH_INFO: `/v3/users` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:42.281797 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bfebb0-2793-475e-8557-17218bccd180 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:42.282521 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bfebb0-2793-475e-8557-17218bccd180 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:42.284815 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bfebb0-2793-475e-8557-17218bccd180 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:42.309991 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 285/558] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Jul 5 21:26:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:26:42.311637 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4816fab-eb2c-41c1-b16e-e5d2ef83ae95 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:42.312146 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4816fab-eb2c-41c1-b16e-e5d2ef83ae95 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:42.312641 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4816fab-eb2c-41c1-b16e-e5d2ef83ae95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:42.327078 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac08f8de-5fa5-4242-b363-987701da681b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:42.328620 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac08f8de-5fa5-4242-b363-987701da681b None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:42.335452 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-f4816fab-eb2c-41c1-b16e-e5d2ef83ae95 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:42.337977 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-f4816fab-eb2c-41c1-b16e-e5d2ef83ae95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:42.385119 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:42.393245 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:42.418752 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 286/559] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:26:42.422245 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4816fab-eb2c-41c1-b16e-e5d2ef83ae95 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:42.472390 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 274/560] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:26:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:26:42.472390 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08f8de-5fa5-4242-b363-987701da681b None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:42.554774 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4816fab-eb2c-41c1-b16e-e5d2ef83ae95 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:42.603111 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6130407-bdfe-4856-b687-2454c190491d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:42.603913 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6130407-bdfe-4856-b687-2454c190491d None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:42.604216 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6130407-bdfe-4856-b687-2454c190491d None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:42.604490 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6130407-bdfe-4856-b687-2454c190491d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:42.607782 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08f8de-5fa5-4242-b363-987701da681b None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:42.614658 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6130407-bdfe-4856-b687-2454c190491d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:42.616272 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6130407-bdfe-4856-b687-2454c190491d None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:42.635420 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-b6130407-bdfe-4856-b687-2454c190491d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:42.635420 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:42.635420 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:42.635420 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:42.635420 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:42.635420 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:42.635420 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:42.635420 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:42.635420 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:42.635420 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:42.635420 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:42.635420 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:42.635420 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:26:42.635420 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:26:42.635420 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:26:42.636479 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:26:42.636479 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:42.636479 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:42.636479 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:42.636479 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:42.636479 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:42.636479 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:42.636479 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:42.636479 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:42.636479 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:42.636479 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:42.636479 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:42.636479 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:42.636479 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:42.636479 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:42.636479 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:42.636479 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:42.637512 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:26:42.637512 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:26:42.637512 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:42.637512 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:42.637512 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 287/561] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:26:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:42.637832 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6130407-bdfe-4856-b687-2454c190491d None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:42.650721 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb1d75-8879-4e67-8000-c31bb9ce8385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:42.651536 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb1d75-8879-4e67-8000-c31bb9ce8385 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:42.651833 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb1d75-8879-4e67-8000-c31bb9ce8385 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:42.652216 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb1d75-8879-4e67-8000-c31bb9ce8385 None admin] PATH_INFO: `/v3/roles/service` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:42.661278 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:42.665588 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fb1d75-8879-4e67-8000-c31bb9ce8385 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:26:42.672539 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:42.673942 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-d5fb1d75-8879-4e67-8000-c31bb9ce8385 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:26:42.673942 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:42.673942 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:42.673942 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:42.673942 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:42.673942 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:42.673942 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:42.673942 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:42.673942 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:42.673942 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:42.673942 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:42.673942 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:42.673942 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:26:42.673942 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:26:42.673942 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:26:42.673942 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:26:42.674836 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:26:42.674836 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:26:42.674836 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:26:42.674836 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:26:42.674836 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:42.674836 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:42.674836 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:42.674836 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:42.674836 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:42.674836 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:42.674836 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:42.674836 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:42.674836 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:42.674836 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:42.674836 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:42.674836 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:42.675679 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:42.675679 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:42.675679 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:42.675679 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:42.675679 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:26:42.675679 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:26:42.675679 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:26:42.675679 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:26:42.675679 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:26:42.675679 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:26:42.675679 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:26:42.675679 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:42.675679 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 275/562] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:26:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:42.676294 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd3f12-b896-44e9-8511-758dd92e1da3 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:42.676294 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd3f12-b896-44e9-8511-758dd92e1da3 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:42.676928 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd3f12-b896-44e9-8511-758dd92e1da3 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:42.682719 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 276/563] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:42.683956 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd3f12-b896-44e9-8511-758dd92e1da3 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:42.752099 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6130407-bdfe-4856-b687-2454c190491d None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:42.789565 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68981c7-8e63-475b-8532-6679c217183d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:42.790669 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68981c7-8e63-475b-8532-6679c217183d None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:42.790963 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68981c7-8e63-475b-8532-6679c217183d None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:42.791250 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68981c7-8e63-475b-8532-6679c217183d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:42.799477 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd3f12-b896-44e9-8511-758dd92e1da3 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:42.801974 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68981c7-8e63-475b-8532-6679c217183d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:42.803475 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68981c7-8e63-475b-8532-6679c217183d None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:42.823723 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-c68981c7-8e63-475b-8532-6679c217183d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:42.823723 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:42.823723 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:42.823723 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:42.823723 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:42.823723 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:42.823723 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:42.823723 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:42.823723 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:42.823723 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:42.823723 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:42.823723 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:42.823723 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:26:42.823723 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:26:42.823723 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:26:42.824547 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:26:42.824547 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:42.824547 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:42.824547 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:42.824547 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:42.824547 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:42.824547 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:42.824547 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:42.824547 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:42.824547 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:42.824547 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:42.824547 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:42.824547 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:42.824547 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:42.824547 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:42.824547 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:42.824547 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:42.826001 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:26:42.826001 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:26:42.826001 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:42.826001 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:42.826001 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 288/564] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:26:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:42.826001 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68981c7-8e63-475b-8532-6679c217183d None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:42.844441 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d15143-7669-434b-b8b8-6eddc7c97b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:42.845399 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d15143-7669-434b-b8b8-6eddc7c97b45 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:42.845696 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d15143-7669-434b-b8b8-6eddc7c97b45 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:42.845987 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d15143-7669-434b-b8b8-6eddc7c97b45 None admin] PATH_INFO: `/v3/domains` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:42.846893 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d15143-7669-434b-b8b8-6eddc7c97b45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:42.847513 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d15143-7669-434b-b8b8-6eddc7c97b45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:42.848929 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d15143-7669-434b-b8b8-6eddc7c97b45 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:42.869814 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 277/565] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:42.869814 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0409151-cb92-4e19-a428-fbfd2d4aaf2e None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:42.869814 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0409151-cb92-4e19-a428-fbfd2d4aaf2e None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:42.869814 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0409151-cb92-4e19-a428-fbfd2d4aaf2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:42.889826 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-b0409151-cb92-4e19-a428-fbfd2d4aaf2e None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:42.891077 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-b0409151-cb92-4e19-a428-fbfd2d4aaf2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:42.918161 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:42.934101 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68981c7-8e63-475b-8532-6679c217183d None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:42.948601 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:42.960380 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 278/566] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:26:42.961250 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0409151-cb92-4e19-a428-fbfd2d4aaf2e None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:42.978551 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11e1217-4918-4d73-b753-5708bd70a13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:42.979216 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e1217-4918-4d73-b753-5708bd70a13f None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:42.979576 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e1217-4918-4d73-b753-5708bd70a13f None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:42.979838 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e1217-4918-4d73-b753-5708bd70a13f None admin] PATH_INFO: `/v3/roles` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:42.980528 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11e1217-4918-4d73-b753-5708bd70a13f None admin] RBAC: Adding query filter params (name=service) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:42.980836 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11e1217-4918-4d73-b753-5708bd70a13f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:42.982273 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11e1217-4918-4d73-b753-5708bd70a13f None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:42.995972 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 289/567] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:26:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:42.995972 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11e1217-4918-4d73-b753-5708bd70a13f None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:43.063474 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0409151-cb92-4e19-a428-fbfd2d4aaf2e None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:43.094331 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11e1217-4918-4d73-b753-5708bd70a13f None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:43.096802 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc190e-6d62-4867-8b4c-b852dc3f6df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:43.097475 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc190e-6d62-4867-8b4c-b852dc3f6df7 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:43.097767 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc190e-6d62-4867-8b4c-b852dc3f6df7 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:43.098052 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc190e-6d62-4867-8b4c-b852dc3f6df7 None admin] PATH_INFO: `/v3/domains` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:43.098811 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc190e-6d62-4867-8b4c-b852dc3f6df7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:43.099133 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc190e-6d62-4867-8b4c-b852dc3f6df7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:43.100526 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc190e-6d62-4867-8b4c-b852dc3f6df7 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:43.112148 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 279/568] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:43.113501 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4e1ef-2415-4055-b6c6-5be407677f8c None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:43.113893 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4e1ef-2415-4055-b6c6-5be407677f8c None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:43.114320 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4e1ef-2415-4055-b6c6-5be407677f8c None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:43.115619 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 280/569] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:43.118175 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4e1ef-2415-4055-b6c6-5be407677f8c None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:43.131864 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e7d3c-5341-4fff-b7d5-12c16c2c09f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:43.132664 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e7d3c-5341-4fff-b7d5-12c16c2c09f9 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:43.132958 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e7d3c-5341-4fff-b7d5-12c16c2c09f9 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:43.133269 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e7d3c-5341-4fff-b7d5-12c16c2c09f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:43.140561 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1e7d3c-5341-4fff-b7d5-12c16c2c09f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:43.142019 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1e7d3c-5341-4fff-b7d5-12c16c2c09f9 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:43.156221 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-ae1e7d3c-5341-4fff-b7d5-12c16c2c09f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:26:43.156221 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:43.156221 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:43.156221 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:43.156221 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:43.156221 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:43.156221 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:43.156221 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:43.156221 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:43.156221 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:43.156221 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:43.156221 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:43.156221 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:26:43.156221 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:26:43.156221 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:26:43.157166 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:26:43.157166 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:43.157166 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:43.157166 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:43.157166 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:43.157166 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:43.157166 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:43.157166 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:43.157166 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:43.157166 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:43.157166 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:43.157166 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:43.157166 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:43.157166 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:43.157166 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:43.157166 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:43.157166 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:43.158082 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:26:43.158082 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:26:43.158082 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:26:43.158082 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:26:43.158082 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:26:43.158082 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:26:43.158082 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:26:43.158082 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:43.158082 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 290/570] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:26:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:43.158638 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e7d3c-5341-4fff-b7d5-12c16c2c09f9 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:43.169263 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:43.172294 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:43.223919 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4e1ef-2415-4055-b6c6-5be407677f8c None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:43.257666 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c4021-a561-42e6-9dfc-551a4911fa02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:43.258525 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c4021-a561-42e6-9dfc-551a4911fa02 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:43.258813 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c4021-a561-42e6-9dfc-551a4911fa02 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:43.259088 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c4021-a561-42e6-9dfc-551a4911fa02 None admin] PATH_INFO: `/v3/roles/service` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:43.259299 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e7d3c-5341-4fff-b7d5-12c16c2c09f9 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:43.269333 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c4021-a561-42e6-9dfc-551a4911fa02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:26:43.277134 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-0d8c4021-a561-42e6-9dfc-551a4911fa02 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:26:43.277134 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:43.277134 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:43.277134 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:43.277134 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:43.277134 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:43.277134 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:43.277134 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:43.277134 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:43.277134 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:43.277134 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:43.277134 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:43.277134 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:26:43.277134 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:26:43.277134 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:26:43.277134 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:26:43.278908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:26:43.278908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:26:43.278908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:26:43.278908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:26:43.278908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:43.278908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:43.278908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:43.278908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:43.278908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:43.278908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:43.278908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:43.278908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:43.278908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:43.278908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:43.278908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:43.278908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:43.279653 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:43.279653 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:43.279653 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:43.279653 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:43.279653 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:26:43.279653 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:26:43.279653 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:26:43.279653 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:26:43.279653 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:26:43.279653 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:26:43.279653 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:26:43.279653 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:43.283413 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 281/571] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:26:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:43.284127 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c4021-a561-42e6-9dfc-551a4911fa02 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:43.295162 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d3878e-77c2-446c-9a46-e284769410fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:43.295960 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3878e-77c2-446c-9a46-e284769410fb None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:43.296250 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3878e-77c2-446c-9a46-e284769410fb None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:43.296533 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3878e-77c2-446c-9a46-e284769410fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:43.307624 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d3878e-77c2-446c-9a46-e284769410fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:43.309113 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d3878e-77c2-446c-9a46-e284769410fb None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:43.326711 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-45d3878e-77c2-446c-9a46-e284769410fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:43.326711 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:43.326711 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:43.326711 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:43.326711 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:43.326711 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:43.326711 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:43.326711 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:43.326711 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:43.326711 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:43.326711 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:43.326711 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:43.326711 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:26:43.326711 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:26:43.326711 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:26:43.327541 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:26:43.327541 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:43.327541 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:43.327541 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:43.327541 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:43.327541 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:43.327541 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:43.327541 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:43.327541 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:43.327541 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:43.327541 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:43.327541 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:43.327541 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:43.327541 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:43.327541 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:43.327541 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:43.327541 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:43.328336 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:26:43.328336 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:26:43.328336 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:43.328336 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:43.328336 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 291/572] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:26:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:43.329067 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edea8d-32c3-41e6-b8d0-e9c83768a8b4 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:43.329357 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edea8d-32c3-41e6-b8d0-e9c83768a8b4 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:43.329642 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edea8d-32c3-41e6-b8d0-e9c83768a8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:43.347009 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-b8edea8d-32c3-41e6-b8d0-e9c83768a8b4 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:43.348149 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-b8edea8d-32c3-41e6-b8d0-e9c83768a8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:43.389830 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c4021-a561-42e6-9dfc-551a4911fa02 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:43.400666 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:43.405695 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:43.417725 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 292/573] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:26:43.419057 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8edea8d-32c3-41e6-b8d0-e9c83768a8b4 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:43.423967 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c0a81-840a-415b-a29a-35b46475f6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:43.424759 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c0a81-840a-415b-a29a-35b46475f6ca None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:43.425048 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c0a81-840a-415b-a29a-35b46475f6ca None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:43.425328 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c0a81-840a-415b-a29a-35b46475f6ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:43.432041 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c0a81-840a-415b-a29a-35b46475f6ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:43.433494 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c0a81-840a-415b-a29a-35b46475f6ca None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:43.448379 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-033c0a81-840a-415b-a29a-35b46475f6ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:26:43.448379 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:43.448379 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:43.448379 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:43.448379 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:43.448379 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:43.448379 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:43.448379 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:43.448379 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:43.448379 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:43.448379 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:43.448379 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:43.448379 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:26:43.448379 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:26:43.448379 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:26:43.449258 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:26:43.449258 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:43.449258 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:43.449258 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:43.449258 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:43.449258 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:43.449258 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:43.449258 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:43.449258 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:43.449258 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:43.449258 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:43.449258 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:43.449258 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:43.449258 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:43.449258 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:43.449258 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:43.449258 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:43.450047 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:26:43.450047 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:26:43.450047 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:26:43.450047 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:26:43.450047 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:26:43.450047 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:26:43.450047 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:26:43.450047 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:43.450047 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 282/574] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:26:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:43.450598 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c0a81-840a-415b-a29a-35b46475f6ca None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:43.531747 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8edea8d-32c3-41e6-b8d0-e9c83768a8b4 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:43.552801 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c0a81-840a-415b-a29a-35b46475f6ca None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:43.567578 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95220c66-56af-4886-b8da-ae0c51729a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:43.568251 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95220c66-56af-4886-b8da-ae0c51729a4b None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:43.568540 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95220c66-56af-4886-b8da-ae0c51729a4b None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:43.568823 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95220c66-56af-4886-b8da-ae0c51729a4b None admin] PATH_INFO: `/v3/projects` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:43.569615 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95220c66-56af-4886-b8da-ae0c51729a4b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:43.569933 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95220c66-56af-4886-b8da-ae0c51729a4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:43.571730 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95220c66-56af-4886-b8da-ae0c51729a4b None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:43.583859 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 293/575] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:26:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:43.584482 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95220c66-56af-4886-b8da-ae0c51729a4b None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:43.594736 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ec0d0-1a2b-4ae9-a76a-619ecdf3dbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:43.595416 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ec0d0-1a2b-4ae9-a76a-619ecdf3dbe6 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:43.595704 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ec0d0-1a2b-4ae9-a76a-619ecdf3dbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:43.595987 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ec0d0-1a2b-4ae9-a76a-619ecdf3dbe6 None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:43.596732 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82ec0d0-1a2b-4ae9-a76a-619ecdf3dbe6 None admin] RBAC: Adding query filter params (name=service) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:43.597089 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82ec0d0-1a2b-4ae9-a76a-619ecdf3dbe6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:43.598436 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82ec0d0-1a2b-4ae9-a76a-619ecdf3dbe6 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:43.606545 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 283/576] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:26:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:43.607337 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ec0d0-1a2b-4ae9-a76a-619ecdf3dbe6 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:43.639801 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:43.640156 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:43.691352 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95220c66-56af-4886-b8da-ae0c51729a4b None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:43.709125 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ec0d0-1a2b-4ae9-a76a-619ecdf3dbe6 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:43.729843 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdef36f-1d45-4665-9153-07bc8d55f2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:43.730549 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdef36f-1d45-4665-9153-07bc8d55f2bf None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:43.730839 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdef36f-1d45-4665-9153-07bc8d55f2bf None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:43.731118 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdef36f-1d45-4665-9153-07bc8d55f2bf None admin] PATH_INFO: `/v3/domains` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:43.731839 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdef36f-1d45-4665-9153-07bc8d55f2bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:43.732148 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdef36f-1d45-4665-9153-07bc8d55f2bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:43.733542 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdef36f-1d45-4665-9153-07bc8d55f2bf None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:43.744397 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5cfff3-31c8-459e-a179-a077b998a89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:43.745198 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cfff3-31c8-459e-a179-a077b998a89b None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:43.745491 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cfff3-31c8-459e-a179-a077b998a89b None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:43.745778 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cfff3-31c8-459e-a179-a077b998a89b None admin] PATH_INFO: `/v3/roles/service` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:43.745903 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 294/577] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:43.746998 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdef36f-1d45-4665-9153-07bc8d55f2bf None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:43.756627 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5cfff3-31c8-459e-a179-a077b998a89b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:26:43.764764 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-dc5cfff3-31c8-459e-a179-a077b998a89b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:26:43.764764 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:43.764764 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:43.764764 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:43.764764 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:43.764764 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:43.764764 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:43.764764 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:43.764764 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:43.764764 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:43.764764 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:43.764764 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:43.764764 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:26:43.764764 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:26:43.764764 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:26:43.764764 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:26:43.765776 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:26:43.765776 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:26:43.765776 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:26:43.765776 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:26:43.765776 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:43.765776 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:43.765776 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:43.765776 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:43.765776 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:43.765776 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:43.765776 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:43.765776 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:43.765776 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:43.765776 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:43.765776 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:43.765776 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:43.766744 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:43.766744 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:43.766744 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:43.766744 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:43.766744 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:26:43.766744 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:26:43.766744 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:26:43.766744 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:26:43.766744 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:26:43.766744 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:26:43.766744 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:26:43.766744 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:43.766744 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 284/578] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:26:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:43.767490 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5cfff3-31c8-459e-a179-a077b998a89b None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:43.850737 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdef36f-1d45-4665-9153-07bc8d55f2bf None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:43.859084 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:43.861596 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:43.869341 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5cfff3-31c8-459e-a179-a077b998a89b None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:43.884580 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c584175-f147-4e25-9aba-afa8fe29d63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:43.885231 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c584175-f147-4e25-9aba-afa8fe29d63a None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:43.885519 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c584175-f147-4e25-9aba-afa8fe29d63a None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:43.885796 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c584175-f147-4e25-9aba-afa8fe29d63a None admin] PATH_INFO: `/v3/projects` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:43.886607 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c584175-f147-4e25-9aba-afa8fe29d63a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:43.886918 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c584175-f147-4e25-9aba-afa8fe29d63a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:43.888348 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c584175-f147-4e25-9aba-afa8fe29d63a None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:43.899539 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 295/579] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:26:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:43.900324 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c584175-f147-4e25-9aba-afa8fe29d63a None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:43.903840 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d575127c-c416-48a8-9f07-5797aee325b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:43.904742 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575127c-c416-48a8-9f07-5797aee325b0 None admin] REQUEST_METHOD: `PUT` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:43.905036 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575127c-c416-48a8-9f07-5797aee325b0 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:43.905322 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575127c-c416-48a8-9f07-5797aee325b0 None admin] PATH_INFO: `/v3/projects/7fe768315f5c43f487f71f043f11b8b8/users/941ed10dfafc4bd48896843da26c9175/roles/1cb72e4884a744f99a3df0dc628f7493` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:43.921260 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d575127c-c416-48a8-9f07-5797aee325b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=7fe768315f5c43f487f71f043f11b8b8, user_id=941ed10dfafc4bd48896843da26c9175, role_id=1cb72e4884a744f99a3df0dc628f7493)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:43.922787 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d575127c-c416-48a8-9f07-5797aee325b0 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:44.001014 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 285/580] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:26:43 2022] PUT /identity/v3/projects/7fe768315f5c43f487f71f043f11b8b8/users/941ed10dfafc4bd48896843da26c9175/roles/1cb72e4884a744f99a3df0dc628f7493 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:26:44.001748 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c584175-f147-4e25-9aba-afa8fe29d63a None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:44.002019 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d575127c-c416-48a8-9f07-5797aee325b0 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:44.048453 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b91766a-9f75-46b0-8f0e-ddc120f51cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:44.049273 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91766a-9f75-46b0-8f0e-ddc120f51cff None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:44.049557 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91766a-9f75-46b0-8f0e-ddc120f51cff None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:44.049836 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91766a-9f75-46b0-8f0e-ddc120f51cff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:44.062599 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b91766a-9f75-46b0-8f0e-ddc120f51cff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:44.064086 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b91766a-9f75-46b0-8f0e-ddc120f51cff None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:44.086914 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-8b91766a-9f75-46b0-8f0e-ddc120f51cff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:44.086914 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:44.086914 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:44.086914 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:44.086914 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:44.086914 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:44.086914 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:44.086914 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:44.086914 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:44.086914 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:44.086914 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:44.086914 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:44.086914 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:26:44.086914 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:26:44.086914 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:26:44.087801 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:26:44.087801 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:44.087801 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:44.087801 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:44.087801 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:44.087801 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:44.087801 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:44.087801 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:44.087801 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:44.087801 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:44.087801 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:44.087801 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:44.087801 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:44.087801 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:44.087801 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:44.087801 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:44.087801 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:44.088644 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:26:44.088644 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:26:44.088644 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:44.088644 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:44.092946 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 296/581] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:26:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:44.093916 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b91766a-9f75-46b0-8f0e-ddc120f51cff None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:44.120336 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d575127c-c416-48a8-9f07-5797aee325b0 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:44.122652 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:44.161528 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde160c0-aa59-4b5e-9321-a863f38286fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:44.162373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde160c0-aa59-4b5e-9321-a863f38286fd None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:44.162660 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde160c0-aa59-4b5e-9321-a863f38286fd None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:44.162940 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde160c0-aa59-4b5e-9321-a863f38286fd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:44.173633 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde160c0-aa59-4b5e-9321-a863f38286fd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:44.175136 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde160c0-aa59-4b5e-9321-a863f38286fd None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:44.189996 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-fde160c0-aa59-4b5e-9321-a863f38286fd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 21:26:44.189996 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:44.189996 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:44.189996 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:44.189996 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:44.189996 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:44.189996 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:44.189996 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:44.189996 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:44.189996 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:44.189996 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:44.189996 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:44.189996 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:26:44.189996 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:26:44.189996 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:26:44.189996 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:26:44.191139 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:44.191139 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:44.191139 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:26:44.191139 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:26:44.191139 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:26:44.191139 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:26:44.191139 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:44.191139 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:44.191139 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:44.191139 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:44.191139 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:44.191139 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:44.191139 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:44.191139 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:44.191139 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:44.191139 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:44.191139 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:44.191139 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:44.192041 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:44.192041 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:44.192041 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:26:44.192041 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:26:44.192041 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:26:44.192041 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:26:44.192041 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:26:44.192041 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:26:44.192041 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 21:26:44.192041 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:44.192041 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 286/582] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:26:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:44.192567 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde160c0-aa59-4b5e-9321-a863f38286fd None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:44.206875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:44.209866 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b91766a-9f75-46b0-8f0e-ddc120f51cff None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:44.246624 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c56165c-d141-4b96-b387-0d428b7e061e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:44.247301 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56165c-d141-4b96-b387-0d428b7e061e None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:44.247592 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56165c-d141-4b96-b387-0d428b7e061e None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:44.247875 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56165c-d141-4b96-b387-0d428b7e061e None admin] PATH_INFO: `/v3/roles` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:44.248672 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c56165c-d141-4b96-b387-0d428b7e061e None admin] RBAC: Adding query filter params (name=service) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:44.248989 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c56165c-d141-4b96-b387-0d428b7e061e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:44.250398 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c56165c-d141-4b96-b387-0d428b7e061e None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:44.259182 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 297/583] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:26:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:44.260026 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c56165c-d141-4b96-b387-0d428b7e061e None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:44.302937 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde160c0-aa59-4b5e-9321-a863f38286fd None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:44.374748 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285a93c3-5b7d-4ab2-bfc6-1c765bf3d96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:44.375833 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a93c3-5b7d-4ab2-bfc6-1c765bf3d96c None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:44.376296 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a93c3-5b7d-4ab2-bfc6-1c765bf3d96c None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:44.376747 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a93c3-5b7d-4ab2-bfc6-1c765bf3d96c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:44.377755 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285a93c3-5b7d-4ab2-bfc6-1c765bf3d96c None admin] RBAC: Adding query filter params (role.id=1cb72e4884a744f99a3df0dc628f7493, scope.project.id=7fe768315f5c43f487f71f043f11b8b8, user.id=f659395837ac4e6dbc17ed925f81f672) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:44.378264 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285a93c3-5b7d-4ab2-bfc6-1c765bf3d96c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:44.379891 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285a93c3-5b7d-4ab2-bfc6-1c765bf3d96c None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:44.386178 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 287/584] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:26:44 2022] GET /identity/v3/role_assignments?user.id=f659395837ac4e6dbc17ed925f81f672&scope.project.id=7fe768315f5c43f487f71f043f11b8b8&role.id=1cb72e4884a744f99a3df0dc628f7493 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:44.387164 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285a93c3-5b7d-4ab2-bfc6-1c765bf3d96c None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:44.401612 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:44.424187 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c56165c-d141-4b96-b387-0d428b7e061e None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:44.474280 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:44.475177 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74079079-f98f-4727-89b8-758598708f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:44.476322 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74079079-f98f-4727-89b8-758598708f58 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:44.476681 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74079079-f98f-4727-89b8-758598708f58 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:44.477558 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74079079-f98f-4727-89b8-758598708f58 None admin] PATH_INFO: `/v3/domains` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:44.478413 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74079079-f98f-4727-89b8-758598708f58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:44.478790 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74079079-f98f-4727-89b8-758598708f58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:44.480306 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74079079-f98f-4727-89b8-758598708f58 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:44.495149 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 298/585] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:44.496142 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74079079-f98f-4727-89b8-758598708f58 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:44.527658 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285a93c3-5b7d-4ab2-bfc6-1c765bf3d96c None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:44.586154 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd855efa-a4f3-4e35-be9d-3e427dd2dc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:44.586154 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd855efa-a4f3-4e35-be9d-3e427dd2dc64 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:44.586154 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd855efa-a4f3-4e35-be9d-3e427dd2dc64 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:44.586154 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd855efa-a4f3-4e35-be9d-3e427dd2dc64 None admin] PATH_INFO: `/v3/users` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:44.586677 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd855efa-a4f3-4e35-be9d-3e427dd2dc64 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:44.586677 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd855efa-a4f3-4e35-be9d-3e427dd2dc64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:44.586677 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd855efa-a4f3-4e35-be9d-3e427dd2dc64 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:44.608312 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 288/586] 10.222.0.30 () {56 vars in 1137 bytes} [Tue Jul 5 21:26:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:44.609499 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd855efa-a4f3-4e35-be9d-3e427dd2dc64 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:44.614909 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74079079-f98f-4727-89b8-758598708f58 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:44.654377 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf349e28-c379-482d-870e-2151a9699f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:44.655104 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf349e28-c379-482d-870e-2151a9699f84 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:44.655393 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf349e28-c379-482d-870e-2151a9699f84 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:44.655671 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf349e28-c379-482d-870e-2151a9699f84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:44.669592 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf349e28-c379-482d-870e-2151a9699f84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:44.671806 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf349e28-c379-482d-870e-2151a9699f84 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:44.675923 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:44.699006 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-bf349e28-c379-482d-870e-2151a9699f84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:44.699006 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:44.699006 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:44.699006 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:44.699006 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:44.699006 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:44.699006 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:44.699006 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:44.699006 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:44.699006 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:44.699006 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:44.699006 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:44.699006 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:26:44.699006 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:26:44.699006 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:26:44.699866 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:26:44.699866 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:44.699866 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:44.699866 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:44.699866 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:44.699866 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:44.699866 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:44.699866 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:44.699866 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:44.699866 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:44.699866 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:44.699866 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:44.699866 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:44.699866 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:44.699866 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:44.699866 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:44.699866 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:44.700656 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:26:44.700656 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:26:44.700656 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:44.700656 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:44.700656 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 299/587] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:26:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:44.702179 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf349e28-c379-482d-870e-2151a9699f84 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:44.738242 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd855efa-a4f3-4e35-be9d-3e427dd2dc64 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:44.767362 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:44.781478 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17439cc5-9a5c-4cfb-9c80-fd065ebdf527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:44.783324 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17439cc5-9a5c-4cfb-9c80-fd065ebdf527 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:44.783324 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17439cc5-9a5c-4cfb-9c80-fd065ebdf527 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:44.783640 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17439cc5-9a5c-4cfb-9c80-fd065ebdf527 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:44.792284 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17439cc5-9a5c-4cfb-9c80-fd065ebdf527 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:44.794007 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17439cc5-9a5c-4cfb-9c80-fd065ebdf527 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:44.811320 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-17439cc5-9a5c-4cfb-9c80-fd065ebdf527 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 21:26:44.811320 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:44.811320 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:44.811320 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:44.811320 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:44.811320 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:44.811320 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:44.811320 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:44.811320 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:44.811320 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:44.811320 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:44.811320 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:44.811320 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:26:44.811320 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:26:44.811320 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:26:44.811320 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:26:44.812196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:44.812196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:44.812196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:26:44.812196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:26:44.812196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:26:44.812196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:26:44.812196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:44.812196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:44.812196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:44.812196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:44.812196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:44.812196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:44.812196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:44.812196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:44.812196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:44.812196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:44.812196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:44.812196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:44.813052 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:44.813052 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:44.813052 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:26:44.813052 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:26:44.813052 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:26:44.813052 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:26:44.813052 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:26:44.813052 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:26:44.813052 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 21:26:44.813052 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:44.815770 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 289/588] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:26:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:44.817048 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17439cc5-9a5c-4cfb-9c80-fd065ebdf527 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:44.823650 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf349e28-c379-482d-870e-2151a9699f84 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:44.860154 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4dfb29-9f79-4431-9138-4cfd95bbd0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:44.860951 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4dfb29-9f79-4431-9138-4cfd95bbd0ac None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:44.861237 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4dfb29-9f79-4431-9138-4cfd95bbd0ac None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:44.861517 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4dfb29-9f79-4431-9138-4cfd95bbd0ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:44.873074 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4dfb29-9f79-4431-9138-4cfd95bbd0ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:44.874568 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4dfb29-9f79-4431-9138-4cfd95bbd0ac None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:44.893208 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-cd4dfb29-9f79-4431-9138-4cfd95bbd0ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:44.893208 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:44.893208 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:44.893208 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:44.893208 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:44.893208 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:44.893208 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:44.893208 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:44.893208 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:44.893208 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:44.893208 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:44.893208 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:44.893208 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:26:44.893208 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:26:44.893208 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:26:44.894069 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:26:44.894069 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:44.894069 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:44.894069 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:44.894069 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:44.894069 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:44.894069 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:44.894069 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:44.894069 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:44.894069 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:44.894069 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:44.894069 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:44.894069 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:44.894069 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:44.894069 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:44.894069 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:44.894069 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:44.894905 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:26:44.894905 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:26:44.894905 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:44.894905 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:44.899368 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 300/589] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:26:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:44.900550 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4dfb29-9f79-4431-9138-4cfd95bbd0ac None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:44.933599 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17439cc5-9a5c-4cfb-9c80-fd065ebdf527 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:44.951114 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:44.973018 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb4057-ea93-4bf5-8c30-dcdca0db37e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:44.985844 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb4057-ea93-4bf5-8c30-dcdca0db37e9 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:44.985844 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb4057-ea93-4bf5-8c30-dcdca0db37e9 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:44.985844 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb4057-ea93-4bf5-8c30-dcdca0db37e9 None admin] PATH_INFO: `/v3/domains` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:44.985844 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfb4057-ea93-4bf5-8c30-dcdca0db37e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:44.985844 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfb4057-ea93-4bf5-8c30-dcdca0db37e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:44.985844 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfb4057-ea93-4bf5-8c30-dcdca0db37e9 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:44.994066 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 290/590] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:44.995051 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb4057-ea93-4bf5-8c30-dcdca0db37e9 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:45.004723 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4dfb29-9f79-4431-9138-4cfd95bbd0ac None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:45.043342 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def2d13-a4cd-4e16-9c02-38f48efbcf6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:45.043998 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def2d13-a4cd-4e16-9c02-38f48efbcf6d None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:45.044290 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def2d13-a4cd-4e16-9c02-38f48efbcf6d None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:45.044566 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def2d13-a4cd-4e16-9c02-38f48efbcf6d None admin] PATH_INFO: `/v3/users` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:45.045403 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def2d13-a4cd-4e16-9c02-38f48efbcf6d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:45.045710 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def2d13-a4cd-4e16-9c02-38f48efbcf6d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:45.047320 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def2d13-a4cd-4e16-9c02-38f48efbcf6d None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:45.049489 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:45.066173 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 301/591] 10.222.0.30 () {56 vars in 1139 bytes} [Tue Jul 5 21:26:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:45.067011 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def2d13-a4cd-4e16-9c02-38f48efbcf6d None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:45.110829 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb4057-ea93-4bf5-8c30-dcdca0db37e9 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:45.148220 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd9284c-e10a-4ed4-8a95-deef514a0980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:45.149543 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9284c-e10a-4ed4-8a95-deef514a0980 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:45.149836 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9284c-e10a-4ed4-8a95-deef514a0980 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:45.150115 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9284c-e10a-4ed4-8a95-deef514a0980 None admin] PATH_INFO: `/v3/domains` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:45.150906 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd9284c-e10a-4ed4-8a95-deef514a0980 None admin] RBAC: Adding query filter params (name=Default) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:45.151218 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd9284c-e10a-4ed4-8a95-deef514a0980 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:45.152782 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd9284c-e10a-4ed4-8a95-deef514a0980 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:45.167451 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 291/592] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:45.168462 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd9284c-e10a-4ed4-8a95-deef514a0980 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:45.178237 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def2d13-a4cd-4e16-9c02-38f48efbcf6d None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:45.186652 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:45.215156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3c807-21cf-4013-b423-4277ff1f3062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:45.216087 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3c807-21cf-4013-b423-4277ff1f3062 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:45.216483 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3c807-21cf-4013-b423-4277ff1f3062 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:45.216872 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3c807-21cf-4013-b423-4277ff1f3062 None admin] PATH_INFO: `/v3/users/glance` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:45.224634 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3c807-21cf-4013-b423-4277ff1f3062 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:45.226341 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3c807-21cf-4013-b423-4277ff1f3062 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:45.241879 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-1aa3c807-21cf-4013-b423-4277ff1f3062 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 05 21:26:45.241879 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:45.241879 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:45.241879 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:45.241879 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:45.241879 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:45.241879 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:45.241879 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:45.241879 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:45.241879 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:45.241879 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:45.241879 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:45.241879 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:26:45.241879 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:26:45.241879 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:26:45.241879 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:26:45.243097 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:45.243097 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:45.243097 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:26:45.243097 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:26:45.243097 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:26:45.243097 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:26:45.243097 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:45.243097 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:45.243097 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:45.243097 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:45.243097 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:45.243097 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:45.243097 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:45.243097 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:45.243097 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:45.243097 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:45.243097 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:45.243097 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:45.244171 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:45.244171 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:45.244171 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:26:45.244171 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:26:45.244171 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:26:45.244171 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:26:45.244171 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:26:45.244171 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:26:45.244171 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 05 21:26:45.244171 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:45.245369 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 302/593] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:26:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:45.249343 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3c807-21cf-4013-b423-4277ff1f3062 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:45.286820 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd9284c-e10a-4ed4-8a95-deef514a0980 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:45.289858 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:45.324709 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5cd30-46ec-4b86-ab24-451836320511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:45.325506 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5cd30-46ec-4b86-ab24-451836320511 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:45.325899 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5cd30-46ec-4b86-ab24-451836320511 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:45.326224 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5cd30-46ec-4b86-ab24-451836320511 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:45.337532 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e5cd30-46ec-4b86-ab24-451836320511 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:45.339008 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e5cd30-46ec-4b86-ab24-451836320511 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:45.352442 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3c807-21cf-4013-b423-4277ff1f3062 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:45.359223 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-97e5cd30-46ec-4b86-ab24-451836320511 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:45.359223 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:45.359223 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:45.359223 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:45.359223 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:45.359223 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:45.359223 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:45.359223 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:45.359223 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:45.359223 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:45.359223 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:45.359223 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:45.359223 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:26:45.359223 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:26:45.359223 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:26:45.361539 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:26:45.361539 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:45.361539 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:45.361539 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:45.361539 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:45.361539 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:45.361539 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:45.361539 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:45.361539 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:45.361539 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:45.361539 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:45.361539 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:45.361539 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:45.361539 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:45.361539 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:45.361539 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:45.361539 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:45.363597 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:26:45.363597 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:26:45.363597 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:45.363597 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:45.363597 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 292/594] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:26:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:45.363597 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5cd30-46ec-4b86-ab24-451836320511 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:45.389172 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5179f-9e55-4b9f-bf4b-376010233b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:45.390021 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5179f-9e55-4b9f-bf4b-376010233b89 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:45.390329 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5179f-9e55-4b9f-bf4b-376010233b89 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:45.390607 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5179f-9e55-4b9f-bf4b-376010233b89 None admin] PATH_INFO: `/v3/projects/service` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:45.397479 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce5179f-9e55-4b9f-bf4b-376010233b89 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:45.399619 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce5179f-9e55-4b9f-bf4b-376010233b89 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:45.413984 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-3ce5179f-9e55-4b9f-bf4b-376010233b89 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:26:45.413984 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:45.413984 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:45.413984 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:45.413984 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:45.413984 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:45.413984 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:45.413984 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:45.413984 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:45.413984 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:45.413984 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:45.413984 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:45.413984 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:26:45.413984 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:26:45.413984 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:26:45.416067 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:26:45.416067 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:45.416067 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:45.416067 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:45.416067 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:45.416067 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:45.416067 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:45.416067 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:45.416067 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:45.416067 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:45.416067 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:45.416067 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:45.416067 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:45.416067 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:45.416067 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:45.416067 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:45.416067 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:45.418151 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:26:45.418151 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:26:45.418151 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:26:45.418151 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:26:45.418151 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:26:45.418151 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:26:45.418151 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:26:45.418151 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:45.426150 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 303/595] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:26:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:45.426150 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5179f-9e55-4b9f-bf4b-376010233b89 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:45.449007 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:45.471398 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5cd30-46ec-4b86-ab24-451836320511 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:45.510494 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c24a7-16bb-4694-aa53-44ec94d0a4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:45.511210 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c24a7-16bb-4694-aa53-44ec94d0a4fe None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:45.511456 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c24a7-16bb-4694-aa53-44ec94d0a4fe None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:45.511738 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c24a7-16bb-4694-aa53-44ec94d0a4fe None admin] PATH_INFO: `/v3/users` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:45.512587 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c24a7-16bb-4694-aa53-44ec94d0a4fe None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:45.512899 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c24a7-16bb-4694-aa53-44ec94d0a4fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:45.514496 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c24a7-16bb-4694-aa53-44ec94d0a4fe None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:45.526420 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5179f-9e55-4b9f-bf4b-376010233b89 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:45.538489 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 293/596] 10.222.0.30 () {56 vars in 1137 bytes} [Tue Jul 5 21:26:45 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:45.539928 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c24a7-16bb-4694-aa53-44ec94d0a4fe None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:45.565672 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:45.565938 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b7660-2b74-46e8-914b-48ffdd0cff32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:45.565938 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b7660-2b74-46e8-914b-48ffdd0cff32 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:45.565938 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b7660-2b74-46e8-914b-48ffdd0cff32 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:45.565938 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b7660-2b74-46e8-914b-48ffdd0cff32 None admin] PATH_INFO: `/v3/domains` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:45.572581 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b7660-2b74-46e8-914b-48ffdd0cff32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:45.572581 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b7660-2b74-46e8-914b-48ffdd0cff32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:45.572581 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b7660-2b74-46e8-914b-48ffdd0cff32 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:45.578343 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 304/597] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:45.579199 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b7660-2b74-46e8-914b-48ffdd0cff32 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:45.657256 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c24a7-16bb-4694-aa53-44ec94d0a4fe None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:45.669198 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:45.685023 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b7660-2b74-46e8-914b-48ffdd0cff32 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:45.696744 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10fbdf-ac62-44d4-9056-b06f6455282e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:45.697417 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10fbdf-ac62-44d4-9056-b06f6455282e None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:45.698360 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10fbdf-ac62-44d4-9056-b06f6455282e None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:45.698360 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10fbdf-ac62-44d4-9056-b06f6455282e None admin] PATH_INFO: `/v3/projects` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:45.698822 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10fbdf-ac62-44d4-9056-b06f6455282e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:45.699189 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10fbdf-ac62-44d4-9056-b06f6455282e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:45.700626 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10fbdf-ac62-44d4-9056-b06f6455282e None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:45.714020 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 294/598] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:26:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:45.716225 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10fbdf-ac62-44d4-9056-b06f6455282e None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:45.731749 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e15e9-c8b0-434c-8c35-8d26b331c172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:45.732563 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e15e9-c8b0-434c-8c35-8d26b331c172 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:45.732876 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e15e9-c8b0-434c-8c35-8d26b331c172 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:45.733223 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e15e9-c8b0-434c-8c35-8d26b331c172 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:45.747035 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e15e9-c8b0-434c-8c35-8d26b331c172 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:45.750158 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e15e9-c8b0-434c-8c35-8d26b331c172 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:45.767833 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-182e15e9-c8b0-434c-8c35-8d26b331c172 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:45.767833 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:45.767833 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:45.767833 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:45.767833 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:45.767833 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:45.767833 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:45.767833 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:45.767833 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:45.767833 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:45.767833 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:45.767833 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:45.767833 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:26:45.767833 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:26:45.767833 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:26:45.769960 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:26:45.769960 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:45.769960 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:45.769960 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:45.769960 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:45.769960 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:45.769960 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:45.769960 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:45.769960 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:45.769960 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:45.769960 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:45.769960 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:45.769960 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:45.769960 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:45.769960 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:45.769960 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:45.769960 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:45.772141 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:26:45.772141 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:26:45.772141 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:45.772141 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:45.772141 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 305/599] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:26:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:45.772141 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e15e9-c8b0-434c-8c35-8d26b331c172 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:45.807102 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:45.833284 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10fbdf-ac62-44d4-9056-b06f6455282e None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:45.870697 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f306cc6-9471-4db3-b544-c9694ac5ecb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:45.871625 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f306cc6-9471-4db3-b544-c9694ac5ecb7 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:45.871984 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f306cc6-9471-4db3-b544-c9694ac5ecb7 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:45.872334 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f306cc6-9471-4db3-b544-c9694ac5ecb7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:45.879551 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f306cc6-9471-4db3-b544-c9694ac5ecb7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:45.881100 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f306cc6-9471-4db3-b544-c9694ac5ecb7 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:45.886035 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e15e9-c8b0-434c-8c35-8d26b331c172 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:45.896702 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-2f306cc6-9471-4db3-b544-c9694ac5ecb7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:26:45.896702 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:45.896702 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:45.896702 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:45.896702 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:45.896702 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:45.896702 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:45.896702 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:45.896702 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:45.896702 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:45.896702 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:45.896702 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:45.896702 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:26:45.896702 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:26:45.896702 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:26:45.898531 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:26:45.898531 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:45.898531 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:45.898531 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:45.898531 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:45.898531 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:45.898531 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:45.898531 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:45.898531 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:45.898531 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:45.898531 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:45.898531 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:45.898531 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:45.898531 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:45.898531 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:45.898531 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:45.898531 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:45.900742 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:26:45.900742 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:26:45.900742 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:26:45.900742 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:26:45.900742 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:26:45.900742 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:26:45.900742 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:26:45.900742 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:45.900742 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 295/600] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:26:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:45.900742 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f306cc6-9471-4db3-b544-c9694ac5ecb7 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:45.923020 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa467188-193d-4e1c-befb-3af9324fc071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:45.924090 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa467188-193d-4e1c-befb-3af9324fc071 None admin] REQUEST_METHOD: `PUT` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:45.924425 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa467188-193d-4e1c-befb-3af9324fc071 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:45.924703 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa467188-193d-4e1c-befb-3af9324fc071 None admin] PATH_INFO: `/v3/projects/7fe768315f5c43f487f71f043f11b8b8/users/8e88abf44b444872ad688677ddb437ac/roles/1cb72e4884a744f99a3df0dc628f7493` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:45.934166 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:45.941653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa467188-193d-4e1c-befb-3af9324fc071 None admin] RBAC: Authorizing `identity:create_grant(project_id=7fe768315f5c43f487f71f043f11b8b8, user_id=8e88abf44b444872ad688677ddb437ac, role_id=1cb72e4884a744f99a3df0dc628f7493)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:45.943407 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa467188-193d-4e1c-befb-3af9324fc071 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:46.007135 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f306cc6-9471-4db3-b544-c9694ac5ecb7 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:46.034467 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 306/601] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:26:45 2022] PUT /identity/v3/projects/7fe768315f5c43f487f71f043f11b8b8/users/8e88abf44b444872ad688677ddb437ac/roles/1cb72e4884a744f99a3df0dc628f7493 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:26:46.035516 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa467188-193d-4e1c-befb-3af9324fc071 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:46.060271 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46aa312-2815-46e6-b805-ca43daef3859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:46.061346 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46aa312-2815-46e6-b805-ca43daef3859 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:46.064483 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46aa312-2815-46e6-b805-ca43daef3859 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:46.065081 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46aa312-2815-46e6-b805-ca43daef3859 None admin] PATH_INFO: `/v3/domains` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:46.066175 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46aa312-2815-46e6-b805-ca43daef3859 None admin] RBAC: Adding query filter params (name=Default) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:46.068554 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46aa312-2815-46e6-b805-ca43daef3859 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:46.070834 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46aa312-2815-46e6-b805-ca43daef3859 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:46.079282 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:46.112880 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 296/602] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:46.117390 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4f510-cfdf-46b8-8298-a513e30d887b None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:46.118802 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4f510-cfdf-46b8-8298-a513e30d887b None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:46.119285 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4f510-cfdf-46b8-8298-a513e30d887b None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:46.122624 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 297/603] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:46.126590 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4f510-cfdf-46b8-8298-a513e30d887b None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:46.213699 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa467188-193d-4e1c-befb-3af9324fc071 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:46.255476 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743f46c-d3c1-4bf9-aa4a-57cea9ddc28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:46.256194 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743f46c-d3c1-4bf9-aa4a-57cea9ddc28d None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:46.256482 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743f46c-d3c1-4bf9-aa4a-57cea9ddc28d None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:46.256757 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743f46c-d3c1-4bf9-aa4a-57cea9ddc28d None admin] PATH_INFO: `/v3/projects` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:46.260671 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4743f46c-d3c1-4bf9-aa4a-57cea9ddc28d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:46.260671 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4743f46c-d3c1-4bf9-aa4a-57cea9ddc28d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:46.260671 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4743f46c-d3c1-4bf9-aa4a-57cea9ddc28d None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:46.272299 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 307/604] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:26:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:46.273700 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e9269-83cf-4997-814f-d29479137175 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:46.274001 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e9269-83cf-4997-814f-d29479137175 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:46.274309 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e9269-83cf-4997-814f-d29479137175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:46.276733 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4f510-cfdf-46b8-8298-a513e30d887b None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:46.296040 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-604e9269-83cf-4997-814f-d29479137175 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:46.297726 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-604e9269-83cf-4997-814f-d29479137175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:46.322330 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe041c2f-1267-43f0-b116-b852e146c72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:46.323326 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe041c2f-1267-43f0-b116-b852e146c72b None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:46.323622 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe041c2f-1267-43f0-b116-b852e146c72b None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:46.324225 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe041c2f-1267-43f0-b116-b852e146c72b None admin] PATH_INFO: `/v3/projects/service` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:46.332082 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe041c2f-1267-43f0-b116-b852e146c72b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:46.333606 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe041c2f-1267-43f0-b116-b852e146c72b None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:46.345735 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:46.350545 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-fe041c2f-1267-43f0-b116-b852e146c72b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:26:46.350545 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:46.350545 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:46.350545 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:46.350545 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:46.350545 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:46.350545 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:46.350545 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:46.350545 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:46.350545 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:46.350545 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:46.350545 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:46.350545 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:26:46.350545 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:26:46.350545 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:26:46.351547 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:26:46.351547 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:46.351547 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:46.351547 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:46.351547 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:46.351547 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:46.351547 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:46.351547 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:46.351547 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:46.351547 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:46.351547 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:46.351547 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:46.351547 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:46.351547 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:46.351547 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:46.351547 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:46.351547 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:46.352633 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:26:46.352633 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:26:46.352633 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:26:46.352633 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:26:46.352633 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:26:46.352633 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:26:46.352633 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:26:46.352633 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:46.354671 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 298/605] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:26:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:46.355584 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe041c2f-1267-43f0-b116-b852e146c72b None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:46.376356 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 308/606] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:26:46.382148 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e9269-83cf-4997-814f-d29479137175 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:46.445901 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:46.495899 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e9269-83cf-4997-814f-d29479137175 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:46.504539 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe041c2f-1267-43f0-b116-b852e146c72b None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:46.544522 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe4a57-948a-4f17-887a-53ccf7ee7a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:46.545123 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe4a57-948a-4f17-887a-53ccf7ee7a14 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:46.545411 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe4a57-948a-4f17-887a-53ccf7ee7a14 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:46.545690 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe4a57-948a-4f17-887a-53ccf7ee7a14 None admin] PATH_INFO: `/v3/projects` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:46.546522 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe4a57-948a-4f17-887a-53ccf7ee7a14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:46.546836 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe4a57-948a-4f17-887a-53ccf7ee7a14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:46.548277 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe4a57-948a-4f17-887a-53ccf7ee7a14 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:46.548888 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67bd099-4c98-4f4c-80e7-957cfbba6d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:46.550404 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67bd099-4c98-4f4c-80e7-957cfbba6d04 None admin] REQUEST_METHOD: `PUT` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:46.550937 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67bd099-4c98-4f4c-80e7-957cfbba6d04 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:46.551360 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67bd099-4c98-4f4c-80e7-957cfbba6d04 None admin] PATH_INFO: `/v3/projects/7fe768315f5c43f487f71f043f11b8b8/users/5eefecdea1014aedad4c2a49686a7a89/roles/1cb72e4884a744f99a3df0dc628f7493` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:46.568639 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 309/607] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:26:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:46.569876 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe4a57-948a-4f17-887a-53ccf7ee7a14 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:46.575714 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67bd099-4c98-4f4c-80e7-957cfbba6d04 None admin] RBAC: Authorizing `identity:create_grant(project_id=7fe768315f5c43f487f71f043f11b8b8, user_id=5eefecdea1014aedad4c2a49686a7a89, role_id=1cb72e4884a744f99a3df0dc628f7493)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:46.577413 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67bd099-4c98-4f4c-80e7-957cfbba6d04 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:46.613802 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:46.673225 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe4a57-948a-4f17-887a-53ccf7ee7a14 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:46.693610 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 299/608] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:26:46 2022] PUT /identity/v3/projects/7fe768315f5c43f487f71f043f11b8b8/users/5eefecdea1014aedad4c2a49686a7a89/roles/1cb72e4884a744f99a3df0dc628f7493 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:26:46.694485 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67bd099-4c98-4f4c-80e7-957cfbba6d04 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:46.716407 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef161b-cda2-474e-b338-8e1b74eb3b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:46.717828 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef161b-cda2-474e-b338-8e1b74eb3b07 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:46.719225 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef161b-cda2-474e-b338-8e1b74eb3b07 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:46.719531 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef161b-cda2-474e-b338-8e1b74eb3b07 None admin] PATH_INFO: `/v3/roles/service` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:46.736452 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aef161b-cda2-474e-b338-8e1b74eb3b07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:26:46.745264 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-8aef161b-cda2-474e-b338-8e1b74eb3b07 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:26:46.745264 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:46.745264 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:46.745264 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:46.745264 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:46.745264 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:46.745264 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:46.745264 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:46.745264 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:46.745264 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:46.745264 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:46.745264 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:46.745264 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:26:46.745264 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:26:46.745264 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:26:46.745264 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:26:46.746259 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:26:46.746259 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:26:46.746259 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:26:46.746259 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:26:46.746259 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:46.746259 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:46.746259 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:46.746259 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:46.746259 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:46.746259 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:46.746259 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:46.746259 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:46.746259 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:46.746259 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:46.746259 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:46.746259 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:46.747056 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:46.747056 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:46.747056 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:46.747056 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:46.747056 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:26:46.747056 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:26:46.747056 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:26:46.747056 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:26:46.747056 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:26:46.747056 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:26:46.747056 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:26:46.747056 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:46.751614 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 310/609] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:26:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:46.753124 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4fa01-9c24-4394-a39f-2a075882e4ae None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:46.753437 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4fa01-9c24-4394-a39f-2a075882e4ae None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:46.753706 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4fa01-9c24-4394-a39f-2a075882e4ae None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:46.755480 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 311/610] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:46.756263 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4fa01-9c24-4394-a39f-2a075882e4ae None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:46.847949 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67bd099-4c98-4f4c-80e7-957cfbba6d04 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:46.852313 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:46.874240 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:46.879270 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4fa01-9c24-4394-a39f-2a075882e4ae None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:46.894550 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fdd0c0-181e-4a63-8a20-3ff7c7f416ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:46.895461 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fdd0c0-181e-4a63-8a20-3ff7c7f416ea None admin] REQUEST_METHOD: `PUT` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:46.895754 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fdd0c0-181e-4a63-8a20-3ff7c7f416ea None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:46.896043 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fdd0c0-181e-4a63-8a20-3ff7c7f416ea None admin] PATH_INFO: `/v3/projects/7fe768315f5c43f487f71f043f11b8b8/users/9fab25f2362e4043a83964e177bbcb3e/roles/1cb72e4884a744f99a3df0dc628f7493` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:46.915482 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fdd0c0-181e-4a63-8a20-3ff7c7f416ea None admin] RBAC: Authorizing `identity:create_grant(project_id=7fe768315f5c43f487f71f043f11b8b8, user_id=9fab25f2362e4043a83964e177bbcb3e, role_id=1cb72e4884a744f99a3df0dc628f7493)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:46.916935 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fdd0c0-181e-4a63-8a20-3ff7c7f416ea None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:46.921211 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f8ede-d359-4074-a7f8-dedae0594e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:46.921887 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f8ede-d359-4074-a7f8-dedae0594e0b None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:46.923268 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f8ede-d359-4074-a7f8-dedae0594e0b None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:46.923268 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f8ede-d359-4074-a7f8-dedae0594e0b None admin] PATH_INFO: `/v3/roles` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:46.923427 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f8ede-d359-4074-a7f8-dedae0594e0b None admin] RBAC: Adding query filter params (name=service) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:46.925726 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f8ede-d359-4074-a7f8-dedae0594e0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:46.925726 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f8ede-d359-4074-a7f8-dedae0594e0b None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:46.933779 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 312/611] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:26:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:46.938229 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9658a-5c2e-4945-a9b7-111323057c79 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:46.938229 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9658a-5c2e-4945-a9b7-111323057c79 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:46.938229 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9658a-5c2e-4945-a9b7-111323057c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:46.952960 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-26e9658a-5c2e-4945-a9b7-111323057c79 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:46.954182 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-26e9658a-5c2e-4945-a9b7-111323057c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:47.012247 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 300/612] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:26:46 2022] PUT /identity/v3/projects/7fe768315f5c43f487f71f043f11b8b8/users/9fab25f2362e4043a83964e177bbcb3e/roles/1cb72e4884a744f99a3df0dc628f7493 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:26:47.013742 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fdd0c0-181e-4a63-8a20-3ff7c7f416ea None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:47.031523 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 313/613] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:26:47.070031 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9658a-5c2e-4945-a9b7-111323057c79 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:47.177140 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fdd0c0-181e-4a63-8a20-3ff7c7f416ea None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:47.229352 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93c827-2ba4-43a7-a63f-1aaf09ac45ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:47.231109 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93c827-2ba4-43a7-a63f-1aaf09ac45ba None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:47.231689 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93c827-2ba4-43a7-a63f-1aaf09ac45ba None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:47.232149 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93c827-2ba4-43a7-a63f-1aaf09ac45ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:47.248227 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:47.251282 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c93c827-2ba4-43a7-a63f-1aaf09ac45ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:47.253620 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c93c827-2ba4-43a7-a63f-1aaf09ac45ba None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:47.259024 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9658a-5c2e-4945-a9b7-111323057c79 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:47.281404 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-0c93c827-2ba4-43a7-a63f-1aaf09ac45ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:47.281404 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:47.281404 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:47.281404 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:47.281404 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:47.281404 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:47.281404 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:47.281404 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:47.281404 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:47.281404 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:47.281404 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:47.281404 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:47.281404 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:26:47.281404 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:26:47.281404 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:26:47.282497 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:26:47.282497 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:47.282497 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:47.282497 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:47.282497 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:47.282497 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:47.282497 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:47.282497 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:47.282497 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:47.282497 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:47.282497 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:47.282497 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:47.282497 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:47.282497 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:47.282497 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:47.282497 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:47.282497 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:47.283501 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:26:47.283501 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:26:47.283501 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:47.283501 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:47.290329 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 301/614] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:26:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:47.293699 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93c827-2ba4-43a7-a63f-1aaf09ac45ba None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:47.305994 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:47.307334 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f499f31-2865-4b95-9163-4a5810bf372e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:47.307819 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f499f31-2865-4b95-9163-4a5810bf372e None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:47.308145 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f499f31-2865-4b95-9163-4a5810bf372e None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:47.308424 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f499f31-2865-4b95-9163-4a5810bf372e None admin] PATH_INFO: `/v3/roles/service` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:47.320082 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f499f31-2865-4b95-9163-4a5810bf372e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:26:47.328812 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-7f499f31-2865-4b95-9163-4a5810bf372e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:26:47.328812 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:47.328812 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:47.328812 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:47.328812 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:47.328812 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:47.328812 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:47.328812 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:47.328812 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:47.328812 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:47.328812 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:47.328812 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:47.328812 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:26:47.328812 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:26:47.328812 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:26:47.328812 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:26:47.329872 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:26:47.329872 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:26:47.329872 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:26:47.329872 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:26:47.329872 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:47.329872 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:47.329872 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:47.329872 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:47.329872 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:47.329872 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:47.329872 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:47.329872 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:47.329872 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:47.329872 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:47.329872 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:47.329872 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:47.334649 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:47.334649 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:47.334649 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:47.334649 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:47.334649 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:26:47.334649 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:26:47.334649 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:26:47.334649 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:26:47.334649 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:26:47.334649 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:26:47.334649 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:26:47.334649 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:47.334649 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 314/615] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:26:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:26:47.338408 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f499f31-2865-4b95-9163-4a5810bf372e None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:47.440372 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93c827-2ba4-43a7-a63f-1aaf09ac45ba None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:47.453799 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f499f31-2865-4b95-9163-4a5810bf372e None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:47.490910 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf1567-c806-45be-ae14-b353a4936460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:47.491897 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf1567-c806-45be-ae14-b353a4936460 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:47.492363 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf1567-c806-45be-ae14-b353a4936460 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:47.493078 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf1567-c806-45be-ae14-b353a4936460 None admin] PATH_INFO: `/v3/domains` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:47.493995 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cf1567-c806-45be-ae14-b353a4936460 None admin] RBAC: Adding query filter params (name=Default) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:47.495429 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cf1567-c806-45be-ae14-b353a4936460 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:47.497470 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cf1567-c806-45be-ae14-b353a4936460 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:47.514031 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c9c72-504a-443e-bb8b-eeb9df0d178f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:47.514998 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c9c72-504a-443e-bb8b-eeb9df0d178f None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:47.515460 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c9c72-504a-443e-bb8b-eeb9df0d178f None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:47.516030 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c9c72-504a-443e-bb8b-eeb9df0d178f None admin] PATH_INFO: `/v3/roles` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:47.516961 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c9c72-504a-443e-bb8b-eeb9df0d178f None admin] RBAC: Adding query filter params (name=service) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:47.517446 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c9c72-504a-443e-bb8b-eeb9df0d178f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:47.520993 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c9c72-504a-443e-bb8b-eeb9df0d178f None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:47.535082 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 302/616] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:47.544186 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 315/617] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:26:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:47.545728 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf1567-c806-45be-ae14-b353a4936460 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:47.551410 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c9c72-504a-443e-bb8b-eeb9df0d178f None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:47.588995 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:47.653872 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:47.714699 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf1567-c806-45be-ae14-b353a4936460 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:47.760806 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c9c72-504a-443e-bb8b-eeb9df0d178f None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:47.785643 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c942b0-af53-4294-a986-8db08f71af0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:47.786701 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c942b0-af53-4294-a986-8db08f71af0d None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:47.787129 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c942b0-af53-4294-a986-8db08f71af0d None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:47.787574 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c942b0-af53-4294-a986-8db08f71af0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:47.803463 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c942b0-af53-4294-a986-8db08f71af0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:47.806155 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c942b0-af53-4294-a986-8db08f71af0d None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:47.825309 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-a0c942b0-af53-4294-a986-8db08f71af0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:47.825309 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:47.825309 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:47.825309 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:47.825309 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:47.825309 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:47.825309 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:47.825309 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:47.825309 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:47.825309 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:47.825309 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:47.825309 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:47.825309 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:26:47.825309 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:26:47.825309 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:26:47.826373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:26:47.826373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:47.826373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:47.826373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:47.826373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:47.826373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:47.826373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:47.826373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:47.826373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:47.826373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:47.826373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:47.826373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:47.826373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:47.826373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:47.826373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:47.826373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:47.826373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:47.827387 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:26:47.827387 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:26:47.827387 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:47.827387 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:47.829732 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 303/618] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:26:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:47.835011 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c942b0-af53-4294-a986-8db08f71af0d None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:47.853746 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd097de9-1139-4669-8aac-f733f29ee001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:47.855774 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd097de9-1139-4669-8aac-f733f29ee001 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:47.856773 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd097de9-1139-4669-8aac-f733f29ee001 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:47.858346 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd097de9-1139-4669-8aac-f733f29ee001 None admin] PATH_INFO: `/v3/users/nova` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:47.876308 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd097de9-1139-4669-8aac-f733f29ee001 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:47.880803 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd097de9-1139-4669-8aac-f733f29ee001 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:47.912702 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-bd097de9-1139-4669-8aac-f733f29ee001 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:26:47.912702 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:47.912702 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:47.912702 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:47.912702 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:47.912702 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:47.912702 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:47.912702 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:47.912702 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:47.912702 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:47.912702 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:47.912702 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:47.912702 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:26:47.912702 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:26:47.912702 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:26:47.912702 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:26:47.913635 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:47.913635 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:47.913635 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:26:47.913635 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:26:47.913635 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:26:47.913635 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:26:47.913635 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:47.913635 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:47.913635 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:47.913635 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:47.913635 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:47.913635 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:47.913635 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:47.913635 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:47.913635 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:47.913635 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:47.913635 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:47.913635 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:47.915203 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:47.915203 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:47.915203 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:26:47.915203 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:26:47.915203 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:26:47.915203 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:26:47.915203 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:26:47.915203 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:26:47.915203 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:26:47.915203 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:47.918684 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 316/619] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Jul 5 21:26:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:47.924709 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd097de9-1139-4669-8aac-f733f29ee001 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:48.030609 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:48.038793 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd097de9-1139-4669-8aac-f733f29ee001 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:48.073476 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c942b0-af53-4294-a986-8db08f71af0d None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:48.094122 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:48.112184 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e22e7a-a6a7-4bec-9efe-1f639ce754e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:48.113171 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e22e7a-a6a7-4bec-9efe-1f639ce754e7 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:48.113678 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e22e7a-a6a7-4bec-9efe-1f639ce754e7 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:48.114201 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e22e7a-a6a7-4bec-9efe-1f639ce754e7 None admin] PATH_INFO: `/v3/domains` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:48.115129 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e22e7a-a6a7-4bec-9efe-1f639ce754e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:48.115850 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e22e7a-a6a7-4bec-9efe-1f639ce754e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:48.118067 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e22e7a-a6a7-4bec-9efe-1f639ce754e7 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:48.122954 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f725e-1595-4f5f-a668-2087821c8d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:48.123666 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f725e-1595-4f5f-a668-2087821c8d5a None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:48.123951 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f725e-1595-4f5f-a668-2087821c8d5a None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:48.124227 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f725e-1595-4f5f-a668-2087821c8d5a None admin] PATH_INFO: `/v3/users` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:48.125102 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7f725e-1595-4f5f-a668-2087821c8d5a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:48.125419 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7f725e-1595-4f5f-a668-2087821c8d5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:48.126949 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7f725e-1595-4f5f-a668-2087821c8d5a None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:48.135327 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 304/620] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:48.141302 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e22e7a-a6a7-4bec-9efe-1f639ce754e7 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:48.161962 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 317/621] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Jul 5 21:26:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:48.167960 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f725e-1595-4f5f-a668-2087821c8d5a None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:48.293834 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f725e-1595-4f5f-a668-2087821c8d5a None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:48.295935 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e22e7a-a6a7-4bec-9efe-1f639ce754e7 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:48.324921 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:48.331484 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542bdb52-cd06-4a73-b007-9e3a8637c06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:48.336140 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542bdb52-cd06-4a73-b007-9e3a8637c06a None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:48.336140 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542bdb52-cd06-4a73-b007-9e3a8637c06a None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:48.336140 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542bdb52-cd06-4a73-b007-9e3a8637c06a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:48.342867 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a6c160-f1ef-4106-9389-c518934f94a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:48.343841 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6c160-f1ef-4106-9389-c518934f94a9 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:48.344292 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6c160-f1ef-4106-9389-c518934f94a9 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:48.344762 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6c160-f1ef-4106-9389-c518934f94a9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:48.356610 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a6c160-f1ef-4106-9389-c518934f94a9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:48.358758 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a6c160-f1ef-4106-9389-c518934f94a9 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:48.378118 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-02a6c160-f1ef-4106-9389-c518934f94a9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 21:26:48.378118 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:48.378118 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:48.378118 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:48.378118 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:48.378118 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:48.378118 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:48.378118 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:48.378118 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:48.378118 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:48.378118 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:48.378118 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:48.378118 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:26:48.378118 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:26:48.378118 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:26:48.378118 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:26:48.379213 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:48.379213 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:48.379213 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:26:48.379213 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:26:48.379213 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:26:48.379213 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:26:48.379213 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:48.379213 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:48.379213 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:48.379213 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:48.379213 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:48.379213 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:48.379213 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:48.379213 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:48.379213 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:48.379213 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:48.379213 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:48.379213 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:48.380105 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:48.380105 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:48.380105 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:26:48.380105 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:26:48.380105 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:26:48.380105 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:26:48.380105 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:26:48.380105 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:26:48.380105 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 21:26:48.380105 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:48.382917 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 305/622] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:26:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:48.384752 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b87a6a-45c9-4e4a-9b5a-60bcff94cd26 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:48.385174 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b87a6a-45c9-4e4a-9b5a-60bcff94cd26 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:48.385576 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b87a6a-45c9-4e4a-9b5a-60bcff94cd26 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:48.387275 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 306/623] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:48.389033 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b87a6a-45c9-4e4a-9b5a-60bcff94cd26 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:48.421529 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542bdb52-cd06-4a73-b007-9e3a8637c06a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:48.423342 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542bdb52-cd06-4a73-b007-9e3a8637c06a None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:48.443155 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:48.531038 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b87a6a-45c9-4e4a-9b5a-60bcff94cd26 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:48.577799 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6201c7f-12f5-4242-9c1a-37c98a0a8a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:48.578372 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 318/624] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:26:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:26:48.578876 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6201c7f-12f5-4242-9c1a-37c98a0a8a5e None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:48.579318 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6201c7f-12f5-4242-9c1a-37c98a0a8a5e None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:48.579677 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78964b-ff6b-440a-88ef-7ae7ba97f7f9 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:48.579927 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6201c7f-12f5-4242-9c1a-37c98a0a8a5e None admin] PATH_INFO: `/v3/users` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:48.580035 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78964b-ff6b-440a-88ef-7ae7ba97f7f9 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:48.580235 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78964b-ff6b-440a-88ef-7ae7ba97f7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:48.581396 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6201c7f-12f5-4242-9c1a-37c98a0a8a5e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:48.582273 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6201c7f-12f5-4242-9c1a-37c98a0a8a5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:48.583918 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6201c7f-12f5-4242-9c1a-37c98a0a8a5e None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:48.597284 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-de78964b-ff6b-440a-88ef-7ae7ba97f7f9 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:48.598587 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-de78964b-ff6b-440a-88ef-7ae7ba97f7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:48.604703 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 307/625] 10.222.0.30 () {56 vars in 1135 bytes} [Tue Jul 5 21:26:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:48.605987 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6201c7f-12f5-4242-9c1a-37c98a0a8a5e None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:48.623550 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:48.667183 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 319/626] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:26:48.668110 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78964b-ff6b-440a-88ef-7ae7ba97f7f9 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:48.714882 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:48.722468 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6201c7f-12f5-4242-9c1a-37c98a0a8a5e None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:48.761864 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85febf-0f11-4717-a40d-77bc53982f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:48.763155 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85febf-0f11-4717-a40d-77bc53982f58 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:48.763665 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85febf-0f11-4717-a40d-77bc53982f58 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:48.764199 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85febf-0f11-4717-a40d-77bc53982f58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:48.773002 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78964b-ff6b-440a-88ef-7ae7ba97f7f9 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:48.777051 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85febf-0f11-4717-a40d-77bc53982f58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:48.778801 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85febf-0f11-4717-a40d-77bc53982f58 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:48.799578 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-3e85febf-0f11-4717-a40d-77bc53982f58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:48.799578 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:48.799578 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:48.799578 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:48.799578 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:48.799578 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:48.799578 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:48.799578 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:48.799578 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:48.799578 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:48.799578 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:48.799578 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:48.799578 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:26:48.799578 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:26:48.799578 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:26:48.800455 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:26:48.800455 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:48.800455 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:48.800455 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:48.800455 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:48.800455 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:48.800455 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:48.800455 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:48.800455 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:48.800455 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:48.800455 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:48.800455 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:48.800455 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:48.800455 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:48.800455 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:48.800455 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:48.800455 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:48.801267 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:26:48.801267 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:26:48.801267 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:48.801267 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:48.803649 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 308/627] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:26:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:48.804810 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85febf-0f11-4717-a40d-77bc53982f58 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:48.810049 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41555d3e-82f5-4a17-ac61-23759eff3dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:48.810668 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41555d3e-82f5-4a17-ac61-23759eff3dbd None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:48.810956 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41555d3e-82f5-4a17-ac61-23759eff3dbd None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:48.811236 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41555d3e-82f5-4a17-ac61-23759eff3dbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:48.822315 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41555d3e-82f5-4a17-ac61-23759eff3dbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:48.824175 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41555d3e-82f5-4a17-ac61-23759eff3dbd None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:48.843537 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-41555d3e-82f5-4a17-ac61-23759eff3dbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:48.843537 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:48.843537 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:48.843537 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:48.843537 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:48.843537 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:48.843537 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:48.843537 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:48.843537 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:48.843537 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:48.843537 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:48.843537 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:48.843537 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:26:48.843537 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:26:48.843537 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:26:48.844392 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:26:48.844392 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:48.844392 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:48.844392 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:48.844392 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:48.844392 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:48.844392 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:48.844392 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:48.844392 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:48.844392 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:48.844392 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:48.844392 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:48.844392 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:48.844392 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:48.844392 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:48.844392 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:48.844392 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:48.845222 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:26:48.845222 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:26:48.845222 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:48.845222 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:48.845222 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 320/628] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:26:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:48.845921 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41555d3e-82f5-4a17-ac61-23759eff3dbd None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:48.861895 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:48.924534 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85febf-0f11-4717-a40d-77bc53982f58 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:48.954405 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41555d3e-82f5-4a17-ac61-23759eff3dbd None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:48.964387 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d89883-42bc-4a60-9909-1e03ad8bea4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:48.965682 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d89883-42bc-4a60-9909-1e03ad8bea4e None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:48.966269 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d89883-42bc-4a60-9909-1e03ad8bea4e None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:48.966806 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d89883-42bc-4a60-9909-1e03ad8bea4e None admin] PATH_INFO: `/v3/roles/service` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:48.978929 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d89883-42bc-4a60-9909-1e03ad8bea4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:26:48.988138 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-e7d89883-42bc-4a60-9909-1e03ad8bea4e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:26:48.988138 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:48.988138 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:48.988138 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:48.988138 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:48.988138 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:48.988138 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:48.988138 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:48.988138 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:48.988138 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:48.988138 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:48.988138 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:48.988138 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:26:48.988138 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:26:48.988138 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:26:48.988138 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:26:48.988983 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:26:48.988983 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:26:48.988983 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:26:48.988983 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:26:48.988983 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:48.988983 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:48.988983 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:48.988983 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:48.988983 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:48.988983 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:48.988983 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:48.988983 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:48.988983 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:48.988983 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:48.988983 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:48.988983 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:48.989752 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:48.989752 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:48.989752 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:48.989752 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:48.989752 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:26:48.989752 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:26:48.989752 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:26:48.989752 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:26:48.989752 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:26:48.989752 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:26:48.989752 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:26:48.989752 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:48.991637 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 309/629] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:26:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:48.992264 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d89883-42bc-4a60-9909-1e03ad8bea4e None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:48.999041 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944518b7-a60f-4dd9-8dae-4c9531131481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:48.999727 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944518b7-a60f-4dd9-8dae-4c9531131481 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:49.000018 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944518b7-a60f-4dd9-8dae-4c9531131481 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:49.000302 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944518b7-a60f-4dd9-8dae-4c9531131481 None admin] PATH_INFO: `/v3/domains` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:49.001100 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944518b7-a60f-4dd9-8dae-4c9531131481 None admin] RBAC: Adding query filter params (name=Default) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:49.001419 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944518b7-a60f-4dd9-8dae-4c9531131481 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:49.002897 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944518b7-a60f-4dd9-8dae-4c9531131481 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:49.006495 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:49.021776 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 321/630] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:26:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:49.023144 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944518b7-a60f-4dd9-8dae-4c9531131481 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:49.107664 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d89883-42bc-4a60-9909-1e03ad8bea4e None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:49.116073 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:49.146224 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944518b7-a60f-4dd9-8dae-4c9531131481 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:49.148223 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045827da-f486-43ef-b801-181888066bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:49.150110 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045827da-f486-43ef-b801-181888066bee None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:49.150442 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045827da-f486-43ef-b801-181888066bee None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:49.150721 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045827da-f486-43ef-b801-181888066bee None admin] PATH_INFO: `/v3/domains` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:49.151467 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045827da-f486-43ef-b801-181888066bee None admin] RBAC: Adding query filter params (name=Default) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:49.151787 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045827da-f486-43ef-b801-181888066bee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:49.153190 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045827da-f486-43ef-b801-181888066bee None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:49.166327 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 310/631] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:26:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:49.171035 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045827da-f486-43ef-b801-181888066bee None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:49.183659 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441b7da-1116-4eb2-87e2-a777754ad9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:49.184330 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441b7da-1116-4eb2-87e2-a777754ad9ab None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:49.184617 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441b7da-1116-4eb2-87e2-a777754ad9ab None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:49.184896 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441b7da-1116-4eb2-87e2-a777754ad9ab None admin] PATH_INFO: `/v3/roles` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:49.185643 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c441b7da-1116-4eb2-87e2-a777754ad9ab None admin] RBAC: Adding query filter params (name=service) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:49.185950 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c441b7da-1116-4eb2-87e2-a777754ad9ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:49.187376 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c441b7da-1116-4eb2-87e2-a777754ad9ab None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:49.196266 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 322/632] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:26:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:49.197500 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df5615-5a9a-479a-a032-1264f5343816 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:49.197785 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df5615-5a9a-479a-a032-1264f5343816 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:49.198064 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df5615-5a9a-479a-a032-1264f5343816 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:49.199471 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 323/633] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:49.200002 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df5615-5a9a-479a-a032-1264f5343816 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:49.257129 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:49.298619 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045827da-f486-43ef-b801-181888066bee None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:49.318420 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df5615-5a9a-479a-a032-1264f5343816 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:49.334639 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5fc1a8-ca19-4fef-8ac1-2833a5dcfd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:49.335441 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fc1a8-ca19-4fef-8ac1-2833a5dcfd92 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:49.335730 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fc1a8-ca19-4fef-8ac1-2833a5dcfd92 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:49.336011 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fc1a8-ca19-4fef-8ac1-2833a5dcfd92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:49.343720 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5fc1a8-ca19-4fef-8ac1-2833a5dcfd92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:49.345177 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5fc1a8-ca19-4fef-8ac1-2833a5dcfd92 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:49.356991 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc50e19-1a3e-48f5-a2e1-81f6a8d8319c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:49.357837 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc50e19-1a3e-48f5-a2e1-81f6a8d8319c None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:49.358073 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc50e19-1a3e-48f5-a2e1-81f6a8d8319c None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:49.358382 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc50e19-1a3e-48f5-a2e1-81f6a8d8319c None admin] PATH_INFO: `/v3/projects/service` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:49.360441 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:49.360641 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-6c5fc1a8-ca19-4fef-8ac1-2833a5dcfd92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:26:49.360641 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:49.360641 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:49.360641 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:49.360641 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:49.360641 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:49.360641 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:49.360641 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:49.360641 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:49.360641 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:49.360641 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:49.360641 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:49.360641 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:26:49.360641 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:26:49.360641 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:26:49.361423 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:26:49.361423 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:49.361423 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:49.361423 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:49.361423 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:49.361423 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:49.361423 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:49.361423 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:49.361423 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:49.361423 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:49.361423 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:49.361423 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:49.361423 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:49.361423 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:49.361423 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:49.361423 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:49.361423 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:49.362276 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:26:49.362276 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:26:49.362276 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:26:49.362276 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:26:49.362276 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:26:49.362276 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:26:49.362276 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:26:49.362276 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:49.366574 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 311/634] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:26:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:49.367538 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5fc1a8-ca19-4fef-8ac1-2833a5dcfd92 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:49.368318 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc50e19-1a3e-48f5-a2e1-81f6a8d8319c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:49.369880 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc50e19-1a3e-48f5-a2e1-81f6a8d8319c None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:49.384886 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-ddc50e19-1a3e-48f5-a2e1-81f6a8d8319c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:26:49.384886 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:49.384886 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:49.384886 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:49.384886 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:49.384886 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:49.384886 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:49.384886 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:49.384886 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:49.384886 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:49.384886 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:49.384886 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:49.384886 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:26:49.384886 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:26:49.384886 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:26:49.385738 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:26:49.385738 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:49.385738 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:49.385738 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:49.385738 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:49.385738 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:49.385738 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:49.385738 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:49.385738 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:49.385738 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:49.385738 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:49.385738 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:49.385738 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:49.385738 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:49.385738 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:49.385738 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:49.385738 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:49.386596 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:26:49.386596 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:26:49.386596 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:26:49.386596 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:26:49.386596 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:26:49.386596 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:26:49.386596 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:26:49.386596 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:49.386596 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 324/635] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:26:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:49.387641 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c65f57-0027-4339-b09c-126a989ce019 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:49.387641 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c65f57-0027-4339-b09c-126a989ce019 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:49.387872 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c65f57-0027-4339-b09c-126a989ce019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:49.404871 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-28c65f57-0027-4339-b09c-126a989ce019 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:49.406248 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-28c65f57-0027-4339-b09c-126a989ce019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:49.474858 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 325/636] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:26:49.477697 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5fc1a8-ca19-4fef-8ac1-2833a5dcfd92 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:49.478717 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c65f57-0027-4339-b09c-126a989ce019 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:49.505107 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:49.512753 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2882d8e-98fc-455e-aab1-1d719c945ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:49.513554 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2882d8e-98fc-455e-aab1-1d719c945ed5 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:49.513845 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2882d8e-98fc-455e-aab1-1d719c945ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:49.514142 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2882d8e-98fc-455e-aab1-1d719c945ed5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:49.524628 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2882d8e-98fc-455e-aab1-1d719c945ed5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:49.526080 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2882d8e-98fc-455e-aab1-1d719c945ed5 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:49.544332 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-d2882d8e-98fc-455e-aab1-1d719c945ed5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:49.544332 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:49.544332 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:49.544332 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:49.544332 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:49.544332 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:49.544332 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:49.544332 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:49.544332 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:49.544332 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:49.544332 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:49.544332 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:49.544332 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:26:49.544332 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:26:49.544332 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:26:49.545173 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:26:49.545173 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:49.545173 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:49.545173 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:49.545173 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:49.545173 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:49.545173 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:49.545173 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:49.545173 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:49.545173 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:49.545173 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:49.545173 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:49.545173 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:49.545173 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:49.545173 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:49.545173 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:49.545173 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:49.546007 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:26:49.546007 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:26:49.546007 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:49.546007 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:49.546007 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 312/637] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:26:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:49.546555 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2882d8e-98fc-455e-aab1-1d719c945ed5 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:49.589387 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c65f57-0027-4339-b09c-126a989ce019 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:49.612432 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:49.623529 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08099d74-8cbe-48ba-ae1d-7024732289d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:49.624199 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08099d74-8cbe-48ba-ae1d-7024732289d8 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:49.624490 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08099d74-8cbe-48ba-ae1d-7024732289d8 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:49.624773 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08099d74-8cbe-48ba-ae1d-7024732289d8 None admin] PATH_INFO: `/v3/projects` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:49.625567 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08099d74-8cbe-48ba-ae1d-7024732289d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:49.625890 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08099d74-8cbe-48ba-ae1d-7024732289d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:49.627382 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08099d74-8cbe-48ba-ae1d-7024732289d8 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:49.639319 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 326/638] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:26:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:49.640697 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e061cf0-33c6-4aa3-8e58-7d3d427c2054 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:49.641041 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e061cf0-33c6-4aa3-8e58-7d3d427c2054 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:49.641380 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e061cf0-33c6-4aa3-8e58-7d3d427c2054 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:49.644467 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 327/639] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:49.644467 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e061cf0-33c6-4aa3-8e58-7d3d427c2054 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:49.653313 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2882d8e-98fc-455e-aab1-1d719c945ed5 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:49.687296 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffbaf6e-ac2c-47c9-9fac-736c871cc2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:49.687954 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbaf6e-ac2c-47c9-9fac-736c871cc2b1 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:49.688246 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbaf6e-ac2c-47c9-9fac-736c871cc2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:49.688535 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbaf6e-ac2c-47c9-9fac-736c871cc2b1 None admin] PATH_INFO: `/v3/projects` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:49.689322 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffbaf6e-ac2c-47c9-9fac-736c871cc2b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:49.689636 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffbaf6e-ac2c-47c9-9fac-736c871cc2b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:49.691090 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffbaf6e-ac2c-47c9-9fac-736c871cc2b1 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:49.703406 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 313/640] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:26:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:49.704216 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffbaf6e-ac2c-47c9-9fac-736c871cc2b1 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:49.746371 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e061cf0-33c6-4aa3-8e58-7d3d427c2054 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:49.750604 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:49.780958 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28352cc2-45b9-4b52-a875-adad25e90f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:49.781758 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28352cc2-45b9-4b52-a875-adad25e90f82 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:49.782046 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28352cc2-45b9-4b52-a875-adad25e90f82 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:49.782360 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28352cc2-45b9-4b52-a875-adad25e90f82 None admin] PATH_INFO: `/v3/roles/service` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:49.792594 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28352cc2-45b9-4b52-a875-adad25e90f82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:26:49.800400 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-28352cc2-45b9-4b52-a875-adad25e90f82 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:26:49.800400 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:49.800400 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:49.800400 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:49.800400 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:49.800400 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:49.800400 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:49.800400 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:49.800400 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:49.800400 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:49.800400 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:49.800400 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:49.800400 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:26:49.800400 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:26:49.800400 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:26:49.800400 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:26:49.801232 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:26:49.801232 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:26:49.801232 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:26:49.801232 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:26:49.801232 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:49.801232 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:49.801232 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:49.801232 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:49.801232 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:49.801232 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:49.801232 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:49.801232 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:49.801232 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:49.801232 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:49.801232 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:49.801232 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:49.802010 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:49.802010 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:49.802010 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:49.802010 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:49.802010 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:26:49.802010 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:26:49.802010 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:26:49.802010 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:26:49.802010 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:26:49.802010 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:26:49.802010 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:26:49.802010 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:49.802010 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 328/641] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:26:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:49.802671 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28352cc2-45b9-4b52-a875-adad25e90f82 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:49.812457 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffbaf6e-ac2c-47c9-9fac-736c871cc2b1 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:49.846948 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99095e7e-c84d-4598-b2ea-c0964bd6fb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:49.847610 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99095e7e-c84d-4598-b2ea-c0964bd6fb3c None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:49.847913 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99095e7e-c84d-4598-b2ea-c0964bd6fb3c None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:49.848119 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:49.848215 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99095e7e-c84d-4598-b2ea-c0964bd6fb3c None admin] PATH_INFO: `/v3/domains` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:49.848908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99095e7e-c84d-4598-b2ea-c0964bd6fb3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:49.849223 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99095e7e-c84d-4598-b2ea-c0964bd6fb3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:49.850640 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99095e7e-c84d-4598-b2ea-c0964bd6fb3c None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:49.862324 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 314/642] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:26:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:49.863597 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf761de-5490-41c7-9977-39b9345b2d3b None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:49.863839 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf761de-5490-41c7-9977-39b9345b2d3b None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:49.864128 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf761de-5490-41c7-9977-39b9345b2d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:49.880453 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-8cf761de-5490-41c7-9977-39b9345b2d3b None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:49.881662 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-8cf761de-5490-41c7-9977-39b9345b2d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:49.903560 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28352cc2-45b9-4b52-a875-adad25e90f82 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:49.936457 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f192d2b0-0739-4c5b-8a01-27a42ec03b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:49.937304 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192d2b0-0739-4c5b-8a01-27a42ec03b3a None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:49.937724 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192d2b0-0739-4c5b-8a01-27a42ec03b3a None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:49.937842 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192d2b0-0739-4c5b-8a01-27a42ec03b3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:49.938721 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f192d2b0-0739-4c5b-8a01-27a42ec03b3a None admin] RBAC: Adding query filter params (role.id=1cb72e4884a744f99a3df0dc628f7493, scope.project.id=7fe768315f5c43f487f71f043f11b8b8, user.id=941ed10dfafc4bd48896843da26c9175) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:49.939039 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f192d2b0-0739-4c5b-8a01-27a42ec03b3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:49.940477 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f192d2b0-0739-4c5b-8a01-27a42ec03b3a None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:49.947069 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 329/643] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:26:49 2022] GET /identity/v3/role_assignments?user.id=941ed10dfafc4bd48896843da26c9175&scope.project.id=7fe768315f5c43f487f71f043f11b8b8&role.id=1cb72e4884a744f99a3df0dc628f7493 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:49.947850 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f192d2b0-0739-4c5b-8a01-27a42ec03b3a None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:49.960913 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 315/644] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:26:49.960913 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf761de-5490-41c7-9977-39b9345b2d3b None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:49.988506 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:50.073440 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf761de-5490-41c7-9977-39b9345b2d3b None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:50.087107 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f192d2b0-0739-4c5b-8a01-27a42ec03b3a None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:50.096898 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:50.119555 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116faf1-0d1c-4bc0-81a9-9b2ad86a769a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:50.119795 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116faf1-0d1c-4bc0-81a9-9b2ad86a769a None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:50.120077 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116faf1-0d1c-4bc0-81a9-9b2ad86a769a None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:50.120484 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116faf1-0d1c-4bc0-81a9-9b2ad86a769a None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:50.121355 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8116faf1-0d1c-4bc0-81a9-9b2ad86a769a None admin] RBAC: Adding query filter params (name=service) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:50.121672 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8116faf1-0d1c-4bc0-81a9-9b2ad86a769a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:50.124051 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8116faf1-0d1c-4bc0-81a9-9b2ad86a769a None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:50.127741 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135624b1-7b24-426e-a3a0-6345d8bff6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:50.129260 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135624b1-7b24-426e-a3a0-6345d8bff6ab None admin] REQUEST_METHOD: `PUT` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:50.129557 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135624b1-7b24-426e-a3a0-6345d8bff6ab None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:50.129843 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135624b1-7b24-426e-a3a0-6345d8bff6ab None admin] PATH_INFO: `/v3/projects/7fe768315f5c43f487f71f043f11b8b8/users/f659395837ac4e6dbc17ed925f81f672/roles/1cb72e4884a744f99a3df0dc628f7493` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:50.132669 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 316/645] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:26:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:50.134854 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116faf1-0d1c-4bc0-81a9-9b2ad86a769a None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:50.149179 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135624b1-7b24-426e-a3a0-6345d8bff6ab None admin] RBAC: Authorizing `identity:create_grant(project_id=7fe768315f5c43f487f71f043f11b8b8, user_id=f659395837ac4e6dbc17ed925f81f672, role_id=1cb72e4884a744f99a3df0dc628f7493)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:50.151151 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135624b1-7b24-426e-a3a0-6345d8bff6ab None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:50.220263 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 330/646] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:26:49 2022] PUT /identity/v3/projects/7fe768315f5c43f487f71f043f11b8b8/users/f659395837ac4e6dbc17ed925f81f672/roles/1cb72e4884a744f99a3df0dc628f7493 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:26:50.220263 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135624b1-7b24-426e-a3a0-6345d8bff6ab None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:50.236985 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:50.247636 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116faf1-0d1c-4bc0-81a9-9b2ad86a769a None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:50.288766 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06aabf6-7b3e-4b6a-9421-9fdcb5edd95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:50.290777 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06aabf6-7b3e-4b6a-9421-9fdcb5edd95c None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:50.291296 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06aabf6-7b3e-4b6a-9421-9fdcb5edd95c None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:50.291743 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06aabf6-7b3e-4b6a-9421-9fdcb5edd95c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:50.300569 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06aabf6-7b3e-4b6a-9421-9fdcb5edd95c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:50.302495 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06aabf6-7b3e-4b6a-9421-9fdcb5edd95c None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:50.319627 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-d06aabf6-7b3e-4b6a-9421-9fdcb5edd95c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 21:26:50.319627 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:50.319627 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:50.319627 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:50.319627 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:50.319627 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:50.319627 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:50.319627 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:50.319627 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:50.319627 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:50.319627 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:50.319627 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:50.319627 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:26:50.319627 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:26:50.319627 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:26:50.319627 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:26:50.320605 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:50.320605 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:50.320605 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:26:50.320605 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:26:50.320605 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:26:50.320605 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:26:50.320605 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:50.320605 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:50.320605 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:50.320605 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:50.320605 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:50.320605 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:50.320605 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:50.320605 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:50.320605 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:50.320605 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:50.320605 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:50.320605 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:50.321575 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:50.321575 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:50.321575 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:26:50.321575 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:26:50.321575 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:26:50.321575 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:26:50.321575 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:26:50.321575 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:26:50.321575 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 21:26:50.321575 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:50.324448 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 317/647] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:26:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:50.325545 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06aabf6-7b3e-4b6a-9421-9fdcb5edd95c None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:50.351193 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135624b1-7b24-426e-a3a0-6345d8bff6ab None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:50.389931 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624fd2d-e997-41da-b71d-4aef5eeacc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:50.391069 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624fd2d-e997-41da-b71d-4aef5eeacc5d None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:50.391538 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624fd2d-e997-41da-b71d-4aef5eeacc5d None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:50.391995 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624fd2d-e997-41da-b71d-4aef5eeacc5d None admin] PATH_INFO: `/v3/roles/service` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:50.404351 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7624fd2d-e997-41da-b71d-4aef5eeacc5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:26:50.412710 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-7624fd2d-e997-41da-b71d-4aef5eeacc5d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:26:50.412710 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:50.412710 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:50.412710 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:50.412710 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:50.412710 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:50.412710 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:50.412710 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:50.412710 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:50.412710 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:50.412710 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:50.412710 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:50.412710 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:26:50.412710 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:26:50.412710 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:26:50.412710 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:26:50.413635 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:26:50.413635 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:26:50.413635 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:26:50.413635 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:26:50.413635 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:50.413635 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:50.413635 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:50.413635 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:50.413635 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:50.413635 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:50.413635 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:50.413635 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:50.413635 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:50.413635 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:50.413635 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:50.413635 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:50.415570 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:50.415570 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:50.415570 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:50.415570 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:50.415570 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:26:50.415570 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:26:50.415570 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:26:50.415570 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:26:50.415570 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:26:50.415570 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:26:50.415570 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:26:50.415570 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:50.418185 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 331/648] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:26:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:50.419262 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624fd2d-e997-41da-b71d-4aef5eeacc5d None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:50.443377 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:50.449249 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06aabf6-7b3e-4b6a-9421-9fdcb5edd95c None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:50.489521 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db536485-7a0a-40ab-abb4-e088d3b09f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:50.490386 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db536485-7a0a-40ab-abb4-e088d3b09f53 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:50.490674 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db536485-7a0a-40ab-abb4-e088d3b09f53 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:50.490947 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db536485-7a0a-40ab-abb4-e088d3b09f53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:50.513940 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db536485-7a0a-40ab-abb4-e088d3b09f53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:50.516310 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db536485-7a0a-40ab-abb4-e088d3b09f53 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:50.535918 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-db536485-7a0a-40ab-abb4-e088d3b09f53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:50.535918 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:50.535918 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:50.535918 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:50.535918 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:50.535918 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:50.535918 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:50.535918 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:50.535918 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:50.535918 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:50.535918 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:50.535918 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:50.535918 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:26:50.535918 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:26:50.535918 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:26:50.536822 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:26:50.536822 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:50.536822 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:50.536822 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:50.536822 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:50.536822 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:50.536822 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:50.536822 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:50.536822 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:50.536822 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:50.536822 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:50.536822 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:50.536822 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:50.536822 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:50.536822 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:50.536822 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:50.536822 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:50.538139 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:26:50.538139 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:26:50.538139 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:50.538139 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:50.538139 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 318/649] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:26:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:50.542392 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db536485-7a0a-40ab-abb4-e088d3b09f53 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:50.547391 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:50.551817 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624fd2d-e997-41da-b71d-4aef5eeacc5d None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:50.603949 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd71dd8-f370-4e7c-9d16-9455b19c8125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:50.604866 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd71dd8-f370-4e7c-9d16-9455b19c8125 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:50.605328 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd71dd8-f370-4e7c-9d16-9455b19c8125 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:50.605754 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd71dd8-f370-4e7c-9d16-9455b19c8125 None admin] PATH_INFO: `/v3/users` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:50.607062 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd71dd8-f370-4e7c-9d16-9455b19c8125 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:50.607444 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd71dd8-f370-4e7c-9d16-9455b19c8125 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:50.608901 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd71dd8-f370-4e7c-9d16-9455b19c8125 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:50.629209 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 332/650] 10.222.0.30 () {56 vars in 1137 bytes} [Tue Jul 5 21:26:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:50.630527 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd71dd8-f370-4e7c-9d16-9455b19c8125 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:50.674072 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db536485-7a0a-40ab-abb4-e088d3b09f53 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:50.719889 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:50.721860 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bab999-cd91-49bf-be04-9c60056dfb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:50.722749 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bab999-cd91-49bf-be04-9c60056dfb6b None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:50.723271 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bab999-cd91-49bf-be04-9c60056dfb6b None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:50.723520 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bab999-cd91-49bf-be04-9c60056dfb6b None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:50.724388 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bab999-cd91-49bf-be04-9c60056dfb6b None admin] RBAC: Adding query filter params (name=service) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:50.724823 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bab999-cd91-49bf-be04-9c60056dfb6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:50.726425 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bab999-cd91-49bf-be04-9c60056dfb6b None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:50.738271 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 319/651] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:26:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:50.738271 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bab999-cd91-49bf-be04-9c60056dfb6b None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:50.758743 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd71dd8-f370-4e7c-9d16-9455b19c8125 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:50.808252 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310dff69-35c2-4709-84d0-e3c4f160a01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:50.809249 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310dff69-35c2-4709-84d0-e3c4f160a01b None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:50.809548 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310dff69-35c2-4709-84d0-e3c4f160a01b None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:50.810106 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310dff69-35c2-4709-84d0-e3c4f160a01b None admin] PATH_INFO: `/v3/domains` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:50.810873 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310dff69-35c2-4709-84d0-e3c4f160a01b None admin] RBAC: Adding query filter params (name=Default) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:50.811190 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310dff69-35c2-4709-84d0-e3c4f160a01b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:50.812585 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310dff69-35c2-4709-84d0-e3c4f160a01b None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:50.812735 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:50.833093 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 333/652] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:26:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:50.833093 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310dff69-35c2-4709-84d0-e3c4f160a01b None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:50.861213 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bab999-cd91-49bf-be04-9c60056dfb6b None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:50.900742 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4269eb-1305-47a0-b275-293ffe6f156c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:50.901916 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4269eb-1305-47a0-b275-293ffe6f156c None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:50.902604 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4269eb-1305-47a0-b275-293ffe6f156c None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:50.903261 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4269eb-1305-47a0-b275-293ffe6f156c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:50.969521 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310dff69-35c2-4709-84d0-e3c4f160a01b None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:50.981125 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4269eb-1305-47a0-b275-293ffe6f156c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:50.982950 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4269eb-1305-47a0-b275-293ffe6f156c None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:51.020023 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e66a11-db49-4b13-b48e-b84cb830be1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:51.020845 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e66a11-db49-4b13-b48e-b84cb830be1f None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:51.021142 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e66a11-db49-4b13-b48e-b84cb830be1f None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:51.021458 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e66a11-db49-4b13-b48e-b84cb830be1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:51.026878 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:51.038422 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e66a11-db49-4b13-b48e-b84cb830be1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:51.042256 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e66a11-db49-4b13-b48e-b84cb830be1f None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:51.062114 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:51.069436 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-63e66a11-db49-4b13-b48e-b84cb830be1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:51.069436 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:51.069436 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:51.069436 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:51.069436 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:51.069436 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:51.069436 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:51.069436 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:51.069436 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:51.069436 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:51.069436 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:51.069436 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:51.069436 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:26:51.069436 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:26:51.069436 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:26:51.070488 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:26:51.070488 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:51.070488 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:51.070488 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:51.070488 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:51.070488 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:51.070488 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:51.070488 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:51.070488 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:51.070488 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:51.070488 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:51.070488 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:51.070488 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:51.070488 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:51.070488 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:51.070488 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:51.070488 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:51.071604 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:26:51.071604 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:26:51.071604 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:51.071604 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:51.078211 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 334/653] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:26:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:51.079349 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e66a11-db49-4b13-b48e-b84cb830be1f None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:51.115472 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 320/654] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:26:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:26:51.116529 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4269eb-1305-47a0-b275-293ffe6f156c None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:51.227054 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4269eb-1305-47a0-b275-293ffe6f156c None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:51.232425 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e66a11-db49-4b13-b48e-b84cb830be1f None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:51.271228 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7695283-d1ca-4726-89cc-c832aa81956f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:51.272943 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7695283-d1ca-4726-89cc-c832aa81956f None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:51.273546 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7695283-d1ca-4726-89cc-c832aa81956f None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:51.274743 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7695283-d1ca-4726-89cc-c832aa81956f None admin] PATH_INFO: `/v3/domains` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:51.275854 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7695283-d1ca-4726-89cc-c832aa81956f None admin] RBAC: Adding query filter params (name=Default) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:51.276376 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7695283-d1ca-4726-89cc-c832aa81956f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:51.277968 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7695283-d1ca-4726-89cc-c832aa81956f None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:51.285298 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7755476c-fda4-4061-9c36-e69c8f05d7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:51.286100 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755476c-fda4-4061-9c36-e69c8f05d7e4 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:51.286428 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755476c-fda4-4061-9c36-e69c8f05d7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:51.286703 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755476c-fda4-4061-9c36-e69c8f05d7e4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:51.297233 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7755476c-fda4-4061-9c36-e69c8f05d7e4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:51.297233 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7755476c-fda4-4061-9c36-e69c8f05d7e4 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:51.297797 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 321/655] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:51.298921 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7695283-d1ca-4726-89cc-c832aa81956f None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:51.311481 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-7755476c-fda4-4061-9c36-e69c8f05d7e4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 21:26:51.311481 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:51.311481 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:51.311481 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:51.311481 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:51.311481 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:51.311481 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:51.311481 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:51.311481 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:51.311481 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:51.311481 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:51.311481 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:51.311481 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:26:51.311481 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:26:51.311481 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:26:51.311481 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:26:51.316431 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:51.316431 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:51.316431 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:26:51.316431 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:26:51.316431 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:26:51.316431 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:26:51.316431 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:51.316431 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:51.316431 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:51.316431 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:51.316431 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:51.316431 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:51.316431 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:51.316431 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:51.316431 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:51.316431 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:51.316431 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:51.316431 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:51.317784 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:51.317784 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:51.317784 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:26:51.317784 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:26:51.317784 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:26:51.317784 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:26:51.317784 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:26:51.317784 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:26:51.317784 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 21:26:51.317784 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:51.317784 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 335/656] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:26:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:51.317784 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7755476c-fda4-4061-9c36-e69c8f05d7e4 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:51.334965 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:51.365939 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:51.418016 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7695283-d1ca-4726-89cc-c832aa81956f None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:51.419570 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7755476c-fda4-4061-9c36-e69c8f05d7e4 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:51.458066 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8e0e9-a56d-4e3c-ad84-5729d6e77da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:51.458330 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b159cff-0e29-463f-910f-2561c3f50f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:51.458914 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b159cff-0e29-463f-910f-2561c3f50f11 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:51.459197 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b159cff-0e29-463f-910f-2561c3f50f11 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:51.459477 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b159cff-0e29-463f-910f-2561c3f50f11 None admin] PATH_INFO: `/v3/users/glance` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:51.460020 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8e0e9-a56d-4e3c-ad84-5729d6e77da3 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:51.460509 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8e0e9-a56d-4e3c-ad84-5729d6e77da3 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:51.461005 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8e0e9-a56d-4e3c-ad84-5729d6e77da3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:51.467676 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b159cff-0e29-463f-910f-2561c3f50f11 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:51.469133 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b159cff-0e29-463f-910f-2561c3f50f11 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:51.473963 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b8e0e9-a56d-4e3c-ad84-5729d6e77da3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:51.475684 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b8e0e9-a56d-4e3c-ad84-5729d6e77da3 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:51.484520 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-2b159cff-0e29-463f-910f-2561c3f50f11 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 05 21:26:51.484520 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:51.484520 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:51.484520 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:51.484520 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:51.484520 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:51.484520 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:51.484520 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:51.484520 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:51.484520 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:51.484520 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:51.484520 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:51.484520 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:26:51.484520 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:26:51.484520 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:26:51.484520 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:26:51.485477 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:51.485477 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:51.485477 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:26:51.485477 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:26:51.485477 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:26:51.485477 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:26:51.485477 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:51.485477 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:51.485477 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:51.485477 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:51.485477 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:51.485477 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:51.485477 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:51.485477 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:51.485477 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:51.485477 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:51.485477 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:51.485477 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:51.486405 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:51.486405 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:51.486405 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:26:51.486405 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:26:51.486405 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:26:51.486405 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:26:51.486405 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:26:51.486405 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:26:51.486405 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 05 21:26:51.486405 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:51.490146 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 336/657] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:26:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:51.491004 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b159cff-0e29-463f-910f-2561c3f50f11 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:51.500593 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-32b8e0e9-a56d-4e3c-ad84-5729d6e77da3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:51.500593 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:51.500593 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:51.500593 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:51.500593 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:51.500593 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:51.500593 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:51.500593 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:51.500593 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:51.500593 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:51.500593 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:51.500593 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:51.500593 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:26:51.500593 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:26:51.500593 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:26:51.501454 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:26:51.501454 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:51.501454 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:51.501454 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:51.501454 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:51.501454 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:51.501454 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:51.501454 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:51.501454 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:51.501454 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:51.501454 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:51.501454 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:51.501454 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:51.501454 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:51.501454 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:51.501454 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:51.501454 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:51.502326 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:26:51.502326 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:26:51.502326 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:51.502326 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:51.504541 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 322/658] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:26:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:51.505666 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8e0e9-a56d-4e3c-ad84-5729d6e77da3 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:51.594638 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:51.603451 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b159cff-0e29-463f-910f-2561c3f50f11 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:51.612665 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:51.619195 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8e0e9-a56d-4e3c-ad84-5729d6e77da3 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:51.638703 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035666c-0dd8-44cb-97ab-d0ed63521c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:51.639378 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035666c-0dd8-44cb-97ab-d0ed63521c30 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:51.639666 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035666c-0dd8-44cb-97ab-d0ed63521c30 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:51.639943 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035666c-0dd8-44cb-97ab-d0ed63521c30 None admin] PATH_INFO: `/v3/users` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:51.640783 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9035666c-0dd8-44cb-97ab-d0ed63521c30 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:51.641092 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9035666c-0dd8-44cb-97ab-d0ed63521c30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:51.642637 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9035666c-0dd8-44cb-97ab-d0ed63521c30 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:51.657565 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3ac41-2bde-40ce-aabc-6f6556fbb7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:51.658637 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3ac41-2bde-40ce-aabc-6f6556fbb7ff None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:51.659125 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3ac41-2bde-40ce-aabc-6f6556fbb7ff None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:51.659671 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3ac41-2bde-40ce-aabc-6f6556fbb7ff None admin] PATH_INFO: `/v3/users` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:51.660724 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f3ac41-2bde-40ce-aabc-6f6556fbb7ff None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:51.661231 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f3ac41-2bde-40ce-aabc-6f6556fbb7ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:51.662856 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 337/659] 10.222.0.30 () {56 vars in 1139 bytes} [Tue Jul 5 21:26:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:51.663213 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f3ac41-2bde-40ce-aabc-6f6556fbb7ff None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:51.663752 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035666c-0dd8-44cb-97ab-d0ed63521c30 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:51.687793 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 323/660] 10.222.0.30 () {56 vars in 1137 bytes} [Tue Jul 5 21:26:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:51.688980 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3ac41-2bde-40ce-aabc-6f6556fbb7ff None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:51.769190 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035666c-0dd8-44cb-97ab-d0ed63521c30 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:51.796776 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3ac41-2bde-40ce-aabc-6f6556fbb7ff None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:51.805659 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5befc9c0-1d21-4805-93bb-9eeace9469de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:51.806532 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befc9c0-1d21-4805-93bb-9eeace9469de None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:51.806820 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befc9c0-1d21-4805-93bb-9eeace9469de None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:51.807100 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befc9c0-1d21-4805-93bb-9eeace9469de None admin] PATH_INFO: `/v3/domains` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:51.807855 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5befc9c0-1d21-4805-93bb-9eeace9469de None admin] RBAC: Adding query filter params (name=Default) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:51.808351 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5befc9c0-1d21-4805-93bb-9eeace9469de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:51.809536 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5befc9c0-1d21-4805-93bb-9eeace9469de None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:51.822163 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 338/661] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:51.826968 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5befc9c0-1d21-4805-93bb-9eeace9469de None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:51.838562 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7000d2c0-ddd8-4276-8c7e-c58e29b2cc69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:51.839835 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000d2c0-ddd8-4276-8c7e-c58e29b2cc69 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:51.840346 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000d2c0-ddd8-4276-8c7e-c58e29b2cc69 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:51.840820 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000d2c0-ddd8-4276-8c7e-c58e29b2cc69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:51.844651 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:51.857824 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:51.913945 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7000d2c0-ddd8-4276-8c7e-c58e29b2cc69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:51.916038 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7000d2c0-ddd8-4276-8c7e-c58e29b2cc69 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:51.938633 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5befc9c0-1d21-4805-93bb-9eeace9469de None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:51.976414 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86828f75-c173-45ae-98e6-d12faa77778e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:51.978062 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86828f75-c173-45ae-98e6-d12faa77778e None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:51.978613 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86828f75-c173-45ae-98e6-d12faa77778e None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:51.979055 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86828f75-c173-45ae-98e6-d12faa77778e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:52.019735 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 324/662] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:26:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:26:52.020765 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7000d2c0-ddd8-4276-8c7e-c58e29b2cc69 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:52.055367 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86828f75-c173-45ae-98e6-d12faa77778e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:52.056602 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:52.058326 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86828f75-c173-45ae-98e6-d12faa77778e None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:52.088729 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:52.126330 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7000d2c0-ddd8-4276-8c7e-c58e29b2cc69 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:52.162140 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67dd9bb-18ae-49f7-a66f-7c2e5810a2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:52.162951 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67dd9bb-18ae-49f7-a66f-7c2e5810a2f4 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:52.163238 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67dd9bb-18ae-49f7-a66f-7c2e5810a2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:52.163519 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67dd9bb-18ae-49f7-a66f-7c2e5810a2f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:52.170363 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67dd9bb-18ae-49f7-a66f-7c2e5810a2f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:52.170791 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 339/663] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:26:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:26:52.171792 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86828f75-c173-45ae-98e6-d12faa77778e None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:52.171969 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67dd9bb-18ae-49f7-a66f-7c2e5810a2f4 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:52.189160 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-f67dd9bb-18ae-49f7-a66f-7c2e5810a2f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:26:52.189160 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:52.189160 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:52.189160 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:52.189160 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:52.189160 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:52.189160 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:52.189160 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:52.189160 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:52.189160 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:52.189160 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:52.189160 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:52.189160 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:26:52.189160 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:26:52.189160 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:26:52.190033 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:26:52.190033 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:52.190033 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:52.190033 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:52.190033 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:52.190033 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:52.190033 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:52.190033 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:52.190033 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:52.190033 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:52.190033 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:52.190033 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:52.190033 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:52.190033 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:52.190033 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:52.190033 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:52.190033 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:52.190899 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:26:52.190899 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:26:52.190899 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:26:52.190899 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:26:52.190899 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:26:52.190899 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:26:52.190899 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:26:52.190899 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:52.197621 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 325/664] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:26:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:52.199110 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b048e-36e3-4c65-a74e-aed4c562a08e None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:52.199544 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b048e-36e3-4c65-a74e-aed4c562a08e None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:52.199967 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b048e-36e3-4c65-a74e-aed4c562a08e None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:52.201646 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 326/665] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:52.202388 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b048e-36e3-4c65-a74e-aed4c562a08e None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:52.279184 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86828f75-c173-45ae-98e6-d12faa77778e None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:52.307658 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:52.308872 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:52.315657 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b048e-36e3-4c65-a74e-aed4c562a08e None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:52.317355 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4347b-f821-4213-b715-f041fb0c661b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:52.318187 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4347b-f821-4213-b715-f041fb0c661b None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:52.318479 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4347b-f821-4213-b715-f041fb0c661b None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:52.318766 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4347b-f821-4213-b715-f041fb0c661b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:52.328959 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e4347b-f821-4213-b715-f041fb0c661b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:52.330449 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e4347b-f821-4213-b715-f041fb0c661b None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:52.349224 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-35e4347b-f821-4213-b715-f041fb0c661b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:52.349224 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:52.349224 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:52.349224 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:52.349224 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:52.349224 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:52.349224 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:52.349224 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:52.349224 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:52.349224 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:52.349224 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:52.349224 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:52.349224 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:26:52.349224 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:26:52.349224 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:26:52.350295 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:26:52.350295 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:52.350295 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:52.350295 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:52.350295 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:52.350295 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:52.350295 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:52.350295 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:52.350295 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:52.350295 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:52.350295 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:52.350295 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:52.350295 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:52.350295 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:52.350295 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:52.350295 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:52.350295 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:52.351316 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:26:52.351316 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:26:52.351316 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:52.351316 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:52.354466 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa20248-3c78-4b6f-8b67-52543b63b041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:52.354961 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 340/666] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:26:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:52.355745 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa20248-3c78-4b6f-8b67-52543b63b041 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:52.355877 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4347b-f821-4213-b715-f041fb0c661b None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:52.356282 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa20248-3c78-4b6f-8b67-52543b63b041 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:52.356739 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa20248-3c78-4b6f-8b67-52543b63b041 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:52.369953 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa20248-3c78-4b6f-8b67-52543b63b041 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:52.372202 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa20248-3c78-4b6f-8b67-52543b63b041 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:52.390875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-9fa20248-3c78-4b6f-8b67-52543b63b041 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:52.390875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:52.390875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:52.390875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:52.390875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:52.390875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:52.390875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:52.390875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:52.390875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:52.390875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:52.390875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:52.390875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:52.390875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:26:52.390875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:26:52.390875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:26:52.391727 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:26:52.391727 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:52.391727 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:52.391727 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:52.391727 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:52.391727 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:52.391727 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:52.391727 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:52.391727 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:52.391727 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:52.391727 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:52.391727 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:52.391727 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:52.391727 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:52.391727 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:52.391727 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:52.391727 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:52.392560 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:26:52.392560 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:26:52.392560 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:52.392560 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:52.392560 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 327/667] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:26:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:52.393602 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9dafb-16c7-45a5-b5cb-20ab40be8828 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:52.393602 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9dafb-16c7-45a5-b5cb-20ab40be8828 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:52.393850 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9dafb-16c7-45a5-b5cb-20ab40be8828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:52.411938 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-bbd9dafb-16c7-45a5-b5cb-20ab40be8828 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:52.413128 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-bbd9dafb-16c7-45a5-b5cb-20ab40be8828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:52.467085 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4347b-f821-4213-b715-f041fb0c661b None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:52.488931 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 328/668] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:26:52.488931 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9dafb-16c7-45a5-b5cb-20ab40be8828 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:52.501324 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4941a44-5795-4c2b-8765-71865c89f8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:52.501992 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4941a44-5795-4c2b-8765-71865c89f8b8 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:52.502617 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4941a44-5795-4c2b-8765-71865c89f8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:52.502908 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4941a44-5795-4c2b-8765-71865c89f8b8 None admin] PATH_INFO: `/v3/projects` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:52.503704 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4941a44-5795-4c2b-8765-71865c89f8b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:52.504018 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4941a44-5795-4c2b-8765-71865c89f8b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:52.505456 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4941a44-5795-4c2b-8765-71865c89f8b8 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:52.517235 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 341/669] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:26:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:52.518036 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4941a44-5795-4c2b-8765-71865c89f8b8 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:52.561185 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:52.574180 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:52.595067 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9dafb-16c7-45a5-b5cb-20ab40be8828 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:52.624214 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4941a44-5795-4c2b-8765-71865c89f8b8 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:52.628371 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e97fb-7c02-4d88-a7f9-46bdec2cf093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:52.629036 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e97fb-7c02-4d88-a7f9-46bdec2cf093 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:52.629325 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e97fb-7c02-4d88-a7f9-46bdec2cf093 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:52.629607 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e97fb-7c02-4d88-a7f9-46bdec2cf093 None admin] PATH_INFO: `/v3/domains` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:52.630355 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2e97fb-7c02-4d88-a7f9-46bdec2cf093 None admin] RBAC: Adding query filter params (name=Default) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:52.630675 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2e97fb-7c02-4d88-a7f9-46bdec2cf093 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:52.632104 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2e97fb-7c02-4d88-a7f9-46bdec2cf093 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:52.644707 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 329/670] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:52.645965 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38596a8-b322-4a2e-8498-4539ad23d800 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:52.646294 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38596a8-b322-4a2e-8498-4539ad23d800 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:52.646573 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38596a8-b322-4a2e-8498-4539ad23d800 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:52.647935 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 330/671] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:52.648561 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38596a8-b322-4a2e-8498-4539ad23d800 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:52.660980 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0180101e-481e-4562-8fdd-bccf07f0e6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:52.661651 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180101e-481e-4562-8fdd-bccf07f0e6c6 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:52.661938 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180101e-481e-4562-8fdd-bccf07f0e6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:52.662246 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180101e-481e-4562-8fdd-bccf07f0e6c6 None admin] PATH_INFO: `/v3/domains` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:52.662975 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0180101e-481e-4562-8fdd-bccf07f0e6c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:52.663285 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0180101e-481e-4562-8fdd-bccf07f0e6c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:52.665287 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0180101e-481e-4562-8fdd-bccf07f0e6c6 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:52.677176 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 342/672] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:52.678072 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0180101e-481e-4562-8fdd-bccf07f0e6c6 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:52.751622 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38596a8-b322-4a2e-8498-4539ad23d800 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:52.773854 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:52.777858 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0180101e-481e-4562-8fdd-bccf07f0e6c6 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:52.785498 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb740877-b377-474e-bfe9-0107508c6b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:52.786384 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb740877-b377-474e-bfe9-0107508c6b98 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:52.786681 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb740877-b377-474e-bfe9-0107508c6b98 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:52.786957 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb740877-b377-474e-bfe9-0107508c6b98 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:52.794631 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:52.798663 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb740877-b377-474e-bfe9-0107508c6b98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:26:52.806634 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-bb740877-b377-474e-bfe9-0107508c6b98 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:26:52.806634 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:52.806634 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:52.806634 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:52.806634 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:52.806634 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:52.806634 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:52.806634 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:52.806634 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:52.806634 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:52.806634 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:52.806634 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:52.806634 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:26:52.806634 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:26:52.806634 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:26:52.806634 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:26:52.807583 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:26:52.807583 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:26:52.807583 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:26:52.807583 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:26:52.807583 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:52.807583 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:52.807583 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:52.807583 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:52.807583 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:52.807583 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:52.807583 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:52.807583 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:52.807583 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:52.807583 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:52.807583 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:52.807583 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:52.808512 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:52.808512 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:52.808512 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:52.808512 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:52.808512 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:26:52.808512 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:26:52.808512 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:26:52.808512 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:26:52.808512 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:26:52.808512 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:26:52.808512 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:26:52.808512 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:52.808512 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 331/673] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:26:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:52.809159 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb740877-b377-474e-bfe9-0107508c6b98 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:52.816949 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51161a97-bd8d-4761-bfa4-2d09bf701b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:52.817557 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51161a97-bd8d-4761-bfa4-2d09bf701b4a None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:52.817841 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51161a97-bd8d-4761-bfa4-2d09bf701b4a None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:52.818115 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51161a97-bd8d-4761-bfa4-2d09bf701b4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:52.818964 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51161a97-bd8d-4761-bfa4-2d09bf701b4a None admin] RBAC: Adding query filter params (role.id=1cb72e4884a744f99a3df0dc628f7493, scope.project.id=7fe768315f5c43f487f71f043f11b8b8, user.id=8e88abf44b444872ad688677ddb437ac) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:52.819283 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51161a97-bd8d-4761-bfa4-2d09bf701b4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:52.821353 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51161a97-bd8d-4761-bfa4-2d09bf701b4a None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:52.827360 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 343/674] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:26:52 2022] GET /identity/v3/role_assignments?user.id=8e88abf44b444872ad688677ddb437ac&scope.project.id=7fe768315f5c43f487f71f043f11b8b8&role.id=1cb72e4884a744f99a3df0dc628f7493 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:52.828737 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e3f5e-00a8-4959-91fb-db851291f2d0 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:52.829027 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e3f5e-00a8-4959-91fb-db851291f2d0 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:52.829309 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e3f5e-00a8-4959-91fb-db851291f2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:52.860345 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-f78e3f5e-00a8-4959-91fb-db851291f2d0 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:52.861601 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-f78e3f5e-00a8-4959-91fb-db851291f2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:52.928804 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb740877-b377-474e-bfe9-0107508c6b98 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:52.954158 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 344/675] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:26:52.954158 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e3f5e-00a8-4959-91fb-db851291f2d0 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:52.983623 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc86519-fe30-454d-9f88-014b58093c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:52.984545 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc86519-fe30-454d-9f88-014b58093c5e None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:52.984901 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc86519-fe30-454d-9f88-014b58093c5e None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:52.985193 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc86519-fe30-454d-9f88-014b58093c5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:52.992235 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc86519-fe30-454d-9f88-014b58093c5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:52.994330 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc86519-fe30-454d-9f88-014b58093c5e None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:53.011139 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-edc86519-fe30-454d-9f88-014b58093c5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:26:53.011139 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:53.011139 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:53.011139 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:53.011139 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:53.011139 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:53.011139 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:53.011139 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:53.011139 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:53.011139 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:53.011139 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:53.011139 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:53.011139 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:26:53.011139 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:26:53.011139 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:26:53.012025 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:26:53.012025 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:53.012025 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:53.012025 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:53.012025 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:53.012025 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:53.012025 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:53.012025 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:53.012025 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:53.012025 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:53.012025 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:53.012025 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:53.012025 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:53.012025 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:53.012025 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:53.012025 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:53.012025 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:53.012862 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:26:53.012862 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:26:53.012862 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:26:53.012862 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:26:53.012862 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:26:53.012862 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:26:53.012862 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:26:53.012862 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:53.012862 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 332/676] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:26:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:53.013344 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc86519-fe30-454d-9f88-014b58093c5e None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:53.066343 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:53.079876 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e3f5e-00a8-4959-91fb-db851291f2d0 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:53.080030 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:53.115802 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e2944-e2c4-4289-81ce-9585bf70eab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:53.116613 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e2944-e2c4-4289-81ce-9585bf70eab3 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:53.116969 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e2944-e2c4-4289-81ce-9585bf70eab3 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:53.117356 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e2944-e2c4-4289-81ce-9585bf70eab3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:53.125099 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e2944-e2c4-4289-81ce-9585bf70eab3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:53.126613 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e2944-e2c4-4289-81ce-9585bf70eab3 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:53.127998 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc86519-fe30-454d-9f88-014b58093c5e None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:53.141172 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-738e2944-e2c4-4289-81ce-9585bf70eab3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:26:53.141172 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:53.141172 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:53.141172 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:53.141172 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:53.141172 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:53.141172 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:53.141172 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:53.141172 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:53.141172 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:53.141172 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:53.141172 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:53.141172 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:26:53.141172 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:26:53.141172 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:26:53.142063 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:26:53.142063 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:53.142063 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:53.142063 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:53.142063 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:53.142063 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:53.142063 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:53.142063 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:53.142063 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:53.142063 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:53.142063 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:53.142063 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:53.142063 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:53.142063 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:53.142063 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:53.142063 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:53.142063 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:53.143042 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:26:53.143042 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:26:53.143042 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:26:53.143042 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:26:53.143042 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:26:53.143042 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:26:53.143042 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:26:53.143042 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:53.143042 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 345/677] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:26:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:53.143524 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e2944-e2c4-4289-81ce-9585bf70eab3 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:53.172092 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e1436-8db1-470b-90d6-3ea1e958529f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:53.172972 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e1436-8db1-470b-90d6-3ea1e958529f None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:53.173376 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e1436-8db1-470b-90d6-3ea1e958529f None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:53.173663 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e1436-8db1-470b-90d6-3ea1e958529f None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:53.174466 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e1436-8db1-470b-90d6-3ea1e958529f None admin] RBAC: Adding query filter params (name=admin) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:53.174783 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e1436-8db1-470b-90d6-3ea1e958529f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:53.176178 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e1436-8db1-470b-90d6-3ea1e958529f None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:53.186265 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 333/678] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:26:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:53.187104 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e1436-8db1-470b-90d6-3ea1e958529f None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:53.266654 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e2944-e2c4-4289-81ce-9585bf70eab3 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:53.294476 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e1436-8db1-470b-90d6-3ea1e958529f None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:53.305344 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f76383c-10cc-46b1-9473-82bc503236db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:53.306394 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76383c-10cc-46b1-9473-82bc503236db None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:53.306768 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76383c-10cc-46b1-9473-82bc503236db None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:53.307054 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76383c-10cc-46b1-9473-82bc503236db None admin] PATH_INFO: `/v3/roles/service` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:53.315624 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:53.319777 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f76383c-10cc-46b1-9473-82bc503236db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:26:53.328256 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-1f76383c-10cc-46b1-9473-82bc503236db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:26:53.328256 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:53.328256 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:53.328256 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:53.328256 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:53.328256 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:53.328256 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:53.328256 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:53.328256 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:53.328256 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:53.328256 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:53.328256 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:53.328256 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:26:53.328256 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:26:53.328256 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:26:53.328256 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:26:53.329345 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:26:53.329345 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:26:53.329345 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:26:53.329345 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:26:53.329345 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:53.329345 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:53.329345 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:53.329345 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:53.329345 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:53.329345 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:53.329345 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:53.329345 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:53.329345 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:53.329345 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:53.329345 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:53.329345 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:53.330713 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:53.330713 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:53.330713 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:53.330713 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:53.330713 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:26:53.330713 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:26:53.330713 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:26:53.330713 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:26:53.330713 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:26:53.330713 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:26:53.330713 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:26:53.330713 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:53.330713 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 346/679] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:26:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:53.330713 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f76383c-10cc-46b1-9473-82bc503236db None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:53.338857 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4acff-b614-4cdb-a6aa-0a45ea4c804c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:53.339548 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4acff-b614-4cdb-a6aa-0a45ea4c804c None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:53.339842 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4acff-b614-4cdb-a6aa-0a45ea4c804c None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:53.340128 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4acff-b614-4cdb-a6aa-0a45ea4c804c None admin] PATH_INFO: `/v3/projects` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:53.340930 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d4acff-b614-4cdb-a6aa-0a45ea4c804c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:53.341245 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d4acff-b614-4cdb-a6aa-0a45ea4c804c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:53.343401 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d4acff-b614-4cdb-a6aa-0a45ea4c804c None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:53.348029 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:53.358817 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 334/680] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:26:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:53.359575 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4acff-b614-4cdb-a6aa-0a45ea4c804c None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:53.448444 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f76383c-10cc-46b1-9473-82bc503236db None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:53.467381 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4acff-b614-4cdb-a6aa-0a45ea4c804c None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:53.484811 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a4526-9631-48ab-85b5-0902f6610d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:53.485483 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a4526-9631-48ab-85b5-0902f6610d21 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:53.485778 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a4526-9631-48ab-85b5-0902f6610d21 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:53.486062 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a4526-9631-48ab-85b5-0902f6610d21 None admin] PATH_INFO: `/v3/projects` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:53.486885 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77a4526-9631-48ab-85b5-0902f6610d21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:53.487214 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77a4526-9631-48ab-85b5-0902f6610d21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:53.488665 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77a4526-9631-48ab-85b5-0902f6610d21 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:53.502551 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 347/681] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:26:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:53.503223 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a4526-9631-48ab-85b5-0902f6610d21 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:53.513402 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59df280-4a9c-4b3e-8457-8c4ba9694c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:53.514312 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59df280-4a9c-4b3e-8457-8c4ba9694c9e None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:53.514674 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59df280-4a9c-4b3e-8457-8c4ba9694c9e None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:53.515029 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59df280-4a9c-4b3e-8457-8c4ba9694c9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:53.527153 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59df280-4a9c-4b3e-8457-8c4ba9694c9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:53.528716 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59df280-4a9c-4b3e-8457-8c4ba9694c9e None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:53.547076 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-e59df280-4a9c-4b3e-8457-8c4ba9694c9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:53.547076 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:53.547076 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:53.547076 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:53.547076 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:53.547076 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:53.547076 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:53.547076 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:53.547076 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:53.547076 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:53.547076 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:53.547076 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:53.547076 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:26:53.547076 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:26:53.547076 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:26:53.548042 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:26:53.548042 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:53.548042 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:53.548042 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:53.548042 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:53.548042 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:53.548042 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:53.548042 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:53.548042 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:53.548042 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:53.548042 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:53.548042 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:53.548042 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:53.548042 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:53.548042 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:53.548042 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:53.548042 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:53.549040 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:26:53.549040 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:26:53.549040 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:53.549040 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:53.549040 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 335/682] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:26:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:53.549486 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59df280-4a9c-4b3e-8457-8c4ba9694c9e None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:53.587436 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:53.593529 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:53.623318 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a4526-9631-48ab-85b5-0902f6610d21 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:53.659792 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff5a85d-9f4f-49e4-a437-60e575897966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:53.660285 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59df280-4a9c-4b3e-8457-8c4ba9694c9e None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:53.660480 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5a85d-9f4f-49e4-a437-60e575897966 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:53.660754 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5a85d-9f4f-49e4-a437-60e575897966 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:53.661034 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5a85d-9f4f-49e4-a437-60e575897966 None admin] PATH_INFO: `/v3/roles` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:53.661785 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff5a85d-9f4f-49e4-a437-60e575897966 None admin] RBAC: Adding query filter params (name=service) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:53.662092 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff5a85d-9f4f-49e4-a437-60e575897966 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:53.663518 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff5a85d-9f4f-49e4-a437-60e575897966 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:53.676810 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 348/683] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:26:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:53.677677 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff5a85d-9f4f-49e4-a437-60e575897966 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:53.698016 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850f2e3-cc42-4e7b-b9c4-0a56de9e0455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:53.698905 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850f2e3-cc42-4e7b-b9c4-0a56de9e0455 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:53.699371 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850f2e3-cc42-4e7b-b9c4-0a56de9e0455 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:53.699803 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850f2e3-cc42-4e7b-b9c4-0a56de9e0455 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:53.700786 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4850f2e3-cc42-4e7b-b9c4-0a56de9e0455 None admin] RBAC: Adding query filter params (role.id=1cb72e4884a744f99a3df0dc628f7493, scope.project.id=7fe768315f5c43f487f71f043f11b8b8, user.id=5eefecdea1014aedad4c2a49686a7a89) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:53.701263 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4850f2e3-cc42-4e7b-b9c4-0a56de9e0455 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:53.702762 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4850f2e3-cc42-4e7b-b9c4-0a56de9e0455 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:53.709326 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 336/684] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:26:53 2022] GET /identity/v3/role_assignments?user.id=5eefecdea1014aedad4c2a49686a7a89&scope.project.id=7fe768315f5c43f487f71f043f11b8b8&role.id=1cb72e4884a744f99a3df0dc628f7493 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:53.715108 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850f2e3-cc42-4e7b-b9c4-0a56de9e0455 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:53.805939 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff5a85d-9f4f-49e4-a437-60e575897966 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:53.850582 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:53.857827 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850f2e3-cc42-4e7b-b9c4-0a56de9e0455 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:53.860019 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000587e-0bf1-4511-afde-7f3f56e58c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:53.860796 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000587e-0bf1-4511-afde-7f3f56e58c9d None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:53.862000 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000587e-0bf1-4511-afde-7f3f56e58c9d None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:53.862374 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000587e-0bf1-4511-afde-7f3f56e58c9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:53.863282 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4000587e-0bf1-4511-afde-7f3f56e58c9d None admin] RBAC: Adding query filter params (role.id=1cb72e4884a744f99a3df0dc628f7493, scope.project.id=7fe768315f5c43f487f71f043f11b8b8, user.id=9fab25f2362e4043a83964e177bbcb3e) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:53.866510 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4000587e-0bf1-4511-afde-7f3f56e58c9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:53.866510 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4000587e-0bf1-4511-afde-7f3f56e58c9d None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:53.868629 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:53.878430 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 349/685] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:26:53 2022] GET /identity/v3/role_assignments?user.id=9fab25f2362e4043a83964e177bbcb3e&scope.project.id=7fe768315f5c43f487f71f043f11b8b8&role.id=1cb72e4884a744f99a3df0dc628f7493 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:53.879277 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000587e-0bf1-4511-afde-7f3f56e58c9d None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:53.904150 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e08e6-339e-41e9-8aa9-1675f7e68a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:53.905926 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e08e6-339e-41e9-8aa9-1675f7e68a8e None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:53.906488 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e08e6-339e-41e9-8aa9-1675f7e68a8e None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:53.907250 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e08e6-339e-41e9-8aa9-1675f7e68a8e None admin] PATH_INFO: `/v3/domains` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:53.908240 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1e08e6-339e-41e9-8aa9-1675f7e68a8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:53.908967 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1e08e6-339e-41e9-8aa9-1675f7e68a8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:53.911045 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1e08e6-339e-41e9-8aa9-1675f7e68a8e None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:53.933087 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 337/686] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:53.939720 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e08e6-339e-41e9-8aa9-1675f7e68a8e None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:54.038891 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000587e-0bf1-4511-afde-7f3f56e58c9d None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:54.077647 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e08e6-339e-41e9-8aa9-1675f7e68a8e None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:54.085807 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36bf635-77bf-4ea5-a886-28748630db61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:54.088093 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36bf635-77bf-4ea5-a886-28748630db61 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:54.088391 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36bf635-77bf-4ea5-a886-28748630db61 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:54.088673 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36bf635-77bf-4ea5-a886-28748630db61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:54.104011 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36bf635-77bf-4ea5-a886-28748630db61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:54.105411 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36bf635-77bf-4ea5-a886-28748630db61 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:54.117320 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382097a-eb9b-4582-8e2f-6014a0b40096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:54.118521 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382097a-eb9b-4582-8e2f-6014a0b40096 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:54.118818 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382097a-eb9b-4582-8e2f-6014a0b40096 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:54.119101 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382097a-eb9b-4582-8e2f-6014a0b40096 None admin] PATH_INFO: `/v3/users/nova` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:54.125236 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-e36bf635-77bf-4ea5-a886-28748630db61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:54.125236 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:54.125236 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:54.125236 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:54.125236 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:54.125236 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:54.125236 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:54.125236 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:54.125236 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:54.125236 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:54.125236 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:54.125236 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:54.125236 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:26:54.125236 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:26:54.125236 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:26:54.126212 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:26:54.126212 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:54.126212 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:54.126212 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:54.126212 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:54.126212 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:54.126212 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:54.126212 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:54.126212 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:54.126212 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:54.126212 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:54.126212 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:54.126212 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:54.126212 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:54.126212 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:54.126212 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:54.126212 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:54.127097 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:26:54.127097 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:26:54.127097 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:54.127097 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:54.127097 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 350/687] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:26:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:54.127364 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e382097a-eb9b-4582-8e2f-6014a0b40096 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:54.128486 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e382097a-eb9b-4582-8e2f-6014a0b40096 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:54.133688 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36bf635-77bf-4ea5-a886-28748630db61 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:54.143720 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-e382097a-eb9b-4582-8e2f-6014a0b40096 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:26:54.143720 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:54.143720 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:54.143720 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:54.143720 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:54.143720 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:54.143720 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:54.143720 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:54.143720 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:54.143720 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:54.143720 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:54.143720 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:54.143720 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:26:54.143720 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:26:54.143720 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:26:54.143720 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:26:54.144651 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:54.144651 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:54.144651 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:26:54.144651 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:26:54.144651 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:26:54.144651 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:26:54.144651 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:54.144651 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:54.144651 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:54.144651 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:54.144651 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:54.144651 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:54.144651 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:54.144651 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:54.144651 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:54.144651 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:54.144651 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:54.144651 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:54.145563 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:54.145563 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:54.145563 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:26:54.145563 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:26:54.145563 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:26:54.145563 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:26:54.145563 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:26:54.145563 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:26:54.145563 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:26:54.145563 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:54.145563 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 338/688] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Jul 5 21:26:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:26:54.152184 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382097a-eb9b-4582-8e2f-6014a0b40096 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:54.179966 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:54.207643 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:54.269420 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36bf635-77bf-4ea5-a886-28748630db61 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:54.288232 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382097a-eb9b-4582-8e2f-6014a0b40096 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:54.314196 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e363f52-2254-4f96-9b8a-ed9f76b5f152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:54.315279 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e363f52-2254-4f96-9b8a-ed9f76b5f152 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:54.315642 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e363f52-2254-4f96-9b8a-ed9f76b5f152 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:54.316003 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e363f52-2254-4f96-9b8a-ed9f76b5f152 None admin] PATH_INFO: `/v3/domains` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:54.317543 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e363f52-2254-4f96-9b8a-ed9f76b5f152 None admin] RBAC: Adding query filter params (name=Default) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:54.317935 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e363f52-2254-4f96-9b8a-ed9f76b5f152 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:54.319482 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e363f52-2254-4f96-9b8a-ed9f76b5f152 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:54.334018 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 351/689] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:26:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:54.337846 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b23c6-a208-4920-9f1e-64313485e47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:54.343393 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b23c6-a208-4920-9f1e-64313485e47c None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:54.343393 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b23c6-a208-4920-9f1e-64313485e47c None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:54.343393 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b23c6-a208-4920-9f1e-64313485e47c None admin] PATH_INFO: `/v3/users` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:54.343393 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2b23c6-a208-4920-9f1e-64313485e47c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:54.343393 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2b23c6-a208-4920-9f1e-64313485e47c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:54.343393 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2b23c6-a208-4920-9f1e-64313485e47c None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:54.343839 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e363f52-2254-4f96-9b8a-ed9f76b5f152 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:54.366417 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 339/690] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Jul 5 21:26:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:54.374170 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b23c6-a208-4920-9f1e-64313485e47c None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:54.487259 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e363f52-2254-4f96-9b8a-ed9f76b5f152 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:54.504403 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:54.510504 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:54.527821 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b23c6-a208-4920-9f1e-64313485e47c None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:54.553587 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9932bfd-b9d8-4c1e-87f4-1ef292ee5354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:54.554434 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9932bfd-b9d8-4c1e-87f4-1ef292ee5354 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:54.554726 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9932bfd-b9d8-4c1e-87f4-1ef292ee5354 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:54.555598 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9932bfd-b9d8-4c1e-87f4-1ef292ee5354 None admin] PATH_INFO: `/v3/users/swift` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:54.569373 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9932bfd-b9d8-4c1e-87f4-1ef292ee5354 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:54.570937 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9932bfd-b9d8-4c1e-87f4-1ef292ee5354 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:54.593118 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-e9932bfd-b9d8-4c1e-87f4-1ef292ee5354 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 21:26:54.593118 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:54.593118 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:54.593118 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:54.593118 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:54.593118 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:54.593118 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:54.593118 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:54.593118 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:54.593118 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:54.593118 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:54.593118 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:54.593118 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:26:54.593118 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:26:54.593118 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:26:54.593118 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:26:54.594073 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:54.594073 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:54.594073 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:26:54.594073 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:26:54.594073 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:26:54.594073 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:26:54.594073 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:54.594073 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:54.594073 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:54.594073 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:54.594073 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:54.594073 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:54.594073 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:54.594073 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:54.594073 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:54.594073 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:54.594073 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:54.594073 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:54.595010 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:54.595010 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:54.595010 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:26:54.595010 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:26:54.595010 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:26:54.595010 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:26:54.595010 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:26:54.595010 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:26:54.595010 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 21:26:54.595010 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:54.595010 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 352/691] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:26:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:54.603553 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1f94e-b042-4e91-814e-f6c290617e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:54.604231 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1f94e-b042-4e91-814e-f6c290617e84 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:54.604521 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1f94e-b042-4e91-814e-f6c290617e84 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:54.604802 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1f94e-b042-4e91-814e-f6c290617e84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:54.608229 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9932bfd-b9d8-4c1e-87f4-1ef292ee5354 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:54.695300 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e1f94e-b042-4e91-814e-f6c290617e84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:54.697375 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e1f94e-b042-4e91-814e-f6c290617e84 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:54.753646 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9932bfd-b9d8-4c1e-87f4-1ef292ee5354 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:54.800582 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b992ce1-2b34-47fb-ab50-bd7fe3cc43fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:54.801327 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b992ce1-2b34-47fb-ab50-bd7fe3cc43fa None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:54.801614 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b992ce1-2b34-47fb-ab50-bd7fe3cc43fa None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:54.801890 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b992ce1-2b34-47fb-ab50-bd7fe3cc43fa None admin] PATH_INFO: `/v3/users` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:54.802763 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b992ce1-2b34-47fb-ab50-bd7fe3cc43fa None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:54.803079 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b992ce1-2b34-47fb-ab50-bd7fe3cc43fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:54.807340 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b992ce1-2b34-47fb-ab50-bd7fe3cc43fa None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:54.834093 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 353/692] 10.222.0.30 () {56 vars in 1135 bytes} [Tue Jul 5 21:26:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:54.840194 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b992ce1-2b34-47fb-ab50-bd7fe3cc43fa None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:54.842680 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:54.877879 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:54.893249 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 340/693] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:26:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:26:54.899819 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1f94e-b042-4e91-814e-f6c290617e84 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:54.988157 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b992ce1-2b34-47fb-ab50-bd7fe3cc43fa None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:55.047318 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef3e963-8dba-40c4-9d93-3dcc54cecb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:55.048808 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3e963-8dba-40c4-9d93-3dcc54cecb89 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:55.049095 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3e963-8dba-40c4-9d93-3dcc54cecb89 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:55.049369 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3e963-8dba-40c4-9d93-3dcc54cecb89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:55.100535 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1f94e-b042-4e91-814e-f6c290617e84 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:55.150069 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119523e-696d-4b23-a3c0-3fb147cdd8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:55.150893 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119523e-696d-4b23-a3c0-3fb147cdd8b7 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:55.151237 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119523e-696d-4b23-a3c0-3fb147cdd8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:55.151515 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119523e-696d-4b23-a3c0-3fb147cdd8b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:55.152878 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef3e963-8dba-40c4-9d93-3dcc54cecb89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:55.154496 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef3e963-8dba-40c4-9d93-3dcc54cecb89 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:55.171036 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e119523e-696d-4b23-a3c0-3fb147cdd8b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:55.173517 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e119523e-696d-4b23-a3c0-3fb147cdd8b7 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:55.186970 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:55.201456 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-e119523e-696d-4b23-a3c0-3fb147cdd8b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:55.201456 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:55.201456 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:55.201456 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:55.201456 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:55.201456 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:55.201456 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:55.201456 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:55.201456 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:55.201456 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:55.201456 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:55.201456 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:55.201456 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:26:55.201456 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:26:55.201456 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:26:55.203031 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:26:55.203031 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:55.203031 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:55.203031 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:55.203031 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:55.203031 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:55.203031 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:55.203031 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:55.203031 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:55.203031 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:55.203031 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:55.203031 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:55.203031 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:55.203031 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:55.203031 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:55.203031 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:55.203031 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:55.203880 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:26:55.203880 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:26:55.203880 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:55.203880 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:55.203880 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 341/694] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:26:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:26:55.209749 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5958265-fb9c-40c7-a2b6-4957ba833421 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:55.209749 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5958265-fb9c-40c7-a2b6-4957ba833421 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:55.209749 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5958265-fb9c-40c7-a2b6-4957ba833421 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:55.213087 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 342/695] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:55 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:55.214261 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5958265-fb9c-40c7-a2b6-4957ba833421 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:55.252844 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:55.283454 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 354/696] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:26:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 21:26:55.283454 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505eaef-7d27-4cf9-b529-0611ec17d3e0 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:55.283454 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505eaef-7d27-4cf9-b529-0611ec17d3e0 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:55.283454 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505eaef-7d27-4cf9-b529-0611ec17d3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:55.300471 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-a505eaef-7d27-4cf9-b529-0611ec17d3e0 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:55.301804 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-a505eaef-7d27-4cf9-b529-0611ec17d3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:55.358994 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5958265-fb9c-40c7-a2b6-4957ba833421 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:55.385249 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 355/697] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:26:55.386254 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a505eaef-7d27-4cf9-b529-0611ec17d3e0 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:55.408942 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7deced2-e1d2-4ed1-afd5-5808ba31872f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:55.409945 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7deced2-e1d2-4ed1-afd5-5808ba31872f None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:55.410482 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7deced2-e1d2-4ed1-afd5-5808ba31872f None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:55.410974 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7deced2-e1d2-4ed1-afd5-5808ba31872f None admin] PATH_INFO: `/v3/domains` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:55.411954 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7deced2-e1d2-4ed1-afd5-5808ba31872f None admin] RBAC: Adding query filter params (name=Default) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:55.412464 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7deced2-e1d2-4ed1-afd5-5808ba31872f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:55.414043 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7deced2-e1d2-4ed1-afd5-5808ba31872f None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:55.435863 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 343/698] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:26:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:55.435863 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7deced2-e1d2-4ed1-afd5-5808ba31872f None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:55.478982 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:55.532132 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:55.545541 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a505eaef-7d27-4cf9-b529-0611ec17d3e0 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:55.548008 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7deced2-e1d2-4ed1-afd5-5808ba31872f None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:55.591582 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f8f2e-5269-4369-b5b6-1aca57054544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:55.592814 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f8f2e-5269-4369-b5b6-1aca57054544 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:55.593106 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f8f2e-5269-4369-b5b6-1aca57054544 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:55.593389 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f8f2e-5269-4369-b5b6-1aca57054544 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:55.600965 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6841a1-4baa-46fe-be2b-9b069449e586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:55.602178 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6841a1-4baa-46fe-be2b-9b069449e586 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:55.602669 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6841a1-4baa-46fe-be2b-9b069449e586 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:55.603172 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6841a1-4baa-46fe-be2b-9b069449e586 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:55.604071 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6841a1-4baa-46fe-be2b-9b069449e586 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:55.605433 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629f8f2e-5269-4369-b5b6-1aca57054544 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:55.606012 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6841a1-4baa-46fe-be2b-9b069449e586 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:55.606907 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629f8f2e-5269-4369-b5b6-1aca57054544 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:55.623044 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-6c6841a1-4baa-46fe-be2b-9b069449e586 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 21:26:55.623044 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:55.623044 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:26:55.623044 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:26:55.623044 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:26:55.623044 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:26:55.623044 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:26:55.623044 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:26:55.623044 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 21:26:55.623044 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:55.623044 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:26:55.623044 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:55.623044 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:55.623044 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:55.623044 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:55.623044 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:55.623956 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:55.623956 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:55.623956 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:55.623956 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:55.623956 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:55.623956 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:55.623956 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:55.623956 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:26:55.623956 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:26:55.623956 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:26:55.623956 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:26:55.623956 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:55.623956 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:55.623956 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:55.623956 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:55.623956 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:55.624749 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:55.624749 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:55.624749 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:55.624749 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:55.624749 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:55.624749 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:55.624749 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:55.624749 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:55.624749 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:55.624749 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:55.624749 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:55.624749 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:26:55.624749 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:26:55.624749 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 21:26:55.624749 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:55.627192 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-629f8f2e-5269-4369-b5b6-1aca57054544 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:55.627192 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:55.627192 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:55.627192 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:55.627192 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:55.627192 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:55.627192 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:55.627192 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:55.627192 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:55.627192 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:55.627192 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:55.627192 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:55.627192 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:26:55.627192 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:26:55.627192 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:26:55.627986 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:26:55.627986 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:55.627986 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:55.627986 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:55.627986 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:55.627986 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:55.627986 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:55.627986 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:55.627986 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:55.627986 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:55.627986 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:55.627986 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:55.627986 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:55.627986 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:55.627986 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:55.627986 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:55.627986 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:55.628841 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:26:55.628841 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:26:55.628841 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:55.628841 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:55.629934 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 344/700] 10.222.0.30 () {56 vars in 1129 bytes} [Tue Jul 5 21:26:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:55.631048 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6841a1-4baa-46fe-be2b-9b069449e586 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:55.633174 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 356/700] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:26:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:55.634774 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f8f2e-5269-4369-b5b6-1aca57054544 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:55.757537 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f8f2e-5269-4369-b5b6-1aca57054544 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:55.766860 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6841a1-4baa-46fe-be2b-9b069449e586 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:55.770736 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:55.798475 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba359c7-0af0-4ad0-8c77-069a92e435d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:55.799077 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba359c7-0af0-4ad0-8c77-069a92e435d6 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:55.799365 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba359c7-0af0-4ad0-8c77-069a92e435d6 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:55.799644 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba359c7-0af0-4ad0-8c77-069a92e435d6 None admin] PATH_INFO: `/v3/domains` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:55.800377 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba359c7-0af0-4ad0-8c77-069a92e435d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:55.800689 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba359c7-0af0-4ad0-8c77-069a92e435d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:55.802081 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba359c7-0af0-4ad0-8c77-069a92e435d6 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:55.813241 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce77423-70ab-4f2f-9368-5e2f130af20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:55.814959 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce77423-70ab-4f2f-9368-5e2f130af20b None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:55.815639 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce77423-70ab-4f2f-9368-5e2f130af20b None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:55.816455 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce77423-70ab-4f2f-9368-5e2f130af20b None admin] PATH_INFO: `/v3/projects/service` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:55.823556 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 357/701] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:26:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:26:55.824400 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba359c7-0af0-4ad0-8c77-069a92e435d6 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:55.826491 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce77423-70ab-4f2f-9368-5e2f130af20b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:55.829355 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce77423-70ab-4f2f-9368-5e2f130af20b None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:55.848343 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-4ce77423-70ab-4f2f-9368-5e2f130af20b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:26:55.848343 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:55.848343 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:55.848343 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:55.848343 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:55.848343 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:55.848343 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:55.848343 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:55.848343 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:55.848343 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:55.848343 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:55.848343 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:55.848343 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:26:55.848343 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:26:55.848343 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:26:55.849205 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:26:55.849205 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:55.849205 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:55.849205 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:55.849205 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:55.849205 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:55.849205 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:55.849205 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:55.849205 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:55.849205 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:55.849205 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:55.849205 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:55.849205 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:55.849205 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:55.849205 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:55.849205 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:55.849205 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:55.850040 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:26:55.850040 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:26:55.850040 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:26:55.850040 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:26:55.850040 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:26:55.850040 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:26:55.850040 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:26:55.850040 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:55.856257 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 345/702] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:26:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:55.856257 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce77423-70ab-4f2f-9368-5e2f130af20b None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:55.870157 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:55.946937 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba359c7-0af0-4ad0-8c77-069a92e435d6 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:55.986466 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c8d191-6535-46c0-af22-9b777fdeb921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:55.987077 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c8d191-6535-46c0-af22-9b777fdeb921 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:55.987411 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c8d191-6535-46c0-af22-9b777fdeb921 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:55.987698 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c8d191-6535-46c0-af22-9b777fdeb921 None admin] PATH_INFO: `/v3/services` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:55.988416 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c8d191-6535-46c0-af22-9b777fdeb921 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:55.988732 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c8d191-6535-46c0-af22-9b777fdeb921 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:55.990115 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c8d191-6535-46c0-af22-9b777fdeb921 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:55.994785 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce77423-70ab-4f2f-9368-5e2f130af20b None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:55.995400 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 358/703] 10.222.0.30 () {56 vars in 1124 bytes} [Tue Jul 5 21:26:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:55.996229 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c8d191-6535-46c0-af22-9b777fdeb921 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:56.033513 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:56.044467 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24579044-54e1-473b-bf7b-b369d1369f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:56.046028 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24579044-54e1-473b-bf7b-b369d1369f52 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:56.046916 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24579044-54e1-473b-bf7b-b369d1369f52 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:56.046916 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24579044-54e1-473b-bf7b-b369d1369f52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:56.056849 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24579044-54e1-473b-bf7b-b369d1369f52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:56.058278 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24579044-54e1-473b-bf7b-b369d1369f52 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:56.073251 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-24579044-54e1-473b-bf7b-b369d1369f52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:26:56.073251 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:56.073251 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:56.073251 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:56.073251 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:56.073251 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:56.073251 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:56.073251 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:56.073251 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:56.073251 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:56.073251 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:56.073251 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:56.073251 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:26:56.073251 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:26:56.073251 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:26:56.074162 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:26:56.074162 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:56.074162 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:56.074162 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:56.074162 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:56.074162 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:56.074162 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:56.074162 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:56.074162 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:56.074162 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:56.074162 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:56.074162 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:56.074162 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:56.074162 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:56.074162 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:56.074162 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:56.074162 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:56.075002 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:26:56.075002 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:26:56.075002 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:26:56.075002 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:26:56.075002 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:26:56.075002 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:26:56.075002 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:26:56.075002 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:56.079459 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 346/704] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:26:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:56.080419 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24579044-54e1-473b-bf7b-b369d1369f52 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:56.128288 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c8d191-6535-46c0-af22-9b777fdeb921 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:56.154754 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:56.170300 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe2194-c565-431e-a57e-ee5edac5d9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:56.170975 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe2194-c565-431e-a57e-ee5edac5d9b3 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:56.174285 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe2194-c565-431e-a57e-ee5edac5d9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:56.174285 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe2194-c565-431e-a57e-ee5edac5d9b3 None admin] PATH_INFO: `/v3/projects` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:56.174285 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafe2194-c565-431e-a57e-ee5edac5d9b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:56.174285 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafe2194-c565-431e-a57e-ee5edac5d9b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:56.174285 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafe2194-c565-431e-a57e-ee5edac5d9b3 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:56.186564 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 359/705] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:26:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:56.187451 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24579044-54e1-473b-bf7b-b369d1369f52 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:56.188037 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe2194-c565-431e-a57e-ee5edac5d9b3 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:56.226338 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa55b6-310a-47d3-a936-c47a12fc45b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:56.227714 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa55b6-310a-47d3-a936-c47a12fc45b6 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:56.228013 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa55b6-310a-47d3-a936-c47a12fc45b6 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:56.228309 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa55b6-310a-47d3-a936-c47a12fc45b6 None admin] PATH_INFO: `/v3/services` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:56.229002 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fa55b6-310a-47d3-a936-c47a12fc45b6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:56.229309 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fa55b6-310a-47d3-a936-c47a12fc45b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:56.230709 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fa55b6-310a-47d3-a936-c47a12fc45b6 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:56.237068 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 347/706] 10.222.0.30 () {56 vars in 1124 bytes} [Tue Jul 5 21:26:56 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:56.238994 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c1189-ad31-46a2-9740-81977dbf5d67 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:56.239509 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c1189-ad31-46a2-9740-81977dbf5d67 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:56.240329 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c1189-ad31-46a2-9740-81977dbf5d67 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:56.242651 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 348/707] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:56.244284 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8c1189-ad31-46a2-9740-81977dbf5d67 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:56.304980 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:56.310828 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe2194-c565-431e-a57e-ee5edac5d9b3 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:56.349919 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb344a9-8f76-4659-acd8-374ce48cd1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:56.350794 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb344a9-8f76-4659-acd8-374ce48cd1b9 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:56.351178 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb344a9-8f76-4659-acd8-374ce48cd1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:56.351754 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb344a9-8f76-4659-acd8-374ce48cd1b9 None admin] PATH_INFO: `/v3/projects` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:56.353354 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb344a9-8f76-4659-acd8-374ce48cd1b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:56.353654 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb344a9-8f76-4659-acd8-374ce48cd1b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:56.355434 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb344a9-8f76-4659-acd8-374ce48cd1b9 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:56.372884 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 360/708] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:26:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:56.372884 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d5c41-e4b6-4aa5-9202-d8079a9da630 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:56.372884 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d5c41-e4b6-4aa5-9202-d8079a9da630 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:56.372884 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d5c41-e4b6-4aa5-9202-d8079a9da630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:56.390572 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-b11d5c41-e4b6-4aa5-9202-d8079a9da630 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:56.391970 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-b11d5c41-e4b6-4aa5-9202-d8079a9da630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:56.394033 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8c1189-ad31-46a2-9740-81977dbf5d67 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:56.438327 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338c874-41b2-4e03-b610-a22a3d69db65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:56.439137 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338c874-41b2-4e03-b610-a22a3d69db65 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:56.439415 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338c874-41b2-4e03-b610-a22a3d69db65 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:56.439695 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338c874-41b2-4e03-b610-a22a3d69db65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:56.440543 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338c874-41b2-4e03-b610-a22a3d69db65 None admin] RBAC: Adding query filter params (role.id=00090b1962654604b8e106a05d44d06a, scope.project.id=7fe768315f5c43f487f71f043f11b8b8, user.id=941ed10dfafc4bd48896843da26c9175) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:56.440865 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338c874-41b2-4e03-b610-a22a3d69db65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:56.442514 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338c874-41b2-4e03-b610-a22a3d69db65 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:56.444580 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:56.450652 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 349/709] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:26:56 2022] GET /identity/v3/role_assignments?user.id=941ed10dfafc4bd48896843da26c9175&scope.project.id=7fe768315f5c43f487f71f043f11b8b8&role.id=00090b1962654604b8e106a05d44d06a => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:56.451518 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338c874-41b2-4e03-b610-a22a3d69db65 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:56.483920 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 361/710] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:26:56.485246 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e1690-25e9-4ade-98cf-a9e630fb454e None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:56.485540 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e1690-25e9-4ade-98cf-a9e630fb454e None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:56.485821 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e1690-25e9-4ade-98cf-a9e630fb454e None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:56.487505 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 362/711] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:56.493911 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919fe742-33f0-4154-a8eb-b892f5be36e4 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:56.494410 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919fe742-33f0-4154-a8eb-b892f5be36e4 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:56.495061 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919fe742-33f0-4154-a8eb-b892f5be36e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:56.526591 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-919fe742-33f0-4154-a8eb-b892f5be36e4 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:56.528206 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-919fe742-33f0-4154-a8eb-b892f5be36e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:56.598651 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338c874-41b2-4e03-b610-a22a3d69db65 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:56.621153 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 363/712] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:26:56.622257 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919fe742-33f0-4154-a8eb-b892f5be36e4 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:56.639816 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:56.649332 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece95bb-9116-4153-9bd3-2260ef37b755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:56.650508 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece95bb-9116-4153-9bd3-2260ef37b755 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:56.650800 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece95bb-9116-4153-9bd3-2260ef37b755 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:56.651087 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece95bb-9116-4153-9bd3-2260ef37b755 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:56.651932 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece95bb-9116-4153-9bd3-2260ef37b755 None admin] RBAC: Adding query filter params (role.id=1cb72e4884a744f99a3df0dc628f7493, scope.project.id=7fe768315f5c43f487f71f043f11b8b8, user.id=f659395837ac4e6dbc17ed925f81f672) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:56.653666 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece95bb-9116-4153-9bd3-2260ef37b755 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:56.653791 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece95bb-9116-4153-9bd3-2260ef37b755 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:56.661213 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 350/713] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:26:56 2022] GET /identity/v3/role_assignments?user.id=f659395837ac4e6dbc17ed925f81f672&scope.project.id=7fe768315f5c43f487f71f043f11b8b8&role.id=1cb72e4884a744f99a3df0dc628f7493 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:56.663095 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece95bb-9116-4153-9bd3-2260ef37b755 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:56.753821 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919fe742-33f0-4154-a8eb-b892f5be36e4 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:56.766662 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:56.797926 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2070a-da21-49cf-8b55-4d0ac1b0934a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:56.798946 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2070a-da21-49cf-8b55-4d0ac1b0934a None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:56.799343 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2070a-da21-49cf-8b55-4d0ac1b0934a None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:56.799751 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2070a-da21-49cf-8b55-4d0ac1b0934a None admin] PATH_INFO: `/v3/services/network` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:56.800487 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe2070a-da21-49cf-8b55-4d0ac1b0934a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:56.802043 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe2070a-da21-49cf-8b55-4d0ac1b0934a None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:56.812550 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece95bb-9116-4153-9bd3-2260ef37b755 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:56.819427 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-bfe2070a-da21-49cf-8b55-4d0ac1b0934a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 21:26:56.819427 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:56.819427 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:26:56.819427 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:26:56.819427 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:26:56.819427 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:26:56.819427 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:26:56.819427 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:26:56.819427 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 21:26:56.819427 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:56.819427 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:26:56.819427 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:56.819427 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:56.819427 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:56.819427 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:56.819427 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:56.819427 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:56.820405 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:56.820405 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:56.820405 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:56.820405 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:56.820405 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:56.820405 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:56.820405 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:26:56.820405 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:26:56.820405 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:26:56.820405 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:26:56.820405 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:56.820405 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:56.820405 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:56.820405 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:56.820405 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:56.820405 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:56.821267 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:56.821267 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:56.821267 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:56.821267 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:56.821267 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:56.821267 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:56.821267 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:56.821267 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:56.821267 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:56.821267 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:56.821267 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:26:56.821267 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:26:56.821267 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 21:26:56.821267 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:56.826025 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 364/714] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:26:56 2022] GET /identity/v3/services/network => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:56.827411 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2070a-da21-49cf-8b55-4d0ac1b0934a None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:56.871340 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce2083-353b-430d-8a13-8001bcbc9102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:56.872164 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce2083-353b-430d-8a13-8001bcbc9102 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:56.872454 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce2083-353b-430d-8a13-8001bcbc9102 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:56.872738 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce2083-353b-430d-8a13-8001bcbc9102 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:56.888610 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce2083-353b-430d-8a13-8001bcbc9102 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:56.891085 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce2083-353b-430d-8a13-8001bcbc9102 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:56.914618 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-6cce2083-353b-430d-8a13-8001bcbc9102 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:56.914618 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:56.914618 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:56.914618 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:56.914618 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:56.914618 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:56.914618 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:56.914618 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:56.914618 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:56.914618 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:56.914618 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:56.914618 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:56.914618 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:26:56.914618 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:26:56.914618 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:26:56.916630 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:26:56.916630 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:56.916630 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:56.916630 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:56.916630 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:56.916630 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:56.916630 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:56.916630 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:56.916630 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:56.916630 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:56.916630 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:56.916630 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:56.916630 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:56.916630 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:56.916630 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:56.916630 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:56.916630 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:56.917701 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:26:56.917701 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:26:56.917701 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:56.917701 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:56.917701 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 351/715] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:26:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:56.923641 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce2083-353b-430d-8a13-8001bcbc9102 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:56.960871 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:56.979076 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2070a-da21-49cf-8b55-4d0ac1b0934a None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:57.017913 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b691cc0-a7e6-4008-b6c8-165108d52221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:57.018679 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b691cc0-a7e6-4008-b6c8-165108d52221 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:57.018978 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b691cc0-a7e6-4008-b6c8-165108d52221 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:57.019261 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b691cc0-a7e6-4008-b6c8-165108d52221 None admin] PATH_INFO: `/v3/services` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:57.019982 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b691cc0-a7e6-4008-b6c8-165108d52221 None admin] RBAC: Adding query filter params (name=network) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:57.020299 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b691cc0-a7e6-4008-b6c8-165108d52221 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:57.021711 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b691cc0-a7e6-4008-b6c8-165108d52221 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:57.029126 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 365/716] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Jul 5 21:26:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:26:57.035208 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b691cc0-a7e6-4008-b6c8-165108d52221 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:57.078327 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce2083-353b-430d-8a13-8001bcbc9102 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:57.098540 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:57.122766 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0f336-5699-4e18-affc-8100d67dc41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:57.123966 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0f336-5699-4e18-affc-8100d67dc41e None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:57.124265 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0f336-5699-4e18-affc-8100d67dc41e None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:57.124552 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0f336-5699-4e18-affc-8100d67dc41e None admin] PATH_INFO: `/v3/domains` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:57.125453 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b0f336-5699-4e18-affc-8100d67dc41e None admin] RBAC: Adding query filter params (name=Default) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:57.125921 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b0f336-5699-4e18-affc-8100d67dc41e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:57.127579 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b0f336-5699-4e18-affc-8100d67dc41e None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:57.144029 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 352/717] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:26:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:26:57.149970 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0f336-5699-4e18-affc-8100d67dc41e None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:57.171165 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b691cc0-a7e6-4008-b6c8-165108d52221 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:57.233181 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ca7d6-b917-45cb-995a-c627f93e9cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:57.233858 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ca7d6-b917-45cb-995a-c627f93e9cb4 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:57.234405 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ca7d6-b917-45cb-995a-c627f93e9cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:57.234689 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ca7d6-b917-45cb-995a-c627f93e9cb4 None admin] PATH_INFO: `/v3/services` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:57.235402 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0ca7d6-b917-45cb-995a-c627f93e9cb4 None admin] RBAC: Adding query filter params (type=network) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:57.235716 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0ca7d6-b917-45cb-995a-c627f93e9cb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:57.237099 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0ca7d6-b917-45cb-995a-c627f93e9cb4 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:57.244249 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 366/718] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Jul 5 21:26:57 2022] GET /identity/v3/services?type=network => generated 124 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:26:57.320891 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0f336-5699-4e18-affc-8100d67dc41e None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:57.375200 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49dae0-9144-4a57-a15a-441565ee8c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:57.375834 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49dae0-9144-4a57-a15a-441565ee8c61 None admin] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:57.376124 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49dae0-9144-4a57-a15a-441565ee8c61 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:57.376408 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49dae0-9144-4a57-a15a-441565ee8c61 None admin] PATH_INFO: `/v3/users` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:57.377129 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a49dae0-9144-4a57-a15a-441565ee8c61 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:57.378727 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a49dae0-9144-4a57-a15a-441565ee8c61 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:57.485277 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 353/719] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:26:57 2022] POST /identity/v3/users => generated 254 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:26:58.799693 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472e2b9-3b55-447c-ada4-4ad7a40e9ab1 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:58.800207 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472e2b9-3b55-447c-ada4-4ad7a40e9ab1 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:58.800281 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472e2b9-3b55-447c-ada4-4ad7a40e9ab1 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:58.802089 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 367/720] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:58.820345 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d29a4b-54ad-4c71-a16d-163e88126767 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:58.821369 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d29a4b-54ad-4c71-a16d-163e88126767 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:58.821369 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d29a4b-54ad-4c71-a16d-163e88126767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:58.842687 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-56d29a4b-54ad-4c71-a16d-163e88126767 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:58.843900 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-56d29a4b-54ad-4c71-a16d-163e88126767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:58.881772 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:58.930666 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 354/721] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:26:58.958012 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d005bd9-6c29-4b68-9cab-7e8fff930fa0 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:58.958356 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d005bd9-6c29-4b68-9cab-7e8fff930fa0 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:58.958629 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d005bd9-6c29-4b68-9cab-7e8fff930fa0 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:58.960204 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 368/722] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:58.965818 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdce666-b953-4b12-8c44-f1fa187a3b33 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:58.966198 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdce666-b953-4b12-8c44-f1fa187a3b33 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:58.966779 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdce666-b953-4b12-8c44-f1fa187a3b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:58.973951 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d005bd9-6c29-4b68-9cab-7e8fff930fa0 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:58.983861 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:58.987817 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-6fdce666-b953-4b12-8c44-f1fa187a3b33 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:58.989024 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-6fdce666-b953-4b12-8c44-f1fa187a3b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:59.068876 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 355/723] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:26:59.097230 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdce666-b953-4b12-8c44-f1fa187a3b33 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:59.177218 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d005bd9-6c29-4b68-9cab-7e8fff930fa0 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:59.205906 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:59.219111 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdce666-b953-4b12-8c44-f1fa187a3b33 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:59.250635 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961fc2c5-8197-4b70-9ca6-b3749bb99363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:59.251633 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fc2c5-8197-4b70-9ca6-b3749bb99363 None admin] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:59.252977 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fc2c5-8197-4b70-9ca6-b3749bb99363 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:59.256359 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fc2c5-8197-4b70-9ca6-b3749bb99363 None admin] PATH_INFO: `/v3/services` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:59.257493 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961fc2c5-8197-4b70-9ca6-b3749bb99363 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:59.259391 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961fc2c5-8197-4b70-9ca6-b3749bb99363 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:59.282738 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e8b11-afbf-437d-91d7-8ec90e83bfe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:59.283854 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e8b11-afbf-437d-91d7-8ec90e83bfe4 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:59.284328 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e8b11-afbf-437d-91d7-8ec90e83bfe4 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:59.284821 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e8b11-afbf-437d-91d7-8ec90e83bfe4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:59.296559 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e8b11-afbf-437d-91d7-8ec90e83bfe4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:26:59.307584 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-0c6e8b11-afbf-437d-91d7-8ec90e83bfe4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:26:59.307584 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:59.307584 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:59.307584 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:59.307584 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:59.307584 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:59.307584 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:59.307584 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:59.307584 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:59.307584 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:59.307584 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:59.307584 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:59.307584 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:26:59.307584 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:26:59.307584 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:26:59.307584 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:26:59.308523 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:26:59.308523 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:26:59.308523 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:26:59.308523 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:26:59.308523 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:59.308523 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:59.308523 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:59.308523 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:59.308523 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:59.308523 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:59.308523 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:59.308523 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:59.308523 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:59.308523 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:59.308523 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:59.308523 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:59.309384 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:59.309384 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:59.309384 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:59.309384 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:59.309384 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:26:59.309384 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:26:59.309384 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:26:59.309384 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:26:59.309384 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:26:59.309384 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:26:59.309384 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:26:59.309384 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:59.311841 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 356/724] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:26:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:26:59.318023 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e8b11-afbf-437d-91d7-8ec90e83bfe4 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:59.391605 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 369/725] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Jul 5 21:26:58 2022] POST /identity/v3/services => generated 251 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:26:59.409818 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a66da-1932-46b2-a703-7eda6f03d52d None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:59.410117 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a66da-1932-46b2-a703-7eda6f03d52d None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:59.410446 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a66da-1932-46b2-a703-7eda6f03d52d None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:59.412245 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 370/726] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:26:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:26:59.419443 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c7124-3ed5-4363-b873-673ce73324e4 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:59.419749 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c7124-3ed5-4363-b873-673ce73324e4 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:59.420294 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c7124-3ed5-4363-b873-673ce73324e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:59.459296 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-4d4c7124-3ed5-4363-b873-673ce73324e4 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:26:59.460547 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-4d4c7124-3ed5-4363-b873-673ce73324e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:26:59.462393 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e8b11-afbf-437d-91d7-8ec90e83bfe4 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:59.535458 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc37af-a2c1-43b7-b80e-f75e5b9a8e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:59.536630 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc37af-a2c1-43b7-b80e-f75e5b9a8e28 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:59.536630 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc37af-a2c1-43b7-b80e-f75e5b9a8e28 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:59.536799 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc37af-a2c1-43b7-b80e-f75e5b9a8e28 None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:59.537440 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedc37af-a2c1-43b7-b80e-f75e5b9a8e28 None admin] RBAC: Adding query filter params (name=admin) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:59.537753 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedc37af-a2c1-43b7-b80e-f75e5b9a8e28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:59.539190 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedc37af-a2c1-43b7-b80e-f75e5b9a8e28 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:59.561267 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:59.570014 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 371/727] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:26:59 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:26:59.573488 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 357/728] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:26:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:26:59.579193 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c7124-3ed5-4363-b873-673ce73324e4 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:59.616914 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc37af-a2c1-43b7-b80e-f75e5b9a8e28 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:59.629581 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:59.703937 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c7124-3ed5-4363-b873-673ce73324e4 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:59.735341 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc37af-a2c1-43b7-b80e-f75e5b9a8e28 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:59.741320 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758dc8f9-497b-491a-8224-29afc0fa16cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:59.742365 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758dc8f9-497b-491a-8224-29afc0fa16cc None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:59.743433 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758dc8f9-497b-491a-8224-29afc0fa16cc None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:59.743909 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758dc8f9-497b-491a-8224-29afc0fa16cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:59.754970 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758dc8f9-497b-491a-8224-29afc0fa16cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:59.756679 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758dc8f9-497b-491a-8224-29afc0fa16cc None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:59.773383 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548aaec8-69c1-41b8-b52c-9dd30e272f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:59.774334 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548aaec8-69c1-41b8-b52c-9dd30e272f5b None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:59.774767 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548aaec8-69c1-41b8-b52c-9dd30e272f5b None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:59.775183 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548aaec8-69c1-41b8-b52c-9dd30e272f5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:59.777333 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-758dc8f9-497b-491a-8224-29afc0fa16cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:59.777333 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:59.777333 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:59.777333 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:59.777333 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:59.777333 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:59.777333 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:59.777333 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:59.777333 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:59.777333 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:59.777333 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:59.777333 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:59.777333 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:26:59.777333 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:26:59.777333 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:26:59.778196 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:26:59.778196 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:59.778196 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:59.778196 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:59.778196 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:59.778196 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:59.778196 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:59.778196 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:59.778196 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:59.778196 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:59.778196 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:59.778196 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:59.778196 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:59.778196 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:59.778196 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:59.778196 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:59.778196 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:59.779048 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:26:59.779048 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:26:59.779048 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:26:59.779048 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:26:59.781248 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 372/729] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:26:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:26:59.787386 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758dc8f9-497b-491a-8224-29afc0fa16cc None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:59.793950 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548aaec8-69c1-41b8-b52c-9dd30e272f5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:26:59.803177 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-548aaec8-69c1-41b8-b52c-9dd30e272f5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:26:59.803177 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:26:59.803177 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:26:59.803177 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:26:59.803177 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:26:59.803177 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:26:59.803177 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:26:59.803177 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:26:59.803177 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:26:59.803177 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:26:59.803177 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:26:59.803177 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:26:59.803177 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:26:59.803177 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:26:59.803177 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:26:59.803177 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:26:59.804087 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:26:59.804087 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:26:59.804087 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:26:59.804087 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:26:59.804087 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:26:59.804087 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:26:59.804087 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:26:59.804087 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:26:59.804087 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:26:59.804087 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:26:59.804087 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:26:59.804087 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:26:59.804087 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:26:59.804087 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:26:59.804087 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:26:59.804087 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:26:59.804887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:26:59.804887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:26:59.804887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:26:59.804887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:26:59.804887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:26:59.804887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:26:59.804887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:26:59.804887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:26:59.804887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:26:59.804887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:26:59.804887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:26:59.804887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:26:59.808201 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 358/730] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:26:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:26:59.817157 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548aaec8-69c1-41b8-b52c-9dd30e272f5b None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:26:59.883304 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:59.890232 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:26:59.942827 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548aaec8-69c1-41b8-b52c-9dd30e272f5b None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:59.954235 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758dc8f9-497b-491a-8224-29afc0fa16cc None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:26:59.988426 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad2ddd-e348-4970-b621-82733860ee8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:59.989115 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad2ddd-e348-4970-b621-82733860ee8b None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:59.989414 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad2ddd-e348-4970-b621-82733860ee8b None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:59.989700 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad2ddd-e348-4970-b621-82733860ee8b None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:59.990490 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fad2ddd-e348-4970-b621-82733860ee8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:59.990873 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fad2ddd-e348-4970-b621-82733860ee8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:59.992066 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66ef71-1838-4a25-8dba-1e2ebd937d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:26:59.992202 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fad2ddd-e348-4970-b621-82733860ee8b None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:26:59.993323 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66ef71-1838-4a25-8dba-1e2ebd937d7b None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:26:59.993663 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66ef71-1838-4a25-8dba-1e2ebd937d7b None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:26:59.994012 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66ef71-1838-4a25-8dba-1e2ebd937d7b None admin] PATH_INFO: `/v3/domains` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:26:59.994878 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66ef71-1838-4a25-8dba-1e2ebd937d7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:26:59.995255 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66ef71-1838-4a25-8dba-1e2ebd937d7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:26:59.996699 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66ef71-1838-4a25-8dba-1e2ebd937d7b None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:00.001834 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 359/731] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:26:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:00.003193 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c63174d-10a8-45e3-a98e-2a817a5263d6 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:00.003489 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c63174d-10a8-45e3-a98e-2a817a5263d6 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:00.003777 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c63174d-10a8-45e3-a98e-2a817a5263d6 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:00.005026 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 360/732] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:27:00.009889 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c63174d-10a8-45e3-a98e-2a817a5263d6 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:00.010220 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 373/733] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:00.011585 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d98e1f-90b6-4c68-967c-4074d27bf68d None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:00.011885 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d98e1f-90b6-4c68-967c-4074d27bf68d None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:00.012165 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d98e1f-90b6-4c68-967c-4074d27bf68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:00.029894 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-73d98e1f-90b6-4c68-967c-4074d27bf68d None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:27:00.031161 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-73d98e1f-90b6-4c68-967c-4074d27bf68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:27:00.106997 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 374/734] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:27:00 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:27:00.107874 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d98e1f-90b6-4c68-967c-4074d27bf68d None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:00.143834 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c63174d-10a8-45e3-a98e-2a817a5263d6 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:00.153516 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:00.185066 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:00.191468 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcee8a1-70de-4602-8125-7392084d3904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:00.192576 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcee8a1-70de-4602-8125-7392084d3904 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:00.192878 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcee8a1-70de-4602-8125-7392084d3904 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:00.193164 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcee8a1-70de-4602-8125-7392084d3904 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:00.207015 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcee8a1-70de-4602-8125-7392084d3904 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:00.207015 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcee8a1-70de-4602-8125-7392084d3904 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:00.220011 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d98e1f-90b6-4c68-967c-4074d27bf68d None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:00.227653 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-2dcee8a1-70de-4602-8125-7392084d3904 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:00.227653 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:00.227653 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:00.227653 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:00.227653 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:00.227653 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:00.227653 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:00.227653 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:00.227653 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:00.227653 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:00.227653 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:00.227653 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:00.227653 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:27:00.227653 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:27:00.227653 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:27:00.229603 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:27:00.229603 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:00.229603 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:00.229603 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:00.229603 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:00.229603 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:00.229603 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:00.229603 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:00.229603 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:00.229603 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:00.229603 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:00.229603 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:00.229603 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:00.229603 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:00.229603 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:00.229603 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:00.229603 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:00.231844 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:27:00.231844 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:27:00.231844 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:00.231844 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:00.231844 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 361/735] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:27:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:00.231844 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcee8a1-70de-4602-8125-7392084d3904 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:00.257395 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47945967-790f-40dc-bac7-7234d282fa94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:00.258746 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47945967-790f-40dc-bac7-7234d282fa94 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:00.259127 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47945967-790f-40dc-bac7-7234d282fa94 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:00.259591 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47945967-790f-40dc-bac7-7234d282fa94 None admin] PATH_INFO: `/v3/users/nova` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:00.267450 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47945967-790f-40dc-bac7-7234d282fa94 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:00.268976 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47945967-790f-40dc-bac7-7234d282fa94 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:00.284853 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-47945967-790f-40dc-bac7-7234d282fa94 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:27:00.284853 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:00.284853 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:00.284853 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:00.284853 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:00.284853 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:00.284853 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:00.284853 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:00.284853 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:00.284853 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:00.284853 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:00.284853 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:00.284853 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:27:00.284853 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:27:00.284853 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:27:00.284853 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:27:00.286985 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:00.286985 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:00.286985 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:27:00.286985 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:27:00.286985 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:27:00.286985 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:27:00.286985 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:00.286985 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:00.286985 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:00.286985 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:00.286985 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:00.286985 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:00.286985 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:00.286985 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:00.286985 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:00.286985 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:00.286985 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:00.286985 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:00.289259 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:00.289259 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:00.289259 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:27:00.289259 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:27:00.289259 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:27:00.289259 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:27:00.289259 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:27:00.289259 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:27:00.289259 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:27:00.289259 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:00.289259 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 375/736] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Jul 5 21:27:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:00.289259 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47945967-790f-40dc-bac7-7234d282fa94 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:00.341023 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcee8a1-70de-4602-8125-7392084d3904 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:00.377736 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36732342-a50b-448f-a41a-1a2ee9d3b67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:00.378469 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36732342-a50b-448f-a41a-1a2ee9d3b67a None admin] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:00.378767 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36732342-a50b-448f-a41a-1a2ee9d3b67a None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:00.379059 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36732342-a50b-448f-a41a-1a2ee9d3b67a None admin] PATH_INFO: `/v3/services` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:00.379796 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36732342-a50b-448f-a41a-1a2ee9d3b67a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:00.381548 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36732342-a50b-448f-a41a-1a2ee9d3b67a None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:00.390812 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:00.394655 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47945967-790f-40dc-bac7-7234d282fa94 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:00.428841 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aefc257-95db-4ffc-acf7-5cac281b61ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:00.430842 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aefc257-95db-4ffc-acf7-5cac281b61ca None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:00.430842 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aefc257-95db-4ffc-acf7-5cac281b61ca None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:00.430842 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aefc257-95db-4ffc-acf7-5cac281b61ca None admin] PATH_INFO: `/v3/domains` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:00.431058 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aefc257-95db-4ffc-acf7-5cac281b61ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:00.431205 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aefc257-95db-4ffc-acf7-5cac281b61ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:00.432591 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aefc257-95db-4ffc-acf7-5cac281b61ca None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:00.443883 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 376/737] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:27:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:00.444690 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aefc257-95db-4ffc-acf7-5cac281b61ca None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:00.466308 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 362/738] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Jul 5 21:27:00 2022] POST /identity/v3/services => generated 240 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:27:00.468193 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc47b32-a737-4890-90a5-ff7b07058b28 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:00.468656 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc47b32-a737-4890-90a5-ff7b07058b28 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:00.468948 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc47b32-a737-4890-90a5-ff7b07058b28 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:00.470657 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 363/739] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:27:00.471389 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc47b32-a737-4890-90a5-ff7b07058b28 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:00.544669 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:00.583921 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aefc257-95db-4ffc-acf7-5cac281b61ca None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:00.639507 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08beefef-5eff-4440-a7db-51584ecfe3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:00.640471 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08beefef-5eff-4440-a7db-51584ecfe3e4 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:00.640471 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08beefef-5eff-4440-a7db-51584ecfe3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:00.640804 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08beefef-5eff-4440-a7db-51584ecfe3e4 None admin] PATH_INFO: `/v3/users` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:00.641590 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08beefef-5eff-4440-a7db-51584ecfe3e4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:00.641919 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08beefef-5eff-4440-a7db-51584ecfe3e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:00.643911 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08beefef-5eff-4440-a7db-51584ecfe3e4 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:00.644638 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc47b32-a737-4890-90a5-ff7b07058b28 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:00.666716 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 377/740] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Jul 5 21:27:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:00.668339 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbd04d-df62-4618-98be-b5217d1bc326 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:00.668339 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbd04d-df62-4618-98be-b5217d1bc326 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:00.668537 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbd04d-df62-4618-98be-b5217d1bc326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:00.688133 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-e8cbd04d-df62-4618-98be-b5217d1bc326 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:27:00.689367 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-e8cbd04d-df62-4618-98be-b5217d1bc326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:27:00.689846 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3a288-3f60-47bd-b1d4-00c8010f8454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:00.690981 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3a288-3f60-47bd-b1d4-00c8010f8454 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:00.691276 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3a288-3f60-47bd-b1d4-00c8010f8454 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:00.691563 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3a288-3f60-47bd-b1d4-00c8010f8454 None admin] PATH_INFO: `/v3/users/swift` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:00.699709 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e3a288-3f60-47bd-b1d4-00c8010f8454 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:00.700359 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:00.701185 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e3a288-3f60-47bd-b1d4-00c8010f8454 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:00.718665 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-b1e3a288-3f60-47bd-b1d4-00c8010f8454 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 21:27:00.718665 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:00.718665 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:00.718665 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:00.718665 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:00.718665 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:00.718665 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:00.718665 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:00.718665 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:00.718665 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:00.718665 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:00.718665 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:00.718665 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:27:00.718665 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:27:00.718665 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:27:00.718665 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:27:00.719554 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:00.719554 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:00.719554 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:27:00.719554 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:27:00.719554 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:27:00.719554 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:27:00.719554 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:00.719554 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:00.719554 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:00.719554 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:00.719554 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:00.719554 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:00.719554 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:00.719554 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:00.719554 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:00.719554 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:00.719554 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:00.719554 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:00.720893 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:00.720893 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:00.720893 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:27:00.720893 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:27:00.720893 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:27:00.720893 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:27:00.720893 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:27:00.720893 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:27:00.720893 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 21:27:00.720893 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:00.720893 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 364/741] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:27:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:00.721444 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3a288-3f60-47bd-b1d4-00c8010f8454 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:00.764725 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 378/742] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:27:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:27:00.765669 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cbd04d-df62-4618-98be-b5217d1bc326 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:00.861093 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3a288-3f60-47bd-b1d4-00c8010f8454 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:00.864122 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:00.896079 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cbd04d-df62-4618-98be-b5217d1bc326 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:00.913602 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feabebff-890f-4038-b0ae-773f98724179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:00.916078 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabebff-890f-4038-b0ae-773f98724179 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:00.917054 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabebff-890f-4038-b0ae-773f98724179 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:00.917695 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabebff-890f-4038-b0ae-773f98724179 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:00.931880 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feabebff-890f-4038-b0ae-773f98724179 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:00.934336 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feabebff-890f-4038-b0ae-773f98724179 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:00.946269 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef29fd-98b3-4932-9203-1cbdd234ee5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:00.947706 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef29fd-98b3-4932-9203-1cbdd234ee5d None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:00.947998 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef29fd-98b3-4932-9203-1cbdd234ee5d None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:00.948283 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef29fd-98b3-4932-9203-1cbdd234ee5d None admin] PATH_INFO: `/v3/users` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:00.949145 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef29fd-98b3-4932-9203-1cbdd234ee5d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:00.949465 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef29fd-98b3-4932-9203-1cbdd234ee5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:00.950942 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef29fd-98b3-4932-9203-1cbdd234ee5d None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:00.957811 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-feabebff-890f-4038-b0ae-773f98724179 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:00.957811 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:00.957811 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:00.957811 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:00.957811 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:00.957811 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:00.957811 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:00.957811 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:00.957811 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:00.957811 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:00.957811 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:00.957811 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:00.957811 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:27:00.957811 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:27:00.957811 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:27:00.958810 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:27:00.958810 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:00.958810 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:00.958810 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:00.958810 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:00.958810 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:00.958810 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:00.958810 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:00.958810 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:00.958810 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:00.958810 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:00.958810 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:00.958810 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:00.958810 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:00.958810 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:00.958810 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:00.958810 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:00.959672 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:27:00.959672 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:27:00.959672 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:00.959672 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:00.962474 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 365/743] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:27:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:00.963697 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feabebff-890f-4038-b0ae-773f98724179 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:00.974723 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:00.980906 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 379/744] 10.222.0.30 () {56 vars in 1135 bytes} [Tue Jul 5 21:27:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:00.981992 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef29fd-98b3-4932-9203-1cbdd234ee5d None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:01.079513 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feabebff-890f-4038-b0ae-773f98724179 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:01.119156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef29fd-98b3-4932-9203-1cbdd234ee5d None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:01.126044 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a6707-d6db-4126-a121-7d736553ca9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:01.127405 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a6707-d6db-4126-a121-7d736553ca9e None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:01.127700 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a6707-d6db-4126-a121-7d736553ca9e None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:01.127990 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a6707-d6db-4126-a121-7d736553ca9e None admin] PATH_INFO: `/v3/roles/service` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:01.143859 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956a6707-d6db-4126-a121-7d736553ca9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:27:01.151731 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-956a6707-d6db-4126-a121-7d736553ca9e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:27:01.151731 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:01.151731 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:01.151731 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:01.151731 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:01.151731 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:01.151731 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:01.151731 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:01.151731 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:01.151731 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:01.151731 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:01.151731 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:01.151731 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:27:01.151731 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:27:01.151731 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:27:01.151731 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:27:01.152650 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:27:01.152650 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:27:01.152650 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:27:01.152650 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:27:01.152650 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:01.152650 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:01.152650 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:01.152650 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:01.152650 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:01.152650 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:01.152650 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:01.152650 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:01.152650 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:01.152650 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:01.152650 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:01.152650 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:01.153455 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:01.153455 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:01.153455 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:01.153455 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:01.153455 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:27:01.153455 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:27:01.153455 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:27:01.153455 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:27:01.153455 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:27:01.153455 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:27:01.153455 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:27:01.153455 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:01.153455 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 366/745] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:27:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:01.154233 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a6707-d6db-4126-a121-7d736553ca9e None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:01.165775 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d8e5b-8f87-486e-af15-cd81e16d8551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:01.170149 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d8e5b-8f87-486e-af15-cd81e16d8551 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:01.170149 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d8e5b-8f87-486e-af15-cd81e16d8551 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:01.170149 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d8e5b-8f87-486e-af15-cd81e16d8551 None admin] PATH_INFO: `/v3/domains` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:01.170149 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d8e5b-8f87-486e-af15-cd81e16d8551 None admin] RBAC: Adding query filter params (name=Default) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:01.170149 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d8e5b-8f87-486e-af15-cd81e16d8551 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:01.170756 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d8e5b-8f87-486e-af15-cd81e16d8551 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:01.172596 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:01.188258 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 380/746] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:27:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:01.189126 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d8e5b-8f87-486e-af15-cd81e16d8551 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:01.270530 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a6707-d6db-4126-a121-7d736553ca9e None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:01.273695 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:01.310036 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe8a27-560f-4cce-b9f9-fcb0d954ec67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:01.310847 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe8a27-560f-4cce-b9f9-fcb0d954ec67 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:01.311202 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe8a27-560f-4cce-b9f9-fcb0d954ec67 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:01.311572 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe8a27-560f-4cce-b9f9-fcb0d954ec67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:01.344469 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d8e5b-8f87-486e-af15-cd81e16d8551 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:01.385643 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222023b7-a319-4be2-bb3a-898a02ddc3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:01.386673 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222023b7-a319-4be2-bb3a-898a02ddc3f6 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:01.387127 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222023b7-a319-4be2-bb3a-898a02ddc3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:01.387552 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222023b7-a319-4be2-bb3a-898a02ddc3f6 None admin] PATH_INFO: `/v3/roles` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:01.388464 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222023b7-a319-4be2-bb3a-898a02ddc3f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:01.388924 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222023b7-a319-4be2-bb3a-898a02ddc3f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:01.390538 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222023b7-a319-4be2-bb3a-898a02ddc3f6 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:01.406073 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 381/747] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:27:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:01.407336 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222023b7-a319-4be2-bb3a-898a02ddc3f6 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:01.515714 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe8a27-560f-4cce-b9f9-fcb0d954ec67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:01.517401 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe8a27-560f-4cce-b9f9-fcb0d954ec67 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:01.533194 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:01.550164 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222023b7-a319-4be2-bb3a-898a02ddc3f6 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:01.588501 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:01.605727 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce2e3a2-0c1e-4305-846c-04e357110788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:01.607466 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2e3a2-0c1e-4305-846c-04e357110788 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:01.608046 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2e3a2-0c1e-4305-846c-04e357110788 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:01.608607 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2e3a2-0c1e-4305-846c-04e357110788 None admin] PATH_INFO: `/v3/projects/service` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:01.619532 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce2e3a2-0c1e-4305-846c-04e357110788 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:01.622253 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce2e3a2-0c1e-4305-846c-04e357110788 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:01.636118 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 367/748] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:27:01 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:27:01.636118 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe8a27-560f-4cce-b9f9-fcb0d954ec67 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:01.653761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-1ce2e3a2-0c1e-4305-846c-04e357110788 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:27:01.653761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:01.653761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:01.653761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:01.653761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:01.653761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:01.653761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:01.653761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:01.653761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:01.653761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:01.653761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:01.653761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:01.653761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:27:01.653761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:27:01.653761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:27:01.654833 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:27:01.654833 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:01.654833 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:01.654833 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:01.654833 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:01.654833 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:01.654833 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:01.654833 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:01.654833 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:01.654833 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:01.654833 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:01.654833 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:01.654833 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:01.654833 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:01.654833 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:01.654833 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:01.654833 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:01.655870 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:27:01.655870 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:27:01.655870 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:27:01.655870 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:27:01.655870 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:27:01.655870 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:27:01.655870 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:27:01.655870 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:01.658384 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 382/749] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:27:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:01.659344 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce2e3a2-0c1e-4305-846c-04e357110788 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:01.758960 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe8a27-560f-4cce-b9f9-fcb0d954ec67 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:01.770966 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce2e3a2-0c1e-4305-846c-04e357110788 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:01.775394 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:01.798655 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ca2fe-65e8-4d00-a5bb-7229b53e1165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:01.799145 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ca2fe-65e8-4d00-a5bb-7229b53e1165 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:01.799437 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ca2fe-65e8-4d00-a5bb-7229b53e1165 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:01.799721 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ca2fe-65e8-4d00-a5bb-7229b53e1165 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:01.811262 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35398a-eeec-4d35-a7e7-5f9773d61ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:01.812079 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ca2fe-65e8-4d00-a5bb-7229b53e1165 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:01.812528 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35398a-eeec-4d35-a7e7-5f9773d61ee6 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:01.812994 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35398a-eeec-4d35-a7e7-5f9773d61ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:01.813453 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35398a-eeec-4d35-a7e7-5f9773d61ee6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:01.813557 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ca2fe-65e8-4d00-a5bb-7229b53e1165 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:01.825706 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef35398a-eeec-4d35-a7e7-5f9773d61ee6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:01.827622 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef35398a-eeec-4d35-a7e7-5f9773d61ee6 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:01.833652 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-6b9ca2fe-65e8-4d00-a5bb-7229b53e1165 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:01.833652 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:01.833652 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:01.833652 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:01.833652 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:01.833652 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:01.833652 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:01.833652 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:01.833652 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:01.833652 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:01.833652 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:01.833652 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:01.833652 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:27:01.833652 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:27:01.833652 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:27:01.834549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:27:01.834549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:01.834549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:01.834549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:01.834549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:01.834549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:01.834549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:01.834549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:01.834549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:01.834549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:01.834549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:01.834549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:01.834549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:01.834549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:01.834549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:01.834549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:01.834549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:01.835775 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:27:01.835775 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:27:01.835775 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:01.835775 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:01.835775 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 368/750] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:27:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:01.836349 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ca2fe-65e8-4d00-a5bb-7229b53e1165 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:01.853102 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-ef35398a-eeec-4d35-a7e7-5f9773d61ee6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:01.853102 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:01.853102 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:01.853102 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:01.853102 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:01.853102 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:01.853102 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:01.853102 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:01.853102 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:01.853102 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:01.853102 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:01.853102 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:01.853102 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:27:01.853102 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:27:01.853102 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:27:01.854211 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:27:01.854211 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:01.854211 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:01.854211 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:01.854211 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:01.854211 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:01.854211 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:01.854211 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:01.854211 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:01.854211 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:01.854211 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:01.854211 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:01.854211 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:01.854211 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:01.854211 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:01.854211 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:01.854211 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:01.859946 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:27:01.859946 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:27:01.859946 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:01.859946 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:01.859946 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 383/751] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:27:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:01.859946 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846ee17-c963-4e77-98be-23e0b9d2cc99 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:01.859946 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846ee17-c963-4e77-98be-23e0b9d2cc99 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:01.859946 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846ee17-c963-4e77-98be-23e0b9d2cc99 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:01.862504 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 384/752] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:27:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:27:01.863209 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5846ee17-c963-4e77-98be-23e0b9d2cc99 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:01.898098 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:01.965777 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ca2fe-65e8-4d00-a5bb-7229b53e1165 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:01.967428 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5846ee17-c963-4e77-98be-23e0b9d2cc99 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:02.003616 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0eb9a-cd03-4259-893d-4f2736380cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:02.003793 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58150d-13f4-49e6-a449-b15807f8dd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:02.004287 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58150d-13f4-49e6-a449-b15807f8dd01 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:02.004387 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0eb9a-cd03-4259-893d-4f2736380cce None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:02.004578 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0eb9a-cd03-4259-893d-4f2736380cce None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:02.004673 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58150d-13f4-49e6-a449-b15807f8dd01 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:02.004860 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58150d-13f4-49e6-a449-b15807f8dd01 None admin] PATH_INFO: `/v3/domains` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:02.004961 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0eb9a-cd03-4259-893d-4f2736380cce None admin] PATH_INFO: `/v3/projects` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:02.005581 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e58150d-13f4-49e6-a449-b15807f8dd01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:02.005673 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd0eb9a-cd03-4259-893d-4f2736380cce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:02.005894 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e58150d-13f4-49e6-a449-b15807f8dd01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:02.005986 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd0eb9a-cd03-4259-893d-4f2736380cce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:02.007313 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e58150d-13f4-49e6-a449-b15807f8dd01 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:02.007411 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd0eb9a-cd03-4259-893d-4f2736380cce None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:02.023839 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 385/753] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:02.023839 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58150d-13f4-49e6-a449-b15807f8dd01 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:02.025919 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 369/754] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:27:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:02.027289 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6638f9-57b5-4182-8732-8d65bd49ddfc None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:02.028307 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6638f9-57b5-4182-8732-8d65bd49ddfc None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:02.028307 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6638f9-57b5-4182-8732-8d65bd49ddfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:02.045424 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-6c6638f9-57b5-4182-8732-8d65bd49ddfc None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:27:02.046671 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-6c6638f9-57b5-4182-8732-8d65bd49ddfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:27:02.068558 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:02.123518 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 370/755] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:27:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:27:02.124914 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6638f9-57b5-4182-8732-8d65bd49ddfc None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:02.131821 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:02.139331 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58150d-13f4-49e6-a449-b15807f8dd01 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:02.177192 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d94f7-26a8-4738-b298-931d58d6afd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:02.177864 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d94f7-26a8-4738-b298-931d58d6afd1 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:02.178172 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d94f7-26a8-4738-b298-931d58d6afd1 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:02.178463 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d94f7-26a8-4738-b298-931d58d6afd1 None admin] PATH_INFO: `/v3/domains` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:02.179186 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d94f7-26a8-4738-b298-931d58d6afd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:02.179531 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d94f7-26a8-4738-b298-931d58d6afd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:02.181434 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d94f7-26a8-4738-b298-931d58d6afd1 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:02.193813 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 386/756] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:27:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:02.194656 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d94f7-26a8-4738-b298-931d58d6afd1 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:02.249565 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6638f9-57b5-4182-8732-8d65bd49ddfc None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:02.286790 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63ba63-d0da-4d4a-b94e-7ebefd1a4e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:02.287685 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63ba63-d0da-4d4a-b94e-7ebefd1a4e62 None admin] REQUEST_METHOD: `PUT` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:02.287972 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63ba63-d0da-4d4a-b94e-7ebefd1a4e62 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:02.288252 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63ba63-d0da-4d4a-b94e-7ebefd1a4e62 None admin] PATH_INFO: `/v3/projects/7fe768315f5c43f487f71f043f11b8b8/users/941ed10dfafc4bd48896843da26c9175/roles/00090b1962654604b8e106a05d44d06a` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:02.290356 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63ba63-d0da-4d4a-b94e-7ebefd1a4e62 None admin] RBAC: Authorizing `identity:create_grant(project_id=7fe768315f5c43f487f71f043f11b8b8, user_id=941ed10dfafc4bd48896843da26c9175, role_id=00090b1962654604b8e106a05d44d06a)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:02.291803 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63ba63-d0da-4d4a-b94e-7ebefd1a4e62 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:02.305761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d94f7-26a8-4738-b298-931d58d6afd1 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:02.362097 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86127bfc-b5f9-43b2-8372-16b88d2a911a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:02.362863 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86127bfc-b5f9-43b2-8372-16b88d2a911a None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:02.363143 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86127bfc-b5f9-43b2-8372-16b88d2a911a None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:02.363418 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86127bfc-b5f9-43b2-8372-16b88d2a911a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:02.365020 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 371/757] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:27:02 2022] PUT /identity/v3/projects/7fe768315f5c43f487f71f043f11b8b8/users/941ed10dfafc4bd48896843da26c9175/roles/00090b1962654604b8e106a05d44d06a => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:27:02.371170 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63ba63-d0da-4d4a-b94e-7ebefd1a4e62 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:02.371899 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86127bfc-b5f9-43b2-8372-16b88d2a911a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:02.373389 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86127bfc-b5f9-43b2-8372-16b88d2a911a None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:02.390544 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-86127bfc-b5f9-43b2-8372-16b88d2a911a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 21:27:02.390544 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:02.390544 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:02.390544 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:02.390544 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:02.390544 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:02.390544 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:02.390544 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:02.390544 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:02.390544 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:02.390544 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:02.390544 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:02.390544 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:27:02.390544 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:27:02.390544 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:27:02.390544 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:27:02.392658 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:02.392658 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:02.392658 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:27:02.392658 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:27:02.392658 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:27:02.392658 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:27:02.392658 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:02.392658 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:02.392658 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:02.392658 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:02.392658 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:02.392658 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:02.392658 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:02.392658 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:02.392658 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:02.392658 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:02.392658 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:02.392658 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:02.393781 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:02.393781 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:02.393781 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:27:02.393781 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:27:02.393781 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:27:02.393781 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:27:02.393781 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:27:02.393781 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:27:02.393781 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 21:27:02.393781 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:02.396660 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 387/758] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Jul 5 21:27:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:02.397935 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86127bfc-b5f9-43b2-8372-16b88d2a911a None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:02.408276 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:02.416438 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:02.520350 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86127bfc-b5f9-43b2-8372-16b88d2a911a None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:02.530171 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63ba63-d0da-4d4a-b94e-7ebefd1a4e62 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:02.566947 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95935fec-2d9b-4554-82e7-e7166b6b62e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:02.568091 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95935fec-2d9b-4554-82e7-e7166b6b62e0 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:02.568418 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95935fec-2d9b-4554-82e7-e7166b6b62e0 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:02.568871 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95935fec-2d9b-4554-82e7-e7166b6b62e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:02.579544 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95935fec-2d9b-4554-82e7-e7166b6b62e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:02.582052 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95935fec-2d9b-4554-82e7-e7166b6b62e0 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:02.587824 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce4eb3-678e-4dce-a6ec-d5b31f95ffd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:02.588656 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce4eb3-678e-4dce-a6ec-d5b31f95ffd1 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:02.588952 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce4eb3-678e-4dce-a6ec-d5b31f95ffd1 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:02.589236 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce4eb3-678e-4dce-a6ec-d5b31f95ffd1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:02.589906 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce4eb3-678e-4dce-a6ec-d5b31f95ffd1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:02.594284 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce4eb3-678e-4dce-a6ec-d5b31f95ffd1 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:02.596618 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-95935fec-2d9b-4554-82e7-e7166b6b62e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:27:02.596618 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:02.596618 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:02.596618 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:02.596618 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:02.596618 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:02.596618 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:02.596618 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:02.596618 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:02.596618 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:02.596618 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:02.596618 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:02.596618 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:27:02.596618 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:27:02.596618 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:27:02.597653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:27:02.597653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:02.597653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:02.597653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:02.597653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:02.597653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:02.597653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:02.597653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:02.597653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:02.597653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:02.597653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:02.597653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:02.597653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:02.597653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:02.597653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:02.597653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:02.597653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:02.598672 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:27:02.598672 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:27:02.598672 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:27:02.598672 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:27:02.598672 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:27:02.598672 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:27:02.598672 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:27:02.598672 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:02.602472 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 388/759] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:27:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:02.603426 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95935fec-2d9b-4554-82e7-e7166b6b62e0 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:02.611742 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-e5ce4eb3-678e-4dce-a6ec-d5b31f95ffd1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 21:27:02.611742 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:02.611742 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:27:02.611742 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:27:02.611742 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:27:02.611742 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:27:02.611742 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:27:02.611742 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:27:02.611742 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 21:27:02.611742 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:02.611742 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:27:02.611742 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:02.611742 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:02.611742 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:02.611742 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:02.611742 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:02.612880 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:02.612880 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:02.612880 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:02.612880 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:02.612880 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:02.612880 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:02.612880 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:02.612880 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:27:02.612880 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:27:02.612880 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:27:02.612880 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:27:02.612880 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:02.612880 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:02.612880 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:02.612880 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:02.612880 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:02.613893 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:02.613893 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:02.613893 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:02.613893 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:02.613893 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:02.613893 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:02.613893 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:02.613893 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:02.613893 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:02.613893 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:02.613893 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:02.613893 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:27:02.613893 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:27:02.613893 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 21:27:02.613893 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:02.616568 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 372/760] 10.222.0.30 () {56 vars in 1129 bytes} [Tue Jul 5 21:27:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:02.617403 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce4eb3-678e-4dce-a6ec-d5b31f95ffd1 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:02.687739 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:02.710493 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:02.714948 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95935fec-2d9b-4554-82e7-e7166b6b62e0 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:02.730197 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce4eb3-678e-4dce-a6ec-d5b31f95ffd1 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:02.750721 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326cf9a-790c-4a05-90e0-07bbe3238adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:02.751552 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326cf9a-790c-4a05-90e0-07bbe3238adc None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:02.751750 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326cf9a-790c-4a05-90e0-07bbe3238adc None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:02.751966 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326cf9a-790c-4a05-90e0-07bbe3238adc None admin] PATH_INFO: `/v3/users` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:02.752962 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6326cf9a-790c-4a05-90e0-07bbe3238adc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:02.753155 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6326cf9a-790c-4a05-90e0-07bbe3238adc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:02.754596 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6326cf9a-790c-4a05-90e0-07bbe3238adc None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:02.766907 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a51048e-7bd4-4f8f-94ac-51868d60587c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:02.767578 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51048e-7bd4-4f8f-94ac-51868d60587c None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:02.767868 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51048e-7bd4-4f8f-94ac-51868d60587c None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:02.768152 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51048e-7bd4-4f8f-94ac-51868d60587c None admin] PATH_INFO: `/v3/projects` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:02.768951 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a51048e-7bd4-4f8f-94ac-51868d60587c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:02.769300 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a51048e-7bd4-4f8f-94ac-51868d60587c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:02.770750 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a51048e-7bd4-4f8f-94ac-51868d60587c None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:02.777845 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 389/761] 10.222.0.30 () {56 vars in 1149 bytes} [Tue Jul 5 21:27:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:02.777845 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326cf9a-790c-4a05-90e0-07bbe3238adc None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:02.793168 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 373/762] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:27:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:02.793168 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d0db7-da15-46b4-ac23-5288180fdcf0 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:02.793168 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d0db7-da15-46b4-ac23-5288180fdcf0 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:02.793168 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d0db7-da15-46b4-ac23-5288180fdcf0 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:02.793168 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 374/763] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:27:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:27:02.793168 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d0db7-da15-46b4-ac23-5288180fdcf0 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:02.890481 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326cf9a-790c-4a05-90e0-07bbe3238adc None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:02.904085 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d0db7-da15-46b4-ac23-5288180fdcf0 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:02.923821 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:02.929174 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5420e76d-a252-480f-996b-835b9ee7bfdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:02.930544 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420e76d-a252-480f-996b-835b9ee7bfdc None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:02.930962 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420e76d-a252-480f-996b-835b9ee7bfdc None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:02.931430 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420e76d-a252-480f-996b-835b9ee7bfdc None admin] PATH_INFO: `/v3/services` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:02.932233 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5420e76d-a252-480f-996b-835b9ee7bfdc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:02.934977 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5420e76d-a252-480f-996b-835b9ee7bfdc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:02.934977 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5420e76d-a252-480f-996b-835b9ee7bfdc None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:02.939933 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a46ee6-e631-47a8-ab33-ef34d4bf6492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:02.940692 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a46ee6-e631-47a8-ab33-ef34d4bf6492 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:02.940983 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a46ee6-e631-47a8-ab33-ef34d4bf6492 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:02.941259 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a46ee6-e631-47a8-ab33-ef34d4bf6492 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:02.943535 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 390/764] 10.222.0.30 () {56 vars in 1124 bytes} [Tue Jul 5 21:27:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:02.944533 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5420e76d-a252-480f-996b-835b9ee7bfdc None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:02.952601 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:03.016174 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a46ee6-e631-47a8-ab33-ef34d4bf6492 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:03.017954 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a46ee6-e631-47a8-ab33-ef34d4bf6492 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:03.053743 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5420e76d-a252-480f-996b-835b9ee7bfdc None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:03.091402 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a361a-255b-4967-b833-ac0bfda484ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:03.092417 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a361a-255b-4967-b833-ac0bfda484ed None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:03.092846 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a361a-255b-4967-b833-ac0bfda484ed None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:03.093278 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a361a-255b-4967-b833-ac0bfda484ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:03.094110 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a361a-255b-4967-b833-ac0bfda484ed None admin] RBAC: Adding query filter params (role.id=00090b1962654604b8e106a05d44d06a, scope.project.id=7fe768315f5c43f487f71f043f11b8b8, user.id=f659395837ac4e6dbc17ed925f81f672) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:03.094464 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a361a-255b-4967-b833-ac0bfda484ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:03.095898 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a361a-255b-4967-b833-ac0bfda484ed None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:03.102322 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 391/765] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:27:02 2022] GET /identity/v3/role_assignments?user.id=f659395837ac4e6dbc17ed925f81f672&scope.project.id=7fe768315f5c43f487f71f043f11b8b8&role.id=00090b1962654604b8e106a05d44d06a => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:03.108451 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c71e2-d980-4bb8-9b68-0d590a461f6a None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:03.109361 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c71e2-d980-4bb8-9b68-0d590a461f6a None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:03.109799 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c71e2-d980-4bb8-9b68-0d590a461f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:03.131388 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 375/766] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:27:02 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:27:03.132414 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a46ee6-e631-47a8-ab33-ef34d4bf6492 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:03.135436 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-da3c71e2-d980-4bb8-9b68-0d590a461f6a None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:27:03.137986 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-da3c71e2-d980-4bb8-9b68-0d590a461f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:27:03.199186 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:03.205936 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:03.218894 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 392/767] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:27:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:27:03.220098 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c71e2-d980-4bb8-9b68-0d590a461f6a None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:03.282350 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a46ee6-e631-47a8-ab33-ef34d4bf6492 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:03.326934 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43aaa9d-4833-4886-be00-f57a5e841c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:03.327606 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43aaa9d-4833-4886-be00-f57a5e841c30 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:03.327895 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43aaa9d-4833-4886-be00-f57a5e841c30 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:03.328172 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43aaa9d-4833-4886-be00-f57a5e841c30 None admin] PATH_INFO: `/v3/services` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:03.328878 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43aaa9d-4833-4886-be00-f57a5e841c30 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:03.329183 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43aaa9d-4833-4886-be00-f57a5e841c30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:03.330789 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43aaa9d-4833-4886-be00-f57a5e841c30 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:03.364072 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c71e2-d980-4bb8-9b68-0d590a461f6a None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:03.382692 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 376/768] 10.222.0.30 () {56 vars in 1124 bytes} [Tue Jul 5 21:27:03 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:03.384348 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43aaa9d-4833-4886-be00-f57a5e841c30 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:03.405685 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff922a-8c0b-4bb3-8b5d-5c660b04416e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:03.406862 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff922a-8c0b-4bb3-8b5d-5c660b04416e None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:03.407287 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff922a-8c0b-4bb3-8b5d-5c660b04416e None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:03.407695 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff922a-8c0b-4bb3-8b5d-5c660b04416e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:03.419787 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ff922a-8c0b-4bb3-8b5d-5c660b04416e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:03.421512 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ff922a-8c0b-4bb3-8b5d-5c660b04416e None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:03.441092 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-06ff922a-8c0b-4bb3-8b5d-5c660b04416e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:03.441092 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:03.441092 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:03.441092 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:03.441092 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:03.441092 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:03.441092 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:03.441092 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:03.441092 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:03.441092 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:03.441092 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:03.441092 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:03.441092 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:27:03.441092 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:27:03.441092 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:27:03.442156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:27:03.442156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:03.442156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:03.442156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:03.442156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:03.442156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:03.442156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:03.442156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:03.442156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:03.442156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:03.442156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:03.442156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:03.442156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:03.442156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:03.442156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:03.442156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:03.442156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:03.443269 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:27:03.443269 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:27:03.443269 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:03.443269 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:03.449990 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 393/769] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:27:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:03.451080 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff922a-8c0b-4bb3-8b5d-5c660b04416e None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:03.497726 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:03.499862 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43aaa9d-4833-4886-be00-f57a5e841c30 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:03.502393 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:03.538056 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc1715-6db3-4c6a-a14c-24e1a8f33f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:03.539923 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc1715-6db3-4c6a-a14c-24e1a8f33f7c None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:03.540442 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc1715-6db3-4c6a-a14c-24e1a8f33f7c None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:03.540928 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc1715-6db3-4c6a-a14c-24e1a8f33f7c None admin] PATH_INFO: `/v3/services/network` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:03.541817 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbc1715-6db3-4c6a-a14c-24e1a8f33f7c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:03.543441 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbc1715-6db3-4c6a-a14c-24e1a8f33f7c None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:03.556844 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-8fbc1715-6db3-4c6a-a14c-24e1a8f33f7c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 21:27:03.556844 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:03.556844 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:27:03.556844 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:27:03.556844 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:27:03.556844 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:27:03.556844 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:27:03.556844 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:27:03.556844 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 21:27:03.556844 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:03.556844 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:27:03.556844 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:03.556844 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:03.556844 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:03.556844 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:03.556844 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:03.556844 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:03.558036 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:03.558036 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:03.558036 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:03.558036 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:03.558036 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:03.558036 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:03.558036 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:27:03.558036 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:27:03.558036 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:27:03.558036 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:27:03.558036 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:03.558036 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:03.558036 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:03.558036 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:03.558036 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:03.558036 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:03.558875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:03.558875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:03.558875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:03.558875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:03.558875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:03.558875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:03.558875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:03.558875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:03.558875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:03.558875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:03.558875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:27:03.558875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:27:03.558875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 21:27:03.558875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:03.564957 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 377/770] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:27:03 2022] GET /identity/v3/services/network => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:03.568044 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff922a-8c0b-4bb3-8b5d-5c660b04416e None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:03.568639 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc1715-6db3-4c6a-a14c-24e1a8f33f7c None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:03.616429 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc48c4-9c46-4286-a079-1912950c5b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:03.617107 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc48c4-9c46-4286-a079-1912950c5b61 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:03.617397 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc48c4-9c46-4286-a079-1912950c5b61 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:03.618364 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc48c4-9c46-4286-a079-1912950c5b61 None admin] PATH_INFO: `/v3/endpoints` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:03.619164 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc48c4-9c46-4286-a079-1912950c5b61 None admin] RBAC: Adding query filter params (interface=public, service_id=93dc019cda384a5ba4daaa086690068e, region_id=RegionOne) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:03.619482 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc48c4-9c46-4286-a079-1912950c5b61 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:03.620866 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc48c4-9c46-4286-a079-1912950c5b61 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:03.633556 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 394/771] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Jul 5 21:27:03 2022] GET /identity/v3/endpoints?service_id=93dc019cda384a5ba4daaa086690068e&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:03.633556 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc48c4-9c46-4286-a079-1912950c5b61 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:03.715646 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc1715-6db3-4c6a-a14c-24e1a8f33f7c None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:03.744362 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc48c4-9c46-4286-a079-1912950c5b61 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:03.752247 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:03.765503 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795bc08-db90-4aec-9cc3-61e8d9f61f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:03.766878 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795bc08-db90-4aec-9cc3-61e8d9f61f24 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:03.767474 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795bc08-db90-4aec-9cc3-61e8d9f61f24 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:03.768016 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795bc08-db90-4aec-9cc3-61e8d9f61f24 None admin] PATH_INFO: `/v3/domains` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:03.769184 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5795bc08-db90-4aec-9cc3-61e8d9f61f24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:03.769650 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5795bc08-db90-4aec-9cc3-61e8d9f61f24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:03.771758 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5795bc08-db90-4aec-9cc3-61e8d9f61f24 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:03.780745 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b6458-5c12-4edf-bd7c-0a161c6a2810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:03.781691 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b6458-5c12-4edf-bd7c-0a161c6a2810 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:03.782206 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b6458-5c12-4edf-bd7c-0a161c6a2810 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:03.782687 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b6458-5c12-4edf-bd7c-0a161c6a2810 None admin] PATH_INFO: `/v3/services` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:03.783704 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517b6458-5c12-4edf-bd7c-0a161c6a2810 None admin] RBAC: Adding query filter params (name=network) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:03.784214 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517b6458-5c12-4edf-bd7c-0a161c6a2810 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:03.785788 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517b6458-5c12-4edf-bd7c-0a161c6a2810 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:03.791243 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 378/772] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:27:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:03.791243 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795bc08-db90-4aec-9cc3-61e8d9f61f24 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:03.796064 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 395/773] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Jul 5 21:27:03 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:03.797239 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b6458-5c12-4edf-bd7c-0a161c6a2810 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:03.824761 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:03.914028 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795bc08-db90-4aec-9cc3-61e8d9f61f24 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:03.934098 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b6458-5c12-4edf-bd7c-0a161c6a2810 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:03.963020 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2c416-56c2-4fa3-8a75-e5c7c4797eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:03.963712 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2c416-56c2-4fa3-8a75-e5c7c4797eea None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:03.964007 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2c416-56c2-4fa3-8a75-e5c7c4797eea None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:03.964292 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2c416-56c2-4fa3-8a75-e5c7c4797eea None admin] PATH_INFO: `/v3/services` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:03.965431 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca2c416-56c2-4fa3-8a75-e5c7c4797eea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:03.967471 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca2c416-56c2-4fa3-8a75-e5c7c4797eea None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:03.973374 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55b459-4144-40ca-bcdf-afff54199024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:03.974463 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55b459-4144-40ca-bcdf-afff54199024 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:03.974960 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55b459-4144-40ca-bcdf-afff54199024 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:03.975512 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55b459-4144-40ca-bcdf-afff54199024 None admin] PATH_INFO: `/v3/projects/service` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:03.978217 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 379/774] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Jul 5 21:27:03 2022] GET /identity/v3/services => generated 772 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:03.979443 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2c416-56c2-4fa3-8a75-e5c7c4797eea None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:03.997799 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc55b459-4144-40ca-bcdf-afff54199024 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:03.999733 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc55b459-4144-40ca-bcdf-afff54199024 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:04.028492 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-bc55b459-4144-40ca-bcdf-afff54199024 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:27:04.028492 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:04.028492 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:04.028492 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:04.028492 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:04.028492 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:04.028492 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:04.028492 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:04.028492 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:04.028492 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:04.028492 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:04.028492 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:04.028492 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:27:04.028492 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:27:04.028492 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:27:04.029412 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:27:04.029412 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:04.029412 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:04.029412 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:04.029412 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:04.029412 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:04.029412 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:04.029412 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:04.029412 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:04.029412 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:04.029412 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:04.029412 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:04.029412 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:04.029412 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:04.029412 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:04.029412 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:04.029412 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:04.030267 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:27:04.030267 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:27:04.030267 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:27:04.030267 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:27:04.030267 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:27:04.030267 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:27:04.030267 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:27:04.030267 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:04.042238 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 396/775] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:27:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:04.044231 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55b459-4144-40ca-bcdf-afff54199024 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:04.090367 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:04.175706 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:04.188867 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2c416-56c2-4fa3-8a75-e5c7c4797eea None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:04.210887 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55b459-4144-40ca-bcdf-afff54199024 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:04.234623 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a2bbd-658b-4744-b1ea-783ffe5e896b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:04.235223 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a2bbd-658b-4744-b1ea-783ffe5e896b None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:04.235515 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a2bbd-658b-4744-b1ea-783ffe5e896b None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:04.235802 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a2bbd-658b-4744-b1ea-783ffe5e896b None admin] PATH_INFO: `/v3/services` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:04.237010 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a2bbd-658b-4744-b1ea-783ffe5e896b None admin] RBAC: Adding query filter params (type=network) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:04.237335 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a2bbd-658b-4744-b1ea-783ffe5e896b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:04.239069 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a2bbd-658b-4744-b1ea-783ffe5e896b None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:04.246959 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 380/776] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Jul 5 21:27:03 2022] GET /identity/v3/services?type=network => generated 350 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:04.255279 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a2bbd-658b-4744-b1ea-783ffe5e896b None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:04.255864 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696dba58-4b3e-4ff3-a97a-8410f9b7c734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:04.262426 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696dba58-4b3e-4ff3-a97a-8410f9b7c734 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:04.262426 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696dba58-4b3e-4ff3-a97a-8410f9b7c734 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:04.262426 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696dba58-4b3e-4ff3-a97a-8410f9b7c734 None admin] PATH_INFO: `/v3/projects` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:04.262426 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696dba58-4b3e-4ff3-a97a-8410f9b7c734 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:04.262426 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696dba58-4b3e-4ff3-a97a-8410f9b7c734 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:04.262426 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696dba58-4b3e-4ff3-a97a-8410f9b7c734 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:04.278920 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 397/777] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:27:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:27:04.284452 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696dba58-4b3e-4ff3-a97a-8410f9b7c734 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:04.389840 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:04.401730 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696dba58-4b3e-4ff3-a97a-8410f9b7c734 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:04.402993 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a2bbd-658b-4744-b1ea-783ffe5e896b None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:04.438159 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb33c98-f9ca-4985-80cc-7923919f35e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:04.438947 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb33c98-f9ca-4985-80cc-7923919f35e2 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:04.439297 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb33c98-f9ca-4985-80cc-7923919f35e2 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:04.439648 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb33c98-f9ca-4985-80cc-7923919f35e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:04.440548 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb33c98-f9ca-4985-80cc-7923919f35e2 None admin] RBAC: Adding query filter params (role.id=1cb72e4884a744f99a3df0dc628f7493, scope.project.id=7fe768315f5c43f487f71f043f11b8b8, user.id=0b40f943261d4cd3a6d0a27335e9806d) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:04.440927 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb33c98-f9ca-4985-80cc-7923919f35e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:04.442470 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb33c98-f9ca-4985-80cc-7923919f35e2 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:04.446021 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa29eeea-a6cb-4b44-aeec-8feb3a8121c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:04.447198 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29eeea-a6cb-4b44-aeec-8feb3a8121c3 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:04.447797 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29eeea-a6cb-4b44-aeec-8feb3a8121c3 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:04.448152 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29eeea-a6cb-4b44-aeec-8feb3a8121c3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:04.449023 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa29eeea-a6cb-4b44-aeec-8feb3a8121c3 None admin] RBAC: Adding query filter params (interface=public, service_id=3f8d09b0337c4a4cac9174f8b2f72ee5, region_id=RegionOne) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:04.449411 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa29eeea-a6cb-4b44-aeec-8feb3a8121c3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:04.450882 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa29eeea-a6cb-4b44-aeec-8feb3a8121c3 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:04.454314 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 398/778] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:27:04 2022] GET /identity/v3/role_assignments?user.id=0b40f943261d4cd3a6d0a27335e9806d&scope.project.id=7fe768315f5c43f487f71f043f11b8b8&role.id=1cb72e4884a744f99a3df0dc628f7493 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:04.460119 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 381/779] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Jul 5 21:27:04 2022] GET /identity/v3/endpoints?service_id=3f8d09b0337c4a4cac9174f8b2f72ee5&interface=public®ion_id=RegionOne => generated 194 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:04.466475 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb33c98-f9ca-4985-80cc-7923919f35e2 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:04.622516 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb33c98-f9ca-4985-80cc-7923919f35e2 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:04.656998 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387e7e4-1b0e-4ae5-83a5-6cf21e3cb26a None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:04.657371 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387e7e4-1b0e-4ae5-83a5-6cf21e3cb26a None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:04.657727 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387e7e4-1b0e-4ae5-83a5-6cf21e3cb26a None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:04.659646 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 382/780] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:27:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:27:04.664735 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0370e-2619-4f6e-ae7f-f7565d3edaed None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:04.665039 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0370e-2619-4f6e-ae7f-f7565d3edaed None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:04.665364 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0370e-2619-4f6e-ae7f-f7565d3edaed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:04.678307 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ce28e-a9fe-4886-81b3-b2e25bdf19e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:04.679000 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ce28e-a9fe-4886-81b3-b2e25bdf19e2 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:04.679288 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ce28e-a9fe-4886-81b3-b2e25bdf19e2 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:04.679566 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ce28e-a9fe-4886-81b3-b2e25bdf19e2 None admin] PATH_INFO: `/v3/services` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:04.680300 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ce28e-a9fe-4886-81b3-b2e25bdf19e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:04.681711 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ce28e-a9fe-4886-81b3-b2e25bdf19e2 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:04.701255 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 399/781] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Jul 5 21:27:04 2022] GET /identity/v3/services => generated 772 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:04.702330 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-dda0370e-2619-4f6e-ae7f-f7565d3edaed None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:27:04.703604 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-dda0370e-2619-4f6e-ae7f-f7565d3edaed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:27:04.722008 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:04.796776 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 383/782] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:27:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:27:04.845611 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ce28e-a9fe-4886-81b3-b2e25bdf19e2 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:04.867638 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:04.982012 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ce28e-a9fe-4886-81b3-b2e25bdf19e2 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:05.027251 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026c2d8-e04e-4839-8858-717be4e01092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:05.028060 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026c2d8-e04e-4839-8858-717be4e01092 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:05.028347 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026c2d8-e04e-4839-8858-717be4e01092 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:05.028623 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026c2d8-e04e-4839-8858-717be4e01092 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:05.050235 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4026c2d8-e04e-4839-8858-717be4e01092 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:27:05.058104 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-4026c2d8-e04e-4839-8858-717be4e01092 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:27:05.058104 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:05.058104 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:05.058104 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:05.058104 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:05.058104 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:05.058104 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:05.058104 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:05.058104 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:05.058104 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:05.058104 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:05.058104 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:05.058104 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:27:05.058104 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:27:05.058104 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:27:05.058104 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:27:05.058996 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:27:05.058996 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:27:05.058996 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:27:05.058996 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:27:05.058996 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:05.058996 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:05.058996 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:05.058996 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:05.058996 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:05.058996 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:05.058996 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:05.058996 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:05.058996 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:05.058996 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:05.058996 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:05.058996 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:05.060213 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:05.060213 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:05.060213 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:05.060213 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:05.060213 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:27:05.060213 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:27:05.060213 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:27:05.060213 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:27:05.060213 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:27:05.060213 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:27:05.060213 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:27:05.060213 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:05.060213 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 400/783] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:27:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:05.065288 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda0370e-2619-4f6e-ae7f-f7565d3edaed None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:05.176510 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda0370e-2619-4f6e-ae7f-f7565d3edaed None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:05.217634 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871dcad-d6c3-4d5f-a396-221a52e79c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:05.218336 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871dcad-d6c3-4d5f-a396-221a52e79c72 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:05.218627 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871dcad-d6c3-4d5f-a396-221a52e79c72 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:05.218909 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871dcad-d6c3-4d5f-a396-221a52e79c72 None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:05.219665 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871dcad-d6c3-4d5f-a396-221a52e79c72 None admin] RBAC: Adding query filter params (name=admin) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:05.219978 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871dcad-d6c3-4d5f-a396-221a52e79c72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:05.221354 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871dcad-d6c3-4d5f-a396-221a52e79c72 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:05.230484 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 384/784] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:27:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:05.236169 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026c2d8-e04e-4839-8858-717be4e01092 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:05.339625 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:05.368513 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026c2d8-e04e-4839-8858-717be4e01092 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:05.418255 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a539a-f011-41f0-b41a-48628d06470b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:05.419066 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a539a-f011-41f0-b41a-48628d06470b None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:05.419349 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a539a-f011-41f0-b41a-48628d06470b None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:05.419626 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a539a-f011-41f0-b41a-48628d06470b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:05.434530 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd17fdc-5bc4-476b-8478-d4bd583a0960 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:05.434797 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd17fdc-5bc4-476b-8478-d4bd583a0960 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:05.435029 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd17fdc-5bc4-476b-8478-d4bd583a0960 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:05.436675 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 385/785] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:27:05.440156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a539a-f011-41f0-b41a-48628d06470b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:05.441624 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a539a-f011-41f0-b41a-48628d06470b None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:05.442712 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57c8f4-a10d-4e2d-8028-4ec0f19a5217 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:05.443007 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57c8f4-a10d-4e2d-8028-4ec0f19a5217 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:05.443288 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57c8f4-a10d-4e2d-8028-4ec0f19a5217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:05.462816 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-0e57c8f4-a10d-4e2d-8028-4ec0f19a5217 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:27:05.464029 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-0e57c8f4-a10d-4e2d-8028-4ec0f19a5217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:27:05.466538 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-b30a539a-f011-41f0-b41a-48628d06470b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:05.466538 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:05.466538 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:05.466538 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:05.466538 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:05.466538 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:05.466538 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:05.466538 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:05.466538 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:05.466538 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:05.466538 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:05.466538 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:05.466538 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:27:05.466538 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:27:05.466538 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:27:05.467578 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:27:05.467578 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:05.467578 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:05.467578 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:05.467578 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:05.467578 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:05.467578 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:05.467578 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:05.467578 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:05.467578 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:05.467578 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:05.467578 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:05.467578 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:05.467578 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:05.467578 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:05.467578 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:05.467578 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:05.468418 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:27:05.468418 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:27:05.468418 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:05.468418 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:05.469085 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 401/786] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:27:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:05.472832 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:05.477927 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a539a-f011-41f0-b41a-48628d06470b None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:05.547826 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 386/787] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:27:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:27:05.595931 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57c8f4-a10d-4e2d-8028-4ec0f19a5217 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:05.677908 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a539a-f011-41f0-b41a-48628d06470b None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:05.713739 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57c8f4-a10d-4e2d-8028-4ec0f19a5217 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:05.747543 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:05.751717 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e103d99-e168-407f-952a-01709011e005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:05.752531 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e103d99-e168-407f-952a-01709011e005 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:05.752854 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e103d99-e168-407f-952a-01709011e005 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:05.753140 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e103d99-e168-407f-952a-01709011e005 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:05.764808 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e103d99-e168-407f-952a-01709011e005 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:27:05.767868 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9ddb5-3fa3-40b6-85f8-952da21a3a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:05.768522 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9ddb5-3fa3-40b6-85f8-952da21a3a83 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:05.768806 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9ddb5-3fa3-40b6-85f8-952da21a3a83 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:05.769092 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9ddb5-3fa3-40b6-85f8-952da21a3a83 None admin] PATH_INFO: `/v3/domains` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:05.769831 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d9ddb5-3fa3-40b6-85f8-952da21a3a83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:05.770172 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d9ddb5-3fa3-40b6-85f8-952da21a3a83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:05.771580 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d9ddb5-3fa3-40b6-85f8-952da21a3a83 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:05.773276 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-5e103d99-e168-407f-952a-01709011e005 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:27:05.773276 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:05.773276 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:05.773276 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:05.773276 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:05.773276 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:05.773276 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:05.773276 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:05.773276 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:05.773276 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:05.773276 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:05.773276 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:05.773276 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:27:05.773276 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:27:05.773276 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:27:05.773276 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:27:05.775216 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:27:05.775216 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:27:05.775216 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:27:05.775216 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:27:05.775216 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:05.775216 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:05.775216 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:05.775216 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:05.775216 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:05.775216 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:05.775216 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:05.775216 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:05.775216 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:05.775216 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:05.775216 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:05.775216 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:05.776293 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:05.776293 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:05.776293 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:05.776293 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:05.776293 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:27:05.776293 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:27:05.776293 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:27:05.776293 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:27:05.776293 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:27:05.776293 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:27:05.776293 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:27:05.776293 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:05.776293 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 387/788] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:27:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:27:05.785026 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e103d99-e168-407f-952a-01709011e005 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:05.787919 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:05.796911 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 402/789] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:05.802044 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9ddb5-3fa3-40b6-85f8-952da21a3a83 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:05.893713 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e103d99-e168-407f-952a-01709011e005 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:05.934776 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4041e7-0774-44bb-b27b-cb2168bce066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:05.936514 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4041e7-0774-44bb-b27b-cb2168bce066 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:05.936801 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4041e7-0774-44bb-b27b-cb2168bce066 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:05.937083 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4041e7-0774-44bb-b27b-cb2168bce066 None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:05.937835 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4041e7-0774-44bb-b27b-cb2168bce066 None admin] RBAC: Adding query filter params (name=admin) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:05.938939 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4041e7-0774-44bb-b27b-cb2168bce066 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:05.940325 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4041e7-0774-44bb-b27b-cb2168bce066 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:05.957068 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 388/790] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:27:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:05.964266 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4041e7-0774-44bb-b27b-cb2168bce066 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:05.983819 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9ddb5-3fa3-40b6-85f8-952da21a3a83 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:06.045957 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:06.061656 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac4928-fb62-48bc-afb5-b2a7176e4c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:06.062512 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac4928-fb62-48bc-afb5-b2a7176e4c00 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:06.062810 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac4928-fb62-48bc-afb5-b2a7176e4c00 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:06.063089 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac4928-fb62-48bc-afb5-b2a7176e4c00 None admin] PATH_INFO: `/v3/users/nova` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:06.079977 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ac4928-fb62-48bc-afb5-b2a7176e4c00 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:06.081464 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ac4928-fb62-48bc-afb5-b2a7176e4c00 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:06.085930 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4041e7-0774-44bb-b27b-cb2168bce066 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:06.105642 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-49ac4928-fb62-48bc-afb5-b2a7176e4c00 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:27:06.105642 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:06.105642 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:06.105642 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:06.105642 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:06.105642 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:06.105642 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:06.105642 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:06.105642 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:06.105642 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:06.105642 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:06.105642 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:06.105642 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:27:06.105642 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:27:06.105642 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:27:06.105642 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:27:06.106617 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:06.106617 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:06.106617 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:27:06.106617 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:27:06.106617 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:27:06.106617 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:27:06.106617 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:06.106617 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:06.106617 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:06.106617 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:06.106617 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:06.106617 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:06.106617 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:06.106617 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:06.106617 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:06.106617 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:06.106617 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:06.106617 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:06.107518 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:06.107518 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:06.107518 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:27:06.107518 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:27:06.107518 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:27:06.107518 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:27:06.107518 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:27:06.107518 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:27:06.107518 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:27:06.107518 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:06.119232 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 403/791] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Jul 5 21:27:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:06.121500 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b2cc8-acf6-4fb5-8d10-6bbc0da8166a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:06.122329 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b2cc8-acf6-4fb5-8d10-6bbc0da8166a None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:06.122620 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b2cc8-acf6-4fb5-8d10-6bbc0da8166a None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:06.122954 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b2cc8-acf6-4fb5-8d10-6bbc0da8166a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:06.124507 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac4928-fb62-48bc-afb5-b2a7176e4c00 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:06.134657 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b2cc8-acf6-4fb5-8d10-6bbc0da8166a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:06.136179 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b2cc8-acf6-4fb5-8d10-6bbc0da8166a None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:06.160925 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-2d3b2cc8-acf6-4fb5-8d10-6bbc0da8166a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:06.160925 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:06.160925 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:06.160925 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:06.160925 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:06.160925 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:06.160925 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:06.160925 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:06.160925 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:06.160925 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:06.160925 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:06.160925 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:06.160925 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:27:06.160925 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:27:06.160925 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:27:06.161807 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:27:06.161807 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:06.161807 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:06.161807 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:06.161807 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:06.161807 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:06.161807 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:06.161807 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:06.161807 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:06.161807 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:06.161807 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:06.161807 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:06.161807 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:06.161807 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:06.161807 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:06.161807 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:06.161807 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:06.163170 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:27:06.163170 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:27:06.163170 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:06.163170 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:06.166188 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 389/792] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:27:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:27:06.169627 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b2cc8-acf6-4fb5-8d10-6bbc0da8166a None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:06.197205 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:06.246178 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac4928-fb62-48bc-afb5-b2a7176e4c00 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:06.283130 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b4f9a-ee02-4130-8357-f6725d990df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:06.284005 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b4f9a-ee02-4130-8357-f6725d990df5 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:06.284418 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b4f9a-ee02-4130-8357-f6725d990df5 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:06.284800 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b4f9a-ee02-4130-8357-f6725d990df5 None admin] PATH_INFO: `/v3/users` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:06.285747 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8b4f9a-ee02-4130-8357-f6725d990df5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:06.286195 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8b4f9a-ee02-4130-8357-f6725d990df5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:06.287748 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8b4f9a-ee02-4130-8357-f6725d990df5 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:06.306440 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 404/793] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Jul 5 21:27:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:06.312184 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b4f9a-ee02-4130-8357-f6725d990df5 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:06.384138 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b2cc8-acf6-4fb5-8d10-6bbc0da8166a None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:06.420592 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b4f9a-ee02-4130-8357-f6725d990df5 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:06.424092 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:06.434508 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:06.458795 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10219375-e8a6-4040-89c5-e9992879cc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:06.459454 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10219375-e8a6-4040-89c5-e9992879cc8f None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:06.459748 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10219375-e8a6-4040-89c5-e9992879cc8f None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:06.460035 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10219375-e8a6-4040-89c5-e9992879cc8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:06.474881 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e282c1-7579-423e-8535-8f193e3fb43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:06.475582 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e282c1-7579-423e-8535-8f193e3fb43c None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:06.475900 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e282c1-7579-423e-8535-8f193e3fb43c None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:06.476193 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e282c1-7579-423e-8535-8f193e3fb43c None admin] PATH_INFO: `/v3/domains` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:06.477578 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e282c1-7579-423e-8535-8f193e3fb43c None admin] RBAC: Adding query filter params (name=Default) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:06.478044 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e282c1-7579-423e-8535-8f193e3fb43c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:06.479486 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e282c1-7579-423e-8535-8f193e3fb43c None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:06.492612 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 390/794] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:27:06.498152 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e282c1-7579-423e-8535-8f193e3fb43c None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:06.532979 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10219375-e8a6-4040-89c5-e9992879cc8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:06.534641 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10219375-e8a6-4040-89c5-e9992879cc8f None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:06.641306 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e282c1-7579-423e-8535-8f193e3fb43c None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:06.665016 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 405/795] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:27:06 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:27:06.670678 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10219375-e8a6-4040-89c5-e9992879cc8f None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:06.694536 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:06.707109 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e78188-f566-431b-a2ed-550f6595ec7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:06.708000 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e78188-f566-431b-a2ed-550f6595ec7d None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:06.709281 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e78188-f566-431b-a2ed-550f6595ec7d None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:06.709281 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e78188-f566-431b-a2ed-550f6595ec7d None admin] PATH_INFO: `/v3/users/swift` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:06.721742 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e78188-f566-431b-a2ed-550f6595ec7d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:06.731401 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e78188-f566-431b-a2ed-550f6595ec7d None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:06.747279 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-40e78188-f566-431b-a2ed-550f6595ec7d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 21:27:06.747279 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:06.747279 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:06.747279 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:06.747279 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:06.747279 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:06.747279 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:06.747279 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:06.747279 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:06.747279 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:06.747279 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:06.747279 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:06.747279 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:27:06.747279 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:27:06.747279 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:27:06.747279 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:27:06.748271 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:06.748271 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:06.748271 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:27:06.748271 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:27:06.748271 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:27:06.748271 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:27:06.748271 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:06.748271 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:06.748271 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:06.748271 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:06.748271 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:06.748271 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:06.748271 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:06.748271 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:06.748271 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:06.748271 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:06.748271 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:06.748271 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:06.749176 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:06.749176 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:06.749176 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:27:06.749176 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:27:06.749176 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:27:06.749176 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:27:06.749176 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:27:06.749176 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:27:06.749176 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 21:27:06.749176 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:06.751797 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 391/796] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:27:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:06.757510 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e78188-f566-431b-a2ed-550f6595ec7d None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:06.778618 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10219375-e8a6-4040-89c5-e9992879cc8f None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:06.811644 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:06.816242 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4653d4-0f98-4aef-bf73-b9e2dfa1b02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:06.817379 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4653d4-0f98-4aef-bf73-b9e2dfa1b02a None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:06.817867 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4653d4-0f98-4aef-bf73-b9e2dfa1b02a None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:06.818376 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4653d4-0f98-4aef-bf73-b9e2dfa1b02a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:06.829785 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4653d4-0f98-4aef-bf73-b9e2dfa1b02a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:06.831542 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4653d4-0f98-4aef-bf73-b9e2dfa1b02a None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:06.853017 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-af4653d4-0f98-4aef-bf73-b9e2dfa1b02a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:06.853017 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:06.853017 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:06.853017 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:06.853017 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:06.853017 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:06.853017 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:06.853017 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:06.853017 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:06.853017 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:06.853017 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:06.853017 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:06.853017 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:27:06.853017 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:27:06.853017 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:27:06.854027 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:27:06.854027 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:06.854027 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:06.854027 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:06.854027 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:06.854027 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:06.854027 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:06.854027 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:06.854027 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:06.854027 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:06.854027 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:06.854027 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:06.854027 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:06.854027 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:06.854027 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:06.854027 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:06.854027 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:06.854915 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:27:06.854915 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:27:06.854915 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:06.854915 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:06.857124 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 406/797] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:27:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:27:06.863138 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb20a0c-cc82-4cf4-9b50-bd717fe4603d None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:06.863673 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb20a0c-cc82-4cf4-9b50-bd717fe4603d None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:06.864191 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb20a0c-cc82-4cf4-9b50-bd717fe4603d None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:06.865962 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 407/798] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:27:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:27:06.866897 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb20a0c-cc82-4cf4-9b50-bd717fe4603d None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:06.886352 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e78188-f566-431b-a2ed-550f6595ec7d None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:06.924123 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9754b67-90d2-4a6f-9411-c078cc1a1a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:06.924803 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9754b67-90d2-4a6f-9411-c078cc1a1a10 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:06.925147 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9754b67-90d2-4a6f-9411-c078cc1a1a10 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:06.925481 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9754b67-90d2-4a6f-9411-c078cc1a1a10 None admin] PATH_INFO: `/v3/users` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:06.926352 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9754b67-90d2-4a6f-9411-c078cc1a1a10 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:06.926665 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9754b67-90d2-4a6f-9411-c078cc1a1a10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:06.928195 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9754b67-90d2-4a6f-9411-c078cc1a1a10 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:06.935480 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:06.949575 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 392/799] 10.222.0.30 () {56 vars in 1135 bytes} [Tue Jul 5 21:27:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:27:06.951329 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7125cd6-71dc-4983-96c4-abe0f0ee3717 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:06.951800 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7125cd6-71dc-4983-96c4-abe0f0ee3717 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:06.952283 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7125cd6-71dc-4983-96c4-abe0f0ee3717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:06.971064 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-c7125cd6-71dc-4983-96c4-abe0f0ee3717 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:27:06.972581 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-c7125cd6-71dc-4983-96c4-abe0f0ee3717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:27:06.981802 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb20a0c-cc82-4cf4-9b50-bd717fe4603d None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:07.018487 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024db982-7648-43bb-8389-6028e4abf186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:07.019817 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024db982-7648-43bb-8389-6028e4abf186 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:07.020418 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024db982-7648-43bb-8389-6028e4abf186 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:07.020899 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024db982-7648-43bb-8389-6028e4abf186 None admin] PATH_INFO: `/v3/domains` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:07.021822 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024db982-7648-43bb-8389-6028e4abf186 None admin] RBAC: Adding query filter params (name=Default) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:07.022367 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024db982-7648-43bb-8389-6028e4abf186 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:07.024082 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024db982-7648-43bb-8389-6028e4abf186 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:07.036212 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 408/800] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:07.043492 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024db982-7648-43bb-8389-6028e4abf186 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:07.046959 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 393/801] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:27:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:27:07.047982 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7125cd6-71dc-4983-96c4-abe0f0ee3717 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:07.074668 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:07.152009 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7125cd6-71dc-4983-96c4-abe0f0ee3717 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:07.152627 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024db982-7648-43bb-8389-6028e4abf186 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:07.173503 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:07.187877 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84a078-9dbb-4922-83a5-bebb52903cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:07.188705 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a474bfd7-eda2-4b5f-b66a-5fa9e9eb64e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:07.189151 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84a078-9dbb-4922-83a5-bebb52903cd2 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:07.189587 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474bfd7-eda2-4b5f-b66a-5fa9e9eb64e0 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:07.189798 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84a078-9dbb-4922-83a5-bebb52903cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:07.189897 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474bfd7-eda2-4b5f-b66a-5fa9e9eb64e0 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:07.190159 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474bfd7-eda2-4b5f-b66a-5fa9e9eb64e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:07.190553 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84a078-9dbb-4922-83a5-bebb52903cd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:07.197719 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a474bfd7-eda2-4b5f-b66a-5fa9e9eb64e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:07.199216 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a474bfd7-eda2-4b5f-b66a-5fa9e9eb64e0 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:07.202239 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df84a078-9dbb-4922-83a5-bebb52903cd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:07.203918 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df84a078-9dbb-4922-83a5-bebb52903cd2 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:07.213664 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-a474bfd7-eda2-4b5f-b66a-5fa9e9eb64e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:27:07.213664 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:07.213664 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:07.213664 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:07.213664 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:07.213664 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:07.213664 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:07.213664 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:07.213664 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:07.213664 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:07.213664 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:07.213664 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:07.213664 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:27:07.213664 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:27:07.213664 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:27:07.214592 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:27:07.214592 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:07.214592 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:07.214592 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:07.214592 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:07.214592 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:07.214592 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:07.214592 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:07.214592 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:07.214592 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:07.214592 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:07.214592 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:07.214592 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:07.214592 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:07.214592 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:07.214592 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:07.214592 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:07.220599 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:27:07.220599 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:27:07.220599 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:27:07.220599 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:27:07.220599 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:27:07.220599 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:27:07.220599 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:27:07.220599 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:07.220599 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 394/802] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:27:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:07.220599 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf43975-ef87-4535-a4c7-d47615dbe28d None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:07.220599 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf43975-ef87-4535-a4c7-d47615dbe28d None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:07.221167 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf43975-ef87-4535-a4c7-d47615dbe28d None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:07.223689 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-df84a078-9dbb-4922-83a5-bebb52903cd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:07.223689 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:07.223689 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:07.223689 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:07.223689 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:07.223689 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:07.223689 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:07.223689 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:07.223689 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:07.223689 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:07.223689 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:07.223689 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:07.223689 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:27:07.223689 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:27:07.223689 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:27:07.224494 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:27:07.224494 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:07.224494 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:07.224494 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:07.224494 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:07.224494 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:07.224494 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:07.224494 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:07.224494 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:07.224494 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:07.224494 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:07.224494 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:07.224494 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:07.224494 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:07.224494 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:07.224494 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:07.224494 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:07.225328 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:27:07.225328 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:27:07.225328 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:07.225328 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:07.225549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 395/803] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:27:07 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:27:07.225549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf43975-ef87-4535-a4c7-d47615dbe28d None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:07.226274 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 409/804] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:27:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:07.227878 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84a078-9dbb-4922-83a5-bebb52903cd2 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:07.321509 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:07.338737 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84a078-9dbb-4922-83a5-bebb52903cd2 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:07.342355 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf43975-ef87-4535-a4c7-d47615dbe28d None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:07.375729 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c389414-abc0-4eb8-9591-9bdf048d9150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:07.376392 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c389414-abc0-4eb8-9591-9bdf048d9150 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:07.376681 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c389414-abc0-4eb8-9591-9bdf048d9150 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:07.376962 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c389414-abc0-4eb8-9591-9bdf048d9150 None admin] PATH_INFO: `/v3/projects` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:07.377754 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c389414-abc0-4eb8-9591-9bdf048d9150 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:07.378068 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c389414-abc0-4eb8-9591-9bdf048d9150 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:07.380596 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c389414-abc0-4eb8-9591-9bdf048d9150 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:07.387655 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a05b112-5485-4c5b-90f9-822cec1b1ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:07.388689 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05b112-5485-4c5b-90f9-822cec1b1ee3 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:07.388881 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05b112-5485-4c5b-90f9-822cec1b1ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:07.389171 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05b112-5485-4c5b-90f9-822cec1b1ee3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:07.389833 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a05b112-5485-4c5b-90f9-822cec1b1ee3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:07.391238 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a05b112-5485-4c5b-90f9-822cec1b1ee3 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:07.399735 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 410/805] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:27:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:07.399735 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b17c86-1391-4b19-b8fa-b6b05079b562 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:07.399735 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b17c86-1391-4b19-b8fa-b6b05079b562 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:07.399735 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b17c86-1391-4b19-b8fa-b6b05079b562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:07.404202 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-3a05b112-5485-4c5b-90f9-822cec1b1ee3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 21:27:07.404202 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:07.404202 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:27:07.404202 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:27:07.404202 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:27:07.404202 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:27:07.404202 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:27:07.404202 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:27:07.404202 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 21:27:07.404202 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:07.404202 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:27:07.404202 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:07.404202 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:07.404202 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:07.404202 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:07.404202 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:07.405067 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:07.405067 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:07.405067 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:07.405067 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:07.405067 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:07.405067 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:07.405067 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:07.405067 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:27:07.405067 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:27:07.405067 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:27:07.405067 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:27:07.405067 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:07.405067 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:07.405067 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:07.405067 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:07.405067 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:07.405892 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:07.405892 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:07.405892 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:07.405892 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:07.405892 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:07.405892 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:07.405892 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:07.405892 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:07.405892 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:07.405892 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:07.405892 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:07.405892 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:27:07.405892 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:27:07.405892 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 21:27:07.405892 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:07.405892 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 396/806] 10.222.0.30 () {56 vars in 1129 bytes} [Tue Jul 5 21:27:07 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:07.408148 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a05b112-5485-4c5b-90f9-822cec1b1ee3 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:07.419515 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-a7b17c86-1391-4b19-b8fa-b6b05079b562 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:27:07.420752 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-a7b17c86-1391-4b19-b8fa-b6b05079b562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:27:07.447524 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:07.489074 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 411/807] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:27:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:27:07.490037 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b17c86-1391-4b19-b8fa-b6b05079b562 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:07.511911 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a05b112-5485-4c5b-90f9-822cec1b1ee3 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:07.546387 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfdc348-f4f7-485c-94c3-bdc5e69cd63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:07.547049 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdc348-f4f7-485c-94c3-bdc5e69cd63c None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:07.547336 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdc348-f4f7-485c-94c3-bdc5e69cd63c None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:07.547616 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdc348-f4f7-485c-94c3-bdc5e69cd63c None admin] PATH_INFO: `/v3/domains` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:07.548345 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfdc348-f4f7-485c-94c3-bdc5e69cd63c None admin] RBAC: Adding query filter params (name=Default) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:07.548654 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfdc348-f4f7-485c-94c3-bdc5e69cd63c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:07.550030 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfdc348-f4f7-485c-94c3-bdc5e69cd63c None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:07.562368 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 397/808] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:07.563752 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b3880-d818-4d00-847a-c07742a953a5 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:07.564048 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b3880-d818-4d00-847a-c07742a953a5 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:07.564327 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b3880-d818-4d00-847a-c07742a953a5 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:07.565694 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 398/809] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:27:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:27:07.566561 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b3880-d818-4d00-847a-c07742a953a5 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:07.577252 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:07.595865 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b17c86-1391-4b19-b8fa-b6b05079b562 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:07.630474 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48b898-308f-47e8-9a9e-c200056e5444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:07.631134 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48b898-308f-47e8-9a9e-c200056e5444 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:07.631423 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48b898-308f-47e8-9a9e-c200056e5444 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:07.631707 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48b898-308f-47e8-9a9e-c200056e5444 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:07.632544 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d48b898-308f-47e8-9a9e-c200056e5444 None admin] RBAC: Adding query filter params (role.id=00090b1962654604b8e106a05d44d06a, scope.project.id=7fe768315f5c43f487f71f043f11b8b8, user.id=941ed10dfafc4bd48896843da26c9175) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:07.632864 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d48b898-308f-47e8-9a9e-c200056e5444 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:07.634722 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d48b898-308f-47e8-9a9e-c200056e5444 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:07.640517 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 412/810] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:27:07 2022] GET /identity/v3/role_assignments?user.id=941ed10dfafc4bd48896843da26c9175&scope.project.id=7fe768315f5c43f487f71f043f11b8b8&role.id=00090b1962654604b8e106a05d44d06a => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:07.641309 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48b898-308f-47e8-9a9e-c200056e5444 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:07.671767 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:07.680254 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b3880-d818-4d00-847a-c07742a953a5 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:07.718763 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f15502-1550-42e6-bbef-6f352195a3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:07.719455 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f15502-1550-42e6-bbef-6f352195a3c1 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:07.719747 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f15502-1550-42e6-bbef-6f352195a3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:07.720027 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f15502-1550-42e6-bbef-6f352195a3c1 None admin] PATH_INFO: `/v3/services` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:07.720793 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f15502-1550-42e6-bbef-6f352195a3c1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:07.721107 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f15502-1550-42e6-bbef-6f352195a3c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:07.722581 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f15502-1550-42e6-bbef-6f352195a3c1 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:07.728935 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 399/811] 10.222.0.30 () {56 vars in 1124 bytes} [Tue Jul 5 21:27:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:07.729814 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f15502-1550-42e6-bbef-6f352195a3c1 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:07.762289 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48b898-308f-47e8-9a9e-c200056e5444 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:07.803841 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79736b7b-d83c-4411-baab-8083cfb62a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:07.804749 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79736b7b-d83c-4411-baab-8083cfb62a5b None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:07.805672 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79736b7b-d83c-4411-baab-8083cfb62a5b None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:07.805967 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79736b7b-d83c-4411-baab-8083cfb62a5b None admin] PATH_INFO: `/v3/roles/service` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:07.819842 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:07.821731 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79736b7b-d83c-4411-baab-8083cfb62a5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:27:07.842171 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-79736b7b-d83c-4411-baab-8083cfb62a5b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:27:07.842171 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:07.842171 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:07.842171 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:07.842171 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:07.842171 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:07.842171 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:07.842171 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:07.842171 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:07.842171 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:07.842171 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:07.842171 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:07.842171 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:27:07.842171 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:27:07.842171 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:27:07.842171 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:27:07.843132 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:27:07.843132 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:27:07.843132 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:27:07.843132 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:27:07.843132 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:07.843132 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:07.843132 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:07.843132 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:07.843132 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:07.843132 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:07.843132 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:07.843132 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:07.843132 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:07.843132 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:07.843132 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:07.843132 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:07.843961 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:07.843961 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:07.843961 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:07.843961 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:07.843961 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:27:07.843961 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:27:07.843961 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:27:07.843961 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:27:07.843961 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:27:07.843961 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:27:07.843961 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:27:07.843961 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:07.843961 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 413/812] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:27:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:07.843961 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9e265-6309-4bc3-a9ca-7b9784dce5bc None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:07.845438 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9e265-6309-4bc3-a9ca-7b9784dce5bc None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:07.845438 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9e265-6309-4bc3-a9ca-7b9784dce5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:07.851759 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-18f9e265-6309-4bc3-a9ca-7b9784dce5bc None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:27:07.853506 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-18f9e265-6309-4bc3-a9ca-7b9784dce5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:27:07.861394 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f15502-1550-42e6-bbef-6f352195a3c1 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:07.906653 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58ab00-33e8-40ca-8e2b-d790eef59d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:07.907605 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58ab00-33e8-40ca-8e2b-d790eef59d73 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:07.907903 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58ab00-33e8-40ca-8e2b-d790eef59d73 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:07.908257 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58ab00-33e8-40ca-8e2b-d790eef59d73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:07.916598 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d58ab00-33e8-40ca-8e2b-d790eef59d73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:07.918075 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d58ab00-33e8-40ca-8e2b-d790eef59d73 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:07.933635 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 414/813] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:27:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:27:07.934339 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9e265-6309-4bc3-a9ca-7b9784dce5bc None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:07.934939 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-5d58ab00-33e8-40ca-8e2b-d790eef59d73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:27:07.934939 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:07.934939 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:07.934939 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:07.934939 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:07.934939 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:07.934939 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:07.934939 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:07.934939 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:07.934939 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:07.934939 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:07.934939 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:07.934939 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:27:07.934939 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:27:07.934939 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:27:07.935810 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:27:07.935810 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:07.935810 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:07.935810 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:07.935810 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:07.935810 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:07.935810 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:07.935810 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:07.935810 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:07.935810 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:07.935810 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:07.935810 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:07.935810 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:07.935810 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:07.935810 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:07.935810 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:07.935810 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:07.936655 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:27:07.936655 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:27:07.936655 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:27:07.936655 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:27:07.936655 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:27:07.936655 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:27:07.936655 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:27:07.936655 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:07.940033 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 400/814] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:27:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:07.941091 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58ab00-33e8-40ca-8e2b-d790eef59d73 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:07.959613 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:08.055188 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9e265-6309-4bc3-a9ca-7b9784dce5bc None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:08.055807 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58ab00-33e8-40ca-8e2b-d790eef59d73 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:08.085816 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:08.091680 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a9ac6-f76a-491a-8e0f-564b6d880a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:08.092311 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617afa3f-4ab0-48ae-927f-3a02e129239f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:08.092433 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a9ac6-f76a-491a-8e0f-564b6d880a1d None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:08.092647 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a9ac6-f76a-491a-8e0f-564b6d880a1d None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:08.092931 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617afa3f-4ab0-48ae-927f-3a02e129239f None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:08.093053 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a9ac6-f76a-491a-8e0f-564b6d880a1d None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:08.093221 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617afa3f-4ab0-48ae-927f-3a02e129239f None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:08.093502 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617afa3f-4ab0-48ae-927f-3a02e129239f None admin] PATH_INFO: `/v3/services` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:08.093691 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a9ac6-f76a-491a-8e0f-564b6d880a1d None admin] RBAC: Adding query filter params (name=service) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:08.094096 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a9ac6-f76a-491a-8e0f-564b6d880a1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:08.094394 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617afa3f-4ab0-48ae-927f-3a02e129239f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:08.094619 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617afa3f-4ab0-48ae-927f-3a02e129239f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:08.095596 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a9ac6-f76a-491a-8e0f-564b6d880a1d None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:08.096009 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617afa3f-4ab0-48ae-927f-3a02e129239f None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:08.106754 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 415/815] 10.222.0.30 () {56 vars in 1124 bytes} [Tue Jul 5 21:27:07 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:08.106754 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617afa3f-4ab0-48ae-927f-3a02e129239f None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:08.114109 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 401/816] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:27:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:08.114900 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a9ac6-f76a-491a-8e0f-564b6d880a1d None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:08.193300 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:08.215932 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617afa3f-4ab0-48ae-927f-3a02e129239f None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:08.226409 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a9ac6-f76a-491a-8e0f-564b6d880a1d None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:08.255937 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69371353-6ca4-4fab-ba7e-05001e772ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:08.256605 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69371353-6ca4-4fab-ba7e-05001e772ae2 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:08.257009 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69371353-6ca4-4fab-ba7e-05001e772ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:08.257225 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69371353-6ca4-4fab-ba7e-05001e772ae2 None admin] PATH_INFO: `/v3/projects` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:08.258009 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69371353-6ca4-4fab-ba7e-05001e772ae2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:08.262292 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69371353-6ca4-4fab-ba7e-05001e772ae2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:08.262292 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69371353-6ca4-4fab-ba7e-05001e772ae2 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:08.262633 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fce095-febc-4e18-819a-9557665d8a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:08.263446 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fce095-febc-4e18-819a-9557665d8a0e None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:08.263741 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fce095-febc-4e18-819a-9557665d8a0e None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:08.264031 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fce095-febc-4e18-819a-9557665d8a0e None admin] PATH_INFO: `/v3/services/network` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:08.264691 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fce095-febc-4e18-819a-9557665d8a0e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:08.266071 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fce095-febc-4e18-819a-9557665d8a0e None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:08.277242 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 416/817] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:27:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:08.277242 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69371353-6ca4-4fab-ba7e-05001e772ae2 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:08.279887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-82fce095-febc-4e18-819a-9557665d8a0e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 21:27:08.279887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:08.279887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:27:08.279887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:27:08.279887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:27:08.279887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:27:08.279887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:27:08.279887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:27:08.279887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 21:27:08.279887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:08.279887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:27:08.279887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:08.279887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:08.279887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:08.279887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:08.279887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:08.279887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:08.280851 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:08.280851 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:08.280851 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:08.280851 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:08.280851 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:08.280851 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:08.280851 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:27:08.280851 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:27:08.280851 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:27:08.280851 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:27:08.280851 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:08.280851 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:08.280851 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:08.280851 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:08.280851 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:08.280851 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:08.281651 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:08.281651 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:08.281651 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:08.281651 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:08.281651 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:08.281651 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:08.281651 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:08.281651 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:08.281651 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:08.281651 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:08.281651 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:27:08.281651 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:27:08.281651 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 21:27:08.281651 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:08.281651 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 402/818] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:27:08 2022] GET /identity/v3/services/network => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:08.282445 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fce095-febc-4e18-819a-9557665d8a0e None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:08.350643 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:08.392033 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69371353-6ca4-4fab-ba7e-05001e772ae2 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:08.396485 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fce095-febc-4e18-819a-9557665d8a0e None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:08.430072 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff8e8f-49fc-435d-a68b-869b39e900b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:08.430770 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff8e8f-49fc-435d-a68b-869b39e900b7 None admin] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:08.431058 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff8e8f-49fc-435d-a68b-869b39e900b7 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:08.431341 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff8e8f-49fc-435d-a68b-869b39e900b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:08.431688 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0692e6-919e-4c15-b95a-d6546c186b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:08.432088 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ff8e8f-49fc-435d-a68b-869b39e900b7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:08.432491 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0692e6-919e-4c15-b95a-d6546c186b33 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:08.432783 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0692e6-919e-4c15-b95a-d6546c186b33 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:08.433066 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0692e6-919e-4c15-b95a-d6546c186b33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:08.433477 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ff8e8f-49fc-435d-a68b-869b39e900b7 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:08.443922 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:08.444831 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0692e6-919e-4c15-b95a-d6546c186b33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:08.447482 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0692e6-919e-4c15-b95a-d6546c186b33 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:08.466196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-8e0692e6-919e-4c15-b95a-d6546c186b33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:08.466196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:08.466196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:08.466196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:08.466196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:08.466196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:08.466196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:08.466196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:08.466196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:08.466196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:08.466196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:08.466196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:08.466196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:27:08.466196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:27:08.466196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:27:08.467086 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:27:08.467086 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:08.467086 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:08.467086 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:08.467086 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:08.467086 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:08.467086 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:08.467086 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:08.467086 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:08.467086 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:08.467086 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:08.467086 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:08.467086 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:08.467086 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:08.467086 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:08.467086 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:08.467086 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:08.468030 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:27:08.468030 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:27:08.468030 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:08.468030 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:08.468030 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 403/819] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:27:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:08.468308 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0692e6-919e-4c15-b95a-d6546c186b33 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:08.551605 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 417/820] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Jul 5 21:27:08 2022] POST /identity/v3/endpoints => generated 346 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:27:08.552800 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff8e8f-49fc-435d-a68b-869b39e900b7 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:08.604430 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0692e6-919e-4c15-b95a-d6546c186b33 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:08.619590 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:08.661241 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1913067b-786b-4e14-b510-f12aaaf17cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:08.662765 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913067b-786b-4e14-b510-f12aaaf17cf6 None admin] REQUEST_METHOD: `PUT` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:08.663070 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913067b-786b-4e14-b510-f12aaaf17cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:08.663412 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913067b-786b-4e14-b510-f12aaaf17cf6 None admin] PATH_INFO: `/v3/projects/7fe768315f5c43f487f71f043f11b8b8/users/f659395837ac4e6dbc17ed925f81f672/roles/00090b1962654604b8e106a05d44d06a` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:08.666638 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1913067b-786b-4e14-b510-f12aaaf17cf6 None admin] RBAC: Authorizing `identity:create_grant(project_id=7fe768315f5c43f487f71f043f11b8b8, user_id=f659395837ac4e6dbc17ed925f81f672, role_id=00090b1962654604b8e106a05d44d06a)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:08.668904 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1913067b-786b-4e14-b510-f12aaaf17cf6 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:08.686186 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff8e8f-49fc-435d-a68b-869b39e900b7 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:08.726235 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8645a7-34df-42dd-b536-2469f2fb5f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:08.727001 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8645a7-34df-42dd-b536-2469f2fb5f33 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:08.727627 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8645a7-34df-42dd-b536-2469f2fb5f33 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:08.727907 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8645a7-34df-42dd-b536-2469f2fb5f33 None admin] PATH_INFO: `/v3/services` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:08.728623 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8645a7-34df-42dd-b536-2469f2fb5f33 None admin] RBAC: Adding query filter params (name=network) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:08.728937 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8645a7-34df-42dd-b536-2469f2fb5f33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:08.730357 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8645a7-34df-42dd-b536-2469f2fb5f33 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:08.735830 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 418/821] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Jul 5 21:27:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:08.736709 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8645a7-34df-42dd-b536-2469f2fb5f33 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:08.759719 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 404/822] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:27:08 2022] PUT /identity/v3/projects/7fe768315f5c43f487f71f043f11b8b8/users/f659395837ac4e6dbc17ed925f81f672/roles/00090b1962654604b8e106a05d44d06a => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:27:08.760923 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1913067b-786b-4e14-b510-f12aaaf17cf6 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:08.815620 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:08.863698 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8645a7-34df-42dd-b536-2469f2fb5f33 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:08.900778 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c03062-dc1d-4513-8746-ab64d36fc82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:08.901458 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c03062-dc1d-4513-8746-ab64d36fc82d None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:08.901749 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c03062-dc1d-4513-8746-ab64d36fc82d None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:08.902033 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c03062-dc1d-4513-8746-ab64d36fc82d None admin] PATH_INFO: `/v3/domains` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:08.902790 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c03062-dc1d-4513-8746-ab64d36fc82d None admin] RBAC: Adding query filter params (name=Default) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:08.903103 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c03062-dc1d-4513-8746-ab64d36fc82d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:08.904486 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c03062-dc1d-4513-8746-ab64d36fc82d None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:08.915235 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1913067b-786b-4e14-b510-f12aaaf17cf6 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:08.917933 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 419/823] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:27:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:08.929129 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c03062-dc1d-4513-8746-ab64d36fc82d None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:08.960098 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ccaa16-4df4-4f7f-b516-c55b8fe9df60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:08.961019 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccaa16-4df4-4f7f-b516-c55b8fe9df60 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:08.962005 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccaa16-4df4-4f7f-b516-c55b8fe9df60 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:08.962482 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccaa16-4df4-4f7f-b516-c55b8fe9df60 None admin] PATH_INFO: `/v3/services` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:08.963449 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ccaa16-4df4-4f7f-b516-c55b8fe9df60 None admin] RBAC: Adding query filter params (type=network) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:08.963903 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ccaa16-4df4-4f7f-b516-c55b8fe9df60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:08.965438 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ccaa16-4df4-4f7f-b516-c55b8fe9df60 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:08.971855 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 405/824] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Jul 5 21:27:08 2022] GET /identity/v3/services?type=network => generated 350 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:08.977589 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ccaa16-4df4-4f7f-b516-c55b8fe9df60 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:09.016004 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:09.093439 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ccaa16-4df4-4f7f-b516-c55b8fe9df60 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:09.096718 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c03062-dc1d-4513-8746-ab64d36fc82d None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:09.130575 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:09.138151 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f80fe0-465e-49ef-9de8-15d657f6a06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:09.138151 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f80fe0-465e-49ef-9de8-15d657f6a06a None admin] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:09.138151 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f80fe0-465e-49ef-9de8-15d657f6a06a None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:09.138151 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f80fe0-465e-49ef-9de8-15d657f6a06a None admin] PATH_INFO: `/v3/endpoints` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:09.146497 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f80fe0-465e-49ef-9de8-15d657f6a06a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:09.146497 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f80fe0-465e-49ef-9de8-15d657f6a06a None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:09.158570 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74dff40-7427-492a-a304-23574ea23847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:09.159402 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74dff40-7427-492a-a304-23574ea23847 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:09.159692 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74dff40-7427-492a-a304-23574ea23847 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:09.159972 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74dff40-7427-492a-a304-23574ea23847 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:09.168919 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74dff40-7427-492a-a304-23574ea23847 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:09.170409 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74dff40-7427-492a-a304-23574ea23847 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:09.186823 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-e74dff40-7427-492a-a304-23574ea23847 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 21:27:09.186823 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:09.186823 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:09.186823 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:09.186823 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:09.186823 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:09.186823 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:09.186823 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:09.186823 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:09.186823 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:09.186823 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:09.186823 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:09.186823 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:27:09.186823 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:27:09.186823 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:27:09.186823 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:27:09.187933 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:09.187933 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:09.187933 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:27:09.187933 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:27:09.187933 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:27:09.187933 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:27:09.187933 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:09.187933 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:09.187933 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:09.187933 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:09.187933 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:09.187933 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:09.187933 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:09.187933 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:09.187933 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:09.187933 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:09.187933 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:09.187933 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:09.189058 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:09.189058 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:09.189058 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:27:09.189058 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:27:09.189058 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:27:09.189058 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:27:09.189058 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:27:09.189058 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:27:09.189058 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 21:27:09.189058 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:09.189058 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 420/825] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Jul 5 21:27:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:27:09.195508 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74dff40-7427-492a-a304-23574ea23847 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:09.249636 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 406/826] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Jul 5 21:27:08 2022] POST /identity/v3/endpoints => generated 327 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:27:09.340583 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74dff40-7427-492a-a304-23574ea23847 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:09.396564 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8eeb2c-861a-468b-b87d-9a7c6e90b0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:09.397603 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8eeb2c-861a-468b-b87d-9a7c6e90b0a1 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:09.398051 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8eeb2c-861a-468b-b87d-9a7c6e90b0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:09.398499 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8eeb2c-861a-468b-b87d-9a7c6e90b0a1 None admin] PATH_INFO: `/v3/users` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:09.400477 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8eeb2c-861a-468b-b87d-9a7c6e90b0a1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:09.400947 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8eeb2c-861a-468b-b87d-9a7c6e90b0a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:09.403961 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8eeb2c-861a-468b-b87d-9a7c6e90b0a1 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:09.432748 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 421/827] 10.222.0.30 () {56 vars in 1149 bytes} [Tue Jul 5 21:27:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:09.434468 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f80fe0-465e-49ef-9de8-15d657f6a06a None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:09.545485 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:09.566158 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f80fe0-465e-49ef-9de8-15d657f6a06a None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:09.606121 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed3a04-cf97-4933-aa3e-f2b383a3110c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:09.606974 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed3a04-cf97-4933-aa3e-f2b383a3110c None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:09.607266 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed3a04-cf97-4933-aa3e-f2b383a3110c None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:09.607549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed3a04-cf97-4933-aa3e-f2b383a3110c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:09.620130 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfed3a04-cf97-4933-aa3e-f2b383a3110c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:09.623742 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfed3a04-cf97-4933-aa3e-f2b383a3110c None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:09.646814 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-cfed3a04-cf97-4933-aa3e-f2b383a3110c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:09.646814 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:09.646814 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:09.646814 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:09.646814 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:09.646814 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:09.646814 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:09.646814 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:09.646814 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:09.646814 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:09.646814 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:09.646814 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:09.646814 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:27:09.646814 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:27:09.646814 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:27:09.647842 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:27:09.647842 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:09.647842 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:09.647842 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:09.647842 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:09.647842 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:09.647842 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:09.647842 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:09.647842 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:09.647842 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:09.647842 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:09.647842 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:09.647842 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:09.647842 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:09.647842 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:09.647842 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:09.647842 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:09.649051 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:27:09.649051 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:27:09.649051 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:09.649051 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:09.649539 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 407/828] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:27:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:09.657340 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8eeb2c-861a-468b-b87d-9a7c6e90b0a1 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:09.720344 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:09.808266 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8eeb2c-861a-468b-b87d-9a7c6e90b0a1 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:10.001523 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854323d-5516-4989-8737-40302e47b460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:10.002528 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854323d-5516-4989-8737-40302e47b460 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:10.002958 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854323d-5516-4989-8737-40302e47b460 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:10.003516 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854323d-5516-4989-8737-40302e47b460 None admin] PATH_INFO: `/v3/domains` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:10.004387 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8854323d-5516-4989-8737-40302e47b460 None admin] RBAC: Adding query filter params (name=Default) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:10.004835 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8854323d-5516-4989-8737-40302e47b460 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:10.006366 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8854323d-5516-4989-8737-40302e47b460 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:10.024844 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 422/829] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:10.027510 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed3a04-cf97-4933-aa3e-f2b383a3110c None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:10.048716 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993c259-a22b-4d13-bce0-1adc108f9b5e None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:10.049246 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993c259-a22b-4d13-bce0-1adc108f9b5e None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:10.049674 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993c259-a22b-4d13-bce0-1adc108f9b5e None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:10.051547 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 423/830] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:27:10 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:27:10.058089 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb137f59-a2b2-4dde-b89b-5b1480d979f1 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:10.058614 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb137f59-a2b2-4dde-b89b-5b1480d979f1 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:10.059102 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb137f59-a2b2-4dde-b89b-5b1480d979f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:10.090396 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-eb137f59-a2b2-4dde-b89b-5b1480d979f1 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:27:10.092135 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-eb137f59-a2b2-4dde-b89b-5b1480d979f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:27:10.166427 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed3a04-cf97-4933-aa3e-f2b383a3110c None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:10.200866 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 424/831] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:27:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:27:10.224933 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6df33-7f50-47de-94d3-32fe550653fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:10.224933 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6df33-7f50-47de-94d3-32fe550653fc None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:10.224933 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6df33-7f50-47de-94d3-32fe550653fc None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:10.224933 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6df33-7f50-47de-94d3-32fe550653fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:10.226782 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb137f59-a2b2-4dde-b89b-5b1480d979f1 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:10.235479 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af6df33-7f50-47de-94d3-32fe550653fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:10.237875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af6df33-7f50-47de-94d3-32fe550653fc None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:10.241170 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:10.260747 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-9af6df33-7f50-47de-94d3-32fe550653fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:27:10.260747 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:10.260747 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:10.260747 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:10.260747 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:10.260747 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:10.260747 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:10.260747 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:10.260747 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:10.260747 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:10.260747 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:10.260747 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:10.260747 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:27:10.260747 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:27:10.260747 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:27:10.261772 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:27:10.261772 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:10.261772 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:10.261772 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:10.261772 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:10.261772 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:10.261772 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:10.261772 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:10.261772 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:10.261772 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:10.261772 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:10.261772 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:10.261772 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:10.261772 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:10.261772 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:10.261772 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:10.261772 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:10.262681 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:27:10.262681 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:27:10.262681 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:27:10.262681 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:27:10.262681 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:27:10.262681 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:27:10.262681 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:27:10.262681 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:10.262681 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 408/832] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:27:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:10.265989 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6df33-7f50-47de-94d3-32fe550653fc None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:10.275328 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:10.372087 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb137f59-a2b2-4dde-b89b-5b1480d979f1 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:10.402616 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6df33-7f50-47de-94d3-32fe550653fc None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:10.414886 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a408a-b542-4913-869d-2f2c34dda0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:10.415864 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a408a-b542-4913-869d-2f2c34dda0ab None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:10.415976 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a408a-b542-4913-869d-2f2c34dda0ab None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:10.416268 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a408a-b542-4913-869d-2f2c34dda0ab None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:10.416918 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a408a-b542-4913-869d-2f2c34dda0ab None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:10.418339 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a408a-b542-4913-869d-2f2c34dda0ab None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:10.431640 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-929a408a-b542-4913-869d-2f2c34dda0ab None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 21:27:10.431640 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:10.431640 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:27:10.431640 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:27:10.431640 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:27:10.431640 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:27:10.431640 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:27:10.431640 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:27:10.431640 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 21:27:10.431640 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:10.431640 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:27:10.431640 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:10.431640 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:10.431640 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:10.431640 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:10.431640 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:10.432582 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:10.432582 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:10.432582 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:10.432582 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:10.432582 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:10.432582 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:10.432582 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:10.432582 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:27:10.432582 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:27:10.432582 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:27:10.432582 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:27:10.432582 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:10.432582 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:10.432582 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:10.432582 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:10.432582 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:10.433951 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:10.433951 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:10.433951 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:10.433951 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:10.433951 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:10.433951 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:10.433951 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:10.433951 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:10.433951 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:10.433951 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:10.433951 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:10.433951 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:27:10.433951 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:27:10.433951 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 21:27:10.433951 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:10.433951 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 425/833] 10.222.0.30 () {56 vars in 1132 bytes} [Tue Jul 5 21:27:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:27:10.438597 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a408a-b542-4913-869d-2f2c34dda0ab None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:10.455052 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3061966-4f61-4964-875a-414b9654df0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:10.457354 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3061966-4f61-4964-875a-414b9654df0a None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:10.457845 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3061966-4f61-4964-875a-414b9654df0a None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:10.458619 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3061966-4f61-4964-875a-414b9654df0a None admin] PATH_INFO: `/v3/projects` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:10.460033 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3061966-4f61-4964-875a-414b9654df0a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:10.460565 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3061966-4f61-4964-875a-414b9654df0a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:10.462869 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3061966-4f61-4964-875a-414b9654df0a None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:10.485922 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 409/834] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:27:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:27:10.488527 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3061966-4f61-4964-875a-414b9654df0a None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:10.541926 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:10.558058 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a408a-b542-4913-869d-2f2c34dda0ab None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:10.566602 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:10.597326 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68aba2e-c2fe-40a9-8f99-c72784fff7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:10.598122 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68aba2e-c2fe-40a9-8f99-c72784fff7ff None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:10.598442 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68aba2e-c2fe-40a9-8f99-c72784fff7ff None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:10.598776 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68aba2e-c2fe-40a9-8f99-c72784fff7ff None admin] PATH_INFO: `/v3/services` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:10.599496 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68aba2e-c2fe-40a9-8f99-c72784fff7ff None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:10.599806 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68aba2e-c2fe-40a9-8f99-c72784fff7ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:10.601192 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68aba2e-c2fe-40a9-8f99-c72784fff7ff None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:10.605983 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3061966-4f61-4964-875a-414b9654df0a None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:10.606717 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 426/835] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Jul 5 21:27:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:27:10.615131 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68aba2e-c2fe-40a9-8f99-c72784fff7ff None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:10.648681 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e83156-5dc5-4b55-ac4b-e856ce639d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:10.650339 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e83156-5dc5-4b55-ac4b-e856ce639d0d None admin] REQUEST_METHOD: `PUT` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:10.650725 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e83156-5dc5-4b55-ac4b-e856ce639d0d None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:10.651105 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e83156-5dc5-4b55-ac4b-e856ce639d0d None admin] PATH_INFO: `/v3/projects/7fe768315f5c43f487f71f043f11b8b8/users/0b40f943261d4cd3a6d0a27335e9806d/roles/1cb72e4884a744f99a3df0dc628f7493` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:10.667292 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e83156-5dc5-4b55-ac4b-e856ce639d0d None admin] RBAC: Authorizing `identity:create_grant(project_id=7fe768315f5c43f487f71f043f11b8b8, user_id=0b40f943261d4cd3a6d0a27335e9806d, role_id=1cb72e4884a744f99a3df0dc628f7493)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:10.669003 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e83156-5dc5-4b55-ac4b-e856ce639d0d None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:10.733616 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68aba2e-c2fe-40a9-8f99-c72784fff7ff None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:10.770168 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62244efd-e7d1-4c84-8daa-c9ca8542585d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:10.770843 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62244efd-e7d1-4c84-8daa-c9ca8542585d None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:10.771125 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62244efd-e7d1-4c84-8daa-c9ca8542585d None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:10.771401 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62244efd-e7d1-4c84-8daa-c9ca8542585d None admin] PATH_INFO: `/v3/services` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:10.772115 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62244efd-e7d1-4c84-8daa-c9ca8542585d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:10.772412 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62244efd-e7d1-4c84-8daa-c9ca8542585d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:10.774438 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62244efd-e7d1-4c84-8daa-c9ca8542585d None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:10.779412 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 427/836] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Jul 5 21:27:10 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:11.037624 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e87da8-183e-46da-8582-d91c25e9158d None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:11.038022 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e87da8-183e-46da-8582-d91c25e9158d None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:11.038231 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e87da8-183e-46da-8582-d91c25e9158d None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:11.039796 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 428/837] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:27:11.044641 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514583e2-de39-4ecf-aa8c-773ef9de46cd None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:11.044936 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514583e2-de39-4ecf-aa8c-773ef9de46cd None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:11.045221 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514583e2-de39-4ecf-aa8c-773ef9de46cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:11.062552 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-514583e2-de39-4ecf-aa8c-773ef9de46cd None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:27:11.063755 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-514583e2-de39-4ecf-aa8c-773ef9de46cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:27:11.075571 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:11.096285 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 410/838] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:27:10 2022] PUT /identity/v3/projects/7fe768315f5c43f487f71f043f11b8b8/users/0b40f943261d4cd3a6d0a27335e9806d/roles/1cb72e4884a744f99a3df0dc628f7493 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:27:11.150198 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 429/839] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:27:11 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:27:11.174349 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e83156-5dc5-4b55-ac4b-e856ce639d0d None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:11.192686 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290e197-9b66-407a-a23d-5c9addeee122 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:11.193029 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290e197-9b66-407a-a23d-5c9addeee122 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:11.193265 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290e197-9b66-407a-a23d-5c9addeee122 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:11.194980 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 430/840] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:27:11.201277 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e202e-692f-47b4-902f-0d80472c56b8 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:11.201925 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e202e-692f-47b4-902f-0d80472c56b8 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:11.201925 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e202e-692f-47b4-902f-0d80472c56b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:11.221426 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-4a8e202e-692f-47b4-902f-0d80472c56b8 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:27:11.222698 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-4a8e202e-692f-47b4-902f-0d80472c56b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:27:11.307354 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e83156-5dc5-4b55-ac4b-e856ce639d0d None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:11.311498 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 431/841] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:27:11 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:27:11.318250 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:11.337459 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e202e-692f-47b4-902f-0d80472c56b8 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:11.347922 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176db0f4-a3a2-43b0-b656-aadaf292a153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:11.348951 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176db0f4-a3a2-43b0-b656-aadaf292a153 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:11.349238 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176db0f4-a3a2-43b0-b656-aadaf292a153 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:11.349519 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176db0f4-a3a2-43b0-b656-aadaf292a153 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:11.350330 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176db0f4-a3a2-43b0-b656-aadaf292a153 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:11.351769 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176db0f4-a3a2-43b0-b656-aadaf292a153 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:11.364854 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-176db0f4-a3a2-43b0-b656-aadaf292a153 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 21:27:11.364854 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:11.364854 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:27:11.364854 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:27:11.364854 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:27:11.364854 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:27:11.364854 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:27:11.364854 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:27:11.364854 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 21:27:11.364854 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:11.364854 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:27:11.364854 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:11.364854 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:11.364854 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:11.364854 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:11.364854 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:11.364854 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:11.365906 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:11.365906 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:11.365906 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:11.365906 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:11.365906 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:11.365906 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:11.365906 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:27:11.365906 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:27:11.365906 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:27:11.365906 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:27:11.365906 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:11.365906 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:11.365906 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:11.365906 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:11.365906 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:11.365906 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:11.366822 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:11.366822 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:11.366822 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:11.366822 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:11.366822 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:11.366822 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:11.366822 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:11.366822 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:11.366822 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:11.366822 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:11.366822 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:27:11.366822 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:27:11.366822 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 21:27:11.366822 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:11.366822 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 411/842] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:27:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:11.375051 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176db0f4-a3a2-43b0-b656-aadaf292a153 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:11.431981 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:11.457645 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e202e-692f-47b4-902f-0d80472c56b8 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:11.497712 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a8bce-25a4-4621-8b9e-5e90047d1432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:11.498856 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176db0f4-a3a2-43b0-b656-aadaf292a153 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:11.499306 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a8bce-25a4-4621-8b9e-5e90047d1432 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:11.499306 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a8bce-25a4-4621-8b9e-5e90047d1432 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:11.499464 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a8bce-25a4-4621-8b9e-5e90047d1432 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:11.511656 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a8bce-25a4-4621-8b9e-5e90047d1432 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:27:11.520415 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-718a8bce-25a4-4621-8b9e-5e90047d1432 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:27:11.520415 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:11.520415 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:11.520415 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:11.520415 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:11.520415 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:11.520415 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:11.520415 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:11.520415 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:11.520415 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:11.520415 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:11.520415 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:11.520415 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:27:11.520415 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:27:11.520415 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:27:11.520415 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:27:11.521455 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:27:11.521455 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:27:11.521455 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:27:11.521455 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:27:11.521455 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:11.521455 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:11.521455 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:11.521455 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:11.521455 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:11.521455 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:11.521455 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:11.521455 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:11.521455 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:11.521455 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:11.521455 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:11.521455 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:11.522467 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:11.522467 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:11.522467 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:11.522467 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:11.522467 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:27:11.522467 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:27:11.522467 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:27:11.522467 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:27:11.522467 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:27:11.522467 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:27:11.522467 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:27:11.522467 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:11.522467 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 432/843] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:27:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:27:11.529203 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a8bce-25a4-4621-8b9e-5e90047d1432 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:11.549683 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c5a14-ca2d-4fa7-992c-b7dc8cfcf0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:11.550436 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c5a14-ca2d-4fa7-992c-b7dc8cfcf0d2 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:11.550728 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c5a14-ca2d-4fa7-992c-b7dc8cfcf0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:11.551109 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c5a14-ca2d-4fa7-992c-b7dc8cfcf0d2 None admin] PATH_INFO: `/v3/services` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:11.551833 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c5a14-ca2d-4fa7-992c-b7dc8cfcf0d2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:11.552249 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c5a14-ca2d-4fa7-992c-b7dc8cfcf0d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:11.556796 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c5a14-ca2d-4fa7-992c-b7dc8cfcf0d2 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:11.567739 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 412/844] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:27:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:27:11.568898 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c5a14-ca2d-4fa7-992c-b7dc8cfcf0d2 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:11.608834 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:11.651484 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a8bce-25a4-4621-8b9e-5e90047d1432 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:11.681289 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c5a14-ca2d-4fa7-992c-b7dc8cfcf0d2 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:11.690742 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa0c98c-3a19-4465-ac30-b7942b639137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:11.691770 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0c98c-3a19-4465-ac30-b7942b639137 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:11.692251 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0c98c-3a19-4465-ac30-b7942b639137 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:11.692721 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0c98c-3a19-4465-ac30-b7942b639137 None admin] PATH_INFO: `/v3/roles` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:11.693780 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa0c98c-3a19-4465-ac30-b7942b639137 None admin] RBAC: Adding query filter params (name=admin) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:11.694307 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa0c98c-3a19-4465-ac30-b7942b639137 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:11.697089 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa0c98c-3a19-4465-ac30-b7942b639137 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:11.699684 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:11.712918 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 433/845] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:27:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:11.716487 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa0c98c-3a19-4465-ac30-b7942b639137 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:11.720598 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed9483-b61d-4dac-988d-0bef3588c18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:11.721525 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed9483-b61d-4dac-988d-0bef3588c18c None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:11.722002 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed9483-b61d-4dac-988d-0bef3588c18c None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:11.722463 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed9483-b61d-4dac-988d-0bef3588c18c None admin] PATH_INFO: `/v3/services` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:11.723421 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ed9483-b61d-4dac-988d-0bef3588c18c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:11.723889 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ed9483-b61d-4dac-988d-0bef3588c18c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:11.725422 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ed9483-b61d-4dac-988d-0bef3588c18c None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:11.731345 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 413/846] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:27:11 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:27:11.832816 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa0c98c-3a19-4465-ac30-b7942b639137 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:11.874013 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216bc43b-b290-40d4-9461-1852d8e27631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:11.874877 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216bc43b-b290-40d4-9461-1852d8e27631 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:11.875258 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216bc43b-b290-40d4-9461-1852d8e27631 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:11.875537 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216bc43b-b290-40d4-9461-1852d8e27631 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:11.887798 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216bc43b-b290-40d4-9461-1852d8e27631 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:11.889274 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216bc43b-b290-40d4-9461-1852d8e27631 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:11.909039 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-216bc43b-b290-40d4-9461-1852d8e27631 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:11.909039 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:11.909039 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:11.909039 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:11.909039 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:11.909039 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:11.909039 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:11.909039 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:11.909039 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:11.909039 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:11.909039 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:11.909039 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:11.909039 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:27:11.909039 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:27:11.909039 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:27:11.909950 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:27:11.909950 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:11.909950 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:11.909950 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:11.909950 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:11.909950 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:11.909950 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:11.909950 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:11.909950 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:11.909950 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:11.909950 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:11.909950 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:11.909950 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:11.909950 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:11.909950 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:11.909950 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:11.909950 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:11.910919 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:27:11.910919 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:27:11.910919 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:11.910919 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:11.910919 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 434/847] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:27:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:11.917539 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed9483-b61d-4dac-988d-0bef3588c18c None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:12.027814 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:12.031451 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed9483-b61d-4dac-988d-0bef3588c18c None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:12.067356 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91555fe-5eb3-4037-bdb8-a37ea8bd7af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:12.068414 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91555fe-5eb3-4037-bdb8-a37ea8bd7af8 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:12.068931 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91555fe-5eb3-4037-bdb8-a37ea8bd7af8 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:12.069424 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91555fe-5eb3-4037-bdb8-a37ea8bd7af8 None admin] PATH_INFO: `/v3/domains` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:12.070388 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91555fe-5eb3-4037-bdb8-a37ea8bd7af8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:12.070997 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91555fe-5eb3-4037-bdb8-a37ea8bd7af8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:12.072616 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91555fe-5eb3-4037-bdb8-a37ea8bd7af8 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:12.085211 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 414/848] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:12.091700 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216bc43b-b290-40d4-9461-1852d8e27631 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:12.145681 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:12.201419 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216bc43b-b290-40d4-9461-1852d8e27631 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:12.238226 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11022d-fb6b-4352-9bd1-476c72ecd303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:12.239287 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11022d-fb6b-4352-9bd1-476c72ecd303 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:12.239738 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11022d-fb6b-4352-9bd1-476c72ecd303 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:12.240174 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11022d-fb6b-4352-9bd1-476c72ecd303 None admin] PATH_INFO: `/v3/users/swift` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:12.248245 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d11022d-fb6b-4352-9bd1-476c72ecd303 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:12.249899 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d11022d-fb6b-4352-9bd1-476c72ecd303 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:12.266427 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-7d11022d-fb6b-4352-9bd1-476c72ecd303 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 21:27:12.266427 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:12.266427 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:12.266427 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:12.266427 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:12.266427 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:12.266427 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:12.266427 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:12.266427 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:12.266427 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:12.266427 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:12.266427 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:12.266427 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:27:12.266427 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:27:12.266427 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:27:12.266427 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:27:12.267616 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:12.267616 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:12.267616 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:27:12.267616 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:27:12.267616 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:27:12.267616 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:27:12.267616 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:12.267616 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:12.267616 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:12.267616 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:12.267616 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:12.267616 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:12.267616 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:12.267616 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:12.267616 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:12.267616 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:12.267616 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:12.267616 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:12.268757 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:12.268757 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:12.268757 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:27:12.268757 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:27:12.268757 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:27:12.268757 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:27:12.268757 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:27:12.268757 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:27:12.268757 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 21:27:12.268757 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:12.271234 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 435/849] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:27:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:12.277856 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91555fe-5eb3-4037-bdb8-a37ea8bd7af8 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:12.384881 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91555fe-5eb3-4037-bdb8-a37ea8bd7af8 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:12.419759 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8415a6d4-04a1-410f-a5b5-8083900c5ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:12.420443 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8415a6d4-04a1-410f-a5b5-8083900c5ef7 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:12.420732 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8415a6d4-04a1-410f-a5b5-8083900c5ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:12.421021 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8415a6d4-04a1-410f-a5b5-8083900c5ef7 None admin] PATH_INFO: `/v3/users` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:12.421860 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8415a6d4-04a1-410f-a5b5-8083900c5ef7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:12.422203 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8415a6d4-04a1-410f-a5b5-8083900c5ef7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:12.423652 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8415a6d4-04a1-410f-a5b5-8083900c5ef7 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:12.441728 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 415/850] 10.222.0.30 () {56 vars in 1135 bytes} [Tue Jul 5 21:27:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:12.448638 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11022d-fb6b-4352-9bd1-476c72ecd303 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:12.557477 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11022d-fb6b-4352-9bd1-476c72ecd303 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:12.571588 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:12.593623 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310cbde-11e7-4843-8379-4d2c80c3cd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:12.594323 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310cbde-11e7-4843-8379-4d2c80c3cd1a None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:12.594614 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310cbde-11e7-4843-8379-4d2c80c3cd1a None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:12.594895 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310cbde-11e7-4843-8379-4d2c80c3cd1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:12.665273 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6310cbde-11e7-4843-8379-4d2c80c3cd1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:12.666695 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6310cbde-11e7-4843-8379-4d2c80c3cd1a None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:12.769111 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 436/851] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:27:12 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:27:12.779235 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8415a6d4-04a1-410f-a5b5-8083900c5ef7 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:12.806619 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:12.889192 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8415a6d4-04a1-410f-a5b5-8083900c5ef7 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:12.927740 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b23c8-75f1-41df-aab9-7e46746f8889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:12.928885 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b23c8-75f1-41df-aab9-7e46746f8889 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:12.929392 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b23c8-75f1-41df-aab9-7e46746f8889 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:12.929889 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b23c8-75f1-41df-aab9-7e46746f8889 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:12.941545 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b23c8-75f1-41df-aab9-7e46746f8889 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:12.943345 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b23c8-75f1-41df-aab9-7e46746f8889 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:12.964674 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-2d3b23c8-75f1-41df-aab9-7e46746f8889 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:12.964674 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:12.964674 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:12.964674 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:12.964674 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:12.964674 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:12.964674 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:12.964674 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:12.964674 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:12.964674 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:12.964674 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:12.964674 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:12.964674 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:27:12.964674 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:27:12.964674 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:27:12.965557 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:27:12.965557 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:12.965557 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:12.965557 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:12.965557 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:12.965557 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:12.965557 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:12.965557 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:12.965557 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:12.965557 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:12.965557 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:12.965557 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:12.965557 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:12.965557 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:12.965557 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:12.965557 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:12.965557 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:12.966535 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:27:12.966535 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:27:12.966535 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:12.966535 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:12.968774 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 416/852] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:27:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:12.970839 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6310e-bb7a-453e-82aa-79d92f9153aa None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:12.971141 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6310e-bb7a-453e-82aa-79d92f9153aa None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:12.971428 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6310e-bb7a-453e-82aa-79d92f9153aa None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:12.972931 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 437/853] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:27:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:27:12.974492 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b23c8-75f1-41df-aab9-7e46746f8889 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:12.979988 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcedb5af-a97f-4979-a56e-3769b64f9b68 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:12.980357 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcedb5af-a97f-4979-a56e-3769b64f9b68 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:12.980718 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcedb5af-a97f-4979-a56e-3769b64f9b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:12.998695 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-fcedb5af-a97f-4979-a56e-3769b64f9b68 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:27:13.000109 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-fcedb5af-a97f-4979-a56e-3769b64f9b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:27:13.003293 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:13.062827 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:13.078438 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 438/854] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:27:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:27:13.101003 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b23c8-75f1-41df-aab9-7e46746f8889 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:13.104880 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcedb5af-a97f-4979-a56e-3769b64f9b68 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:13.143526 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cde8ae-6c3e-454b-8e29-c72237fdddd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:13.144587 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cde8ae-6c3e-454b-8e29-c72237fdddd5 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:13.145083 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cde8ae-6c3e-454b-8e29-c72237fdddd5 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:13.145634 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cde8ae-6c3e-454b-8e29-c72237fdddd5 None admin] PATH_INFO: `/v3/domains` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:13.146652 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cde8ae-6c3e-454b-8e29-c72237fdddd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:13.147216 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cde8ae-6c3e-454b-8e29-c72237fdddd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:13.149114 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cde8ae-6c3e-454b-8e29-c72237fdddd5 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:13.166469 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 417/855] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:27:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:27:13.168960 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cde8ae-6c3e-454b-8e29-c72237fdddd5 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:13.230936 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcedb5af-a97f-4979-a56e-3769b64f9b68 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:13.266793 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02c97e-ce0d-4a27-bae5-216aae4a8cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:13.267722 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02c97e-ce0d-4a27-bae5-216aae4a8cf9 None admin] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:13.268177 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02c97e-ce0d-4a27-bae5-216aae4a8cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:13.268458 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02c97e-ce0d-4a27-bae5-216aae4a8cf9 None admin] PATH_INFO: `/v3/services` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:13.269195 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d02c97e-ce0d-4a27-bae5-216aae4a8cf9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:13.270605 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d02c97e-ce0d-4a27-bae5-216aae4a8cf9 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:13.285986 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cde8ae-6c3e-454b-8e29-c72237fdddd5 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:13.315754 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:13.320667 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:13.321962 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651782c-aa47-48ce-83f1-ec5bea2c9737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:13.322858 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651782c-aa47-48ce-83f1-ec5bea2c9737 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:13.324463 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651782c-aa47-48ce-83f1-ec5bea2c9737 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:13.324463 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651782c-aa47-48ce-83f1-ec5bea2c9737 None admin] PATH_INFO: `/v3/projects/service` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:13.331704 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 439/856] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Jul 5 21:27:13 2022] POST /identity/v3/services => generated 269 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:27:13.331704 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd62b1d-84da-4d49-b931-431554f2091e None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:13.331704 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd62b1d-84da-4d49-b931-431554f2091e None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:13.331704 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd62b1d-84da-4d49-b931-431554f2091e None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:13.332332 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3651782c-aa47-48ce-83f1-ec5bea2c9737 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:13.332559 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3651782c-aa47-48ce-83f1-ec5bea2c9737 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:13.335648 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 440/857] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:27:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:27:13.337435 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177957e2-cacd-4841-895f-e7186f2c86f9 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:13.337739 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177957e2-cacd-4841-895f-e7186f2c86f9 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:13.338027 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177957e2-cacd-4841-895f-e7186f2c86f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:13.352592 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-3651782c-aa47-48ce-83f1-ec5bea2c9737 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:27:13.352592 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:13.352592 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:13.352592 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:13.352592 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:13.352592 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:13.352592 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:13.352592 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:13.352592 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:13.352592 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:13.352592 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:13.352592 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:13.352592 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:27:13.352592 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:27:13.352592 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:27:13.354073 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:27:13.354073 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:13.354073 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:13.354073 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:13.354073 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:13.354073 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:13.354073 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:13.354073 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:13.354073 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:13.354073 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:13.354073 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:13.354073 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:13.354073 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:13.354073 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:13.354073 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:13.354073 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:13.354073 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:13.354992 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:27:13.354992 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:27:13.354992 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:27:13.354992 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:27:13.354992 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:27:13.354992 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:27:13.354992 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:27:13.354992 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:13.359377 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 418/858] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:27:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:13.359925 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-177957e2-cacd-4841-895f-e7186f2c86f9 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:27:13.360426 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651782c-aa47-48ce-83f1-ec5bea2c9737 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:13.361539 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-177957e2-cacd-4841-895f-e7186f2c86f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:27:13.466168 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 441/859] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:27:13 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:27:13.492011 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177957e2-cacd-4841-895f-e7186f2c86f9 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:13.497261 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651782c-aa47-48ce-83f1-ec5bea2c9737 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:13.536377 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66717ba0-6bd3-49e3-b3cb-721f387e3d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:13.537066 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66717ba0-6bd3-49e3-b3cb-721f387e3d96 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:13.537359 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66717ba0-6bd3-49e3-b3cb-721f387e3d96 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:13.537651 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66717ba0-6bd3-49e3-b3cb-721f387e3d96 None admin] PATH_INFO: `/v3/projects` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:13.538496 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66717ba0-6bd3-49e3-b3cb-721f387e3d96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:13.538816 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66717ba0-6bd3-49e3-b3cb-721f387e3d96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:13.540352 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66717ba0-6bd3-49e3-b3cb-721f387e3d96 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:13.556819 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 419/860] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:27:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:13.564998 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66717ba0-6bd3-49e3-b3cb-721f387e3d96 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:13.627240 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177957e2-cacd-4841-895f-e7186f2c86f9 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:13.635836 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:13.662737 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:13.678800 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d82fd1c-d7d0-4e4e-a2b8-e1a3839707d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:13.680050 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82fd1c-d7d0-4e4e-a2b8-e1a3839707d1 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:13.680741 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82fd1c-d7d0-4e4e-a2b8-e1a3839707d1 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:13.681179 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82fd1c-d7d0-4e4e-a2b8-e1a3839707d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:13.695414 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d82fd1c-d7d0-4e4e-a2b8-e1a3839707d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:27:13.702226 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66717ba0-6bd3-49e3-b3cb-721f387e3d96 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:13.708197 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-7d82fd1c-d7d0-4e4e-a2b8-e1a3839707d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:27:13.708197 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:13.708197 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:13.708197 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:13.708197 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:13.708197 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:13.708197 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:13.708197 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:13.708197 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:13.708197 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:13.708197 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:13.708197 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:13.708197 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:27:13.708197 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:27:13.708197 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:27:13.708197 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:27:13.709172 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:27:13.709172 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:27:13.709172 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:27:13.709172 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:27:13.709172 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:13.709172 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:13.709172 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:13.709172 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:13.709172 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:13.709172 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:13.709172 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:13.709172 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:13.709172 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:13.709172 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:13.709172 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:13.709172 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:13.709974 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:13.709974 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:13.709974 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:13.709974 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:13.709974 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:27:13.709974 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:27:13.709974 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:27:13.709974 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:27:13.709974 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:27:13.709974 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:27:13.709974 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:27:13.709974 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:13.713154 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 442/861] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:27:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:13.719185 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d82fd1c-d7d0-4e4e-a2b8-e1a3839707d1 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:13.744769 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f10ef-e6bf-4956-bef1-a7d2e30c1e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:13.745398 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f10ef-e6bf-4956-bef1-a7d2e30c1e3a None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:13.745696 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f10ef-e6bf-4956-bef1-a7d2e30c1e3a None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:13.745988 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f10ef-e6bf-4956-bef1-a7d2e30c1e3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:13.746871 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f10ef-e6bf-4956-bef1-a7d2e30c1e3a None admin] RBAC: Adding query filter params (role.id=00090b1962654604b8e106a05d44d06a, scope.project.id=7fe768315f5c43f487f71f043f11b8b8, user.id=f659395837ac4e6dbc17ed925f81f672) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:13.747195 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f10ef-e6bf-4956-bef1-a7d2e30c1e3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:13.748781 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f10ef-e6bf-4956-bef1-a7d2e30c1e3a None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:13.755900 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 420/862] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:27:13 2022] GET /identity/v3/role_assignments?user.id=f659395837ac4e6dbc17ed925f81f672&scope.project.id=7fe768315f5c43f487f71f043f11b8b8&role.id=00090b1962654604b8e106a05d44d06a => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:13.845101 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d82fd1c-d7d0-4e4e-a2b8-e1a3839707d1 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:13.886722 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc5be1-4479-4e65-a2ec-92e3f110ce85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:13.887815 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc5be1-4479-4e65-a2ec-92e3f110ce85 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:13.888311 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc5be1-4479-4e65-a2ec-92e3f110ce85 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:13.888805 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc5be1-4479-4e65-a2ec-92e3f110ce85 None admin] PATH_INFO: `/v3/roles` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:13.889792 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc5be1-4479-4e65-a2ec-92e3f110ce85 None admin] RBAC: Adding query filter params (name=service) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:13.890358 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc5be1-4479-4e65-a2ec-92e3f110ce85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:13.892024 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc5be1-4479-4e65-a2ec-92e3f110ce85 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:13.903154 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 443/863] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:27:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:27:13.909191 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f10ef-e6bf-4956-bef1-a7d2e30c1e3a None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:14.006232 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99e154-9da3-45e3-a78c-6992d67a5038 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:14.006523 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99e154-9da3-45e3-a78c-6992d67a5038 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:14.006732 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99e154-9da3-45e3-a78c-6992d67a5038 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:14.008436 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 444/864] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:27:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:27:14.013712 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acbf44-db85-43d6-a0e2-029b82bbb332 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:14.014011 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acbf44-db85-43d6-a0e2-029b82bbb332 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:14.014325 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acbf44-db85-43d6-a0e2-029b82bbb332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:14.024976 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f10ef-e6bf-4956-bef1-a7d2e30c1e3a None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:14.032073 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-30acbf44-db85-43d6-a0e2-029b82bbb332 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:27:14.033388 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-30acbf44-db85-43d6-a0e2-029b82bbb332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:27:14.046075 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:14.076467 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc604242-b593-49b8-acab-ea81c3b361ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:14.077715 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc604242-b593-49b8-acab-ea81c3b361ab None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:14.078251 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc604242-b593-49b8-acab-ea81c3b361ab None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:14.078784 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc604242-b593-49b8-acab-ea81c3b361ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:14.085009 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:14.095311 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc604242-b593-49b8-acab-ea81c3b361ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:14.098316 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc604242-b593-49b8-acab-ea81c3b361ab None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:14.111646 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 445/865] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:27:14 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:27:14.122980 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-cc604242-b593-49b8-acab-ea81c3b361ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:14.122980 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:14.122980 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:14.122980 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:14.122980 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:14.122980 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:14.122980 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:14.122980 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:14.122980 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:14.122980 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:14.122980 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:14.122980 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:14.122980 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:27:14.122980 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:27:14.122980 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:27:14.123835 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:27:14.123835 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:14.123835 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:14.123835 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:14.123835 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:14.123835 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:14.123835 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:14.123835 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:14.123835 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:14.123835 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:14.123835 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:14.123835 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:14.123835 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:14.123835 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:14.123835 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:14.123835 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:14.123835 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:14.124682 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:27:14.124682 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:27:14.124682 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:14.124682 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:14.124682 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 421/866] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:27:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:14.131332 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30acbf44-db85-43d6-a0e2-029b82bbb332 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:14.133724 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc604242-b593-49b8-acab-ea81c3b361ab None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:14.244364 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30acbf44-db85-43d6-a0e2-029b82bbb332 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:14.263058 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc604242-b593-49b8-acab-ea81c3b361ab None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:14.280532 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd93a5bc-5252-4baa-9e85-9c31433e7d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:14.281216 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93a5bc-5252-4baa-9e85-9c31433e7d1e None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:14.281490 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93a5bc-5252-4baa-9e85-9c31433e7d1e None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:14.281770 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93a5bc-5252-4baa-9e85-9c31433e7d1e None admin] PATH_INFO: `/v3/domains` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:14.282545 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd93a5bc-5252-4baa-9e85-9c31433e7d1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:14.282856 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd93a5bc-5252-4baa-9e85-9c31433e7d1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:14.284245 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd93a5bc-5252-4baa-9e85-9c31433e7d1e None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:14.298179 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 446/867] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:14.302015 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd93a5bc-5252-4baa-9e85-9c31433e7d1e None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:14.302298 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73af263-9a42-4b5b-beeb-81bf83781d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:14.303298 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73af263-9a42-4b5b-beeb-81bf83781d75 None admin] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:14.303520 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73af263-9a42-4b5b-beeb-81bf83781d75 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:14.303764 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73af263-9a42-4b5b-beeb-81bf83781d75 None admin] PATH_INFO: `/v3/services` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:14.304602 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73af263-9a42-4b5b-beeb-81bf83781d75 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:14.306842 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73af263-9a42-4b5b-beeb-81bf83781d75 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:14.346712 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:14.386547 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 422/868] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Jul 5 21:27:14 2022] POST /identity/v3/services => generated 251 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:27:14.425438 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd93a5bc-5252-4baa-9e85-9c31433e7d1e None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:14.471987 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce451f5-a7a9-48a5-a1dd-aa2b4af32323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:14.472821 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce451f5-a7a9-48a5-a1dd-aa2b4af32323 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:14.473105 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce451f5-a7a9-48a5-a1dd-aa2b4af32323 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:14.473382 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce451f5-a7a9-48a5-a1dd-aa2b4af32323 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:14.482328 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce451f5-a7a9-48a5-a1dd-aa2b4af32323 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:14.483808 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce451f5-a7a9-48a5-a1dd-aa2b4af32323 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:14.499924 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-8ce451f5-a7a9-48a5-a1dd-aa2b4af32323 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 21:27:14.499924 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:14.499924 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:14.499924 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:14.499924 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:14.499924 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:14.499924 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:14.499924 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:14.499924 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:14.499924 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:14.499924 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:14.499924 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:14.499924 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:27:14.499924 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:27:14.499924 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:27:14.499924 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:27:14.500899 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:14.500899 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:14.500899 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:27:14.500899 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:27:14.500899 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:27:14.500899 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:27:14.500899 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:14.500899 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:14.500899 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:14.500899 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:14.500899 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:14.500899 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:14.500899 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:14.500899 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:14.500899 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:14.500899 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:14.500899 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:14.500899 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:14.501804 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:14.501804 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:14.501804 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:27:14.501804 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:27:14.501804 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:27:14.501804 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:27:14.501804 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:27:14.501804 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:27:14.501804 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 21:27:14.501804 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:14.501804 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 447/869] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Jul 5 21:27:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:14.507020 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73af263-9a42-4b5b-beeb-81bf83781d75 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:14.540051 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:14.626623 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73af263-9a42-4b5b-beeb-81bf83781d75 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:14.663314 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b456b-2721-436e-97b4-4240914ee5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:14.664004 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b456b-2721-436e-97b4-4240914ee5b7 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:14.664296 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b456b-2721-436e-97b4-4240914ee5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:14.664907 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b456b-2721-436e-97b4-4240914ee5b7 None admin] PATH_INFO: `/v3/users` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:14.665759 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b456b-2721-436e-97b4-4240914ee5b7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:14.666076 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b456b-2721-436e-97b4-4240914ee5b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:14.667546 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b456b-2721-436e-97b4-4240914ee5b7 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:14.685865 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 423/870] 10.222.0.30 () {56 vars in 1149 bytes} [Tue Jul 5 21:27:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:14.691380 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce451f5-a7a9-48a5-a1dd-aa2b4af32323 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:14.796689 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:14.803851 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce451f5-a7a9-48a5-a1dd-aa2b4af32323 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:14.839763 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0708c68e-3b81-4d36-b542-5245fe60a272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:14.840420 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708c68e-3b81-4d36-b542-5245fe60a272 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:14.840709 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708c68e-3b81-4d36-b542-5245fe60a272 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:14.840988 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708c68e-3b81-4d36-b542-5245fe60a272 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:14.910658 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0708c68e-3b81-4d36-b542-5245fe60a272 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:14.912189 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0708c68e-3b81-4d36-b542-5245fe60a272 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:15.022553 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:15.026175 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 448/871] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:27:14 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:27:15.031566 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b456b-2721-436e-97b4-4240914ee5b7 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:15.123664 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:15.140329 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b456b-2721-436e-97b4-4240914ee5b7 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:15.176739 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f5de1-0b28-4db1-8faf-041c582d3948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:15.177548 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f5de1-0b28-4db1-8faf-041c582d3948 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:15.177840 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f5de1-0b28-4db1-8faf-041c582d3948 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:15.178143 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f5de1-0b28-4db1-8faf-041c582d3948 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:15.189340 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17f5de1-0b28-4db1-8faf-041c582d3948 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:15.190846 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17f5de1-0b28-4db1-8faf-041c582d3948 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:15.210105 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-a17f5de1-0b28-4db1-8faf-041c582d3948 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:15.210105 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:15.210105 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:15.210105 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:15.210105 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:15.210105 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:15.210105 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:15.210105 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:15.210105 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:15.210105 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:15.210105 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:15.210105 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:15.210105 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:27:15.210105 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:27:15.210105 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:27:15.211061 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:27:15.211061 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:15.211061 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:15.211061 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:15.211061 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:15.211061 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:15.211061 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:15.211061 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:15.211061 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:15.211061 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:15.211061 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:15.211061 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:15.211061 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:15.211061 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:15.211061 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:15.211061 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:15.211061 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:15.212161 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:27:15.212161 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:27:15.212161 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:15.212161 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:15.212848 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 424/872] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:27:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:15.217933 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0708c68e-3b81-4d36-b542-5245fe60a272 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:15.325277 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0708c68e-3b81-4d36-b542-5245fe60a272 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:15.363822 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea2872-35c5-46c2-9894-62b3625dcfc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:15.364552 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea2872-35c5-46c2-9894-62b3625dcfc8 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:15.368566 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea2872-35c5-46c2-9894-62b3625dcfc8 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:15.368566 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea2872-35c5-46c2-9894-62b3625dcfc8 None admin] PATH_INFO: `/v3/domains` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:15.368566 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ea2872-35c5-46c2-9894-62b3625dcfc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:15.368566 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ea2872-35c5-46c2-9894-62b3625dcfc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:15.368566 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ea2872-35c5-46c2-9894-62b3625dcfc8 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:15.380553 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 449/873] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:27:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:15.395421 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f5de1-0b28-4db1-8faf-041c582d3948 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:15.564605 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f5de1-0b28-4db1-8faf-041c582d3948 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:15.613063 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61d6dd-5262-4b4f-89d0-c16b3ef945f4 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:15.613511 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61d6dd-5262-4b4f-89d0-c16b3ef945f4 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:15.613902 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61d6dd-5262-4b4f-89d0-c16b3ef945f4 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:15.618930 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 450/874] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:27:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:27:15.624655 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7f36c-79a9-43d1-9e8b-04deb76a820a None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:15.624955 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7f36c-79a9-43d1-9e8b-04deb76a820a None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:15.625240 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7f36c-79a9-43d1-9e8b-04deb76a820a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:15.626972 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42012d-ed0a-46e4-b470-38942056a688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:15.629044 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42012d-ed0a-46e4-b470-38942056a688 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:15.629415 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42012d-ed0a-46e4-b470-38942056a688 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:15.629754 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42012d-ed0a-46e4-b470-38942056a688 None admin] PATH_INFO: `/v3/projects/service` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:15.633940 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:15.640217 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f42012d-ed0a-46e4-b470-38942056a688 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:15.641836 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f42012d-ed0a-46e4-b470-38942056a688 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:15.662155 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-90d7f36c-79a9-43d1-9e8b-04deb76a820a None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:27:15.662155 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-90d7f36c-79a9-43d1-9e8b-04deb76a820a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:27:15.673040 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-2f42012d-ed0a-46e4-b470-38942056a688 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:27:15.673040 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:15.673040 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:15.673040 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:15.673040 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:15.673040 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:15.673040 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:15.673040 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:15.673040 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:15.673040 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:15.673040 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:15.673040 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:15.673040 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:27:15.673040 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:27:15.673040 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:27:15.673903 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:27:15.673903 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:15.673903 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:15.673903 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:15.673903 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:15.673903 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:15.673903 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:15.673903 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:15.673903 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:15.673903 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:15.673903 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:15.673903 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:15.673903 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:15.673903 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:15.673903 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:15.673903 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:15.673903 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:15.674782 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:27:15.674782 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:27:15.674782 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:27:15.674782 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:27:15.674782 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:27:15.674782 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:27:15.674782 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:27:15.674782 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:15.675578 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 425/875] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:27:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:15.682237 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42012d-ed0a-46e4-b470-38942056a688 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:15.744445 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:15.778975 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 451/876] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:27:15 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:27:15.804829 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7f36c-79a9-43d1-9e8b-04deb76a820a None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:15.850651 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42012d-ed0a-46e4-b470-38942056a688 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:15.904373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a956748d-cfbe-4225-b81e-ce4fc676e3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:15.904962 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956748d-cfbe-4225-b81e-ce4fc676e3eb None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:15.905248 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956748d-cfbe-4225-b81e-ce4fc676e3eb None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:15.905528 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956748d-cfbe-4225-b81e-ce4fc676e3eb None admin] PATH_INFO: `/v3/projects` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:15.910216 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a956748d-cfbe-4225-b81e-ce4fc676e3eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:15.910544 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a956748d-cfbe-4225-b81e-ce4fc676e3eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:15.912616 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a956748d-cfbe-4225-b81e-ce4fc676e3eb None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:15.936481 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 426/877] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:27:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:27:15.942754 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a956748d-cfbe-4225-b81e-ce4fc676e3eb None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:15.950356 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7f36c-79a9-43d1-9e8b-04deb76a820a None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:15.995880 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5c4c5-7071-40ae-8178-82e1707f90ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:15.997134 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5c4c5-7071-40ae-8178-82e1707f90ba None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:15.997907 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5c4c5-7071-40ae-8178-82e1707f90ba None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:15.998518 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5c4c5-7071-40ae-8178-82e1707f90ba None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:15.999724 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a5c4c5-7071-40ae-8178-82e1707f90ba None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:16.001602 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a5c4c5-7071-40ae-8178-82e1707f90ba None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:16.019485 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-b3a5c4c5-7071-40ae-8178-82e1707f90ba None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 21:27:16.019485 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:16.019485 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:27:16.019485 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:27:16.019485 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:27:16.019485 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:27:16.019485 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:27:16.019485 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:27:16.019485 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 21:27:16.019485 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:16.019485 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:27:16.019485 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:16.019485 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:16.019485 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:16.019485 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:16.019485 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:16.020475 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:16.020475 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:16.020475 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:16.020475 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:16.020475 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:16.020475 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:16.020475 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:16.020475 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:27:16.020475 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:27:16.020475 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:27:16.020475 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:27:16.020475 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:16.020475 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:16.020475 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:16.020475 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:16.020475 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:16.021264 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:16.021264 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:16.021264 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:16.021264 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:16.021264 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:16.021264 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:16.021264 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:16.021264 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:16.021264 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:16.021264 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:16.021264 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:16.021264 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:27:16.021264 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:27:16.021264 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 21:27:16.021264 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:16.032473 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 452/878] 10.222.0.30 () {56 vars in 1132 bytes} [Tue Jul 5 21:27:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:16.035281 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5c4c5-7071-40ae-8178-82e1707f90ba None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:16.052322 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:16.089431 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:16.101232 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a956748d-cfbe-4225-b81e-ce4fc676e3eb None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:16.138049 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ce355-6f9a-451c-86ce-427fa9928f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:16.138747 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ce355-6f9a-451c-86ce-427fa9928f8e None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:16.139040 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ce355-6f9a-451c-86ce-427fa9928f8e None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:16.139327 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ce355-6f9a-451c-86ce-427fa9928f8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:16.140162 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ce355-6f9a-451c-86ce-427fa9928f8e None admin] RBAC: Adding query filter params (role.id=1cb72e4884a744f99a3df0dc628f7493, scope.project.id=7fe768315f5c43f487f71f043f11b8b8, user.id=0b40f943261d4cd3a6d0a27335e9806d) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:16.140480 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ce355-6f9a-451c-86ce-427fa9928f8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:16.141932 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ce355-6f9a-451c-86ce-427fa9928f8e None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:16.142668 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5c4c5-7071-40ae-8178-82e1707f90ba None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:16.148225 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 427/879] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:27:15 2022] GET /identity/v3/role_assignments?user.id=0b40f943261d4cd3a6d0a27335e9806d&scope.project.id=7fe768315f5c43f487f71f043f11b8b8&role.id=1cb72e4884a744f99a3df0dc628f7493 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:16.149336 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694b260-6cf0-46cb-9a91-ce1780cd7adf None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:16.149627 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694b260-6cf0-46cb-9a91-ce1780cd7adf None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:16.149910 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694b260-6cf0-46cb-9a91-ce1780cd7adf None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:16.155374 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 428/880] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:27:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:27:16.159895 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc50aed-54a5-4481-b4fd-2b79baeec426 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:16.160200 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc50aed-54a5-4481-b4fd-2b79baeec426 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:16.160466 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc50aed-54a5-4481-b4fd-2b79baeec426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:16.182438 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-1bc50aed-54a5-4481-b4fd-2b79baeec426 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:27:16.184135 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-1bc50aed-54a5-4481-b4fd-2b79baeec426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:27:16.199461 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce581a-3213-40e9-a0a5-469591f82e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:16.200104 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce581a-3213-40e9-a0a5-469591f82e9a None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:16.200403 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce581a-3213-40e9-a0a5-469591f82e9a None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:16.200691 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce581a-3213-40e9-a0a5-469591f82e9a None admin] PATH_INFO: `/v3/services` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:16.201435 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce581a-3213-40e9-a0a5-469591f82e9a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:16.201752 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce581a-3213-40e9-a0a5-469591f82e9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:16.203372 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce581a-3213-40e9-a0a5-469591f82e9a None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:16.215231 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 453/881] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Jul 5 21:27:16 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:27:16.216320 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce581a-3213-40e9-a0a5-469591f82e9a None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:16.274681 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 429/882] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:27:16 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:27:16.293869 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc50aed-54a5-4481-b4fd-2b79baeec426 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:16.334248 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce581a-3213-40e9-a0a5-469591f82e9a None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:16.348904 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:16.354036 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:16.380329 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f6b528-3877-427c-a365-7b0f89aa1fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:16.382274 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6b528-3877-427c-a365-7b0f89aa1fa7 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:16.382274 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6b528-3877-427c-a365-7b0f89aa1fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:16.382464 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6b528-3877-427c-a365-7b0f89aa1fa7 None admin] PATH_INFO: `/v3/services` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:16.383262 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f6b528-3877-427c-a365-7b0f89aa1fa7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:16.383581 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f6b528-3877-427c-a365-7b0f89aa1fa7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:16.385126 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f6b528-3877-427c-a365-7b0f89aa1fa7 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:16.395200 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 454/883] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Jul 5 21:27:16 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:16.395894 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f6b528-3877-427c-a365-7b0f89aa1fa7 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:16.429331 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc50aed-54a5-4481-b4fd-2b79baeec426 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:16.474586 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17dea94-fd0a-42f7-8381-21c5b22cb363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:16.476244 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17dea94-fd0a-42f7-8381-21c5b22cb363 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:16.477126 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17dea94-fd0a-42f7-8381-21c5b22cb363 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:16.477599 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17dea94-fd0a-42f7-8381-21c5b22cb363 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:16.478492 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17dea94-fd0a-42f7-8381-21c5b22cb363 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:16.481027 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17dea94-fd0a-42f7-8381-21c5b22cb363 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:16.497196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-e17dea94-fd0a-42f7-8381-21c5b22cb363 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:27:16.497196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:16.497196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:27:16.497196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:27:16.497196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:27:16.497196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:27:16.497196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:27:16.497196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:27:16.497196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:27:16.497196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:16.497196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:27:16.497196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:16.497196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:16.497196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:16.497196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:16.497196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:16.497196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:16.498242 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:16.498242 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:16.498242 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:16.498242 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:16.498242 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:16.498242 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:16.498242 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:27:16.498242 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:27:16.498242 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:27:16.498242 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:27:16.498242 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:16.498242 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:16.498242 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:16.498242 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:16.498242 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:16.498242 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:16.499045 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:16.499045 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:16.499045 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:16.499045 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:16.499045 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:16.499045 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:16.499045 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:16.499045 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:16.499045 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:16.499045 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:16.499045 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:27:16.499045 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:27:16.499045 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:27:16.499045 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:16.502117 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 430/884] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Jul 5 21:27:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:16.509242 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17dea94-fd0a-42f7-8381-21c5b22cb363 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:16.520119 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f6b528-3877-427c-a365-7b0f89aa1fa7 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:16.577902 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03131e5f-96fd-4824-bff2-77a3417d6f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:16.579165 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03131e5f-96fd-4824-bff2-77a3417d6f10 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:16.580051 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03131e5f-96fd-4824-bff2-77a3417d6f10 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:16.580555 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03131e5f-96fd-4824-bff2-77a3417d6f10 None admin] PATH_INFO: `/v3/endpoints` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:16.581629 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03131e5f-96fd-4824-bff2-77a3417d6f10 None admin] RBAC: Adding query filter params (interface=public, service_id=5cd4e6eeb58f42d69a90494733c65a21, region_id=RegionOne) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:16.582457 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03131e5f-96fd-4824-bff2-77a3417d6f10 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:16.584870 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03131e5f-96fd-4824-bff2-77a3417d6f10 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:16.593952 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 455/885] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Jul 5 21:27:16 2022] GET /identity/v3/endpoints?service_id=5cd4e6eeb58f42d69a90494733c65a21&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:27:16.599096 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03131e5f-96fd-4824-bff2-77a3417d6f10 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:16.640887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17dea94-fd0a-42f7-8381-21c5b22cb363 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:16.644420 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:16.655583 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:16.676957 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf24b84-b5e2-4881-bc5c-3fbbc72c8605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:16.677639 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf24b84-b5e2-4881-bc5c-3fbbc72c8605 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:16.677930 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf24b84-b5e2-4881-bc5c-3fbbc72c8605 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:16.678242 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf24b84-b5e2-4881-bc5c-3fbbc72c8605 None admin] PATH_INFO: `/v3/services` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:16.678962 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf24b84-b5e2-4881-bc5c-3fbbc72c8605 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:16.679283 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf24b84-b5e2-4881-bc5c-3fbbc72c8605 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:16.680831 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf24b84-b5e2-4881-bc5c-3fbbc72c8605 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:16.685817 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 431/886] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Jul 5 21:27:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:16.687477 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ace226-1c02-4d44-94f9-230da20ba2ef None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:16.687992 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ace226-1c02-4d44-94f9-230da20ba2ef None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:16.688582 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ace226-1c02-4d44-94f9-230da20ba2ef None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:16.694183 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 432/887] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:27:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:27:16.694183 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ace226-1c02-4d44-94f9-230da20ba2ef None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:16.712515 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03131e5f-96fd-4824-bff2-77a3417d6f10 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:16.747530 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca56522b-af9b-462c-bf6f-5c9d335667d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:16.748201 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56522b-af9b-462c-bf6f-5c9d335667d5 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:16.748494 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56522b-af9b-462c-bf6f-5c9d335667d5 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:16.748775 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56522b-af9b-462c-bf6f-5c9d335667d5 None admin] PATH_INFO: `/v3/services` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:16.749461 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca56522b-af9b-462c-bf6f-5c9d335667d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:16.750871 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca56522b-af9b-462c-bf6f-5c9d335667d5 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:16.756889 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 456/888] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Jul 5 21:27:16 2022] GET /identity/v3/services => generated 1268 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:27:16.758647 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24bfc0-ca76-41a3-bf52-4ab2e2293328 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:16.758945 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24bfc0-ca76-41a3-bf52-4ab2e2293328 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:16.759226 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24bfc0-ca76-41a3-bf52-4ab2e2293328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:16.785418 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-cf24bfc0-ca76-41a3-bf52-4ab2e2293328 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:27:16.786951 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-cf24bfc0-ca76-41a3-bf52-4ab2e2293328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:27:16.830549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ace226-1c02-4d44-94f9-230da20ba2ef None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:16.872555 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26307b-f920-4757-bd81-2a0e1acf0c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:16.873254 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26307b-f920-4757-bd81-2a0e1acf0c68 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:16.873546 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26307b-f920-4757-bd81-2a0e1acf0c68 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:16.873827 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26307b-f920-4757-bd81-2a0e1acf0c68 None admin] PATH_INFO: `/v3/services` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:16.874586 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26307b-f920-4757-bd81-2a0e1acf0c68 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:16.874901 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26307b-f920-4757-bd81-2a0e1acf0c68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:16.876312 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26307b-f920-4757-bd81-2a0e1acf0c68 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:16.879367 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 457/889] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:27:16 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:27:16.882240 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 433/890] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Jul 5 21:27:16 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:16.903758 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf24bfc0-ca76-41a3-bf52-4ab2e2293328 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:16.944110 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:17.022841 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf24bfc0-ca76-41a3-bf52-4ab2e2293328 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:17.062056 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143bbf7f-bd45-4c81-a5d3-879ef746bfbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:17.062904 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bbf7f-bd45-4c81-a5d3-879ef746bfbf None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:17.063194 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bbf7f-bd45-4c81-a5d3-879ef746bfbf None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:17.063475 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bbf7f-bd45-4c81-a5d3-879ef746bfbf None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:17.064131 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143bbf7f-bd45-4c81-a5d3-879ef746bfbf None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:17.065514 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143bbf7f-bd45-4c81-a5d3-879ef746bfbf None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:17.077611 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-143bbf7f-bd45-4c81-a5d3-879ef746bfbf None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 21:27:17.077611 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:17.077611 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:27:17.077611 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:27:17.077611 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:27:17.077611 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:27:17.077611 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:27:17.077611 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:27:17.077611 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 21:27:17.077611 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:17.077611 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:27:17.077611 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:17.077611 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:17.077611 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:17.077611 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:17.077611 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:17.077611 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:17.078641 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:17.078641 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:17.078641 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:17.078641 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:17.078641 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:17.078641 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:17.078641 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:27:17.078641 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:27:17.078641 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:27:17.078641 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:27:17.078641 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:17.078641 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:17.078641 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:17.078641 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:17.078641 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:17.078641 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:17.079602 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:17.079602 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:17.079602 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:17.079602 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:17.079602 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:17.079602 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:17.079602 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:17.079602 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:17.079602 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:17.079602 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:17.079602 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:27:17.079602 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:27:17.079602 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 21:27:17.079602 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:17.079602 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 458/891] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:27:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:17.087726 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26307b-f920-4757-bd81-2a0e1acf0c68 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:17.138298 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:17.197466 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26307b-f920-4757-bd81-2a0e1acf0c68 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:17.234229 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86722a0-0785-43f7-b12f-2ae298dd1d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:17.234936 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86722a0-0785-43f7-b12f-2ae298dd1d3c None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:17.235224 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86722a0-0785-43f7-b12f-2ae298dd1d3c None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:17.235556 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86722a0-0785-43f7-b12f-2ae298dd1d3c None admin] PATH_INFO: `/v3/services` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:17.236270 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86722a0-0785-43f7-b12f-2ae298dd1d3c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:17.236580 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86722a0-0785-43f7-b12f-2ae298dd1d3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:17.237960 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86722a0-0785-43f7-b12f-2ae298dd1d3c None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:17.246942 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 434/892] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:27:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:27:17.249371 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143bbf7f-bd45-4c81-a5d3-879ef746bfbf None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:17.354112 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:17.358644 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143bbf7f-bd45-4c81-a5d3-879ef746bfbf None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:17.396788 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cbfa2e-eb1d-4932-8fbc-2a636c93fb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:17.397481 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cbfa2e-eb1d-4932-8fbc-2a636c93fb03 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:17.397765 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cbfa2e-eb1d-4932-8fbc-2a636c93fb03 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:17.398045 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cbfa2e-eb1d-4932-8fbc-2a636c93fb03 None admin] PATH_INFO: `/v3/services` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:17.399336 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cbfa2e-eb1d-4932-8fbc-2a636c93fb03 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:17.399647 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cbfa2e-eb1d-4932-8fbc-2a636c93fb03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:17.401162 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cbfa2e-eb1d-4932-8fbc-2a636c93fb03 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:17.411902 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 459/893] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:27:17 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:17.413489 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86722a0-0785-43f7-b12f-2ae298dd1d3c None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:17.527274 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86722a0-0785-43f7-b12f-2ae298dd1d3c None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:17.535571 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:17.576039 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf369b-2790-4eb9-923f-a97431fc2d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:17.576993 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf369b-2790-4eb9-923f-a97431fc2d3b None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:17.577542 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf369b-2790-4eb9-923f-a97431fc2d3b None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:17.578101 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf369b-2790-4eb9-923f-a97431fc2d3b None admin] PATH_INFO: `/v3/endpoints` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:17.579159 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf369b-2790-4eb9-923f-a97431fc2d3b None admin] RBAC: Adding query filter params (interface=public, service_id=428fb2248e254eba8ff8b9b87c0fc430, region_id=RegionOne) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:17.579686 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf369b-2790-4eb9-923f-a97431fc2d3b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:17.581281 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf369b-2790-4eb9-923f-a97431fc2d3b None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:17.587656 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 435/894] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Jul 5 21:27:17 2022] GET /identity/v3/endpoints?service_id=428fb2248e254eba8ff8b9b87c0fc430&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:17.596830 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cbfa2e-eb1d-4932-8fbc-2a636c93fb03 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:17.697761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cbfa2e-eb1d-4932-8fbc-2a636c93fb03 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:17.733322 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1aa2f-cfaf-45c6-9be4-5065a2a16b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:17.733995 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1aa2f-cfaf-45c6-9be4-5065a2a16b72 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:17.734311 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1aa2f-cfaf-45c6-9be4-5065a2a16b72 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:17.734593 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1aa2f-cfaf-45c6-9be4-5065a2a16b72 None admin] PATH_INFO: `/v3/services` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:17.735279 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d1aa2f-cfaf-45c6-9be4-5065a2a16b72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:17.736659 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d1aa2f-cfaf-45c6-9be4-5065a2a16b72 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:17.743076 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 460/895] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Jul 5 21:27:17 2022] GET /identity/v3/services => generated 1268 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:27:18.335308 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7db790-9888-4b2c-b60f-23fa4f56e98e None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:18.335853 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7db790-9888-4b2c-b60f-23fa4f56e98e None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:18.335853 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7db790-9888-4b2c-b60f-23fa4f56e98e None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:18.338190 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 436/896] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:27:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:27:18.343492 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29456446-da7f-4166-9482-8f72fd2417d4 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:18.344046 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29456446-da7f-4166-9482-8f72fd2417d4 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:18.344555 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29456446-da7f-4166-9482-8f72fd2417d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:18.362587 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-29456446-da7f-4166-9482-8f72fd2417d4 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:27:18.364517 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-29456446-da7f-4166-9482-8f72fd2417d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:27:18.387423 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:18.435449 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 461/897] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:27:18 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:27:18.459878 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7db790-9888-4b2c-b60f-23fa4f56e98e None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:18.574860 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7db790-9888-4b2c-b60f-23fa4f56e98e None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:18.611912 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b952a-1ed7-4ec7-953b-1d4f807059bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:18.612650 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b952a-1ed7-4ec7-953b-1d4f807059bd None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:18.612938 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b952a-1ed7-4ec7-953b-1d4f807059bd None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:18.613227 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b952a-1ed7-4ec7-953b-1d4f807059bd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:18.624746 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031b952a-1ed7-4ec7-953b-1d4f807059bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:27:18.632979 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-031b952a-1ed7-4ec7-953b-1d4f807059bd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 21:27:18.632979 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:18.632979 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:18.632979 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:18.632979 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:18.632979 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:18.632979 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:18.632979 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:18.632979 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:18.632979 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:18.632979 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:18.632979 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:18.632979 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:27:18.632979 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:27:18.632979 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:27:18.632979 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:27:18.634013 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:27:18.634013 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:27:18.634013 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:27:18.634013 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:27:18.634013 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:18.634013 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:18.634013 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:18.634013 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:18.634013 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:18.634013 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:18.634013 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:18.634013 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:18.634013 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:18.634013 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:18.634013 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:18.634013 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:18.634902 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:18.634902 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:18.634902 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:18.634902 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:18.634902 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:27:18.634902 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:27:18.634902 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:27:18.634902 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:27:18.634902 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:27:18.634902 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:27:18.634902 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 21:27:18.634902 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:18.634902 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 437/898] 10.222.0.30 () {56 vars in 1120 bytes} [Tue Jul 5 21:27:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:18.640253 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29456446-da7f-4166-9482-8f72fd2417d4 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:18.745452 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29456446-da7f-4166-9482-8f72fd2417d4 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:18.781197 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efdad03-3955-4ef4-870a-e468cbb6040a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:18.781878 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdad03-3955-4ef4-870a-e468cbb6040a None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:18.782189 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdad03-3955-4ef4-870a-e468cbb6040a None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:18.782473 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdad03-3955-4ef4-870a-e468cbb6040a None admin] PATH_INFO: `/v3/roles` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:18.783228 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efdad03-3955-4ef4-870a-e468cbb6040a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:18.783538 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efdad03-3955-4ef4-870a-e468cbb6040a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:18.784935 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efdad03-3955-4ef4-870a-e468cbb6040a None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:18.794491 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 462/899] 10.222.0.30 () {56 vars in 1115 bytes} [Tue Jul 5 21:27:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:18.800039 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b952a-1ed7-4ec7-953b-1d4f807059bd None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:18.831944 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:18.909044 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b952a-1ed7-4ec7-953b-1d4f807059bd None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:18.943333 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15527a81-83d6-4725-ba98-c0a4fce861bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:18.944143 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15527a81-83d6-4725-ba98-c0a4fce861bd None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:18.944431 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15527a81-83d6-4725-ba98-c0a4fce861bd None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:18.944712 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15527a81-83d6-4725-ba98-c0a4fce861bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:18.955833 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15527a81-83d6-4725-ba98-c0a4fce861bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:18.957555 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15527a81-83d6-4725-ba98-c0a4fce861bd None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:18.975427 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-15527a81-83d6-4725-ba98-c0a4fce861bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:18.975427 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:18.975427 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:18.975427 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:18.975427 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:18.975427 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:18.975427 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:18.975427 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:18.975427 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:18.975427 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:18.975427 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:18.975427 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:18.975427 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:27:18.975427 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:27:18.975427 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:27:18.976319 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:27:18.976319 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:18.976319 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:18.976319 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:18.976319 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:18.976319 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:18.976319 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:18.976319 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:18.976319 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:18.976319 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:18.976319 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:18.976319 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:18.976319 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:18.976319 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:18.976319 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:18.976319 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:18.976319 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:18.977838 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:27:18.977838 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:27:18.977838 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:18.977838 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:18.977838 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 438/900] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:27:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:18.984317 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efdad03-3955-4ef4-870a-e468cbb6040a None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:19.003439 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1205d-3a0b-4562-bce1-aa9eeed3c80a None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:19.003733 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1205d-3a0b-4562-bce1-aa9eeed3c80a None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:19.004021 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1205d-3a0b-4562-bce1-aa9eeed3c80a None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:19.005525 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 439/901] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:27:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:27:19.011063 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca0a21-5047-4205-ba96-86ffcbe48308 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:19.011358 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca0a21-5047-4205-ba96-86ffcbe48308 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:19.011646 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca0a21-5047-4205-ba96-86ffcbe48308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:19.016855 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:19.029690 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-3eca0a21-5047-4205-ba96-86ffcbe48308 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:27:19.031240 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-3eca0a21-5047-4205-ba96-86ffcbe48308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:27:19.106054 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efdad03-3955-4ef4-870a-e468cbb6040a None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:19.118496 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 440/902] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:27:19 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:27:19.144229 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca0a21-5047-4205-ba96-86ffcbe48308 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:19.146858 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e4de5-7452-45ec-b43d-000728480888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:19.147846 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e4de5-7452-45ec-b43d-000728480888 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:19.148138 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e4de5-7452-45ec-b43d-000728480888 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:19.148418 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e4de5-7452-45ec-b43d-000728480888 None admin] PATH_INFO: `/v3/domains` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:19.149271 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3e4de5-7452-45ec-b43d-000728480888 None admin] RBAC: Adding query filter params (name=Default) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:19.149583 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3e4de5-7452-45ec-b43d-000728480888 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:19.150992 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3e4de5-7452-45ec-b43d-000728480888 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:19.161666 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:19.164982 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 463/903] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:27:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:19.170739 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5873e-38bf-4591-b9e2-cf191501e37b None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:19.173954 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5873e-38bf-4591-b9e2-cf191501e37b None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:19.173954 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5873e-38bf-4591-b9e2-cf191501e37b None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:19.173954 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 464/904] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:27:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:27:19.173954 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5873e-38bf-4591-b9e2-cf191501e37b None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:19.258381 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca0a21-5047-4205-ba96-86ffcbe48308 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:19.260023 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:19.283489 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5873e-38bf-4591-b9e2-cf191501e37b None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:19.295037 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa00b0-4ad6-4558-a146-703bd4d056a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:19.295868 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa00b0-4ad6-4558-a146-703bd4d056a7 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:19.296479 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa00b0-4ad6-4558-a146-703bd4d056a7 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:19.296768 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa00b0-4ad6-4558-a146-703bd4d056a7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:19.297590 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfa00b0-4ad6-4558-a146-703bd4d056a7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:19.299012 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfa00b0-4ad6-4558-a146-703bd4d056a7 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:19.311836 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-0bfa00b0-4ad6-4558-a146-703bd4d056a7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 21:27:19.311836 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:19.311836 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:27:19.311836 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:27:19.311836 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:27:19.311836 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:27:19.311836 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:27:19.311836 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:27:19.311836 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 21:27:19.311836 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:19.311836 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:27:19.311836 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:19.311836 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:19.311836 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:19.311836 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:19.311836 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:19.312730 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:19.312730 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:19.312730 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:19.312730 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:19.312730 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:19.312730 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:19.312730 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:19.312730 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:27:19.312730 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:27:19.312730 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:27:19.312730 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:27:19.312730 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:19.312730 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:19.312730 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:19.312730 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:19.312730 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:19.313575 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:19.313575 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:19.313575 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:19.313575 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:19.313575 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:19.313575 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:19.313575 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:19.313575 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:19.313575 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:19.313575 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:19.313575 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:19.313575 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:27:19.313575 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:27:19.313575 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 21:27:19.313575 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:19.313575 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 441/905] 10.222.0.30 () {56 vars in 1132 bytes} [Tue Jul 5 21:27:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:27:19.314946 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a658c7-cc27-42fb-b12a-e5230ce17c15 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:19.314946 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a658c7-cc27-42fb-b12a-e5230ce17c15 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:19.315081 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a658c7-cc27-42fb-b12a-e5230ce17c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:19.326644 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab54ee-c23e-4e24-aaf3-b20fbe851de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:19.327463 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab54ee-c23e-4e24-aaf3-b20fbe851de9 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:19.327753 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab54ee-c23e-4e24-aaf3-b20fbe851de9 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:19.328033 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab54ee-c23e-4e24-aaf3-b20fbe851de9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:19.333592 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-e0a658c7-cc27-42fb-b12a-e5230ce17c15 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:27:19.334843 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-e0a658c7-cc27-42fb-b12a-e5230ce17c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:27:19.336765 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab54ee-c23e-4e24-aaf3-b20fbe851de9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:19.338449 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab54ee-c23e-4e24-aaf3-b20fbe851de9 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:19.355137 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-fdab54ee-c23e-4e24-aaf3-b20fbe851de9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 21:27:19.355137 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:19.355137 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:19.355137 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:19.355137 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:19.355137 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:19.355137 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:19.355137 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:19.355137 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:19.355137 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:19.355137 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:19.355137 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:19.355137 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:27:19.355137 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:27:19.355137 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:27:19.355137 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:27:19.356156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:19.356156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:19.356156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:27:19.356156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:27:19.356156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:27:19.356156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:27:19.356156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:19.356156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:19.356156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:19.356156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:19.356156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:19.356156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:19.356156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:19.356156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:19.356156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:19.356156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:19.356156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:19.356156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:19.357069 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:19.357069 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:19.357069 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:27:19.357069 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:27:19.357069 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:27:19.357069 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:27:19.357069 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:27:19.357069 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:27:19.357069 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 21:27:19.357069 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:19.357069 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 465/906] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Jul 5 21:27:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:19.357630 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab54ee-c23e-4e24-aaf3-b20fbe851de9 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:19.413732 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 442/907] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:27:19 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:27:19.414704 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a658c7-cc27-42fb-b12a-e5230ce17c15 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:19.430859 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:19.485406 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab54ee-c23e-4e24-aaf3-b20fbe851de9 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:19.523375 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b9ea2-3ed3-4275-9edb-6fb32360bea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:19.524840 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b9ea2-3ed3-4275-9edb-6fb32360bea5 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:19.525131 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b9ea2-3ed3-4275-9edb-6fb32360bea5 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:19.525409 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b9ea2-3ed3-4275-9edb-6fb32360bea5 None admin] PATH_INFO: `/v3/services` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:19.526289 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3b9ea2-3ed3-4275-9edb-6fb32360bea5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:19.526719 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3b9ea2-3ed3-4275-9edb-6fb32360bea5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:19.528116 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3b9ea2-3ed3-4275-9edb-6fb32360bea5 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:19.529371 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a658c7-cc27-42fb-b12a-e5230ce17c15 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:19.537956 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 466/908] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Jul 5 21:27:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:19.538657 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b9ea2-3ed3-4275-9edb-6fb32360bea5 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:19.543286 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:19.571105 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9814c7-403f-4dd1-809a-f14bc51275b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:19.571806 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9814c7-403f-4dd1-809a-f14bc51275b3 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:19.572096 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9814c7-403f-4dd1-809a-f14bc51275b3 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:19.572379 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9814c7-403f-4dd1-809a-f14bc51275b3 None admin] PATH_INFO: `/v3/users` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:19.573221 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9814c7-403f-4dd1-809a-f14bc51275b3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:19.573596 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9814c7-403f-4dd1-809a-f14bc51275b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:19.575253 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9814c7-403f-4dd1-809a-f14bc51275b3 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:19.593292 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 443/909] 10.222.0.30 () {56 vars in 1149 bytes} [Tue Jul 5 21:27:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:19.594167 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9814c7-403f-4dd1-809a-f14bc51275b3 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:19.657175 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:19.660438 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b9ea2-3ed3-4275-9edb-6fb32360bea5 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:19.696631 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5808c4ee-dc86-4082-95a8-ca3beca429ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:19.697555 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808c4ee-dc86-4082-95a8-ca3beca429ed None admin] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:19.697689 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9814c7-403f-4dd1-809a-f14bc51275b3 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:19.698116 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808c4ee-dc86-4082-95a8-ca3beca429ed None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:19.698586 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808c4ee-dc86-4082-95a8-ca3beca429ed None admin] PATH_INFO: `/v3/services` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:19.699469 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5808c4ee-dc86-4082-95a8-ca3beca429ed None admin] RBAC: Authorizing `identity:create_service()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:19.700997 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5808c4ee-dc86-4082-95a8-ca3beca429ed None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:19.732647 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b3fe0f-c939-45b8-b078-62488533fc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:19.733318 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3fe0f-c939-45b8-b078-62488533fc6e None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:19.733607 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3fe0f-c939-45b8-b078-62488533fc6e None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:19.733885 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3fe0f-c939-45b8-b078-62488533fc6e None admin] PATH_INFO: `/v3/services` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:19.734623 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b3fe0f-c939-45b8-b078-62488533fc6e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:19.734935 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b3fe0f-c939-45b8-b078-62488533fc6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:19.736306 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b3fe0f-c939-45b8-b078-62488533fc6e None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:19.741353 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 444/910] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Jul 5 21:27:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:19.741972 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b3fe0f-c939-45b8-b078-62488533fc6e None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:19.770161 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 467/911] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Jul 5 21:27:19 2022] POST /identity/v3/services => generated 241 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:27:19.770161 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5808c4ee-dc86-4082-95a8-ca3beca429ed None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:19.846888 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:19.888096 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b3fe0f-c939-45b8-b078-62488533fc6e None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:19.900220 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5808c4ee-dc86-4082-95a8-ca3beca429ed None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:19.921257 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:19.930933 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e5422-291b-4dd8-82e4-6b1a856bf3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:19.932144 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e5422-291b-4dd8-82e4-6b1a856bf3f5 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:19.932515 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e5422-291b-4dd8-82e4-6b1a856bf3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:19.932812 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e5422-291b-4dd8-82e4-6b1a856bf3f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:19.939943 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0fae1e-fea3-47d6-a31b-5451dfff29e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:19.940291 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fae1e-fea3-47d6-a31b-5451dfff29e7 None admin] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:19.940383 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fae1e-fea3-47d6-a31b-5451dfff29e7 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:19.940670 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fae1e-fea3-47d6-a31b-5451dfff29e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:19.942092 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0fae1e-fea3-47d6-a31b-5451dfff29e7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:19.943562 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0fae1e-fea3-47d6-a31b-5451dfff29e7 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:20.008589 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e5422-291b-4dd8-82e4-6b1a856bf3f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:20.010035 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e5422-291b-4dd8-82e4-6b1a856bf3f5 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:20.019293 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 468/912] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Jul 5 21:27:19 2022] POST /identity/v3/endpoints => generated 347 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:27:20.019293 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f7e1b-fbe4-44fe-b6eb-0e1b037e2b4b None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:20.019293 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f7e1b-fbe4-44fe-b6eb-0e1b037e2b4b None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:20.019293 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f7e1b-fbe4-44fe-b6eb-0e1b037e2b4b None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:20.019293 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 469/913] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:27:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:27:20.023562 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026dd9a-54b1-488d-97a2-a3f542f93c82 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:20.023942 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026dd9a-54b1-488d-97a2-a3f542f93c82 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:20.024222 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026dd9a-54b1-488d-97a2-a3f542f93c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:20.042876 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-b026dd9a-54b1-488d-97a2-a3f542f93c82 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:27:20.044224 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-b026dd9a-54b1-488d-97a2-a3f542f93c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:27:20.141146 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 470/914] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:27:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:27:20.147302 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 445/915] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:27:19 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:27:20.153097 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b026dd9a-54b1-488d-97a2-a3f542f93c82 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:20.160747 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e5422-291b-4dd8-82e4-6b1a856bf3f5 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:20.202663 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:20.206109 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:20.295003 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e5422-291b-4dd8-82e4-6b1a856bf3f5 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:20.297648 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b026dd9a-54b1-488d-97a2-a3f542f93c82 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:20.333929 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab6aff-fb06-4163-bfdb-654c4c84d516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:20.334771 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab6aff-fb06-4163-bfdb-654c4c84d516 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:20.335063 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab6aff-fb06-4163-bfdb-654c4c84d516 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:20.335176 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf11951-10ae-43fb-af5e-cdc6a418abc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:20.335375 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab6aff-fb06-4163-bfdb-654c4c84d516 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:20.337056 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf11951-10ae-43fb-af5e-cdc6a418abc1 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:20.337844 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf11951-10ae-43fb-af5e-cdc6a418abc1 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:20.338373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf11951-10ae-43fb-af5e-cdc6a418abc1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:20.339265 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf11951-10ae-43fb-af5e-cdc6a418abc1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:20.340883 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf11951-10ae-43fb-af5e-cdc6a418abc1 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:20.347048 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab6aff-fb06-4163-bfdb-654c4c84d516 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:20.348510 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab6aff-fb06-4163-bfdb-654c4c84d516 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:20.355879 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-abf11951-10ae-43fb-af5e-cdc6a418abc1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 21:27:20.355879 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:20.355879 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:27:20.355879 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:27:20.355879 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:27:20.355879 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:27:20.355879 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:27:20.355879 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:27:20.355879 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 21:27:20.355879 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:20.355879 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:27:20.355879 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:20.355879 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:20.355879 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:20.355879 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:20.355879 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:20.355879 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:20.357059 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:20.357059 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:20.357059 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:20.357059 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:20.357059 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:20.357059 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:20.357059 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:27:20.357059 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:27:20.357059 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:27:20.357059 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:27:20.357059 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:20.357059 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:20.357059 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:20.357059 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:20.357059 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:20.357059 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:20.358032 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:20.358032 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:20.358032 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:20.358032 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:20.358032 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:20.358032 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:20.358032 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:20.358032 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:20.358032 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:20.358032 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:20.358032 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:27:20.358032 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:27:20.358032 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 21:27:20.358032 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:20.365052 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 446/916] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:27:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:27:20.366334 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf11951-10ae-43fb-af5e-cdc6a418abc1 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:20.371555 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-30ab6aff-fb06-4163-bfdb-654c4c84d516 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:20.371555 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:20.371555 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:20.371555 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:20.371555 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:20.371555 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:20.371555 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:20.371555 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:20.371555 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:20.371555 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:20.371555 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:20.371555 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:20.371555 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:27:20.371555 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:27:20.371555 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:27:20.372407 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:27:20.372407 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:20.372407 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:20.372407 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:20.372407 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:20.372407 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:20.372407 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:20.372407 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:20.372407 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:20.372407 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:20.372407 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:20.372407 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:20.372407 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:20.372407 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:20.372407 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:20.372407 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:20.372407 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:20.373257 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:27:20.373257 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:27:20.373257 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:20.373257 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:20.375670 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 471/917] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:27:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:20.386153 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab6aff-fb06-4163-bfdb-654c4c84d516 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:20.478728 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:20.489980 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf11951-10ae-43fb-af5e-cdc6a418abc1 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:20.518080 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:20.531741 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab6aff-fb06-4163-bfdb-654c4c84d516 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:20.535887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4d6a7-c290-493b-a2c4-b891f52c0e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:20.536838 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4d6a7-c290-493b-a2c4-b891f52c0e20 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:20.537346 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4d6a7-c290-493b-a2c4-b891f52c0e20 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:20.537862 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4d6a7-c290-493b-a2c4-b891f52c0e20 None admin] PATH_INFO: `/v3/services` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:20.538824 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f4d6a7-c290-493b-a2c4-b891f52c0e20 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:20.540009 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f4d6a7-c290-493b-a2c4-b891f52c0e20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:20.542257 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f4d6a7-c290-493b-a2c4-b891f52c0e20 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:20.549434 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 447/918] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:27:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:27:20.555704 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4d6a7-c290-493b-a2c4-b891f52c0e20 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:20.575255 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3ac31-1987-43b7-a240-9a4b139a4f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:20.575938 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3ac31-1987-43b7-a240-9a4b139a4f0a None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:20.576227 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3ac31-1987-43b7-a240-9a4b139a4f0a None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:20.576509 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3ac31-1987-43b7-a240-9a4b139a4f0a None admin] PATH_INFO: `/v3/domains` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:20.577250 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b3ac31-1987-43b7-a240-9a4b139a4f0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:20.577563 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b3ac31-1987-43b7-a240-9a4b139a4f0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:20.578987 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b3ac31-1987-43b7-a240-9a4b139a4f0a None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:20.591606 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 472/919] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:27:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:20.597000 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3ac31-1987-43b7-a240-9a4b139a4f0a None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:20.675057 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4d6a7-c290-493b-a2c4-b891f52c0e20 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:20.704358 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3ac31-1987-43b7-a240-9a4b139a4f0a None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:20.715069 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0cd381-2609-4a7f-affa-b386d0734a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:20.716120 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0cd381-2609-4a7f-affa-b386d0734a56 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:20.716487 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0cd381-2609-4a7f-affa-b386d0734a56 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:20.716859 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0cd381-2609-4a7f-affa-b386d0734a56 None admin] PATH_INFO: `/v3/services` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:20.717633 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0cd381-2609-4a7f-affa-b386d0734a56 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:20.718021 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0cd381-2609-4a7f-affa-b386d0734a56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:20.719626 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0cd381-2609-4a7f-affa-b386d0734a56 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:20.731433 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 448/920] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:27:20 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:20.732968 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0cd381-2609-4a7f-affa-b386d0734a56 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:20.742876 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ce3b1-fe3e-4550-8475-bb362a481f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:20.743975 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ce3b1-fe3e-4550-8475-bb362a481f39 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:20.744480 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ce3b1-fe3e-4550-8475-bb362a481f39 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:20.745006 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ce3b1-fe3e-4550-8475-bb362a481f39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:20.752498 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6ce3b1-fe3e-4550-8475-bb362a481f39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:20.754302 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6ce3b1-fe3e-4550-8475-bb362a481f39 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:20.757431 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:20.770255 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-ae6ce3b1-fe3e-4550-8475-bb362a481f39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:27:20.770255 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:20.770255 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:20.770255 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:20.770255 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:20.770255 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:20.770255 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:20.770255 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:20.770255 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:20.770255 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:20.770255 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:20.770255 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:20.770255 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:27:20.770255 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:27:20.770255 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:27:20.771132 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:27:20.771132 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:20.771132 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:20.771132 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:20.771132 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:20.771132 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:20.771132 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:20.771132 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:20.771132 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:20.771132 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:20.771132 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:20.771132 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:20.771132 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:20.771132 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:20.771132 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:20.771132 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:20.771132 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:20.771977 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:27:20.771977 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:27:20.771977 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:27:20.771977 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:27:20.771977 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:27:20.771977 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:27:20.771977 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:27:20.771977 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:20.779141 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 473/921] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:27:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:20.780246 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ce3b1-fe3e-4550-8475-bb362a481f39 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:20.796094 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:20.852443 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0cd381-2609-4a7f-affa-b386d0734a56 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:20.886973 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ce3b1-fe3e-4550-8475-bb362a481f39 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:20.893693 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b7015-870d-404f-a06c-04ccb3c2728e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:20.894409 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b7015-870d-404f-a06c-04ccb3c2728e None admin] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:20.894701 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b7015-870d-404f-a06c-04ccb3c2728e None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:20.894987 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b7015-870d-404f-a06c-04ccb3c2728e None admin] PATH_INFO: `/v3/endpoints` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:20.895949 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b7015-870d-404f-a06c-04ccb3c2728e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:20.897225 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b7015-870d-404f-a06c-04ccb3c2728e None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:20.925807 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb500733-0412-451a-aac9-e10476e59bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:20.926698 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb500733-0412-451a-aac9-e10476e59bf4 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:20.926990 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb500733-0412-451a-aac9-e10476e59bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:20.927271 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb500733-0412-451a-aac9-e10476e59bf4 None admin] PATH_INFO: `/v3/projects` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:20.928061 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb500733-0412-451a-aac9-e10476e59bf4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:20.928375 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb500733-0412-451a-aac9-e10476e59bf4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:20.929814 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb500733-0412-451a-aac9-e10476e59bf4 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:20.943049 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 474/922] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:27:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:20.949532 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb500733-0412-451a-aac9-e10476e59bf4 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:21.018428 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 449/923] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Jul 5 21:27:20 2022] POST /identity/v3/endpoints => generated 346 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:27:21.032955 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:21.068128 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb500733-0412-451a-aac9-e10476e59bf4 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:21.114333 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51d2b8-8571-411a-96a1-8c0cbe3b684a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:21.114924 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51d2b8-8571-411a-96a1-8c0cbe3b684a None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:21.115276 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51d2b8-8571-411a-96a1-8c0cbe3b684a None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:21.115565 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51d2b8-8571-411a-96a1-8c0cbe3b684a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:21.116533 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51d2b8-8571-411a-96a1-8c0cbe3b684a None admin] RBAC: Adding query filter params (role.id=dd398730a074417fbbd43b27d2ea03d4, scope.project.id=7fe768315f5c43f487f71f043f11b8b8, user.id=0b40f943261d4cd3a6d0a27335e9806d) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:21.116858 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51d2b8-8571-411a-96a1-8c0cbe3b684a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:21.118950 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51d2b8-8571-411a-96a1-8c0cbe3b684a None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:21.125663 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 475/924] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:27:20 2022] GET /identity/v3/role_assignments?user.id=0b40f943261d4cd3a6d0a27335e9806d&scope.project.id=7fe768315f5c43f487f71f043f11b8b8&role.id=dd398730a074417fbbd43b27d2ea03d4 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:27:21.964764 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642675fc-1ab8-4451-a25d-99bf29dd0dd3 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:21.965309 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642675fc-1ab8-4451-a25d-99bf29dd0dd3 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:21.965628 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642675fc-1ab8-4451-a25d-99bf29dd0dd3 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:21.967423 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 450/925] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:27:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:27:21.972853 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94424ce-2205-4774-9deb-6875f45532a6 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:21.973255 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94424ce-2205-4774-9deb-6875f45532a6 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:21.973606 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94424ce-2205-4774-9deb-6875f45532a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:21.991268 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-d94424ce-2205-4774-9deb-6875f45532a6 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:27:21.992472 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-d94424ce-2205-4774-9deb-6875f45532a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:27:22.063974 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 476/926] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:27:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:27:22.088026 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642675fc-1ab8-4451-a25d-99bf29dd0dd3 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:22.173139 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:22.201147 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642675fc-1ab8-4451-a25d-99bf29dd0dd3 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:22.240171 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534543f-f733-4dbb-939c-75c8a2b3a54f None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:22.240171 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534543f-f733-4dbb-939c-75c8a2b3a54f None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:22.240171 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534543f-f733-4dbb-939c-75c8a2b3a54f None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:22.240475 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799b120-406d-4afe-b6db-e2b5471373c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:22.240580 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 477/927] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:27:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:27:22.240657 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799b120-406d-4afe-b6db-e2b5471373c3 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:22.240657 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799b120-406d-4afe-b6db-e2b5471373c3 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:22.240999 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799b120-406d-4afe-b6db-e2b5471373c3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:22.241590 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2799b120-406d-4afe-b6db-e2b5471373c3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:22.243120 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2799b120-406d-4afe-b6db-e2b5471373c3 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:22.245567 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0124b25-e8ed-428f-9bf9-ddddea89e957 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:22.245865 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0124b25-e8ed-428f-9bf9-ddddea89e957 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:22.246184 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0124b25-e8ed-428f-9bf9-ddddea89e957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:22.257658 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-2799b120-406d-4afe-b6db-e2b5471373c3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:27:22.257658 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:22.257658 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:27:22.257658 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:27:22.257658 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:27:22.257658 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:27:22.257658 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:27:22.257658 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:27:22.257658 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:27:22.257658 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:22.257658 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:27:22.257658 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:22.257658 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:22.257658 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:22.257658 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:22.257658 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:22.257658 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:22.259392 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:22.259392 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:22.259392 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:22.259392 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:22.259392 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:22.259392 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:22.259392 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:27:22.259392 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:27:22.259392 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:27:22.259392 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:27:22.259392 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:22.259392 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:22.259392 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:22.259392 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:22.259392 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:22.259392 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:22.260503 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:22.260503 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:22.260503 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:22.260503 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:22.260503 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:22.260503 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:22.260503 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:22.260503 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:22.260503 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:22.260503 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:22.260503 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:27:22.260503 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:27:22.260503 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:27:22.260503 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:22.261363 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 451/928] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Jul 5 21:27:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:22.266723 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799b120-406d-4afe-b6db-e2b5471373c3 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:22.272776 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-c0124b25-e8ed-428f-9bf9-ddddea89e957 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:27:22.272776 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-c0124b25-e8ed-428f-9bf9-ddddea89e957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:27:22.342653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:22.360789 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 478/929] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:27:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:27:22.382223 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0124b25-e8ed-428f-9bf9-ddddea89e957 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:22.389705 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799b120-406d-4afe-b6db-e2b5471373c3 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:22.438575 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbd923-6824-4f5c-a3c3-b563526b5449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:22.439549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbd923-6824-4f5c-a3c3-b563526b5449 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:22.439843 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbd923-6824-4f5c-a3c3-b563526b5449 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:22.440132 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbd923-6824-4f5c-a3c3-b563526b5449 None admin] PATH_INFO: `/v3/services` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:22.441003 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edbd923-6824-4f5c-a3c3-b563526b5449 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:22.441331 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edbd923-6824-4f5c-a3c3-b563526b5449 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:22.443421 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edbd923-6824-4f5c-a3c3-b563526b5449 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:22.453118 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 452/930] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Jul 5 21:27:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:22.458965 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbd923-6824-4f5c-a3c3-b563526b5449 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:22.463292 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:22.507015 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0124b25-e8ed-428f-9bf9-ddddea89e957 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:22.547271 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e6330c-838a-4c63-8495-30401e3a3fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:22.548182 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6330c-838a-4c63-8495-30401e3a3fef None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:22.548477 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6330c-838a-4c63-8495-30401e3a3fef None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:22.548860 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6330c-838a-4c63-8495-30401e3a3fef None admin] PATH_INFO: `/v3/services/compute` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:22.549641 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e6330c-838a-4c63-8495-30401e3a3fef None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:22.551077 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e6330c-838a-4c63-8495-30401e3a3fef None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:22.565876 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbd923-6824-4f5c-a3c3-b563526b5449 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:22.566875 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-78e6330c-838a-4c63-8495-30401e3a3fef None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 21:27:22.566875 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:22.566875 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:27:22.566875 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:27:22.566875 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:27:22.566875 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:27:22.566875 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:27:22.566875 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:27:22.566875 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 21:27:22.566875 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:22.566875 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:27:22.566875 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:22.566875 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:22.566875 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:22.566875 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:22.566875 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:22.566875 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:22.576337 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:22.576337 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:22.576337 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:22.576337 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:22.576337 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:22.576337 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:22.576337 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:27:22.576337 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:27:22.576337 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:27:22.576337 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:27:22.576337 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:22.576337 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:22.576337 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:22.576337 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:22.576337 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:22.576337 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:22.578308 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:22.578308 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:22.578308 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:22.578308 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:22.578308 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:22.578308 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:22.578308 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:22.578308 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:22.578308 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:22.578308 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:22.578308 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:27:22.578308 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:27:22.578308 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 21:27:22.578308 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:22.578308 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 479/931] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:27:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:27:22.580124 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e6330c-838a-4c63-8495-30401e3a3fef None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:22.604490 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f34ca-cade-4b45-83c2-2280baca221d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:22.605489 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f34ca-cade-4b45-83c2-2280baca221d None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:22.605981 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f34ca-cade-4b45-83c2-2280baca221d None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:22.606500 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f34ca-cade-4b45-83c2-2280baca221d None admin] PATH_INFO: `/v3/services` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:22.607437 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f34ca-cade-4b45-83c2-2280baca221d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:22.607951 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f34ca-cade-4b45-83c2-2280baca221d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:22.609571 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f34ca-cade-4b45-83c2-2280baca221d None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:22.615335 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 453/932] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Jul 5 21:27:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:27:22.626317 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f34ca-cade-4b45-83c2-2280baca221d None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:22.640955 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:22.693339 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e6330c-838a-4c63-8495-30401e3a3fef None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:22.697025 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:22.733436 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f34ca-cade-4b45-83c2-2280baca221d None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:22.735056 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327fa5e3-e142-4da5-af91-ea1c8226250a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:22.736414 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327fa5e3-e142-4da5-af91-ea1c8226250a None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:22.736711 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327fa5e3-e142-4da5-af91-ea1c8226250a None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:22.737805 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327fa5e3-e142-4da5-af91-ea1c8226250a None admin] PATH_INFO: `/v3/services` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:22.737805 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327fa5e3-e142-4da5-af91-ea1c8226250a None admin] RBAC: Adding query filter params (name=compute) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:22.738117 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327fa5e3-e142-4da5-af91-ea1c8226250a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:22.739530 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327fa5e3-e142-4da5-af91-ea1c8226250a None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:22.750538 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 480/933] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Jul 5 21:27:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:27:22.752117 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327fa5e3-e142-4da5-af91-ea1c8226250a None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:22.773152 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd88ef-8959-46fd-bd1c-bcb4da980e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:22.774360 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd88ef-8959-46fd-bd1c-bcb4da980e90 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:22.774826 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd88ef-8959-46fd-bd1c-bcb4da980e90 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:22.775261 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd88ef-8959-46fd-bd1c-bcb4da980e90 None admin] PATH_INFO: `/v3/endpoints` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:22.776211 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd88ef-8959-46fd-bd1c-bcb4da980e90 None admin] RBAC: Adding query filter params (interface=public, service_id=0d03cd204e9d46ffa4f606d4c32815eb, region_id=RegionOne) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:22.776696 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd88ef-8959-46fd-bd1c-bcb4da980e90 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:22.778346 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd88ef-8959-46fd-bd1c-bcb4da980e90 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:22.788846 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 454/934] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Jul 5 21:27:22 2022] GET /identity/v3/endpoints?service_id=0d03cd204e9d46ffa4f606d4c32815eb&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:22.790567 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd88ef-8959-46fd-bd1c-bcb4da980e90 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:22.871128 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327fa5e3-e142-4da5-af91-ea1c8226250a None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:22.894783 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:22.899920 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd88ef-8959-46fd-bd1c-bcb4da980e90 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:22.911323 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d551c1-f338-4fc5-90a0-94be496182fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:22.912004 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d551c1-f338-4fc5-90a0-94be496182fb None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:22.915694 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d551c1-f338-4fc5-90a0-94be496182fb None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:22.915694 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d551c1-f338-4fc5-90a0-94be496182fb None admin] PATH_INFO: `/v3/services` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:22.915694 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d551c1-f338-4fc5-90a0-94be496182fb None admin] RBAC: Adding query filter params (type=compute) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:22.915694 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d551c1-f338-4fc5-90a0-94be496182fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:22.917004 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d551c1-f338-4fc5-90a0-94be496182fb None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:22.926377 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 481/935] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Jul 5 21:27:22 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:27:22.932903 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:22.938476 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2439fbd3-5f08-43c6-8cd0-f7fe9909d861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:22.939175 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439fbd3-5f08-43c6-8cd0-f7fe9909d861 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:22.939473 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439fbd3-5f08-43c6-8cd0-f7fe9909d861 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:22.939778 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439fbd3-5f08-43c6-8cd0-f7fe9909d861 None admin] PATH_INFO: `/v3/services` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:22.940515 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2439fbd3-5f08-43c6-8cd0-f7fe9909d861 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:22.942094 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2439fbd3-5f08-43c6-8cd0-f7fe9909d861 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:22.950767 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 455/936] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Jul 5 21:27:22 2022] GET /identity/v3/services => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:27:23.137241 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65931d04-1eff-4060-8fa7-7f27d97c5b4a None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:23.137723 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65931d04-1eff-4060-8fa7-7f27d97c5b4a None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:23.137723 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65931d04-1eff-4060-8fa7-7f27d97c5b4a None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:23.139275 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 482/937] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:27:23.144670 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5932e5d-11e3-4dd6-ab99-74daa8e3851b None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:23.145124 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5932e5d-11e3-4dd6-ab99-74daa8e3851b None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:23.145307 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5932e5d-11e3-4dd6-ab99-74daa8e3851b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:23.163446 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-f5932e5d-11e3-4dd6-ab99-74daa8e3851b None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:27:23.164781 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-f5932e5d-11e3-4dd6-ab99-74daa8e3851b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:27:23.229299 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfeab06-17c1-46ea-9397-66ac709b7d46 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:23.229789 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfeab06-17c1-46ea-9397-66ac709b7d46 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:23.230397 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfeab06-17c1-46ea-9397-66ac709b7d46 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:23.232153 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 483/938] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:27:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:27:23.237406 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a8dd3-7fb9-4e47-901e-e10bd5650434 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:23.237696 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a8dd3-7fb9-4e47-901e-e10bd5650434 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:23.238002 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a8dd3-7fb9-4e47-901e-e10bd5650434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:23.245175 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 456/939] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:27:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:27:23.255994 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-9c0a8dd3-7fb9-4e47-901e-e10bd5650434 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:27:23.257375 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-9c0a8dd3-7fb9-4e47-901e-e10bd5650434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:27:23.267451 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5932e5d-11e3-4dd6-ab99-74daa8e3851b None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:23.354758 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 484/940] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:27:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:27:23.373568 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a8dd3-7fb9-4e47-901e-e10bd5650434 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:23.386657 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5932e5d-11e3-4dd6-ab99-74daa8e3851b None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:23.416526 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:23.427535 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de4080-de96-4031-a34f-f7aed0244a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:23.428415 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de4080-de96-4031-a34f-f7aed0244a67 None admin] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:23.428855 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de4080-de96-4031-a34f-f7aed0244a67 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:23.429279 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de4080-de96-4031-a34f-f7aed0244a67 None admin] PATH_INFO: `/v3/projects` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:23.430813 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00de4080-de96-4031-a34f-f7aed0244a67 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:23.432741 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00de4080-de96-4031-a34f-f7aed0244a67 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:23.435290 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: WARNING keystone.server.flask.common [None req-00de4080-de96-4031-a34f-f7aed0244a67 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 05 21:27:23.484937 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.sql.core [None req-00de4080-de96-4031-a34f-f7aed0244a67 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 05 21:27:23.484937 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 05 21:27:23.484937 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [parameters: {'id': '21138b515090466fbbe4b47537e4931b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 05 21:27:23.484937 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=172889) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 05 21:27:23.486319 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a8dd3-7fb9-4e47-901e-e10bd5650434 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:23.492975 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-00de4080-de96-4031-a34f-f7aed0244a67 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 21138b515090466fbbe4b47537e4931b.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 21138b515090466fbbe4b47537e4931b. Jul 05 21:27:23.492975 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:23.492975 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 21:27:23.492975 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 21:27:23.492975 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 21:27:23.492975 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 21:27:23.492975 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 21:27:23.492975 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 21:27:23.492975 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 21:27:23.492975 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application conn.query(q) Jul 05 21:27:23.492975 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 21:27:23.492975 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 21:27:23.492975 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 21:27:23.493857 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application result.read() Jul 05 21:27:23.493857 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 21:27:23.493857 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 21:27:23.493857 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 21:27:23.493857 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 21:27:23.493857 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 21:27:23.493857 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 21:27:23.493857 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 21:27:23.493857 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 21:27:23.493857 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 05 21:27:23.493857 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:23.493857 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 05 21:27:23.493857 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:23.493857 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:23.493857 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 05 21:27:23.493857 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 05 21:27:23.493857 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 05 21:27:23.493857 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 05 21:27:23.494832 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 21:27:23.494832 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application next(self.gen) Jul 05 21:27:23.494832 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 05 21:27:23.494832 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application yield resource Jul 05 21:27:23.494832 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 21:27:23.494832 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application next(self.gen) Jul 05 21:27:23.494832 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 05 21:27:23.494832 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application self.session.rollback() Jul 05 21:27:23.494832 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 05 21:27:23.494832 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application self.force_reraise() Jul 05 21:27:23.494832 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 05 21:27:23.494832 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise self.value Jul 05 21:27:23.494832 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 05 21:27:23.494832 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 05 21:27:23.494832 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 05 21:27:23.494832 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application session.commit() Jul 05 21:27:23.494832 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 05 21:27:23.495722 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 05 21:27:23.495722 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 05 21:27:23.495722 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application self._prepare_impl() Jul 05 21:27:23.495722 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 05 21:27:23.495722 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application self.session.flush() Jul 05 21:27:23.495722 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 05 21:27:23.495722 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application self._flush(objects) Jul 05 21:27:23.495722 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 05 21:27:23.495722 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 05 21:27:23.495722 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 05 21:27:23.495722 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application compat.raise_( Jul 05 21:27:23.495722 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 21:27:23.495722 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception Jul 05 21:27:23.495722 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 05 21:27:23.495722 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application flush_context.execute() Jul 05 21:27:23.495722 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 05 21:27:23.495722 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rec.execute(self) Jul 05 21:27:23.496609 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 05 21:27:23.496609 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 05 21:27:23.496609 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 05 21:27:23.496609 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 05 21:27:23.496609 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 05 21:27:23.496609 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 05 21:27:23.496609 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 05 21:27:23.496609 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 05 21:27:23.496609 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 05 21:27:23.496609 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 05 21:27:23.496609 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 05 21:27:23.496609 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 05 21:27:23.496609 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 05 21:27:23.496609 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 05 21:27:23.496609 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 05 21:27:23.497505 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 05 21:27:23.497505 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 21:27:23.497505 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception Jul 05 21:27:23.497505 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 21:27:23.497505 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 21:27:23.497505 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 21:27:23.497505 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 21:27:23.497505 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 21:27:23.497505 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 21:27:23.497505 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 21:27:23.497505 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application conn.query(q) Jul 05 21:27:23.497505 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 21:27:23.497505 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 21:27:23.497505 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 21:27:23.497505 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application result.read() Jul 05 21:27:23.497505 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 21:27:23.497505 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 21:27:23.499588 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 21:27:23.499588 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 21:27:23.499588 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 21:27:23.499588 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 21:27:23.499588 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 21:27:23.499588 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 21:27:23.499588 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 05 21:27:23.499588 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 05 21:27:23.499588 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [parameters: {'id': '21138b515090466fbbe4b47537e4931b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 05 21:27:23.499588 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 05 21:27:23.499588 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:23.499588 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:27:23.499588 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:23.499588 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:23.499588 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 05 21:27:23.501397 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 05 21:27:23.501397 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 05 21:27:23.501397 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 05 21:27:23.501397 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 05 21:27:23.501397 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:23.501397 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:27:23.501397 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:23.501397 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:23.501397 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:23.501397 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:23.501397 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:23.501397 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:23.501397 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:23.501397 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:23.501397 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:23.501397 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:23.501397 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:23.504340 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:23.504340 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 05 21:27:23.504340 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 05 21:27:23.504340 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:23.504340 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:23.504340 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 05 21:27:23.504340 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 05 21:27:23.504340 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 21138b515090466fbbe4b47537e4931b. Jul 05 21:27:23.504340 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:23.504340 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 457/941] 10.222.0.30 () {60 vars in 1140 bytes} [Tue Jul 5 21:27:23 2022] POST /identity/v3/projects => generated 262 bytes in 232 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:27:23.504340 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de4080-de96-4031-a34f-f7aed0244a67 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:23.504953 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:23.530737 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57f9ff-cb7a-4b15-908a-85032d2a65e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:23.531895 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57f9ff-cb7a-4b15-908a-85032d2a65e3 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:23.532379 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57f9ff-cb7a-4b15-908a-85032d2a65e3 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:23.533303 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57f9ff-cb7a-4b15-908a-85032d2a65e3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:23.548002 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed57f9ff-cb7a-4b15-908a-85032d2a65e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:27:23.557871 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-ed57f9ff-cb7a-4b15-908a-85032d2a65e3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 21:27:23.557871 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:23.557871 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:23.557871 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:23.557871 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:23.557871 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:23.557871 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:23.557871 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:23.557871 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:23.557871 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:23.557871 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:23.557871 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:23.557871 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:27:23.557871 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:27:23.557871 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:27:23.557871 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:27:23.558839 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:27:23.558839 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:27:23.558839 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:27:23.558839 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:27:23.558839 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:23.558839 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:23.558839 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:23.558839 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:23.558839 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:23.558839 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:23.558839 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:23.558839 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:23.558839 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:23.558839 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:23.558839 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:23.558839 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:23.560665 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:23.560665 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:23.560665 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:23.560665 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:23.560665 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:27:23.560665 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:27:23.560665 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:27:23.560665 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:27:23.560665 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:27:23.560665 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:27:23.560665 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 21:27:23.560665 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:23.563858 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 485/942] 10.222.0.30 () {56 vars in 1120 bytes} [Tue Jul 5 21:27:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:23.569673 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57f9ff-cb7a-4b15-908a-85032d2a65e3 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:23.631252 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de4080-de96-4031-a34f-f7aed0244a67 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:23.671091 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed8b4e4-25cc-4eda-ab6a-097de98ed639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:23.672169 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8b4e4-25cc-4eda-ab6a-097de98ed639 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:23.672481 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8b4e4-25cc-4eda-ab6a-097de98ed639 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:23.672773 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8b4e4-25cc-4eda-ab6a-097de98ed639 None admin] PATH_INFO: `/v3/projects/service` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:23.681947 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed8b4e4-25cc-4eda-ab6a-097de98ed639 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:23.683659 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed8b4e4-25cc-4eda-ab6a-097de98ed639 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:23.698638 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57f9ff-cb7a-4b15-908a-85032d2a65e3 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:23.702679 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-eed8b4e4-25cc-4eda-ab6a-097de98ed639 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:27:23.702679 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:23.702679 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:23.702679 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:23.702679 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:23.702679 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:23.702679 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:23.702679 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:23.702679 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:23.702679 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:23.702679 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:23.702679 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:23.702679 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:27:23.702679 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:27:23.702679 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:27:23.704026 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:27:23.704026 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:23.704026 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:23.704026 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:23.704026 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:23.704026 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:23.704026 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:23.704026 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:23.704026 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:23.704026 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:23.704026 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:23.704026 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:23.704026 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:23.704026 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:23.704026 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:23.704026 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:23.704026 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:23.704995 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:27:23.704995 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:27:23.704995 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:27:23.704995 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:27:23.704995 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:27:23.704995 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:27:23.704995 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:27:23.704995 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:23.709041 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 458/943] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:27:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:23.709957 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed8b4e4-25cc-4eda-ab6a-097de98ed639 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:23.748248 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704362c-7f6e-401a-be64-b3fbe13f6573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:23.748979 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704362c-7f6e-401a-be64-b3fbe13f6573 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:23.749266 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704362c-7f6e-401a-be64-b3fbe13f6573 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:23.749545 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704362c-7f6e-401a-be64-b3fbe13f6573 None admin] PATH_INFO: `/v3/roles` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:23.750323 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4704362c-7f6e-401a-be64-b3fbe13f6573 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:23.750631 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4704362c-7f6e-401a-be64-b3fbe13f6573 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:23.752005 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4704362c-7f6e-401a-be64-b3fbe13f6573 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:23.766629 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 486/944] 10.222.0.30 () {56 vars in 1115 bytes} [Tue Jul 5 21:27:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:27:23.768248 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704362c-7f6e-401a-be64-b3fbe13f6573 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:23.770927 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:23.809951 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:23.848355 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed8b4e4-25cc-4eda-ab6a-097de98ed639 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:23.889973 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704362c-7f6e-401a-be64-b3fbe13f6573 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:23.897479 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2bacb0-ad54-458c-8ab7-da2fd29a3723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:23.898429 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2bacb0-ad54-458c-8ab7-da2fd29a3723 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:23.900353 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2bacb0-ad54-458c-8ab7-da2fd29a3723 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:23.900877 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2bacb0-ad54-458c-8ab7-da2fd29a3723 None admin] PATH_INFO: `/v3/projects` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:23.902565 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2bacb0-ad54-458c-8ab7-da2fd29a3723 None admin] RBAC: Adding query filter params (name=service) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:23.903115 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2bacb0-ad54-458c-8ab7-da2fd29a3723 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:23.905542 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2bacb0-ad54-458c-8ab7-da2fd29a3723 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:23.927024 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e72ecc-8aec-43bf-8978-5c34a6696059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:23.927677 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e72ecc-8aec-43bf-8978-5c34a6696059 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:23.927962 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e72ecc-8aec-43bf-8978-5c34a6696059 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:23.928233 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e72ecc-8aec-43bf-8978-5c34a6696059 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:23.942753 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 459/945] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Jul 5 21:27:23 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:23.947529 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e72ecc-8aec-43bf-8978-5c34a6696059 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:23.949011 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e72ecc-8aec-43bf-8978-5c34a6696059 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:23.969289 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-c2e72ecc-8aec-43bf-8978-5c34a6696059 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:23.969289 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:23.969289 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:23.969289 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:23.969289 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:23.969289 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:23.969289 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:23.969289 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:23.969289 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:23.969289 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:23.969289 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:23.969289 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:23.969289 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:27:23.969289 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:27:23.969289 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:27:23.970379 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:27:23.970379 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:23.970379 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:23.970379 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:23.970379 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:23.970379 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:23.970379 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:23.970379 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:23.970379 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:23.970379 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:23.970379 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:23.970379 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:23.970379 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:23.970379 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:23.970379 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:23.970379 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:23.970379 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:23.971270 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:27:23.971270 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:27:23.971270 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:23.971270 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:23.971270 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 487/946] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:27:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:23.977505 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2bacb0-ad54-458c-8ab7-da2fd29a3723 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:24.089879 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2bacb0-ad54-458c-8ab7-da2fd29a3723 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:24.091643 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:24.134381 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e76f137-d4cc-4dbc-8dfe-99a3436e1f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:24.135090 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76f137-d4cc-4dbc-8dfe-99a3436e1f75 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:24.135378 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76f137-d4cc-4dbc-8dfe-99a3436e1f75 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:24.135659 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76f137-d4cc-4dbc-8dfe-99a3436e1f75 None admin] PATH_INFO: `/v3/domains` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:24.136422 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e76f137-d4cc-4dbc-8dfe-99a3436e1f75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:24.136999 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e76f137-d4cc-4dbc-8dfe-99a3436e1f75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:24.138629 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e76f137-d4cc-4dbc-8dfe-99a3436e1f75 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:24.155043 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 460/947] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:24.161374 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e72ecc-8aec-43bf-8978-5c34a6696059 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:24.260036 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:24.272622 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e72ecc-8aec-43bf-8978-5c34a6696059 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:24.308343 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46c1a2-9f83-43f6-bd97-23cea5e6d87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:24.309161 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46c1a2-9f83-43f6-bd97-23cea5e6d87a None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:24.309447 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46c1a2-9f83-43f6-bd97-23cea5e6d87a None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:24.309725 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46c1a2-9f83-43f6-bd97-23cea5e6d87a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:24.317760 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd46c1a2-9f83-43f6-bd97-23cea5e6d87a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:24.319242 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd46c1a2-9f83-43f6-bd97-23cea5e6d87a None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:24.334915 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-fd46c1a2-9f83-43f6-bd97-23cea5e6d87a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 21:27:24.334915 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:24.334915 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:24.334915 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:24.334915 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:24.334915 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:24.334915 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:24.334915 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:24.334915 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:24.334915 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:24.334915 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:24.334915 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:24.334915 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:27:24.334915 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:27:24.334915 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:27:24.334915 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:27:24.335902 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:24.335902 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:24.335902 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:27:24.335902 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:27:24.335902 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:27:24.335902 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:27:24.335902 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:24.335902 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:24.335902 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:24.335902 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:24.335902 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:24.335902 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:24.335902 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:24.335902 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:24.335902 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:24.335902 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:24.335902 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:24.335902 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:24.337042 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:24.337042 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:24.337042 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:27:24.337042 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:27:24.337042 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:27:24.337042 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:27:24.337042 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:27:24.337042 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:27:24.337042 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 21:27:24.337042 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:24.342236 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 488/948] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Jul 5 21:27:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:24.343572 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e76f137-d4cc-4dbc-8dfe-99a3436e1f75 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:24.447740 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e76f137-d4cc-4dbc-8dfe-99a3436e1f75 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:24.484612 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a4717-34fe-49fb-888c-86e3c292418a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:24.485290 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a4717-34fe-49fb-888c-86e3c292418a None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:24.485576 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a4717-34fe-49fb-888c-86e3c292418a None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:24.485855 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a4717-34fe-49fb-888c-86e3c292418a None admin] PATH_INFO: `/v3/users` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:24.486725 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a4717-34fe-49fb-888c-86e3c292418a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:24.487037 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a4717-34fe-49fb-888c-86e3c292418a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:24.488604 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a4717-34fe-49fb-888c-86e3c292418a None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:24.510342 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 461/949] 10.222.0.30 () {56 vars in 1149 bytes} [Tue Jul 5 21:27:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:24.513358 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46c1a2-9f83-43f6-bd97-23cea5e6d87a None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:24.621546 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46c1a2-9f83-43f6-bd97-23cea5e6d87a None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:24.656952 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd35506-7890-4079-a169-88c85a97477f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:24.657758 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd35506-7890-4079-a169-88c85a97477f None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:24.658047 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd35506-7890-4079-a169-88c85a97477f None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:24.658432 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd35506-7890-4079-a169-88c85a97477f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:24.670417 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd35506-7890-4079-a169-88c85a97477f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:24.671881 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd35506-7890-4079-a169-88c85a97477f None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:24.680626 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:24.691371 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-7cd35506-7890-4079-a169-88c85a97477f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:24.691371 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:24.691371 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:24.691371 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:24.691371 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:24.691371 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:24.691371 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:24.691371 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:24.691371 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:24.691371 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:24.691371 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:24.691371 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:24.691371 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:27:24.691371 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:27:24.691371 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:27:24.692273 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:27:24.692273 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:24.692273 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:24.692273 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:24.692273 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:24.692273 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:24.692273 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:24.692273 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:24.692273 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:24.692273 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:24.692273 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:24.692273 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:24.692273 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:24.692273 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:24.692273 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:24.692273 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:24.692273 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:24.693176 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:27:24.693176 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:27:24.693176 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:24.693176 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:24.693176 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 489/950] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:27:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:24.698784 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a4717-34fe-49fb-888c-86e3c292418a None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:24.727503 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:24.808487 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a4717-34fe-49fb-888c-86e3c292418a None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:24.844876 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f509c5-15bd-46a7-a5f2-2511d091120b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:24.845584 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f509c5-15bd-46a7-a5f2-2511d091120b None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:24.845875 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f509c5-15bd-46a7-a5f2-2511d091120b None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:24.846185 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f509c5-15bd-46a7-a5f2-2511d091120b None admin] PATH_INFO: `/v3/domains` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:24.846923 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f509c5-15bd-46a7-a5f2-2511d091120b None admin] RBAC: Adding query filter params (name=Default) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:24.847238 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f509c5-15bd-46a7-a5f2-2511d091120b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:24.848630 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f509c5-15bd-46a7-a5f2-2511d091120b None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:24.860877 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 462/951] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:27:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:24.866495 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd35506-7890-4079-a169-88c85a97477f None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:24.974622 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd35506-7890-4079-a169-88c85a97477f None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:25.011313 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a29bc-293d-407f-848b-da32a1764075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:25.012116 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a29bc-293d-407f-848b-da32a1764075 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:25.012404 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a29bc-293d-407f-848b-da32a1764075 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:25.012684 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a29bc-293d-407f-848b-da32a1764075 None admin] PATH_INFO: `/v3/projects/service` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:25.019766 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a29bc-293d-407f-848b-da32a1764075 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:25.021208 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a29bc-293d-407f-848b-da32a1764075 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:25.036618 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-633a29bc-293d-407f-848b-da32a1764075 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:27:25.036618 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:25.036618 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:25.036618 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:25.036618 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:25.036618 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:25.036618 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:25.036618 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:25.036618 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:25.036618 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:25.036618 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:25.036618 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:25.036618 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:27:25.036618 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:27:25.036618 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:27:25.037527 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:27:25.037527 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:25.037527 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:25.037527 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:25.037527 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:25.037527 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:25.037527 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:25.037527 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:25.037527 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:25.037527 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:25.037527 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:25.037527 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:25.037527 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:25.037527 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:25.037527 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:25.037527 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:25.037527 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:25.038450 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:27:25.038450 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:27:25.038450 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:27:25.038450 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:27:25.038450 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:27:25.038450 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:27:25.038450 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:27:25.038450 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:25.038450 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 490/952] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:27:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:25.044364 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f509c5-15bd-46a7-a5f2-2511d091120b None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:25.128579 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb750f32-257d-48de-84d3-7c1232a3176c None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:25.128848 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb750f32-257d-48de-84d3-7c1232a3176c None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:25.129218 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb750f32-257d-48de-84d3-7c1232a3176c None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:25.129684 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:25.131031 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 491/953] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:27:25.136934 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b6b81-2779-412c-bfbc-f2ca798a449f None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:25.137289 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b6b81-2779-412c-bfbc-f2ca798a449f None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:25.137582 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b6b81-2779-412c-bfbc-f2ca798a449f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:25.155951 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f509c5-15bd-46a7-a5f2-2511d091120b None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:25.159842 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-4d4b6b81-2779-412c-bfbc-f2ca798a449f None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:27:25.161225 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-4d4b6b81-2779-412c-bfbc-f2ca798a449f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:27:25.198911 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d56c58-c7ae-4b42-86c1-17b0219e2d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:25.199944 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d56c58-c7ae-4b42-86c1-17b0219e2d81 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:25.200515 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d56c58-c7ae-4b42-86c1-17b0219e2d81 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:25.200802 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d56c58-c7ae-4b42-86c1-17b0219e2d81 None admin] PATH_INFO: `/v3/projects` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:25.201990 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d56c58-c7ae-4b42-86c1-17b0219e2d81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:25.202352 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d56c58-c7ae-4b42-86c1-17b0219e2d81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:25.204405 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d56c58-c7ae-4b42-86c1-17b0219e2d81 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:25.220077 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 463/954] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:27:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:25.225964 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d56c58-c7ae-4b42-86c1-17b0219e2d81 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:25.238937 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:25.250882 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 492/955] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:27:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:27:25.252228 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d7472-1bde-4129-9818-358c41c0c373 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:25.252520 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d7472-1bde-4129-9818-358c41c0c373 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:25.252802 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d7472-1bde-4129-9818-358c41c0c373 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:25.254399 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 493/956] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:27:25.259957 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0434202-32eb-4887-91c6-628e00bf90e7 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:25.260259 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0434202-32eb-4887-91c6-628e00bf90e7 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:25.260522 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0434202-32eb-4887-91c6-628e00bf90e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:25.277271 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-a0434202-32eb-4887-91c6-628e00bf90e7 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:27:25.278529 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-a0434202-32eb-4887-91c6-628e00bf90e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:27:25.339907 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d56c58-c7ae-4b42-86c1-17b0219e2d81 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:25.350180 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 494/957] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:27:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:27:25.354496 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0434202-32eb-4887-91c6-628e00bf90e7 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:25.381893 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386111d-ad2c-443e-b513-ab5aa549f787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:25.382791 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386111d-ad2c-443e-b513-ab5aa549f787 None admin] REQUEST_METHOD: `PUT` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:25.383159 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386111d-ad2c-443e-b513-ab5aa549f787 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:25.383423 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386111d-ad2c-443e-b513-ab5aa549f787 None admin] PATH_INFO: `/v3/projects/7fe768315f5c43f487f71f043f11b8b8/users/0b40f943261d4cd3a6d0a27335e9806d/roles/dd398730a074417fbbd43b27d2ea03d4` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:25.385860 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d386111d-ad2c-443e-b513-ab5aa549f787 None admin] RBAC: Authorizing `identity:create_grant(project_id=7fe768315f5c43f487f71f043f11b8b8, user_id=0b40f943261d4cd3a6d0a27335e9806d, role_id=dd398730a074417fbbd43b27d2ea03d4)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:25.387364 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d386111d-ad2c-443e-b513-ab5aa549f787 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:25.456901 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0434202-32eb-4887-91c6-628e00bf90e7 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:25.477552 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:25.481152 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:25.486096 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 464/958] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:27:25 2022] PUT /identity/v3/projects/7fe768315f5c43f487f71f043f11b8b8/users/0b40f943261d4cd3a6d0a27335e9806d/roles/dd398730a074417fbbd43b27d2ea03d4 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:27:25.486796 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386111d-ad2c-443e-b513-ab5aa549f787 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:25.497191 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22644933-d75d-4232-aa59-9f0999975460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:25.497884 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22644933-d75d-4232-aa59-9f0999975460 None admin] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:25.498197 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22644933-d75d-4232-aa59-9f0999975460 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:25.498483 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22644933-d75d-4232-aa59-9f0999975460 None admin] PATH_INFO: `/v3/services` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:25.499220 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22644933-d75d-4232-aa59-9f0999975460 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:25.500757 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22644933-d75d-4232-aa59-9f0999975460 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:25.577535 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 495/959] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Jul 5 21:27:25 2022] POST /identity/v3/services => generated 242 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:27:25.620055 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386111d-ad2c-443e-b513-ab5aa549f787 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:25.674430 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a7c64-95b7-4fda-aaf9-9b12d4f9c192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:25.675197 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a7c64-95b7-4fda-aaf9-9b12d4f9c192 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:25.675485 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a7c64-95b7-4fda-aaf9-9b12d4f9c192 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:25.675764 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a7c64-95b7-4fda-aaf9-9b12d4f9c192 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:25.676454 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a7c64-95b7-4fda-aaf9-9b12d4f9c192 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:25.677897 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a7c64-95b7-4fda-aaf9-9b12d4f9c192 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:25.691703 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-b59a7c64-95b7-4fda-aaf9-9b12d4f9c192 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:27:25.691703 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:25.691703 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:27:25.691703 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:27:25.691703 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:27:25.691703 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:27:25.691703 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:27:25.691703 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:27:25.691703 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:27:25.691703 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:25.691703 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:27:25.691703 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:25.691703 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:25.691703 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:25.691703 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:25.691703 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:25.691703 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:25.692773 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:25.692773 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:25.692773 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:25.692773 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:25.692773 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:25.692773 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:25.692773 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:27:25.692773 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:27:25.692773 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:27:25.692773 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:27:25.692773 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:25.692773 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:25.692773 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:25.692773 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:25.692773 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:25.692773 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:25.693851 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:25.693851 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:25.693851 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:25.693851 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:25.693851 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:25.693851 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:25.693851 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:25.693851 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:25.693851 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:25.693851 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:25.693851 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:27:25.693851 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:27:25.693851 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:27:25.693851 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:25.693851 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 465/960] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Jul 5 21:27:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:25.699862 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22644933-d75d-4232-aa59-9f0999975460 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:25.822398 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22644933-d75d-4232-aa59-9f0999975460 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:25.858067 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5daf8-38e2-47b6-aefb-cb5b34165a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:25.858835 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5daf8-38e2-47b6-aefb-cb5b34165a09 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:25.859122 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5daf8-38e2-47b6-aefb-cb5b34165a09 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:25.859398 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5daf8-38e2-47b6-aefb-cb5b34165a09 None admin] PATH_INFO: `/v3/services` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:25.860114 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5daf8-38e2-47b6-aefb-cb5b34165a09 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:25.860421 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5daf8-38e2-47b6-aefb-cb5b34165a09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:25.861810 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5daf8-38e2-47b6-aefb-cb5b34165a09 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:25.867230 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 496/961] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Jul 5 21:27:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:25.873092 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a7c64-95b7-4fda-aaf9-9b12d4f9c192 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:25.937732 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:25.981383 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a7c64-95b7-4fda-aaf9-9b12d4f9c192 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:26.021093 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efba0252-5a7b-4c4c-94d2-ff98d6199525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:26.022169 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba0252-5a7b-4c4c-94d2-ff98d6199525 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:26.022674 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba0252-5a7b-4c4c-94d2-ff98d6199525 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:26.023176 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba0252-5a7b-4c4c-94d2-ff98d6199525 None admin] PATH_INFO: `/v3/services` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:26.024241 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efba0252-5a7b-4c4c-94d2-ff98d6199525 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:26.024751 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efba0252-5a7b-4c4c-94d2-ff98d6199525 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:26.026390 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efba0252-5a7b-4c4c-94d2-ff98d6199525 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:26.033992 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 466/962] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Jul 5 21:27:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:26.042152 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5daf8-38e2-47b6-aefb-cb5b34165a09 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:26.088674 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:26.154228 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5daf8-38e2-47b6-aefb-cb5b34165a09 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:26.192514 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7348fd-ff7b-43b6-b941-c73b7287c823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:26.193554 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7348fd-ff7b-43b6-b941-c73b7287c823 None admin] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:26.194043 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7348fd-ff7b-43b6-b941-c73b7287c823 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:26.194554 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7348fd-ff7b-43b6-b941-c73b7287c823 None admin] PATH_INFO: `/v3/endpoints` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:26.195513 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7348fd-ff7b-43b6-b941-c73b7287c823 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:26.197819 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7348fd-ff7b-43b6-b941-c73b7287c823 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:26.199645 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964eddf-b1d7-48ac-b0ba-e62fd5dd0fcb None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:26.200104 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964eddf-b1d7-48ac-b0ba-e62fd5dd0fcb None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:26.200198 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964eddf-b1d7-48ac-b0ba-e62fd5dd0fcb None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:26.201713 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 467/963] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:27:26.206998 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e7710-204b-4ef4-ba74-9c6f027bbf7d None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:26.207819 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e7710-204b-4ef4-ba74-9c6f027bbf7d None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:26.208331 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e7710-204b-4ef4-ba74-9c6f027bbf7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:26.226074 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-fe6e7710-204b-4ef4-ba74-9c6f027bbf7d None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:27:26.227826 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-fe6e7710-204b-4ef4-ba74-9c6f027bbf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:27:26.278675 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 497/964] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Jul 5 21:27:26 2022] POST /identity/v3/endpoints => generated 349 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:27:26.321639 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 468/965] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:27:26 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:27:26.348131 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7348fd-ff7b-43b6-b941-c73b7287c823 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:26.459811 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:26.465163 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7348fd-ff7b-43b6-b941-c73b7287c823 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:26.503210 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ceb63-1f24-40b7-ae29-c39d9ae8b63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:26.503875 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ceb63-1f24-40b7-ae29-c39d9ae8b63b None admin] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:26.504167 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ceb63-1f24-40b7-ae29-c39d9ae8b63b None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:26.504453 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ceb63-1f24-40b7-ae29-c39d9ae8b63b None admin] PATH_INFO: `/v3/users` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:26.505178 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4ceb63-1f24-40b7-ae29-c39d9ae8b63b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:26.506686 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4ceb63-1f24-40b7-ae29-c39d9ae8b63b None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:26.508140 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: WARNING keystone.server.flask.common [None req-cb4ceb63-1f24-40b7-ae29-c39d9ae8b63b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 05 21:27:26.574150 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.sql.core [None req-cb4ceb63-1f24-40b7-ae29-c39d9ae8b63b None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 05 21:27:26.574150 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 05 21:27:26.574150 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [parameters: {'user_id': '64bc50ede8ba418487522179e6dd75a8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 05 21:27:26.574150 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=172890) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 05 21:27:26.584974 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-cb4ceb63-1f24-40b7-ae29-c39d9ae8b63b None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 05 21:27:26.584974 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:26.584974 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 21:27:26.584974 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 21:27:26.584974 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 21:27:26.584974 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 21:27:26.584974 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 21:27:26.584974 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 21:27:26.584974 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 21:27:26.584974 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application conn.query(q) Jul 05 21:27:26.584974 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 21:27:26.584974 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 21:27:26.584974 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 21:27:26.584974 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application result.read() Jul 05 21:27:26.584974 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 21:27:26.585868 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 21:27:26.585868 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 21:27:26.585868 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 21:27:26.585868 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 21:27:26.585868 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 21:27:26.585868 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 21:27:26.585868 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 21:27:26.585868 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 05 21:27:26.585868 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:26.585868 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 05 21:27:26.585868 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:26.585868 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:26.585868 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 05 21:27:26.585868 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 05 21:27:26.585868 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 05 21:27:26.585868 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 05 21:27:26.585868 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 21:27:26.585868 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application next(self.gen) Jul 05 21:27:26.586906 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 05 21:27:26.586906 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application yield resource Jul 05 21:27:26.586906 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 21:27:26.586906 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application next(self.gen) Jul 05 21:27:26.586906 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 05 21:27:26.586906 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application self.session.rollback() Jul 05 21:27:26.586906 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 05 21:27:26.586906 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application self.force_reraise() Jul 05 21:27:26.586906 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 05 21:27:26.586906 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise self.value Jul 05 21:27:26.586906 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 05 21:27:26.586906 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 05 21:27:26.586906 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 05 21:27:26.586906 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application session.commit() Jul 05 21:27:26.586906 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 05 21:27:26.586906 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 05 21:27:26.586906 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 05 21:27:26.587797 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application self._prepare_impl() Jul 05 21:27:26.587797 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 05 21:27:26.587797 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application self.session.flush() Jul 05 21:27:26.587797 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 05 21:27:26.587797 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application self._flush(objects) Jul 05 21:27:26.587797 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 05 21:27:26.587797 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 05 21:27:26.587797 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 05 21:27:26.587797 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application compat.raise_( Jul 05 21:27:26.587797 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 21:27:26.587797 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception Jul 05 21:27:26.587797 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 05 21:27:26.587797 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application flush_context.execute() Jul 05 21:27:26.587797 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 05 21:27:26.587797 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rec.execute(self) Jul 05 21:27:26.587797 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 05 21:27:26.587797 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 05 21:27:26.588688 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 05 21:27:26.588688 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 05 21:27:26.588688 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 05 21:27:26.588688 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 05 21:27:26.588688 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 05 21:27:26.588688 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 05 21:27:26.588688 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 05 21:27:26.588688 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 05 21:27:26.588688 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 05 21:27:26.588688 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 05 21:27:26.588688 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 05 21:27:26.588688 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 05 21:27:26.588688 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 05 21:27:26.588688 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 05 21:27:26.588688 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 21:27:26.588688 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception Jul 05 21:27:26.589539 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 21:27:26.589539 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 21:27:26.589539 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 21:27:26.589539 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 21:27:26.589539 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 21:27:26.589539 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 21:27:26.589539 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 21:27:26.589539 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application conn.query(q) Jul 05 21:27:26.589539 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 21:27:26.589539 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 21:27:26.589539 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 21:27:26.589539 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application result.read() Jul 05 21:27:26.589539 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 21:27:26.589539 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 21:27:26.589539 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 21:27:26.589539 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 21:27:26.590381 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 21:27:26.590381 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 21:27:26.590381 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 21:27:26.590381 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 21:27:26.590381 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 05 21:27:26.590381 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 05 21:27:26.590381 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [parameters: {'user_id': '64bc50ede8ba418487522179e6dd75a8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 05 21:27:26.590381 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 05 21:27:26.590381 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:26.590381 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:27:26.590381 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:26.590381 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:26.590381 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:26.590381 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:26.590381 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:26.591197 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:26.591197 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:26.591197 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:26.591197 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:26.591197 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:26.591197 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:26.591197 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:26.591197 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 05 21:27:26.591197 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 05 21:27:26.591197 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:26.591197 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:26.591197 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:27:26.591197 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:27:26.591197 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:27:26.591197 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:27:26.591197 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 05 21:27:26.591197 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 05 21:27:26.592141 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 05 21:27:26.592141 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 05 21:27:26.592141 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 05 21:27:26.592141 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 05 21:27:26.592141 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 05 21:27:26.592141 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:26.592141 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 498/966] 10.222.0.30 () {60 vars in 1131 bytes} [Tue Jul 5 21:27:26 2022] POST /identity/v3/users => generated 160 bytes in 239 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:26.593829 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e7710-204b-4ef4-ba74-9c6f027bbf7d None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:26.648823 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:26.703833 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e7710-204b-4ef4-ba74-9c6f027bbf7d None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:26.742616 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde44286-f695-4cd0-8ba3-bfc9e8a5badd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:26.744354 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde44286-f695-4cd0-8ba3-bfc9e8a5badd None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:26.744851 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde44286-f695-4cd0-8ba3-bfc9e8a5badd None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:26.745335 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde44286-f695-4cd0-8ba3-bfc9e8a5badd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:26.753081 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde44286-f695-4cd0-8ba3-bfc9e8a5badd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:26.754916 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde44286-f695-4cd0-8ba3-bfc9e8a5badd None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:26.771115 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-bde44286-f695-4cd0-8ba3-bfc9e8a5badd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 21:27:26.771115 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:26.771115 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:26.771115 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:26.771115 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:26.771115 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:26.771115 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:26.771115 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:26.771115 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:26.771115 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:26.771115 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:26.771115 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:26.771115 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:27:26.771115 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:27:26.771115 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:27:26.771115 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:27:26.772103 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:26.772103 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:26.772103 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:27:26.772103 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:27:26.772103 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:27:26.772103 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:27:26.772103 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:26.772103 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:26.772103 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:26.772103 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:26.772103 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:26.772103 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:26.772103 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:26.772103 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:26.772103 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:26.772103 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:26.772103 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:26.772103 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:26.773050 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:26.773050 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:26.773050 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:27:26.773050 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:27:26.773050 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:27:26.773050 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:27:26.773050 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:27:26.773050 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:27:26.773050 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 21:27:26.773050 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:26.776110 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 469/967] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:27:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:26.782006 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ceb63-1f24-40b7-ae29-c39d9ae8b63b None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:26.897989 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ceb63-1f24-40b7-ae29-c39d9ae8b63b None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:26.937835 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1407c0-feae-4772-9fa0-f49c7139ba1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:26.938545 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1407c0-feae-4772-9fa0-f49c7139ba1c None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:26.938831 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1407c0-feae-4772-9fa0-f49c7139ba1c None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:26.939114 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1407c0-feae-4772-9fa0-f49c7139ba1c None admin] PATH_INFO: `/v3/users` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:26.939920 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1407c0-feae-4772-9fa0-f49c7139ba1c None admin] RBAC: Adding query filter params (name=cinder) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:26.940228 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1407c0-feae-4772-9fa0-f49c7139ba1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:26.941886 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1407c0-feae-4772-9fa0-f49c7139ba1c None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:26.982468 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 499/968] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:27:26 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:27.670846 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc564973-d0a0-43c8-b427-7162e94a91af None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:27.671390 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc564973-d0a0-43c8-b427-7162e94a91af None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:27.671390 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc564973-d0a0-43c8-b427-7162e94a91af None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:27.672945 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 470/969] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:27:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:27:27.677971 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a9dfc-78b0-4f41-b2a3-aa422a15ca46 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:27.678404 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a9dfc-78b0-4f41-b2a3-aa422a15ca46 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:27.678576 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a9dfc-78b0-4f41-b2a3-aa422a15ca46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:27.696569 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-ba3a9dfc-78b0-4f41-b2a3-aa422a15ca46 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:27:27.698095 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-ba3a9dfc-78b0-4f41-b2a3-aa422a15ca46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:27:27.713784 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:27.768109 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 500/970] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:27:27 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:27:27.791334 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc564973-d0a0-43c8-b427-7162e94a91af None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:27.869668 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b4541-3cf3-4fb1-8b49-0e180611c710 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:27.869970 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b4541-3cf3-4fb1-8b49-0e180611c710 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:27.870185 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b4541-3cf3-4fb1-8b49-0e180611c710 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:27.871709 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 501/971] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:27:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:27:27.876445 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13be84-c89a-4fde-adff-daea9adb3d28 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:27.876737 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13be84-c89a-4fde-adff-daea9adb3d28 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:27.877027 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13be84-c89a-4fde-adff-daea9adb3d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:27.894628 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-0b13be84-c89a-4fde-adff-daea9adb3d28 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:27:27.895832 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-0b13be84-c89a-4fde-adff-daea9adb3d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:27:27.900654 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc564973-d0a0-43c8-b427-7162e94a91af None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:27.912643 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:27.940269 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d2768-254d-4fb3-bbff-5d0eece67e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:27.941143 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d2768-254d-4fb3-bbff-5d0eece67e4a None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:27.941827 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d2768-254d-4fb3-bbff-5d0eece67e4a None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:27.942514 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d2768-254d-4fb3-bbff-5d0eece67e4a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:27.954404 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76d2768-254d-4fb3-bbff-5d0eece67e4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:27:27.963187 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-d76d2768-254d-4fb3-bbff-5d0eece67e4a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 21:27:27.963187 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:27.963187 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:27.963187 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:27.963187 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:27.963187 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:27.963187 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:27.963187 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:27.963187 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:27.963187 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:27.963187 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:27.963187 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:27.963187 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:27:27.963187 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:27:27.963187 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:27:27.963187 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:27:27.964125 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:27:27.964125 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:27:27.964125 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:27:27.964125 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:27:27.964125 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:27.964125 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:27.964125 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:27.964125 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:27.964125 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:27.964125 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:27.964125 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:27.964125 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:27.964125 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:27.964125 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:27.964125 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:27.964125 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:27.965003 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:27.965003 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:27.965003 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:27.965003 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:27.965003 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:27:27.965003 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:27:27.965003 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:27:27.965003 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:27:27.965003 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:27:27.965003 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:27:27.965003 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 21:27:27.965003 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:27.965003 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 471/972] 10.222.0.30 () {56 vars in 1120 bytes} [Tue Jul 5 21:27:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:27.970163 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d2768-254d-4fb3-bbff-5d0eece67e4a None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:27.971502 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 502/973] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:27:27 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:27:27.994692 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13be84-c89a-4fde-adff-daea9adb3d28 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:28.080559 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:28.087252 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d2768-254d-4fb3-bbff-5d0eece67e4a None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:28.103313 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13be84-c89a-4fde-adff-daea9adb3d28 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:28.123918 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafab76c-cfbd-496c-9b40-3efcdb19bcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:28.124935 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafab76c-cfbd-496c-9b40-3efcdb19bcee None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:28.125238 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafab76c-cfbd-496c-9b40-3efcdb19bcee None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:28.125524 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafab76c-cfbd-496c-9b40-3efcdb19bcee None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:28.126477 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafab76c-cfbd-496c-9b40-3efcdb19bcee None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:28.126792 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafab76c-cfbd-496c-9b40-3efcdb19bcee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:28.128176 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafab76c-cfbd-496c-9b40-3efcdb19bcee None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:28.137253 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 472/974] 10.222.0.30 () {56 vars in 1115 bytes} [Tue Jul 5 21:27:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:27:28.140496 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf064a2-031d-436d-9f2f-d4f2300adb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:28.141526 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf064a2-031d-436d-9f2f-d4f2300adb24 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:28.142045 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf064a2-031d-436d-9f2f-d4f2300adb24 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:28.142361 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf064a2-031d-436d-9f2f-d4f2300adb24 None admin] PATH_INFO: `/v3/services/compute` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:28.142690 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafab76c-cfbd-496c-9b40-3efcdb19bcee None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:28.143074 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf064a2-031d-436d-9f2f-d4f2300adb24 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:28.144387 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf064a2-031d-436d-9f2f-d4f2300adb24 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:28.158997 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-2bf064a2-031d-436d-9f2f-d4f2300adb24 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 21:27:28.158997 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:28.158997 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:27:28.158997 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:27:28.158997 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:27:28.158997 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:27:28.158997 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:27:28.158997 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:27:28.158997 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 21:27:28.158997 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:28.158997 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:27:28.158997 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:28.158997 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:28.158997 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:28.158997 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:28.158997 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:28.158997 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:28.160027 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:28.160027 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:28.160027 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:28.160027 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:28.160027 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:28.160027 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:28.160027 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:27:28.160027 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:27:28.160027 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:27:28.160027 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:27:28.160027 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:28.160027 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:28.160027 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:28.160027 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:28.160027 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:28.160027 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:28.160876 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:28.160876 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:28.160876 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:28.160876 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:28.160876 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:28.160876 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:28.160876 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:28.160876 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:28.160876 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:28.160876 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:28.160876 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:27:28.160876 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:27:28.160876 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 21:27:28.160876 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:28.160876 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 503/975] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:27:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:27:28.166845 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf064a2-031d-436d-9f2f-d4f2300adb24 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:28.180465 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:28.256527 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafab76c-cfbd-496c-9b40-3efcdb19bcee None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:28.277263 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf064a2-031d-436d-9f2f-d4f2300adb24 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:28.292863 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8293dd-ff00-42f5-bb3d-5c3a7c1f8939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:28.293664 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8293dd-ff00-42f5-bb3d-5c3a7c1f8939 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:28.293949 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8293dd-ff00-42f5-bb3d-5c3a7c1f8939 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:28.294262 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8293dd-ff00-42f5-bb3d-5c3a7c1f8939 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:28.306051 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8293dd-ff00-42f5-bb3d-5c3a7c1f8939 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:28.307698 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8293dd-ff00-42f5-bb3d-5c3a7c1f8939 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:28.313255 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5d72a-80e9-4c1b-ba2e-fe289bb580bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:28.313931 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5d72a-80e9-4c1b-ba2e-fe289bb580bd None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:28.314247 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5d72a-80e9-4c1b-ba2e-fe289bb580bd None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:28.314535 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5d72a-80e9-4c1b-ba2e-fe289bb580bd None admin] PATH_INFO: `/v3/services` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:28.315255 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5d72a-80e9-4c1b-ba2e-fe289bb580bd None admin] RBAC: Adding query filter params (name=compute) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:28.315568 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5d72a-80e9-4c1b-ba2e-fe289bb580bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:28.317050 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5d72a-80e9-4c1b-ba2e-fe289bb580bd None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:28.322393 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 504/976] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Jul 5 21:27:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:27:28.326695 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-dc8293dd-ff00-42f5-bb3d-5c3a7c1f8939 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:28.326695 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:28.326695 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:28.326695 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:28.326695 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:28.326695 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:28.326695 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:28.326695 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:28.326695 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:28.326695 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:28.326695 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:28.326695 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:28.326695 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:27:28.326695 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:27:28.326695 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:27:28.327619 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:27:28.327619 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:28.327619 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:28.327619 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:28.327619 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:28.327619 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:28.327619 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:28.327619 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:28.327619 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:28.327619 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:28.327619 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:28.327619 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:28.327619 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:28.327619 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:28.327619 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:28.327619 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:28.327619 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:28.328756 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:27:28.328756 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:27:28.328756 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:28.328756 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:28.329010 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5d72a-80e9-4c1b-ba2e-fe289bb580bd None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:28.330644 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 473/977] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:27:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:27:28.336069 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8293dd-ff00-42f5-bb3d-5c3a7c1f8939 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:28.345205 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:28.425587 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:28.435799 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5d72a-80e9-4c1b-ba2e-fe289bb580bd None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:28.442115 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8293dd-ff00-42f5-bb3d-5c3a7c1f8939 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:28.472012 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5fb2df-399b-4d0f-976e-7ae31bb0f9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:28.473051 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5fb2df-399b-4d0f-976e-7ae31bb0f9de None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:28.473560 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5fb2df-399b-4d0f-976e-7ae31bb0f9de None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:28.474066 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5fb2df-399b-4d0f-976e-7ae31bb0f9de None admin] PATH_INFO: `/v3/services` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:28.475206 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5fb2df-399b-4d0f-976e-7ae31bb0f9de None admin] RBAC: Adding query filter params (type=compute) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:28.475524 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5fb2df-399b-4d0f-976e-7ae31bb0f9de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:28.476941 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5fb2df-399b-4d0f-976e-7ae31bb0f9de None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:28.477648 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a117a-376b-4e8a-a0df-f61a05c64593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:28.478354 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a117a-376b-4e8a-a0df-f61a05c64593 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:28.478646 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a117a-376b-4e8a-a0df-f61a05c64593 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:28.478932 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a117a-376b-4e8a-a0df-f61a05c64593 None admin] PATH_INFO: `/v3/domains` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:28.479664 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85a117a-376b-4e8a-a0df-f61a05c64593 None admin] RBAC: Adding query filter params (name=Default) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:28.479975 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85a117a-376b-4e8a-a0df-f61a05c64593 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:28.481364 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85a117a-376b-4e8a-a0df-f61a05c64593 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:28.482167 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 505/978] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Jul 5 21:27:28 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:27:28.483415 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31544aba-ffb6-442e-98da-a5fa2fa1c1e6 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:28.483709 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31544aba-ffb6-442e-98da-a5fa2fa1c1e6 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:28.483992 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31544aba-ffb6-442e-98da-a5fa2fa1c1e6 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:28.485210 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 506/979] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:27:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:27:28.487859 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31544aba-ffb6-442e-98da-a5fa2fa1c1e6 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:28.500921 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 474/980] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:27:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:27:28.502354 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56190be7-a3ec-4c0b-8e81-32f35bd174c7 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:28.502653 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56190be7-a3ec-4c0b-8e81-32f35bd174c7 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:28.502941 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56190be7-a3ec-4c0b-8e81-32f35bd174c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:28.520207 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-56190be7-a3ec-4c0b-8e81-32f35bd174c7 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:27:28.521418 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-56190be7-a3ec-4c0b-8e81-32f35bd174c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:27:28.561711 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:28.593396 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31544aba-ffb6-442e-98da-a5fa2fa1c1e6 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:28.593843 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 475/981] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:27:28 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:27:28.594799 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56190be7-a3ec-4c0b-8e81-32f35bd174c7 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:28.630015 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5228324-423f-41a5-b11f-d64032cd9b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:28.630707 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5228324-423f-41a5-b11f-d64032cd9b4a None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:28.630995 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5228324-423f-41a5-b11f-d64032cd9b4a None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:28.631280 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5228324-423f-41a5-b11f-d64032cd9b4a None admin] PATH_INFO: `/v3/endpoints` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:28.632071 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5228324-423f-41a5-b11f-d64032cd9b4a None admin] RBAC: Adding query filter params (interface=public, service_id=b34f641c9c3f4a8a832d9df1de4bc776, region_id=RegionOne) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:28.632390 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5228324-423f-41a5-b11f-d64032cd9b4a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:28.634403 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5228324-423f-41a5-b11f-d64032cd9b4a None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:28.639583 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 507/982] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Jul 5 21:27:28 2022] GET /identity/v3/endpoints?service_id=b34f641c9c3f4a8a832d9df1de4bc776&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:27:28.640364 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5228324-423f-41a5-b11f-d64032cd9b4a None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:28.677431 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:28.703736 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56190be7-a3ec-4c0b-8e81-32f35bd174c7 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:28.738798 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a7240-d4f3-470c-9079-52d184ab4adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:28.739618 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a7240-d4f3-470c-9079-52d184ab4adf None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:28.739910 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a7240-d4f3-470c-9079-52d184ab4adf None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:28.740197 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a7240-d4f3-470c-9079-52d184ab4adf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:28.742373 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5228324-423f-41a5-b11f-d64032cd9b4a None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:28.749462 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a7240-d4f3-470c-9079-52d184ab4adf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:28.750964 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a7240-d4f3-470c-9079-52d184ab4adf None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:28.765971 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-0f1a7240-d4f3-470c-9079-52d184ab4adf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 21:27:28.765971 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:28.765971 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:28.765971 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:28.765971 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:28.765971 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:28.765971 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:28.765971 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:28.765971 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:28.765971 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:28.765971 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:28.765971 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:28.765971 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:27:28.765971 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:27:28.765971 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:27:28.765971 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:27:28.766953 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:28.766953 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:28.766953 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:27:28.766953 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:27:28.766953 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:27:28.766953 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:27:28.766953 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:28.766953 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:28.766953 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:28.766953 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:28.766953 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:28.766953 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:28.766953 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:28.766953 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:28.766953 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:28.766953 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:28.766953 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:28.766953 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:28.767885 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:28.767885 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:28.767885 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:27:28.767885 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:27:28.767885 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:27:28.767885 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:27:28.767885 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:27:28.767885 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:27:28.767885 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 21:27:28.767885 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:28.767885 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 476/983] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Jul 5 21:27:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:28.768475 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a7240-d4f3-470c-9079-52d184ab4adf None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:28.780044 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3921c5a-6ce9-4c9e-83ee-88d5565b6772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:28.780854 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3921c5a-6ce9-4c9e-83ee-88d5565b6772 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:28.781144 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3921c5a-6ce9-4c9e-83ee-88d5565b6772 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:28.781428 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3921c5a-6ce9-4c9e-83ee-88d5565b6772 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:28.782083 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3921c5a-6ce9-4c9e-83ee-88d5565b6772 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:28.783492 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3921c5a-6ce9-4c9e-83ee-88d5565b6772 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:28.786118 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:28.796413 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-c3921c5a-6ce9-4c9e-83ee-88d5565b6772 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:27:28.796413 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:28.796413 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:27:28.796413 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:27:28.796413 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:27:28.796413 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:27:28.796413 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:27:28.796413 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:27:28.796413 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:27:28.796413 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:28.796413 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:27:28.796413 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:28.796413 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:28.796413 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:28.796413 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:28.796413 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:28.796413 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:28.801632 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:28.801632 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:28.801632 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:28.801632 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:28.801632 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:28.801632 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:28.801632 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:27:28.801632 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:27:28.801632 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:27:28.801632 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:27:28.801632 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:28.801632 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:28.801632 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:28.801632 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:28.801632 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:28.801632 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:28.802674 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:28.802674 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:28.802674 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:28.802674 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:28.802674 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:28.802674 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:28.802674 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:28.802674 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:28.802674 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:28.802674 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:28.802674 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:27:28.802674 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:27:28.802674 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:27:28.802674 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:28.802674 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 508/984] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Jul 5 21:27:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:28.803474 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3921c5a-6ce9-4c9e-83ee-88d5565b6772 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:28.875430 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a7240-d4f3-470c-9079-52d184ab4adf None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:28.903131 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3921c5a-6ce9-4c9e-83ee-88d5565b6772 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:28.909999 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad891c-461b-4bf5-b198-da152c59e0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:28.910694 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad891c-461b-4bf5-b198-da152c59e0d4 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:28.910984 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad891c-461b-4bf5-b198-da152c59e0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:28.911264 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad891c-461b-4bf5-b198-da152c59e0d4 None admin] PATH_INFO: `/v3/services` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:28.911944 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ad891c-461b-4bf5-b198-da152c59e0d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:28.913319 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ad891c-461b-4bf5-b198-da152c59e0d4 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:28.914880 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:28.920736 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 477/985] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Jul 5 21:27:28 2022] GET /identity/v3/services => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:27:28.921522 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad891c-461b-4bf5-b198-da152c59e0d4 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:28.942345 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660cf70f-34a3-499e-857b-7839ca44225c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:28.942345 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660cf70f-34a3-499e-857b-7839ca44225c None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:28.942345 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660cf70f-34a3-499e-857b-7839ca44225c None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:28.942345 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660cf70f-34a3-499e-857b-7839ca44225c None admin] PATH_INFO: `/v3/users` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:28.942691 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660cf70f-34a3-499e-857b-7839ca44225c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:28.942691 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660cf70f-34a3-499e-857b-7839ca44225c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:28.943020 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660cf70f-34a3-499e-857b-7839ca44225c None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:28.964375 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 509/986] 10.222.0.30 () {56 vars in 1149 bytes} [Tue Jul 5 21:27:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:28.970380 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660cf70f-34a3-499e-857b-7839ca44225c None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:29.035572 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:29.040899 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad891c-461b-4bf5-b198-da152c59e0d4 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:29.080821 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660cf70f-34a3-499e-857b-7839ca44225c None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:29.082660 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9bc04-343a-4d53-a280-6eaaa5deb9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:29.083349 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9bc04-343a-4d53-a280-6eaaa5deb9e3 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:29.083649 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9bc04-343a-4d53-a280-6eaaa5deb9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:29.083933 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9bc04-343a-4d53-a280-6eaaa5deb9e3 None admin] PATH_INFO: `/v3/services` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:29.084656 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae9bc04-343a-4d53-a280-6eaaa5deb9e3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:29.084971 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae9bc04-343a-4d53-a280-6eaaa5deb9e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:29.087003 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae9bc04-343a-4d53-a280-6eaaa5deb9e3 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:29.094040 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 478/987] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Jul 5 21:27:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:29.099674 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9bc04-343a-4d53-a280-6eaaa5deb9e3 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:29.122743 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9742b9-a342-407b-9816-8276d6536c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:29.123400 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9742b9-a342-407b-9816-8276d6536c06 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:29.123692 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9742b9-a342-407b-9816-8276d6536c06 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:29.123974 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9742b9-a342-407b-9816-8276d6536c06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:29.165647 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:29.201444 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9742b9-a342-407b-9816-8276d6536c06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:29.203030 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9742b9-a342-407b-9816-8276d6536c06 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:29.209082 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9bc04-343a-4d53-a280-6eaaa5deb9e3 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:29.249228 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9248a-41de-404e-b597-fbeba3f3c0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:29.249909 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9248a-41de-404e-b597-fbeba3f3c0dc None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:29.250244 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9248a-41de-404e-b597-fbeba3f3c0dc None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:29.250540 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9248a-41de-404e-b597-fbeba3f3c0dc None admin] PATH_INFO: `/v3/services` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:29.251260 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c9248a-41de-404e-b597-fbeba3f3c0dc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:29.251603 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c9248a-41de-404e-b597-fbeba3f3c0dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:29.252994 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c9248a-41de-404e-b597-fbeba3f3c0dc None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:29.263404 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 479/988] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Jul 5 21:27:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:27:29.265245 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9248a-41de-404e-b597-fbeba3f3c0dc None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:29.270588 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:29.318099 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 510/989] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:27:28 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:27:29.324583 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9742b9-a342-407b-9816-8276d6536c06 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:29.384691 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9248a-41de-404e-b597-fbeba3f3c0dc None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:29.411360 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:29.421460 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8f7bd-cda1-43c1-81be-2005bed6a975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:29.422148 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8f7bd-cda1-43c1-81be-2005bed6a975 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:29.424246 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8f7bd-cda1-43c1-81be-2005bed6a975 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:29.424246 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8f7bd-cda1-43c1-81be-2005bed6a975 None admin] PATH_INFO: `/v3/endpoints` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:29.424246 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa8f7bd-cda1-43c1-81be-2005bed6a975 None admin] RBAC: Adding query filter params (interface=admin, service_id=0d03cd204e9d46ffa4f606d4c32815eb, region_id=RegionOne) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:29.424246 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa8f7bd-cda1-43c1-81be-2005bed6a975 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:29.425293 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa8f7bd-cda1-43c1-81be-2005bed6a975 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:29.430891 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 480/990] 10.222.0.30 () {56 vars in 1249 bytes} [Tue Jul 5 21:27:29 2022] GET /identity/v3/endpoints?service_id=0d03cd204e9d46ffa4f606d4c32815eb&interface=admin®ion_id=RegionOne => generated 193 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:27:29.436208 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8f7bd-cda1-43c1-81be-2005bed6a975 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:29.439729 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9742b9-a342-407b-9816-8276d6536c06 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:29.477853 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dcfda8-7a09-4d8b-9ea3-35b19270b9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:29.478611 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcfda8-7a09-4d8b-9ea3-35b19270b9e4 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:29.478903 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcfda8-7a09-4d8b-9ea3-35b19270b9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:29.479184 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcfda8-7a09-4d8b-9ea3-35b19270b9e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:29.490267 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dcfda8-7a09-4d8b-9ea3-35b19270b9e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:29.491729 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dcfda8-7a09-4d8b-9ea3-35b19270b9e4 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:29.511161 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-61dcfda8-7a09-4d8b-9ea3-35b19270b9e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:29.511161 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:29.511161 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:29.511161 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:29.511161 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:29.511161 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:29.511161 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:29.511161 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:29.511161 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:29.511161 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:29.511161 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:29.511161 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:29.511161 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:27:29.511161 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:27:29.511161 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:27:29.512250 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:27:29.512250 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:29.512250 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:29.512250 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:29.512250 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:29.512250 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:29.512250 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:29.512250 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:29.512250 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:29.512250 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:29.512250 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:29.512250 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:29.512250 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:29.512250 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:29.512250 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:29.512250 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:29.512250 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:29.513160 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:27:29.513160 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:27:29.513160 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:29.513160 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:29.513160 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 511/991] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:27:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:27:29.517929 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dcfda8-7a09-4d8b-9ea3-35b19270b9e4 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:29.530640 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:29.545901 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8f7bd-cda1-43c1-81be-2005bed6a975 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:29.588502 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec808d-7fbc-4aad-ba7b-8d42735caad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:29.589187 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec808d-7fbc-4aad-ba7b-8d42735caad1 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:29.589482 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec808d-7fbc-4aad-ba7b-8d42735caad1 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:29.589770 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec808d-7fbc-4aad-ba7b-8d42735caad1 None admin] PATH_INFO: `/v3/services` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:29.590493 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bec808d-7fbc-4aad-ba7b-8d42735caad1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:29.591987 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bec808d-7fbc-4aad-ba7b-8d42735caad1 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:29.606208 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 481/992] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Jul 5 21:27:29 2022] GET /identity/v3/services => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:27:29.637701 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dcfda8-7a09-4d8b-9ea3-35b19270b9e4 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:29.676179 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025a2eb-f56c-4d7c-9ca4-7b5daf0e5482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:29.676863 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025a2eb-f56c-4d7c-9ca4-7b5daf0e5482 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:29.677152 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025a2eb-f56c-4d7c-9ca4-7b5daf0e5482 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:29.677434 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025a2eb-f56c-4d7c-9ca4-7b5daf0e5482 None admin] PATH_INFO: `/v3/domains` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:29.678206 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4025a2eb-f56c-4d7c-9ca4-7b5daf0e5482 None admin] RBAC: Adding query filter params (name=Default) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:29.678523 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4025a2eb-f56c-4d7c-9ca4-7b5daf0e5482 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:29.679933 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4025a2eb-f56c-4d7c-9ca4-7b5daf0e5482 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:29.698301 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 512/993] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:27:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:27:29.700061 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec808d-7fbc-4aad-ba7b-8d42735caad1 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:29.761439 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:29.811735 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec808d-7fbc-4aad-ba7b-8d42735caad1 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:29.846975 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ad45b-355b-4f58-b480-8e489bf67dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:29.847777 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ad45b-355b-4f58-b480-8e489bf67dc1 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:29.848071 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ad45b-355b-4f58-b480-8e489bf67dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:29.848360 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ad45b-355b-4f58-b480-8e489bf67dc1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:29.855738 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8ad45b-355b-4f58-b480-8e489bf67dc1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:29.857204 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8ad45b-355b-4f58-b480-8e489bf67dc1 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:29.872173 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-7d8ad45b-355b-4f58-b480-8e489bf67dc1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:27:29.872173 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:29.872173 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:29.872173 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:29.872173 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:29.872173 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:29.872173 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:29.872173 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:29.872173 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:29.872173 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:29.872173 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:29.872173 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:29.872173 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:27:29.872173 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:27:29.872173 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:27:29.873196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:27:29.873196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:29.873196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:29.873196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:29.873196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:29.873196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:29.873196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:29.873196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:29.873196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:29.873196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:29.873196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:29.873196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:29.873196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:29.873196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:29.873196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:29.873196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:29.873196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:29.874586 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:27:29.874586 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:27:29.874586 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:27:29.874586 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:27:29.874586 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:27:29.874586 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:27:29.874586 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:27:29.874586 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:29.874586 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 482/994] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:27:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:27:29.879483 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025a2eb-f56c-4d7c-9ca4-7b5daf0e5482 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:29.952523 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:29.985057 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025a2eb-f56c-4d7c-9ca4-7b5daf0e5482 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:30.019265 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a7263-f44b-4592-8c34-862380a0c729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:30.019859 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a7263-f44b-4592-8c34-862380a0c729 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:30.020151 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a7263-f44b-4592-8c34-862380a0c729 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:30.020433 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a7263-f44b-4592-8c34-862380a0c729 None admin] PATH_INFO: `/v3/projects` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:30.021228 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a7263-f44b-4592-8c34-862380a0c729 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:30.021548 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a7263-f44b-4592-8c34-862380a0c729 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:30.023032 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a7263-f44b-4592-8c34-862380a0c729 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:30.042202 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 513/995] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:27:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:30.043575 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ad45b-355b-4f58-b480-8e489bf67dc1 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:30.154444 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ad45b-355b-4f58-b480-8e489bf67dc1 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:30.170490 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:30.190885 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0807ed96-4e17-410f-bc47-69b6c89089a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:30.191563 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0807ed96-4e17-410f-bc47-69b6c89089a6 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:30.191870 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0807ed96-4e17-410f-bc47-69b6c89089a6 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:30.192146 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0807ed96-4e17-410f-bc47-69b6c89089a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:30.193371 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0807ed96-4e17-410f-bc47-69b6c89089a6 None admin] RBAC: Adding query filter params (role.id=dd398730a074417fbbd43b27d2ea03d4, scope.project.id=7fe768315f5c43f487f71f043f11b8b8, user.id=0b40f943261d4cd3a6d0a27335e9806d) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:30.194066 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0807ed96-4e17-410f-bc47-69b6c89089a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:30.196960 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0807ed96-4e17-410f-bc47-69b6c89089a6 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:30.210181 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 483/996] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:27:30 2022] GET /identity/v3/role_assignments?user.id=0b40f943261d4cd3a6d0a27335e9806d&scope.project.id=7fe768315f5c43f487f71f043f11b8b8&role.id=dd398730a074417fbbd43b27d2ea03d4 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:30.997876 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33dc78e-4d37-40c1-94ac-abcf67651cd4 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:30.998427 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33dc78e-4d37-40c1-94ac-abcf67651cd4 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:30.998536 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33dc78e-4d37-40c1-94ac-abcf67651cd4 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:30.999865 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 514/997] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:27:31.005072 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f61d2e-143d-48ba-9da4-b94aa7605e5a None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:31.005474 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f61d2e-143d-48ba-9da4-b94aa7605e5a None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:31.005634 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f61d2e-143d-48ba-9da4-b94aa7605e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:31.023050 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-c5f61d2e-143d-48ba-9da4-b94aa7605e5a None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:27:31.024418 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-c5f61d2e-143d-48ba-9da4-b94aa7605e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:27:31.092654 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 484/998] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:27:31 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:27:31.116367 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33dc78e-4d37-40c1-94ac-abcf67651cd4 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:31.219906 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33dc78e-4d37-40c1-94ac-abcf67651cd4 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:31.249646 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:31.255925 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51287c-4c34-4e7e-848e-3653246ea576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:31.256723 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51287c-4c34-4e7e-848e-3653246ea576 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:31.257010 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51287c-4c34-4e7e-848e-3653246ea576 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:31.257286 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51287c-4c34-4e7e-848e-3653246ea576 None admin] PATH_INFO: `/v3/services/compute` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:31.257933 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de51287c-4c34-4e7e-848e-3653246ea576 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:31.260106 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de51287c-4c34-4e7e-848e-3653246ea576 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:31.272021 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-de51287c-4c34-4e7e-848e-3653246ea576 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 21:27:31.272021 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:31.272021 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:27:31.272021 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:27:31.272021 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:27:31.272021 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:27:31.272021 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:27:31.272021 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:27:31.272021 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 21:27:31.272021 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:31.272021 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:27:31.272021 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:31.272021 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:31.272021 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:31.272021 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:31.272021 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:31.272021 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:31.273045 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:31.273045 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:31.273045 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:31.273045 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:31.273045 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:31.273045 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:31.273045 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:27:31.273045 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:27:31.273045 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:27:31.273045 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:27:31.273045 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:31.273045 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:31.273045 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:31.273045 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:31.273045 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:31.273045 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:31.274454 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:31.274454 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:31.274454 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:31.274454 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:31.274454 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:31.274454 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:31.274454 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:31.274454 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:31.274454 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:31.274454 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:31.274454 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:27:31.274454 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:27:31.274454 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 21:27:31.274454 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:31.277668 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 515/999] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:27:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:31.280292 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f61d2e-143d-48ba-9da4-b94aa7605e5a None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:31.385118 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f61d2e-143d-48ba-9da4-b94aa7605e5a None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:31.394534 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:31.419714 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26cedde-3c1e-40d1-9977-b7a3f21dca94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:31.420396 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26cedde-3c1e-40d1-9977-b7a3f21dca94 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:31.420685 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26cedde-3c1e-40d1-9977-b7a3f21dca94 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:31.420964 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26cedde-3c1e-40d1-9977-b7a3f21dca94 None admin] PATH_INFO: `/v3/services` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:31.421669 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26cedde-3c1e-40d1-9977-b7a3f21dca94 None admin] RBAC: Adding query filter params (name=compute) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:31.421978 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26cedde-3c1e-40d1-9977-b7a3f21dca94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:31.423433 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26cedde-3c1e-40d1-9977-b7a3f21dca94 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:31.429383 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 485/1000] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Jul 5 21:27:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:31.435539 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51287c-4c34-4e7e-848e-3653246ea576 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:31.537274 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51287c-4c34-4e7e-848e-3653246ea576 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:31.577441 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b3c36c-3756-4995-9296-985ae7e7f372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:31.578108 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3c36c-3756-4995-9296-985ae7e7f372 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:31.578426 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3c36c-3756-4995-9296-985ae7e7f372 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:31.578703 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3c36c-3756-4995-9296-985ae7e7f372 None admin] PATH_INFO: `/v3/services` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:31.579408 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b3c36c-3756-4995-9296-985ae7e7f372 None admin] RBAC: Adding query filter params (type=compute) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:31.579714 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b3c36c-3756-4995-9296-985ae7e7f372 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:31.581089 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b3c36c-3756-4995-9296-985ae7e7f372 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:31.586326 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 516/1001] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Jul 5 21:27:31 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:31.592111 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26cedde-3c1e-40d1-9977-b7a3f21dca94 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:31.663768 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a4673a-ae3f-4431-9170-3b581f842c9b None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:31.664127 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a4673a-ae3f-4431-9170-3b581f842c9b None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:31.664883 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a4673a-ae3f-4431-9170-3b581f842c9b None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:31.666476 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 517/1002] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:27:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:27:31.671161 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea94980-c321-40d9-b942-6656fa15b875 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:31.671447 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea94980-c321-40d9-b942-6656fa15b875 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:31.671729 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea94980-c321-40d9-b942-6656fa15b875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:31.688681 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-aea94980-c321-40d9-b942-6656fa15b875 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:27:31.689859 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-aea94980-c321-40d9-b942-6656fa15b875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:27:31.693822 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26cedde-3c1e-40d1-9977-b7a3f21dca94 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:31.729674 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc26044f-db7d-496f-a0d4-dfc929a08304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:31.730362 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26044f-db7d-496f-a0d4-dfc929a08304 None admin] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:31.730656 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26044f-db7d-496f-a0d4-dfc929a08304 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:31.730939 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26044f-db7d-496f-a0d4-dfc929a08304 None admin] PATH_INFO: `/v3/endpoints` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:31.731690 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc26044f-db7d-496f-a0d4-dfc929a08304 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:31.733074 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc26044f-db7d-496f-a0d4-dfc929a08304 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:31.747648 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:31.761154 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 518/1003] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:27:31 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:27:31.783970 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea94980-c321-40d9-b942-6656fa15b875 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:31.820462 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 486/1004] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Jul 5 21:27:31 2022] POST /identity/v3/endpoints => generated 334 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:27:31.896849 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea94980-c321-40d9-b942-6656fa15b875 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:31.943835 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca40a8-e086-4dae-b905-13ad950bb76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:31.945058 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca40a8-e086-4dae-b905-13ad950bb76e None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:31.945524 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca40a8-e086-4dae-b905-13ad950bb76e None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:31.946023 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca40a8-e086-4dae-b905-13ad950bb76e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:31.946894 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ca40a8-e086-4dae-b905-13ad950bb76e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:31.948553 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ca40a8-e086-4dae-b905-13ad950bb76e None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:31.962498 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-d1ca40a8-e086-4dae-b905-13ad950bb76e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:27:31.962498 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:31.962498 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:27:31.962498 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:27:31.962498 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:27:31.962498 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:27:31.962498 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:27:31.962498 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:27:31.962498 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:27:31.962498 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:31.962498 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:27:31.962498 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:31.962498 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:31.962498 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:31.962498 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:31.962498 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:31.962498 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:31.963538 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:31.963538 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:31.963538 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:31.963538 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:31.963538 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:31.963538 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:31.963538 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:27:31.963538 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:27:31.963538 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:27:31.963538 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:27:31.963538 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:31.963538 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:31.963538 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:31.963538 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:31.963538 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:31.963538 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:31.964369 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:31.964369 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:31.964369 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:31.964369 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:31.964369 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:31.964369 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:31.964369 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:31.964369 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:31.964369 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:31.964369 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:31.964369 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:27:31.964369 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:27:31.964369 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:27:31.964369 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:31.967050 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 519/1005] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Jul 5 21:27:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:27:31.973099 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc26044f-db7d-496f-a0d4-dfc929a08304 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:32.006301 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:32.087205 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc26044f-db7d-496f-a0d4-dfc929a08304 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:32.131805 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ccc9a-28cb-46e3-a4ba-cae87b1d8503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:32.132483 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ccc9a-28cb-46e3-a4ba-cae87b1d8503 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:32.132770 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ccc9a-28cb-46e3-a4ba-cae87b1d8503 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:32.133097 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ccc9a-28cb-46e3-a4ba-cae87b1d8503 None admin] PATH_INFO: `/v3/services` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:32.133831 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ccc9a-28cb-46e3-a4ba-cae87b1d8503 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:32.134158 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ccc9a-28cb-46e3-a4ba-cae87b1d8503 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:32.135551 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ccc9a-28cb-46e3-a4ba-cae87b1d8503 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:32.140888 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 487/1006] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Jul 5 21:27:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:27:32.146946 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca40a8-e086-4dae-b905-13ad950bb76e None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:32.199508 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:32.253788 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca40a8-e086-4dae-b905-13ad950bb76e None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:32.289247 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b58aeb-4a68-4b2d-946b-cdd355223bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:32.290160 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b58aeb-4a68-4b2d-946b-cdd355223bef None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:32.290471 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b58aeb-4a68-4b2d-946b-cdd355223bef None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:32.290723 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b58aeb-4a68-4b2d-946b-cdd355223bef None admin] PATH_INFO: `/v3/services` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:32.291436 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b58aeb-4a68-4b2d-946b-cdd355223bef None admin] RBAC: Adding query filter params (type=object-store) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:32.291751 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b58aeb-4a68-4b2d-946b-cdd355223bef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:32.293129 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b58aeb-4a68-4b2d-946b-cdd355223bef None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:32.298521 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 520/1007] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Jul 5 21:27:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:32.304106 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ccc9a-28cb-46e3-a4ba-cae87b1d8503 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:32.323769 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051e615-2c8d-457c-8181-1e2baab5d834 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:32.324073 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051e615-2c8d-457c-8181-1e2baab5d834 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:32.324366 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051e615-2c8d-457c-8181-1e2baab5d834 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:32.325881 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 521/1008] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:27:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:27:32.330593 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5f637-0185-47ad-b54f-a207e5e2e25b None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:32.330897 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5f637-0185-47ad-b54f-a207e5e2e25b None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:32.331181 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5f637-0185-47ad-b54f-a207e5e2e25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:32.349159 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-48c5f637-0185-47ad-b54f-a207e5e2e25b None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:27:32.350334 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-48c5f637-0185-47ad-b54f-a207e5e2e25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:27:32.406437 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:32.418411 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ccc9a-28cb-46e3-a4ba-cae87b1d8503 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:32.425488 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 522/1009] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:27:32 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:27:32.449020 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5f637-0185-47ad-b54f-a207e5e2e25b None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:32.455089 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7272afb-13a4-4636-b828-dd99c8b01639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:32.455766 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7272afb-13a4-4636-b828-dd99c8b01639 None admin] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:32.456060 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7272afb-13a4-4636-b828-dd99c8b01639 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:32.456343 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7272afb-13a4-4636-b828-dd99c8b01639 None admin] PATH_INFO: `/v3/endpoints` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:32.457104 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7272afb-13a4-4636-b828-dd99c8b01639 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:32.458776 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7272afb-13a4-4636-b828-dd99c8b01639 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:32.493167 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:32.519969 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 488/1010] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Jul 5 21:27:32 2022] POST /identity/v3/endpoints => generated 325 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:27:32.554997 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5f637-0185-47ad-b54f-a207e5e2e25b None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:32.606950 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f5265-6ba9-48a9-92d8-4da0392f7469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:32.607695 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f5265-6ba9-48a9-92d8-4da0392f7469 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:32.608013 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f5265-6ba9-48a9-92d8-4da0392f7469 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:32.608263 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f5265-6ba9-48a9-92d8-4da0392f7469 None admin] PATH_INFO: `/v3/services/image` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:32.608926 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f5265-6ba9-48a9-92d8-4da0392f7469 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:32.610354 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f5265-6ba9-48a9-92d8-4da0392f7469 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:32.623122 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-f05f5265-6ba9-48a9-92d8-4da0392f7469 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 21:27:32.623122 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:32.623122 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:27:32.623122 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:27:32.623122 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:27:32.623122 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:27:32.623122 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:27:32.623122 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:27:32.623122 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 21:27:32.623122 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:32.623122 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:27:32.623122 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:32.623122 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:32.623122 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:32.623122 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:32.623122 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:32.623122 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:32.624202 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:32.624202 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:32.624202 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:32.624202 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:32.624202 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:32.624202 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:32.624202 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:27:32.624202 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:27:32.624202 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:27:32.624202 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:27:32.624202 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:32.624202 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:32.624202 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:32.624202 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:32.624202 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:32.624202 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:32.625218 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:32.625218 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:32.625218 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:32.625218 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:32.625218 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:32.625218 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:32.625218 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:32.625218 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:32.625218 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:32.625218 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:32.625218 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:27:32.625218 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:27:32.625218 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 21:27:32.625218 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:32.625218 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 523/1011] 10.222.0.30 () {56 vars in 1105 bytes} [Tue Jul 5 21:27:32 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:32.630539 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7272afb-13a4-4636-b828-dd99c8b01639 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:32.743834 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7272afb-13a4-4636-b828-dd99c8b01639 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:32.779501 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b42ad3-bcd8-4a27-95f0-f77111600415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:32.780175 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b42ad3-bcd8-4a27-95f0-f77111600415 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:32.780467 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b42ad3-bcd8-4a27-95f0-f77111600415 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:32.780753 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b42ad3-bcd8-4a27-95f0-f77111600415 None admin] PATH_INFO: `/v3/services` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:32.781465 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b42ad3-bcd8-4a27-95f0-f77111600415 None admin] RBAC: Adding query filter params (name=image) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:32.781784 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b42ad3-bcd8-4a27-95f0-f77111600415 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:32.783196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b42ad3-bcd8-4a27-95f0-f77111600415 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:32.793472 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 489/1012] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:27:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:27:32.794953 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f5265-6ba9-48a9-92d8-4da0392f7469 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:32.897138 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f5265-6ba9-48a9-92d8-4da0392f7469 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:32.898654 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:32.933477 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806e99e-3af0-4f88-9757-168344660a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:32.934167 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806e99e-3af0-4f88-9757-168344660a88 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:32.934466 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806e99e-3af0-4f88-9757-168344660a88 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:32.934753 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806e99e-3af0-4f88-9757-168344660a88 None admin] PATH_INFO: `/v3/services` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:32.935462 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f806e99e-3af0-4f88-9757-168344660a88 None admin] RBAC: Adding query filter params (type=image) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:32.935780 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f806e99e-3af0-4f88-9757-168344660a88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:32.937149 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f806e99e-3af0-4f88-9757-168344660a88 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:32.950159 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 524/1013] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:27:32 2022] GET /identity/v3/services?type=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:27:34.010709 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17681531-7bb6-40c5-bb70-4b1828b1e726 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:34.011246 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17681531-7bb6-40c5-bb70-4b1828b1e726 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:34.011327 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17681531-7bb6-40c5-bb70-4b1828b1e726 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:34.012693 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 490/1014] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:27:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:27:34.017901 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb2148-6cf7-4fb4-b2db-6dfe2a307eaa None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:34.018380 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb2148-6cf7-4fb4-b2db-6dfe2a307eaa None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:34.018532 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb2148-6cf7-4fb4-b2db-6dfe2a307eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:34.036194 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-e6eb2148-6cf7-4fb4-b2db-6dfe2a307eaa None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:27:34.037435 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-e6eb2148-6cf7-4fb4-b2db-6dfe2a307eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:27:34.112275 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 525/1015] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:27:34 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:27:34.136837 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17681531-7bb6-40c5-bb70-4b1828b1e726 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:34.156482 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:34.243552 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17681531-7bb6-40c5-bb70-4b1828b1e726 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:34.279620 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15d623-69cd-4548-8628-61be1bfa7ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:34.280556 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15d623-69cd-4548-8628-61be1bfa7ed2 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:34.280752 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15d623-69cd-4548-8628-61be1bfa7ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:34.281042 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15d623-69cd-4548-8628-61be1bfa7ed2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:34.292197 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca15d623-69cd-4548-8628-61be1bfa7ed2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:27:34.300607 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-ca15d623-69cd-4548-8628-61be1bfa7ed2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 21:27:34.300607 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:34.300607 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:34.300607 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:34.300607 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:34.300607 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:34.300607 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:34.300607 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:34.300607 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:34.300607 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:34.300607 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:34.300607 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:34.300607 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:27:34.300607 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:27:34.300607 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:27:34.300607 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:27:34.301550 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:27:34.301550 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:27:34.301550 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:27:34.301550 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:27:34.301550 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:34.301550 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:34.301550 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:34.301550 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:34.301550 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:34.301550 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:34.301550 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:34.301550 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:34.301550 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:34.301550 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:34.301550 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:34.301550 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:34.302760 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:34.302760 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:34.302760 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:34.302760 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:34.302760 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:27:34.302760 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:27:34.302760 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:27:34.302760 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:27:34.302760 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:27:34.302760 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:27:34.302760 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 21:27:34.302760 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:34.306331 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 491/1016] 10.222.0.30 () {56 vars in 1120 bytes} [Tue Jul 5 21:27:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:34.308854 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb2148-6cf7-4fb4-b2db-6dfe2a307eaa None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:34.404353 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:34.410798 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb2148-6cf7-4fb4-b2db-6dfe2a307eaa None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:34.446278 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e483b3e3-5e70-4560-bfda-ddc4a77818ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:34.446959 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483b3e3-5e70-4560-bfda-ddc4a77818ad None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:34.447246 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483b3e3-5e70-4560-bfda-ddc4a77818ad None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:34.447533 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483b3e3-5e70-4560-bfda-ddc4a77818ad None admin] PATH_INFO: `/v3/roles` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:34.448286 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e483b3e3-5e70-4560-bfda-ddc4a77818ad None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:34.448602 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e483b3e3-5e70-4560-bfda-ddc4a77818ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:34.449992 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e483b3e3-5e70-4560-bfda-ddc4a77818ad None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:34.462214 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 526/1017] 10.222.0.30 () {56 vars in 1115 bytes} [Tue Jul 5 21:27:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:34.465557 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15d623-69cd-4548-8628-61be1bfa7ed2 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:34.545266 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:34.575049 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15d623-69cd-4548-8628-61be1bfa7ed2 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:34.609177 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aba4ff-0f92-4961-93cc-974f42d15915 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:34.609568 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aba4ff-0f92-4961-93cc-974f42d15915 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:34.609873 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aba4ff-0f92-4961-93cc-974f42d15915 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:34.611375 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 527/1018] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:27:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:27:34.613300 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef7305-53ac-48a8-9610-f54470f042c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:34.614115 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef7305-53ac-48a8-9610-f54470f042c2 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:34.614438 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef7305-53ac-48a8-9610-f54470f042c2 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:34.614726 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef7305-53ac-48a8-9610-f54470f042c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:34.617122 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90326b01-bd9b-4bc7-ba0d-6b878e1e0ecb None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:34.617424 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90326b01-bd9b-4bc7-ba0d-6b878e1e0ecb None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:34.618406 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90326b01-bd9b-4bc7-ba0d-6b878e1e0ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:34.627231 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef7305-53ac-48a8-9610-f54470f042c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:34.628706 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef7305-53ac-48a8-9610-f54470f042c2 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:34.637279 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-90326b01-bd9b-4bc7-ba0d-6b878e1e0ecb None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:27:34.639229 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-90326b01-bd9b-4bc7-ba0d-6b878e1e0ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:27:34.646912 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-e7ef7305-53ac-48a8-9610-f54470f042c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:34.646912 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:34.646912 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:34.646912 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:34.646912 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:34.646912 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:34.646912 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:34.646912 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:34.646912 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:34.646912 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:34.646912 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:34.646912 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:34.646912 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:27:34.646912 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:27:34.646912 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:27:34.647823 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:27:34.647823 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:34.647823 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:34.647823 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:34.647823 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:34.647823 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:34.647823 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:34.647823 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:34.647823 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:34.647823 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:34.647823 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:34.647823 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:34.647823 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:34.647823 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:34.647823 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:34.647823 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:34.647823 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:34.649352 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:27:34.649352 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:27:34.649352 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:34.649352 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:34.653721 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 492/1019] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:27:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:34.654432 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef7305-53ac-48a8-9610-f54470f042c2 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:34.709708 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 528/1020] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:27:34 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:27:34.733391 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90326b01-bd9b-4bc7-ba0d-6b878e1e0ecb None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:34.763441 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef7305-53ac-48a8-9610-f54470f042c2 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:34.791974 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:34.800899 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00dc814-ed91-4311-86c0-497e8b1e47d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:34.801568 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00dc814-ed91-4311-86c0-497e8b1e47d4 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:34.801866 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00dc814-ed91-4311-86c0-497e8b1e47d4 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:34.802178 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00dc814-ed91-4311-86c0-497e8b1e47d4 None admin] PATH_INFO: `/v3/domains` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:34.802961 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00dc814-ed91-4311-86c0-497e8b1e47d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:34.803291 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00dc814-ed91-4311-86c0-497e8b1e47d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:34.804715 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00dc814-ed91-4311-86c0-497e8b1e47d4 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:34.822302 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 493/1021] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:27:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:27:34.826029 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00dc814-ed91-4311-86c0-497e8b1e47d4 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:34.827335 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:34.840711 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90326b01-bd9b-4bc7-ba0d-6b878e1e0ecb None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:34.876494 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf07db-703f-4667-8c4b-dc1d25c57d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:34.877290 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf07db-703f-4667-8c4b-dc1d25c57d8d None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:34.877574 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf07db-703f-4667-8c4b-dc1d25c57d8d None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:34.877848 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf07db-703f-4667-8c4b-dc1d25c57d8d None admin] PATH_INFO: `/v3/domains/default` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:34.879201 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cf07db-703f-4667-8c4b-dc1d25c57d8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:34.881020 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cf07db-703f-4667-8c4b-dc1d25c57d8d None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:34.883010 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 529/1022] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:27:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:27:34.889162 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf07db-703f-4667-8c4b-dc1d25c57d8d None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:34.942426 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00dc814-ed91-4311-86c0-497e8b1e47d4 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:34.982907 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f9f00-6782-4eba-8927-27880765784d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:34.983714 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f9f00-6782-4eba-8927-27880765784d None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:34.984006 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f9f00-6782-4eba-8927-27880765784d None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:34.984288 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f9f00-6782-4eba-8927-27880765784d None admin] PATH_INFO: `/v3/users/nova` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:34.991505 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4f9f00-6782-4eba-8927-27880765784d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:34.993201 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4f9f00-6782-4eba-8927-27880765784d None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:34.998288 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf07db-703f-4667-8c4b-dc1d25c57d8d None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:35.010249 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-0d4f9f00-6782-4eba-8927-27880765784d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:27:35.010249 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:35.010249 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:35.010249 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:35.010249 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:35.010249 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:35.010249 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:35.010249 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:35.010249 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:35.010249 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:35.010249 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:35.010249 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:35.010249 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:27:35.010249 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:27:35.010249 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:27:35.010249 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:27:35.011676 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:35.011676 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:35.011676 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:27:35.011676 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:27:35.011676 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:27:35.011676 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:27:35.011676 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:35.011676 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:35.011676 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:35.011676 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:35.011676 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:35.011676 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:35.011676 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:35.011676 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:35.011676 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:35.011676 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:35.011676 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:35.011676 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:35.012658 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:35.012658 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:35.012658 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:27:35.012658 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:27:35.012658 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:27:35.012658 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:27:35.012658 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:27:35.012658 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:27:35.012658 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:27:35.012658 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:35.012658 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 494/1023] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Jul 5 21:27:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:27:35.013812 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d025a-286b-4ad2-ae62-243e61633027 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:35.013982 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d025a-286b-4ad2-ae62-243e61633027 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:35.014411 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d025a-286b-4ad2-ae62-243e61633027 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:35.016101 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 495/1024] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:27:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:27:35.017339 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d025a-286b-4ad2-ae62-243e61633027 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:35.035436 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6210d506-1c9c-473b-b812-50518c0f0edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:35.036097 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210d506-1c9c-473b-b812-50518c0f0edc None admin] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:35.036384 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210d506-1c9c-473b-b812-50518c0f0edc None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:35.036666 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210d506-1c9c-473b-b812-50518c0f0edc None admin] PATH_INFO: `/v3/projects` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:35.037364 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6210d506-1c9c-473b-b812-50518c0f0edc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:35.038830 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6210d506-1c9c-473b-b812-50518c0f0edc None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:35.069784 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:35.120327 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 530/1025] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Jul 5 21:27:34 2022] POST /identity/v3/projects => generated 311 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:27:35.121609 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d602bd1-7dbf-4cf0-a5cc-9227f62be8f2 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:35.121903 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d602bd1-7dbf-4cf0-a5cc-9227f62be8f2 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:35.122225 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d602bd1-7dbf-4cf0-a5cc-9227f62be8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:35.123553 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d025a-286b-4ad2-ae62-243e61633027 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:35.143697 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-8d602bd1-7dbf-4cf0-a5cc-9227f62be8f2 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:27:35.144942 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-8d602bd1-7dbf-4cf0-a5cc-9227f62be8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:27:35.148085 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:35.167444 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448951f1-cce1-42c3-b7cb-9a4c05ed8d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:35.168154 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448951f1-cce1-42c3-b7cb-9a4c05ed8d62 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:35.168449 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448951f1-cce1-42c3-b7cb-9a4c05ed8d62 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:35.168737 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448951f1-cce1-42c3-b7cb-9a4c05ed8d62 None admin] PATH_INFO: `/v3/users` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:35.169622 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448951f1-cce1-42c3-b7cb-9a4c05ed8d62 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:35.169958 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448951f1-cce1-42c3-b7cb-9a4c05ed8d62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:35.171520 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448951f1-cce1-42c3-b7cb-9a4c05ed8d62 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:35.197185 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 496/1026] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Jul 5 21:27:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:27:35.198810 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448951f1-cce1-42c3-b7cb-9a4c05ed8d62 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:35.225824 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 531/1027] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:27:35 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:27:35.252425 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d602bd1-7dbf-4cf0-a5cc-9227f62be8f2 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:35.320791 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448951f1-cce1-42c3-b7cb-9a4c05ed8d62 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:35.330938 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:35.359954 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68d9af-86c9-42b8-92d1-efd149627fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:35.360943 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68d9af-86c9-42b8-92d1-efd149627fae None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:35.361389 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68d9af-86c9-42b8-92d1-efd149627fae None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:35.361670 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68d9af-86c9-42b8-92d1-efd149627fae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:35.370946 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d602bd1-7dbf-4cf0-a5cc-9227f62be8f2 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:35.407914 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b40ba-9e63-45ce-825a-e6b84345466a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:35.408584 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b40ba-9e63-45ce-825a-e6b84345466a None admin] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:35.408863 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b40ba-9e63-45ce-825a-e6b84345466a None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:35.409132 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b40ba-9e63-45ce-825a-e6b84345466a None admin] PATH_INFO: `/v3/services` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:35.409845 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b40ba-9e63-45ce-825a-e6b84345466a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:35.411325 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b40ba-9e63-45ce-825a-e6b84345466a None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:35.437089 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68d9af-86c9-42b8-92d1-efd149627fae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:35.438623 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68d9af-86c9-42b8-92d1-efd149627fae None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:35.502470 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:35.510947 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 532/1028] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Jul 5 21:27:35 2022] POST /identity/v3/services => generated 242 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:27:35.553503 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 497/1029] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:27:35 2022] GET /identity/v3/auth/tokens => generated 1863 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 05 21:27:35.559167 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b40ba-9e63-45ce-825a-e6b84345466a None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:35.682206 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b40ba-9e63-45ce-825a-e6b84345466a None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:35.718930 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5597cb34-6528-4313-bb44-934b5e2a0075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:35.719733 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597cb34-6528-4313-bb44-934b5e2a0075 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:35.720021 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597cb34-6528-4313-bb44-934b5e2a0075 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:35.720301 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597cb34-6528-4313-bb44-934b5e2a0075 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:35.732044 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5597cb34-6528-4313-bb44-934b5e2a0075 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:35.733509 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5597cb34-6528-4313-bb44-934b5e2a0075 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:35.751028 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-5597cb34-6528-4313-bb44-934b5e2a0075 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:35.751028 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:35.751028 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:35.751028 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:35.751028 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:35.751028 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:35.751028 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:35.751028 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:35.751028 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:35.751028 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:35.751028 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:35.751028 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:35.751028 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:27:35.751028 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:27:35.751028 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:27:35.751922 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:27:35.751922 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:35.751922 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:35.751922 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:35.751922 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:35.751922 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:35.751922 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:35.751922 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:35.751922 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:35.751922 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:35.751922 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:35.751922 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:35.751922 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:35.751922 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:35.751922 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:35.751922 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:35.751922 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:35.752993 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:27:35.752993 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:27:35.752993 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:35.752993 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:35.752993 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 533/1030] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:27:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:35.761125 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68d9af-86c9-42b8-92d1-efd149627fae None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:35.768430 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:35.865654 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68d9af-86c9-42b8-92d1-efd149627fae None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:35.900230 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18bd09a-834c-4487-8b11-c3fe4af89018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:35.900911 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bd09a-834c-4487-8b11-c3fe4af89018 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:35.901204 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bd09a-834c-4487-8b11-c3fe4af89018 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:35.901489 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bd09a-834c-4487-8b11-c3fe4af89018 None admin] PATH_INFO: `/v3/domains` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:35.902246 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18bd09a-834c-4487-8b11-c3fe4af89018 None admin] RBAC: Adding query filter params (name=Default) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:35.902565 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18bd09a-834c-4487-8b11-c3fe4af89018 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:35.903947 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18bd09a-834c-4487-8b11-c3fe4af89018 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:35.917068 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 498/1031] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:35.922409 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5597cb34-6528-4313-bb44-934b5e2a0075 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:35.971479 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:36.027288 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5597cb34-6528-4313-bb44-934b5e2a0075 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:36.061240 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f40fc7-30f6-46bc-bc35-5f45845cd6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:36.062037 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f40fc7-30f6-46bc-bc35-5f45845cd6af None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:36.062346 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f40fc7-30f6-46bc-bc35-5f45845cd6af None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:36.062624 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f40fc7-30f6-46bc-bc35-5f45845cd6af None admin] PATH_INFO: `/v3/projects/service` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:36.069300 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f40fc7-30f6-46bc-bc35-5f45845cd6af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:36.070809 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f40fc7-30f6-46bc-bc35-5f45845cd6af None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:36.085277 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-85f40fc7-30f6-46bc-bc35-5f45845cd6af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:27:36.085277 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:36.085277 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:36.085277 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:36.085277 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:36.085277 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:36.085277 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:36.085277 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:36.085277 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:36.085277 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:36.085277 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:36.085277 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:36.085277 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:27:36.085277 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:27:36.085277 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:27:36.086927 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:27:36.086927 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:36.086927 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:36.086927 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:36.086927 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:36.086927 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:36.086927 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:36.086927 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:36.086927 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:36.086927 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:36.086927 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:36.086927 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:36.086927 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:36.086927 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:36.086927 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:36.086927 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:36.086927 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:36.087837 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:27:36.087837 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:27:36.087837 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:27:36.087837 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:27:36.087837 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:27:36.087837 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:27:36.087837 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:27:36.087837 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:36.090455 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 534/1032] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:27:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:36.092795 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18bd09a-834c-4487-8b11-c3fe4af89018 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:36.159055 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:36.193675 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18bd09a-834c-4487-8b11-c3fe4af89018 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:36.229409 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1713621-df64-4352-b683-7b1ed5529f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:36.230000 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1713621-df64-4352-b683-7b1ed5529f9c None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:36.230317 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1713621-df64-4352-b683-7b1ed5529f9c None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:36.230598 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1713621-df64-4352-b683-7b1ed5529f9c None admin] PATH_INFO: `/v3/projects` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:36.231386 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1713621-df64-4352-b683-7b1ed5529f9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:36.231699 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1713621-df64-4352-b683-7b1ed5529f9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:36.233139 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1713621-df64-4352-b683-7b1ed5529f9c None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:36.245899 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 499/1033] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:27:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:36.251764 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f40fc7-30f6-46bc-bc35-5f45845cd6af None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:36.357244 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f40fc7-30f6-46bc-bc35-5f45845cd6af None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:36.364657 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:36.391849 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a46798-ab05-4a0c-bf60-f4a947a00b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:36.392707 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a46798-ab05-4a0c-bf60-f4a947a00b3e None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:36.393040 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a46798-ab05-4a0c-bf60-f4a947a00b3e None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:36.393483 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a46798-ab05-4a0c-bf60-f4a947a00b3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:36.394385 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a46798-ab05-4a0c-bf60-f4a947a00b3e None admin] RBAC: Adding query filter params (role.id=dd398730a074417fbbd43b27d2ea03d4, scope.project.id=7fe768315f5c43f487f71f043f11b8b8, user.id=941ed10dfafc4bd48896843da26c9175) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:36.394972 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a46798-ab05-4a0c-bf60-f4a947a00b3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:36.396423 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a46798-ab05-4a0c-bf60-f4a947a00b3e None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:36.402270 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 535/1034] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:27:36 2022] GET /identity/v3/role_assignments?user.id=941ed10dfafc4bd48896843da26c9175&scope.project.id=7fe768315f5c43f487f71f043f11b8b8&role.id=dd398730a074417fbbd43b27d2ea03d4 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:37.225236 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01440ad5-1cdf-4b59-8d63-2941d6cd20fb None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:37.225826 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01440ad5-1cdf-4b59-8d63-2941d6cd20fb None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:37.225826 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01440ad5-1cdf-4b59-8d63-2941d6cd20fb None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:37.227812 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 500/1035] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:27:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:27:37.233103 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd27e59-cefe-4054-94bb-eb048b59a734 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:37.233515 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd27e59-cefe-4054-94bb-eb048b59a734 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:37.233694 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd27e59-cefe-4054-94bb-eb048b59a734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:37.252526 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-bcd27e59-cefe-4054-94bb-eb048b59a734 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:27:37.253737 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-bcd27e59-cefe-4054-94bb-eb048b59a734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:27:37.322336 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 536/1036] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:27:37 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:27:37.347700 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01440ad5-1cdf-4b59-8d63-2941d6cd20fb None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:37.451214 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01440ad5-1cdf-4b59-8d63-2941d6cd20fb None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:37.479120 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:37.488445 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4076927e-bfc1-473f-bb5a-36dd34e5f34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:37.489269 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076927e-bfc1-473f-bb5a-36dd34e5f34e None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:37.490742 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076927e-bfc1-473f-bb5a-36dd34e5f34e None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:37.490742 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076927e-bfc1-473f-bb5a-36dd34e5f34e None admin] PATH_INFO: `/v3/domains/default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:37.491061 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4076927e-bfc1-473f-bb5a-36dd34e5f34e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:37.492591 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4076927e-bfc1-473f-bb5a-36dd34e5f34e None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:37.494605 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 501/1037] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:27:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:27:37.500355 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd27e59-cefe-4054-94bb-eb048b59a734 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:37.607725 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:37.611187 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd27e59-cefe-4054-94bb-eb048b59a734 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:37.617140 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538b504-5d7f-4054-bc75-ca1e95e35611 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:37.617714 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538b504-5d7f-4054-bc75-ca1e95e35611 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:37.620419 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538b504-5d7f-4054-bc75-ca1e95e35611 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:37.620419 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 502/1038] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:27:37.624128 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655ffab-86ce-4b13-aa32-99f84081acda None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:37.624428 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655ffab-86ce-4b13-aa32-99f84081acda None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:37.624717 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655ffab-86ce-4b13-aa32-99f84081acda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:37.641850 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-c655ffab-86ce-4b13-aa32-99f84081acda None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:27:37.643098 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-c655ffab-86ce-4b13-aa32-99f84081acda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:27:37.646620 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e3afa-b100-4d66-913c-9739e16e97b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:37.647495 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e3afa-b100-4d66-913c-9739e16e97b5 None admin] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:37.647926 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e3afa-b100-4d66-913c-9739e16e97b5 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:37.648373 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e3afa-b100-4d66-913c-9739e16e97b5 None admin] PATH_INFO: `/v3/users` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:37.649764 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e3afa-b100-4d66-913c-9739e16e97b5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:37.651409 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e3afa-b100-4d66-913c-9739e16e97b5 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:37.713634 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 503/1039] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:27:37 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:27:37.736604 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c655ffab-86ce-4b13-aa32-99f84081acda None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:37.756767 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 537/1040] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:27:37 2022] POST /identity/v3/users => generated 285 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:27:37.848523 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c655ffab-86ce-4b13-aa32-99f84081acda None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:37.874364 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:37.887579 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f650be4-288e-4016-8a4f-b91aebb9a2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:37.888404 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f650be4-288e-4016-8a4f-b91aebb9a2ac None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:37.888691 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f650be4-288e-4016-8a4f-b91aebb9a2ac None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:37.888974 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f650be4-288e-4016-8a4f-b91aebb9a2ac None admin] PATH_INFO: `/v3/services/image` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:37.889716 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f650be4-288e-4016-8a4f-b91aebb9a2ac None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:37.891142 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f650be4-288e-4016-8a4f-b91aebb9a2ac None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:37.906698 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-7f650be4-288e-4016-8a4f-b91aebb9a2ac None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 21:27:37.906698 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:37.906698 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:27:37.906698 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:27:37.906698 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:27:37.906698 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:27:37.906698 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:27:37.906698 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:27:37.906698 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 21:27:37.906698 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:37.906698 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:27:37.906698 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:37.906698 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:37.906698 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:37.906698 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:37.906698 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:37.906698 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:37.907751 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:37.907751 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:37.907751 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:37.907751 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:37.907751 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:37.907751 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:37.907751 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:27:37.907751 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:27:37.907751 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:27:37.907751 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:27:37.907751 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:37.907751 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:37.907751 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:37.907751 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:37.907751 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:37.907751 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:37.908594 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:37.908594 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:37.908594 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:37.908594 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:37.908594 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:37.908594 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:37.908594 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:37.908594 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:37.908594 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:37.908594 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:37.908594 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:27:37.908594 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:27:37.908594 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 21:27:37.908594 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:37.908594 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 504/1041] 10.222.0.30 () {56 vars in 1105 bytes} [Tue Jul 5 21:27:37 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:27:37.912650 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e3afa-b100-4d66-913c-9739e16e97b5 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:38.021791 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e3afa-b100-4d66-913c-9739e16e97b5 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:38.059756 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f994a7-4894-485d-9f8a-cdc85da99bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:38.060436 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f994a7-4894-485d-9f8a-cdc85da99bed None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:38.060726 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f994a7-4894-485d-9f8a-cdc85da99bed None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:38.061009 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f994a7-4894-485d-9f8a-cdc85da99bed None admin] PATH_INFO: `/v3/services` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:38.061756 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f994a7-4894-485d-9f8a-cdc85da99bed None admin] RBAC: Adding query filter params (name=image) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:38.062071 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f994a7-4894-485d-9f8a-cdc85da99bed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:38.063489 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f994a7-4894-485d-9f8a-cdc85da99bed None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:38.073622 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 538/1042] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:27:37 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:38.075214 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f650be4-288e-4016-8a4f-b91aebb9a2ac None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:38.182164 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f650be4-288e-4016-8a4f-b91aebb9a2ac None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:38.217226 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1dfb54-1c8a-4aed-9c32-586128a79e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:38.217890 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1dfb54-1c8a-4aed-9c32-586128a79e54 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:38.218203 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1dfb54-1c8a-4aed-9c32-586128a79e54 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:38.218485 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1dfb54-1c8a-4aed-9c32-586128a79e54 None admin] PATH_INFO: `/v3/services` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:38.219185 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1dfb54-1c8a-4aed-9c32-586128a79e54 None admin] RBAC: Adding query filter params (type=image) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:38.219495 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1dfb54-1c8a-4aed-9c32-586128a79e54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:38.220857 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1dfb54-1c8a-4aed-9c32-586128a79e54 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:38.225917 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 505/1043] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:27:38 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:38.231872 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f994a7-4894-485d-9f8a-cdc85da99bed None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:38.256301 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:38.339815 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f994a7-4894-485d-9f8a-cdc85da99bed None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:38.374339 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c70fe0-a6a6-4445-b19f-bc25338e50b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:38.375008 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c70fe0-a6a6-4445-b19f-bc25338e50b8 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:38.375298 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c70fe0-a6a6-4445-b19f-bc25338e50b8 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:38.375582 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c70fe0-a6a6-4445-b19f-bc25338e50b8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:38.376376 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c70fe0-a6a6-4445-b19f-bc25338e50b8 None admin] RBAC: Adding query filter params (interface=public, service_id=b2bef5c9336842e584a06e17e2fbac5c, region_id=RegionOne) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:38.376698 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c70fe0-a6a6-4445-b19f-bc25338e50b8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:38.378088 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c70fe0-a6a6-4445-b19f-bc25338e50b8 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:38.383908 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 539/1044] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Jul 5 21:27:38 2022] GET /identity/v3/endpoints?service_id=b2bef5c9336842e584a06e17e2fbac5c&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:27:38.389785 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1dfb54-1c8a-4aed-9c32-586128a79e54 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:38.445645 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:38.446458 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073fbaf-8324-42f2-8867-9fc6e05cedeb None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:38.446593 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073fbaf-8324-42f2-8867-9fc6e05cedeb None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:38.446878 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073fbaf-8324-42f2-8867-9fc6e05cedeb None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:38.448405 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 540/1045] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:27:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:27:38.453288 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee390576-9177-455e-928c-33beb9e9ec60 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:38.453601 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee390576-9177-455e-928c-33beb9e9ec60 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:38.453884 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee390576-9177-455e-928c-33beb9e9ec60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:38.473335 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-ee390576-9177-455e-928c-33beb9e9ec60 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:27:38.474571 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-ee390576-9177-455e-928c-33beb9e9ec60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:27:38.499377 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1dfb54-1c8a-4aed-9c32-586128a79e54 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:38.535482 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d06a9f-9e21-445e-9122-0358f63126ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:38.536071 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d06a9f-9e21-445e-9122-0358f63126ae None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:38.536365 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d06a9f-9e21-445e-9122-0358f63126ae None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:38.536658 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d06a9f-9e21-445e-9122-0358f63126ae None admin] PATH_INFO: `/v3/services` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:38.537351 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d06a9f-9e21-445e-9122-0358f63126ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:38.538768 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d06a9f-9e21-445e-9122-0358f63126ae None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:38.546454 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 506/1046] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Jul 5 21:27:38 2022] GET /identity/v3/services => generated 1957 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:27:38.550327 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 541/1047] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:27:38 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:27:38.578265 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d06a9f-9e21-445e-9122-0358f63126ae None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:38.689978 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d06a9f-9e21-445e-9122-0358f63126ae None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:38.707242 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:38.726189 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7760445-f9de-480d-93b3-552dba343833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:38.727521 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7760445-f9de-480d-93b3-552dba343833 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:38.727811 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7760445-f9de-480d-93b3-552dba343833 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:38.728099 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7760445-f9de-480d-93b3-552dba343833 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:38.738838 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7760445-f9de-480d-93b3-552dba343833 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:27:38.747684 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-d7760445-f9de-480d-93b3-552dba343833 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 21:27:38.747684 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:38.747684 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:38.747684 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:38.747684 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:38.747684 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:38.747684 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:38.747684 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:38.747684 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:38.747684 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:38.747684 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:38.747684 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:38.747684 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:27:38.747684 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:27:38.747684 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:27:38.747684 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:27:38.748599 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:27:38.748599 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:27:38.748599 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:27:38.748599 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:27:38.748599 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:38.748599 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:38.748599 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:38.748599 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:38.748599 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:38.748599 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:38.748599 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:38.748599 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:38.748599 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:38.748599 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:38.748599 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:38.748599 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:38.749434 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:38.749434 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:38.749434 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:38.749434 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:38.749434 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:27:38.749434 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:27:38.749434 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:27:38.749434 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:27:38.749434 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:27:38.749434 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:27:38.749434 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 21:27:38.749434 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:38.749434 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 507/1048] 10.222.0.30 () {56 vars in 1120 bytes} [Tue Jul 5 21:27:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:38.755027 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee390576-9177-455e-928c-33beb9e9ec60 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:38.770750 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:38.861507 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee390576-9177-455e-928c-33beb9e9ec60 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:38.896110 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d709e0-6452-43bc-866d-039c626eb169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:38.896781 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d709e0-6452-43bc-866d-039c626eb169 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:38.897066 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d709e0-6452-43bc-866d-039c626eb169 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:38.897347 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d709e0-6452-43bc-866d-039c626eb169 None admin] PATH_INFO: `/v3/roles` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:38.898089 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d709e0-6452-43bc-866d-039c626eb169 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:38.898429 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d709e0-6452-43bc-866d-039c626eb169 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:38.900466 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d709e0-6452-43bc-866d-039c626eb169 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:38.913175 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 542/1049] 10.222.0.30 () {56 vars in 1115 bytes} [Tue Jul 5 21:27:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:38.915517 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7760445-f9de-480d-93b3-552dba343833 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:39.026338 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7760445-f9de-480d-93b3-552dba343833 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:39.061263 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29631111-3710-484b-9d46-f88c6db9bb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:39.062079 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29631111-3710-484b-9d46-f88c6db9bb60 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:39.062402 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29631111-3710-484b-9d46-f88c6db9bb60 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:39.062690 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29631111-3710-484b-9d46-f88c6db9bb60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:39.073421 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29631111-3710-484b-9d46-f88c6db9bb60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:39.074976 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29631111-3710-484b-9d46-f88c6db9bb60 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:39.093465 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-29631111-3710-484b-9d46-f88c6db9bb60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:39.093465 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:39.093465 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:39.093465 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:39.093465 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:39.093465 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:39.093465 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:39.093465 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:39.093465 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:39.093465 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:39.093465 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:39.093465 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:39.093465 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:27:39.093465 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:27:39.093465 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:27:39.094636 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:27:39.094636 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:39.094636 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:39.094636 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:39.094636 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:39.094636 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:39.094636 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:39.094636 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:39.094636 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:39.094636 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:39.094636 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:39.094636 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:39.094636 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:39.094636 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:39.094636 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:39.094636 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:39.094636 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:39.095525 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:27:39.095525 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:27:39.095525 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:39.095525 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:39.095525 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 508/1050] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:27:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:27:39.100510 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d709e0-6452-43bc-866d-039c626eb169 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:39.185457 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:39.208889 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d709e0-6452-43bc-866d-039c626eb169 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:39.243138 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b81fe-ec7f-4d0d-a5ea-18e3b9de3675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:39.243808 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b81fe-ec7f-4d0d-a5ea-18e3b9de3675 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:39.244096 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b81fe-ec7f-4d0d-a5ea-18e3b9de3675 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:39.244377 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b81fe-ec7f-4d0d-a5ea-18e3b9de3675 None admin] PATH_INFO: `/v3/domains` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:39.245099 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0b81fe-ec7f-4d0d-a5ea-18e3b9de3675 None admin] RBAC: Adding query filter params (name=Default) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:39.245410 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0b81fe-ec7f-4d0d-a5ea-18e3b9de3675 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:39.246813 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0b81fe-ec7f-4d0d-a5ea-18e3b9de3675 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:39.259427 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 543/1051] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:27:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:39.265031 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29631111-3710-484b-9d46-f88c6db9bb60 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:39.297195 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:39.372425 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29631111-3710-484b-9d46-f88c6db9bb60 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:39.406893 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116893a1-6121-4c41-b00a-e7399f7df8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:39.407685 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116893a1-6121-4c41-b00a-e7399f7df8d1 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:39.407971 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116893a1-6121-4c41-b00a-e7399f7df8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:39.408249 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116893a1-6121-4c41-b00a-e7399f7df8d1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:39.415979 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116893a1-6121-4c41-b00a-e7399f7df8d1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:39.417554 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116893a1-6121-4c41-b00a-e7399f7df8d1 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:39.432354 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-116893a1-6121-4c41-b00a-e7399f7df8d1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:27:39.432354 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:39.432354 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:39.432354 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:39.432354 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:39.432354 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:39.432354 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:39.432354 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:39.432354 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:39.432354 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:39.432354 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:39.432354 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:39.432354 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:27:39.432354 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:27:39.432354 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:27:39.432354 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:27:39.433304 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:39.433304 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:39.433304 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:27:39.433304 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:27:39.433304 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:27:39.433304 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:27:39.433304 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:39.433304 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:39.433304 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:39.433304 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:39.433304 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:39.433304 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:39.433304 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:39.433304 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:39.433304 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:39.433304 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:39.433304 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:39.433304 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:39.434291 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:39.434291 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:39.434291 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:27:39.434291 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:27:39.434291 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:27:39.434291 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:27:39.434291 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:27:39.434291 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:27:39.434291 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:27:39.434291 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:39.434291 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 509/1052] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Jul 5 21:27:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:39.441063 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b81fe-ec7f-4d0d-a5ea-18e3b9de3675 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:39.546761 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b81fe-ec7f-4d0d-a5ea-18e3b9de3675 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:39.589485 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b140f-6ff2-4ea0-9f08-a7c19f69e3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:39.590194 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b140f-6ff2-4ea0-9f08-a7c19f69e3a9 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:39.590486 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b140f-6ff2-4ea0-9f08-a7c19f69e3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:39.590769 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b140f-6ff2-4ea0-9f08-a7c19f69e3a9 None admin] PATH_INFO: `/v3/users` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:39.591607 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822b140f-6ff2-4ea0-9f08-a7c19f69e3a9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:39.591923 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822b140f-6ff2-4ea0-9f08-a7c19f69e3a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:39.593364 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822b140f-6ff2-4ea0-9f08-a7c19f69e3a9 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:39.596909 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:39.616848 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 544/1053] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Jul 5 21:27:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:39.619450 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116893a1-6121-4c41-b00a-e7399f7df8d1 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:39.714085 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:39.727693 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116893a1-6121-4c41-b00a-e7399f7df8d1 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:39.762329 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b20c3-4f83-4753-8788-f0e59e2d5e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:39.763135 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b20c3-4f83-4753-8788-f0e59e2d5e89 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:39.763424 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b20c3-4f83-4753-8788-f0e59e2d5e89 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:39.763704 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b20c3-4f83-4753-8788-f0e59e2d5e89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:39.774830 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457b20c3-4f83-4753-8788-f0e59e2d5e89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:39.776543 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457b20c3-4f83-4753-8788-f0e59e2d5e89 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:39.796639 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-457b20c3-4f83-4753-8788-f0e59e2d5e89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:39.796639 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:39.796639 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:39.796639 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:39.796639 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:39.796639 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:39.796639 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:39.796639 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:39.796639 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:39.796639 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:39.796639 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:39.796639 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:39.796639 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:27:39.796639 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:27:39.796639 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:27:39.797779 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:27:39.797779 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:39.797779 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:39.797779 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:39.797779 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:39.797779 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:39.797779 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:39.797779 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:39.797779 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:39.797779 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:39.797779 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:39.797779 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:39.797779 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:39.797779 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:39.797779 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:39.797779 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:39.797779 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:39.799070 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:27:39.799070 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:27:39.799070 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:39.799070 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:39.802569 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 510/1054] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:27:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:39.803955 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b140f-6ff2-4ea0-9f08-a7c19f69e3a9 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:39.905182 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b140f-6ff2-4ea0-9f08-a7c19f69e3a9 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:39.922520 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee8de3-0313-4da5-8cf2-a6d294d9b7a6 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:39.922798 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee8de3-0313-4da5-8cf2-a6d294d9b7a6 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:39.923077 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee8de3-0313-4da5-8cf2-a6d294d9b7a6 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:39.924454 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 511/1055] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:27:39.931454 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e955f-64bf-4665-825a-3517ed814811 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:39.931752 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e955f-64bf-4665-825a-3517ed814811 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:39.932038 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e955f-64bf-4665-825a-3517ed814811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:39.944049 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e6520-5b6e-47cf-ae09-7cd0ea96428a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:39.944709 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e6520-5b6e-47cf-ae09-7cd0ea96428a None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:39.944996 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e6520-5b6e-47cf-ae09-7cd0ea96428a None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:39.945276 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e6520-5b6e-47cf-ae09-7cd0ea96428a None admin] PATH_INFO: `/v3/domains` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:39.946619 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e6520-5b6e-47cf-ae09-7cd0ea96428a None admin] RBAC: Adding query filter params (name=Default) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:39.946924 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e6520-5b6e-47cf-ae09-7cd0ea96428a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:39.948297 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e6520-5b6e-47cf-ae09-7cd0ea96428a None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:39.951129 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-715e955f-64bf-4665-825a-3517ed814811 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:27:39.952607 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-715e955f-64bf-4665-825a-3517ed814811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:27:39.959940 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 545/1056] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:27:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:39.966200 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e6520-5b6e-47cf-ae09-7cd0ea96428a None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:40.024554 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:40.046474 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 512/1057] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:27:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:27:40.063883 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e955f-64bf-4665-825a-3517ed814811 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:40.073324 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e6520-5b6e-47cf-ae09-7cd0ea96428a None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:40.113218 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e14b81-8a6e-4e76-a76c-6efde293c42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:40.114012 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e14b81-8a6e-4e76-a76c-6efde293c42d None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:40.114347 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e14b81-8a6e-4e76-a76c-6efde293c42d None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:40.114629 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e14b81-8a6e-4e76-a76c-6efde293c42d None admin] PATH_INFO: `/v3/projects/service` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:40.122238 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e14b81-8a6e-4e76-a76c-6efde293c42d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:40.124112 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e14b81-8a6e-4e76-a76c-6efde293c42d None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:40.139161 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-50e14b81-8a6e-4e76-a76c-6efde293c42d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:27:40.139161 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:40.139161 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:40.139161 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:40.139161 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:40.139161 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:40.139161 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:40.139161 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:40.139161 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:40.139161 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:40.139161 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:40.139161 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:40.139161 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:27:40.139161 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:27:40.139161 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:27:40.140056 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:27:40.140056 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:40.140056 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:40.140056 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:40.140056 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:40.140056 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:40.140056 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:40.140056 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:40.140056 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:40.140056 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:40.140056 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:40.140056 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:40.140056 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:40.140056 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:40.140056 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:40.140056 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:40.140056 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:40.141724 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:27:40.141724 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:27:40.141724 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:27:40.141724 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:27:40.141724 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:27:40.141724 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:27:40.141724 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:27:40.141724 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:40.141724 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 546/1058] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:27:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:27:40.144319 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:40.146009 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e14b81-8a6e-4e76-a76c-6efde293c42d None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:40.176779 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e955f-64bf-4665-825a-3517ed814811 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:40.216454 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618f27f-d87e-40f0-922d-2d0ca83ce491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:40.217244 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618f27f-d87e-40f0-922d-2d0ca83ce491 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:40.217532 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618f27f-d87e-40f0-922d-2d0ca83ce491 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:40.217812 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618f27f-d87e-40f0-922d-2d0ca83ce491 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:40.229330 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f618f27f-d87e-40f0-922d-2d0ca83ce491 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:27:40.237524 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-f618f27f-d87e-40f0-922d-2d0ca83ce491 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:27:40.237524 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:40.237524 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:40.237524 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:40.237524 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:40.237524 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:40.237524 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:40.237524 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:40.237524 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:40.237524 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:40.237524 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:40.237524 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:40.237524 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:27:40.237524 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:27:40.237524 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:27:40.237524 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:27:40.238697 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:27:40.238697 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:27:40.238697 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:27:40.238697 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:27:40.238697 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:40.238697 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:40.238697 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:40.238697 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:40.238697 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:40.238697 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:40.238697 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:40.238697 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:40.238697 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:40.238697 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:40.238697 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:40.238697 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:40.239599 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:40.239599 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:40.239599 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:40.239599 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:40.239599 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:27:40.239599 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:27:40.239599 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:27:40.239599 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:27:40.239599 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:27:40.239599 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:27:40.239599 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:27:40.239599 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:40.239599 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 513/1059] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:27:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:27:40.245019 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618f27f-d87e-40f0-922d-2d0ca83ce491 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:40.258780 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e14b81-8a6e-4e76-a76c-6efde293c42d None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:40.274806 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:40.295808 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c85bce3-40c5-45eb-ade1-ab560b7105a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:40.296565 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85bce3-40c5-45eb-ade1-ab560b7105a6 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:40.296859 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85bce3-40c5-45eb-ade1-ab560b7105a6 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:40.297142 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85bce3-40c5-45eb-ade1-ab560b7105a6 None admin] PATH_INFO: `/v3/projects` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:40.297930 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c85bce3-40c5-45eb-ade1-ab560b7105a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:40.298293 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c85bce3-40c5-45eb-ade1-ab560b7105a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:40.299745 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c85bce3-40c5-45eb-ade1-ab560b7105a6 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:40.312950 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 547/1060] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:27:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:27:40.318558 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c85bce3-40c5-45eb-ade1-ab560b7105a6 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:40.362173 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618f27f-d87e-40f0-922d-2d0ca83ce491 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:40.392383 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:40.399192 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b1610-ebc6-4506-a76d-6ef9ed063d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:40.400137 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b1610-ebc6-4506-a76d-6ef9ed063d8a None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:40.400508 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b1610-ebc6-4506-a76d-6ef9ed063d8a None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:40.400740 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b1610-ebc6-4506-a76d-6ef9ed063d8a None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:40.401489 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b1610-ebc6-4506-a76d-6ef9ed063d8a None admin] RBAC: Adding query filter params (name=admin) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:40.401799 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b1610-ebc6-4506-a76d-6ef9ed063d8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:40.403230 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b1610-ebc6-4506-a76d-6ef9ed063d8a None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:40.413860 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 514/1061] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:27:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:27:40.419836 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b1610-ebc6-4506-a76d-6ef9ed063d8a None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:40.437636 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c85bce3-40c5-45eb-ade1-ab560b7105a6 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:40.475520 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6af43-3402-42a5-876c-ded3bb3d6e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:40.476530 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6af43-3402-42a5-876c-ded3bb3d6e0a None admin] REQUEST_METHOD: `PUT` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:40.476943 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6af43-3402-42a5-876c-ded3bb3d6e0a None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:40.477334 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6af43-3402-42a5-876c-ded3bb3d6e0a None admin] PATH_INFO: `/v3/projects/7fe768315f5c43f487f71f043f11b8b8/users/941ed10dfafc4bd48896843da26c9175/roles/dd398730a074417fbbd43b27d2ea03d4` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:40.479814 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d6af43-3402-42a5-876c-ded3bb3d6e0a None admin] RBAC: Authorizing `identity:create_grant(project_id=7fe768315f5c43f487f71f043f11b8b8, user_id=941ed10dfafc4bd48896843da26c9175, role_id=dd398730a074417fbbd43b27d2ea03d4)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:40.481383 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d6af43-3402-42a5-876c-ded3bb3d6e0a None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:40.520011 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b1610-ebc6-4506-a76d-6ef9ed063d8a None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:40.562165 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 548/1062] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:27:40 2022] PUT /identity/v3/projects/7fe768315f5c43f487f71f043f11b8b8/users/941ed10dfafc4bd48896843da26c9175/roles/dd398730a074417fbbd43b27d2ea03d4 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:27:40.562412 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88e562-4332-488f-a8c4-f4991e894931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:40.562412 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88e562-4332-488f-a8c4-f4991e894931 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:40.562412 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88e562-4332-488f-a8c4-f4991e894931 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:40.562412 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88e562-4332-488f-a8c4-f4991e894931 None admin] PATH_INFO: `/v3/users/7ddd8d7bd5da42438042a14c11698807` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:40.578394 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d88e562-4332-488f-a8c4-f4991e894931 None admin] RBAC: Authorizing `identity:get_user(user_id=7ddd8d7bd5da42438042a14c11698807)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:40.579902 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d88e562-4332-488f-a8c4-f4991e894931 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:40.581981 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 515/1063] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:27:40 2022] GET /identity/v3/users/7ddd8d7bd5da42438042a14c11698807 => generated 285 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:27:40.588460 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6af43-3402-42a5-876c-ded3bb3d6e0a None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:40.630473 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:40.700812 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cde497-89c2-442c-b16b-3f240fc12751 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:40.701218 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cde497-89c2-442c-b16b-3f240fc12751 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:40.701571 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cde497-89c2-442c-b16b-3f240fc12751 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:40.703202 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 516/1064] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:27:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:27:40.706938 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6af43-3402-42a5-876c-ded3bb3d6e0a None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:40.709059 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd444b-b086-4458-990d-92c670c2c8a7 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:40.709461 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd444b-b086-4458-990d-92c670c2c8a7 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:40.709843 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd444b-b086-4458-990d-92c670c2c8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:40.730983 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-49dd444b-b086-4458-990d-92c670c2c8a7 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:27:40.732190 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-49dd444b-b086-4458-990d-92c670c2c8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:27:40.747290 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0f01a-c59b-44a7-af29-cdc0ea101830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:40.747956 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0f01a-c59b-44a7-af29-cdc0ea101830 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:40.748249 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0f01a-c59b-44a7-af29-cdc0ea101830 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:40.748531 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0f01a-c59b-44a7-af29-cdc0ea101830 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:40.782398 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:40.807539 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 517/1065] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:27:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:27:40.822421 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de0f01a-c59b-44a7-af29-cdc0ea101830 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:40.823936 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de0f01a-c59b-44a7-af29-cdc0ea101830 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:40.830970 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd444b-b086-4458-990d-92c670c2c8a7 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:40.860526 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:40.941725 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 549/1066] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:27:40 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:27:40.941952 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd444b-b086-4458-990d-92c670c2c8a7 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:40.942813 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0f01a-c59b-44a7-af29-cdc0ea101830 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:40.979569 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be5f81-9fed-497c-8c8d-d20fde844c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:40.980299 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be5f81-9fed-497c-8c8d-d20fde844c1d None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:40.980594 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be5f81-9fed-497c-8c8d-d20fde844c1d None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:40.980879 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be5f81-9fed-497c-8c8d-d20fde844c1d None admin] PATH_INFO: `/v3/services/image` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:40.981543 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be5f81-9fed-497c-8c8d-d20fde844c1d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:40.982986 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be5f81-9fed-497c-8c8d-d20fde844c1d None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:40.995390 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-04be5f81-9fed-497c-8c8d-d20fde844c1d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 21:27:40.995390 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:40.995390 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:27:40.995390 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:27:40.995390 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:27:40.995390 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:27:40.995390 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:27:40.995390 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:27:40.995390 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 21:27:40.995390 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:40.995390 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:27:40.995390 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:40.995390 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:40.995390 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:40.995390 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:40.995390 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:40.995390 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:40.996396 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:40.996396 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:40.996396 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:40.996396 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:40.996396 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:40.996396 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:40.996396 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:27:40.996396 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:27:40.996396 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:27:40.996396 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:27:40.996396 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:40.996396 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:40.996396 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:40.996396 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:40.996396 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:40.996396 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:40.997418 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:40.997418 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:40.997418 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:40.997418 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:40.997418 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:40.997418 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:40.997418 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:40.997418 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:40.997418 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:40.997418 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:40.997418 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:27:40.997418 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:27:40.997418 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 21:27:40.997418 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:40.997418 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 518/1067] 10.222.0.30 () {56 vars in 1105 bytes} [Tue Jul 5 21:27:40 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:27:41.002580 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be5f81-9fed-497c-8c8d-d20fde844c1d None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:41.051354 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:41.054647 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0f01a-c59b-44a7-af29-cdc0ea101830 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:41.091533 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5fa35-f482-49ef-b34f-b6f2512565a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:41.093657 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5fa35-f482-49ef-b34f-b6f2512565a2 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:41.093942 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5fa35-f482-49ef-b34f-b6f2512565a2 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:41.094252 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5fa35-f482-49ef-b34f-b6f2512565a2 None admin] PATH_INFO: `/v3/projects/a07e537c2d2e4f3aba0672bb31210209` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:41.095665 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5fa35-f482-49ef-b34f-b6f2512565a2 None admin] RBAC: Authorizing `identity:get_project(project_id=a07e537c2d2e4f3aba0672bb31210209)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:41.097163 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5fa35-f482-49ef-b34f-b6f2512565a2 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:41.104508 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 550/1068] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:27:40 2022] GET /identity/v3/projects/a07e537c2d2e4f3aba0672bb31210209 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:41.106013 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5fa35-f482-49ef-b34f-b6f2512565a2 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:41.109979 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:41.111636 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be5f81-9fed-497c-8c8d-d20fde844c1d None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:41.150655 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e3ada2-2ad3-44d4-9ee4-c37e93a9bb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:41.151334 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3ada2-2ad3-44d4-9ee4-c37e93a9bb72 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:41.151626 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3ada2-2ad3-44d4-9ee4-c37e93a9bb72 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:41.151908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3ada2-2ad3-44d4-9ee4-c37e93a9bb72 None admin] PATH_INFO: `/v3/services` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:41.152618 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e3ada2-2ad3-44d4-9ee4-c37e93a9bb72 None admin] RBAC: Adding query filter params (name=image) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:41.152934 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e3ada2-2ad3-44d4-9ee4-c37e93a9bb72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:41.154355 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e3ada2-2ad3-44d4-9ee4-c37e93a9bb72 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:41.160039 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 519/1069] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:27:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:27:41.166432 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e3ada2-2ad3-44d4-9ee4-c37e93a9bb72 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:41.218774 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5fa35-f482-49ef-b34f-b6f2512565a2 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:41.257712 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108ca1f-4b37-46d2-ba7d-1c57cd76e035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:41.258655 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108ca1f-4b37-46d2-ba7d-1c57cd76e035 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:41.258945 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108ca1f-4b37-46d2-ba7d-1c57cd76e035 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:41.259227 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108ca1f-4b37-46d2-ba7d-1c57cd76e035 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:41.260073 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e108ca1f-4b37-46d2-ba7d-1c57cd76e035 None admin] RBAC: Adding query filter params (role.id=00090b1962654604b8e106a05d44d06a, scope.project.id=a07e537c2d2e4f3aba0672bb31210209, user.id=7ddd8d7bd5da42438042a14c11698807) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:41.260387 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e108ca1f-4b37-46d2-ba7d-1c57cd76e035 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:41.261847 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e108ca1f-4b37-46d2-ba7d-1c57cd76e035 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:41.268036 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 551/1070] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:27:41 2022] GET /identity/v3/role_assignments?user.id=7ddd8d7bd5da42438042a14c11698807&scope.project.id=a07e537c2d2e4f3aba0672bb31210209&role.id=00090b1962654604b8e106a05d44d06a => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:41.279762 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e3ada2-2ad3-44d4-9ee4-c37e93a9bb72 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:41.292119 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:41.320560 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd5f0d-25ed-46a9-9294-232b7f4604d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:41.321415 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd5f0d-25ed-46a9-9294-232b7f4604d3 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:41.321874 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd5f0d-25ed-46a9-9294-232b7f4604d3 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:41.322194 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd5f0d-25ed-46a9-9294-232b7f4604d3 None admin] PATH_INFO: `/v3/services` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:41.322953 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bd5f0d-25ed-46a9-9294-232b7f4604d3 None admin] RBAC: Adding query filter params (type=image) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:41.323274 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bd5f0d-25ed-46a9-9294-232b7f4604d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:41.324733 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bd5f0d-25ed-46a9-9294-232b7f4604d3 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:41.330891 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 520/1071] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:27:41 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:41.337302 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108ca1f-4b37-46d2-ba7d-1c57cd76e035 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:41.411126 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:41.449037 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108ca1f-4b37-46d2-ba7d-1c57cd76e035 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:41.485299 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58961ae2-3433-4eaa-8a00-0f54d27361e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:41.486459 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58961ae2-3433-4eaa-8a00-0f54d27361e8 None admin] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:41.486866 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58961ae2-3433-4eaa-8a00-0f54d27361e8 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:41.487151 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58961ae2-3433-4eaa-8a00-0f54d27361e8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:41.487965 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58961ae2-3433-4eaa-8a00-0f54d27361e8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:41.489652 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58961ae2-3433-4eaa-8a00-0f54d27361e8 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:41.783310 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 552/1072] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Jul 5 21:27:41 2022] POST /identity/v3/endpoints => generated 327 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:27:42.620432 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65732d1-f0ac-4cbf-a238-a63a2bd10821 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:42.620942 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65732d1-f0ac-4cbf-a238-a63a2bd10821 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:42.621027 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65732d1-f0ac-4cbf-a238-a63a2bd10821 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:42.622561 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 521/1073] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:27:42.627464 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294cf1d-e720-4c59-bdcd-d4776f0894a0 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:42.627854 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294cf1d-e720-4c59-bdcd-d4776f0894a0 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:42.628022 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294cf1d-e720-4c59-bdcd-d4776f0894a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:42.644685 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-d294cf1d-e720-4c59-bdcd-d4776f0894a0 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:27:42.645865 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-d294cf1d-e720-4c59-bdcd-d4776f0894a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:27:42.719996 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 553/1074] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:27:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:27:42.743559 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65732d1-f0ac-4cbf-a238-a63a2bd10821 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:42.847376 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65732d1-f0ac-4cbf-a238-a63a2bd10821 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:42.881808 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e36981-a506-44f7-806a-ff135931a8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:42.882671 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e36981-a506-44f7-806a-ff135931a8e2 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:42.882959 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e36981-a506-44f7-806a-ff135931a8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:42.883296 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e36981-a506-44f7-806a-ff135931a8e2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:42.893562 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e36981-a506-44f7-806a-ff135931a8e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:27:42.902292 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-15e36981-a506-44f7-806a-ff135931a8e2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 21:27:42.902292 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:42.902292 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:42.902292 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:42.902292 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:42.902292 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:42.902292 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:42.902292 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:42.902292 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:42.902292 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:42.902292 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:42.902292 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:42.902292 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:27:42.902292 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:27:42.902292 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:27:42.902292 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:27:42.903296 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:27:42.903296 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:27:42.903296 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:27:42.903296 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:27:42.903296 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:42.903296 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:42.903296 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:42.903296 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:42.903296 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:42.903296 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:42.903296 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:42.903296 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:42.903296 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:42.903296 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:42.903296 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:42.903296 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:42.904208 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:42.904208 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:42.904208 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:42.904208 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:42.904208 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:27:42.904208 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:27:42.904208 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:27:42.904208 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:27:42.904208 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:27:42.904208 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:27:42.904208 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 21:27:42.904208 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:42.905519 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 522/1075] 10.222.0.30 () {56 vars in 1120 bytes} [Tue Jul 5 21:27:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:42.909544 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294cf1d-e720-4c59-bdcd-d4776f0894a0 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:42.961234 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:43.012697 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294cf1d-e720-4c59-bdcd-d4776f0894a0 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:43.047224 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e986880d-60b3-4258-8fa9-64840c2abe0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:43.047891 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986880d-60b3-4258-8fa9-64840c2abe0d None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:43.048178 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986880d-60b3-4258-8fa9-64840c2abe0d None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:43.048459 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986880d-60b3-4258-8fa9-64840c2abe0d None admin] PATH_INFO: `/v3/roles` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:43.049202 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e986880d-60b3-4258-8fa9-64840c2abe0d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:43.049512 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e986880d-60b3-4258-8fa9-64840c2abe0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:43.050913 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e986880d-60b3-4258-8fa9-64840c2abe0d None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:43.063806 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 554/1076] 10.222.0.30 () {56 vars in 1115 bytes} [Tue Jul 5 21:27:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:43.064948 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e36981-a506-44f7-806a-ff135931a8e2 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:43.097843 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:43.166943 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e36981-a506-44f7-806a-ff135931a8e2 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:43.200786 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f06d3-c486-43dd-9ba1-adcbc70bbcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:43.201590 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f06d3-c486-43dd-9ba1-adcbc70bbcba None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:43.201880 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f06d3-c486-43dd-9ba1-adcbc70bbcba None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:43.202182 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f06d3-c486-43dd-9ba1-adcbc70bbcba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:43.213254 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f06d3-c486-43dd-9ba1-adcbc70bbcba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:43.214753 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f06d3-c486-43dd-9ba1-adcbc70bbcba None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:43.232425 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-2a4f06d3-c486-43dd-9ba1-adcbc70bbcba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:43.232425 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:43.232425 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:43.232425 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:43.232425 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:43.232425 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:43.232425 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:43.232425 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:43.232425 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:43.232425 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:43.232425 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:43.232425 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:43.232425 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:27:43.232425 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:27:43.232425 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:27:43.233353 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:27:43.233353 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:43.233353 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:43.233353 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:43.233353 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:43.233353 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:43.233353 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:43.233353 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:43.233353 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:43.233353 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:43.233353 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:43.233353 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:43.233353 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:43.233353 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:43.233353 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:43.233353 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:43.233353 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:43.240620 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:27:43.240620 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:27:43.240620 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:43.240620 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:43.240620 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 523/1077] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:27:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:27:43.240933 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e986880d-60b3-4258-8fa9-64840c2abe0d None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:43.349116 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d60203-6363-43b9-b0de-fdc81846ab33 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:43.349456 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d60203-6363-43b9-b0de-fdc81846ab33 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:43.349751 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d60203-6363-43b9-b0de-fdc81846ab33 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:43.351437 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 524/1078] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:27:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:27:43.353358 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e986880d-60b3-4258-8fa9-64840c2abe0d None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:43.358214 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082d891-e1c2-490c-880e-b30e5a1ef5de None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:43.358513 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082d891-e1c2-490c-880e-b30e5a1ef5de None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:43.358800 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082d891-e1c2-490c-880e-b30e5a1ef5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:43.366551 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:43.376671 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-a082d891-e1c2-490c-880e-b30e5a1ef5de None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:27:43.377980 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-a082d891-e1c2-490c-880e-b30e5a1ef5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:27:43.392448 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42433144-1c58-4786-8936-82262920f23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:43.393123 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42433144-1c58-4786-8936-82262920f23e None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:43.393415 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42433144-1c58-4786-8936-82262920f23e None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:43.393699 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42433144-1c58-4786-8936-82262920f23e None admin] PATH_INFO: `/v3/domains` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:43.394618 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42433144-1c58-4786-8936-82262920f23e None admin] RBAC: Adding query filter params (name=Default) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:43.395730 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42433144-1c58-4786-8936-82262920f23e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:43.397115 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42433144-1c58-4786-8936-82262920f23e None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:43.414240 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 555/1079] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:27:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:43.416496 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42433144-1c58-4786-8936-82262920f23e None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:43.453722 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 525/1080] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:27:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:27:43.476746 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082d891-e1c2-490c-880e-b30e5a1ef5de None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:43.493067 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:43.533130 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42433144-1c58-4786-8936-82262920f23e None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:43.575494 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000db329-dfbc-41b2-b89c-5df98284060d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:43.576358 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000db329-dfbc-41b2-b89c-5df98284060d None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:43.576653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000db329-dfbc-41b2-b89c-5df98284060d None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:43.576934 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000db329-dfbc-41b2-b89c-5df98284060d None admin] PATH_INFO: `/v3/users/nova` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:43.584602 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082d891-e1c2-490c-880e-b30e5a1ef5de None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:43.584983 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000db329-dfbc-41b2-b89c-5df98284060d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:43.587187 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000db329-dfbc-41b2-b89c-5df98284060d None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:43.601673 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-000db329-dfbc-41b2-b89c-5df98284060d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:27:43.601673 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:43.601673 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:43.601673 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:43.601673 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:43.601673 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:43.601673 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:43.601673 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:43.601673 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:43.601673 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:43.601673 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:43.601673 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:43.601673 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:27:43.601673 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:27:43.601673 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:27:43.601673 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:27:43.602998 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:43.602998 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:43.602998 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:27:43.602998 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:27:43.602998 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:27:43.602998 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:27:43.602998 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:43.602998 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:43.602998 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:43.602998 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:43.602998 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:43.602998 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:43.602998 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:43.602998 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:43.602998 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:43.602998 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:43.602998 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:43.602998 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:43.603961 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:43.603961 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:43.603961 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:27:43.603961 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:27:43.603961 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:27:43.603961 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:27:43.603961 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:27:43.603961 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:27:43.603961 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:27:43.603961 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:43.603961 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 556/1081] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Jul 5 21:27:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:27:43.608661 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000db329-dfbc-41b2-b89c-5df98284060d None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:43.625108 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42292e8f-bc9e-43f2-ad5e-acd63af7f737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:43.625923 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42292e8f-bc9e-43f2-ad5e-acd63af7f737 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:43.626251 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42292e8f-bc9e-43f2-ad5e-acd63af7f737 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:43.626537 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42292e8f-bc9e-43f2-ad5e-acd63af7f737 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:43.638457 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42292e8f-bc9e-43f2-ad5e-acd63af7f737 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:27:43.640462 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:43.646264 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-42292e8f-bc9e-43f2-ad5e-acd63af7f737 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:27:43.646264 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:43.646264 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:43.646264 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:43.646264 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:43.646264 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:43.646264 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:43.646264 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:43.646264 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:43.646264 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:43.646264 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:43.646264 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:43.646264 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:27:43.646264 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:27:43.646264 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:27:43.646264 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:27:43.647228 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:27:43.647228 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:27:43.647228 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:27:43.647228 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:27:43.647228 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:43.647228 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:43.647228 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:43.647228 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:43.647228 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:43.647228 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:43.647228 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:43.647228 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:43.647228 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:43.647228 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:43.647228 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:43.647228 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:43.648220 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:43.648220 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:43.648220 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:43.648220 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:43.648220 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:27:43.648220 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:27:43.648220 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:27:43.648220 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:27:43.648220 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:27:43.648220 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:27:43.648220 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:27:43.648220 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:43.648220 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 526/1082] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:27:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:27:43.654288 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42292e8f-bc9e-43f2-ad5e-acd63af7f737 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:43.721165 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000db329-dfbc-41b2-b89c-5df98284060d None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:43.737653 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:43.761063 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b762ea-357b-4a42-8c6b-938125c30e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:43.761740 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b762ea-357b-4a42-8c6b-938125c30e3a None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:43.762027 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b762ea-357b-4a42-8c6b-938125c30e3a None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:43.762330 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b762ea-357b-4a42-8c6b-938125c30e3a None admin] PATH_INFO: `/v3/users` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:43.762816 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42292e8f-bc9e-43f2-ad5e-acd63af7f737 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:43.763174 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b762ea-357b-4a42-8c6b-938125c30e3a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:43.763490 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b762ea-357b-4a42-8c6b-938125c30e3a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:43.764946 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b762ea-357b-4a42-8c6b-938125c30e3a None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:43.783760 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 557/1083] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Jul 5 21:27:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:27:43.789927 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b762ea-357b-4a42-8c6b-938125c30e3a None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:43.802038 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db86e01-675a-4986-bb81-fd2767eebb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:43.802731 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db86e01-675a-4986-bb81-fd2767eebb92 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:43.803031 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db86e01-675a-4986-bb81-fd2767eebb92 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:43.803315 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db86e01-675a-4986-bb81-fd2767eebb92 None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:43.804073 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db86e01-675a-4986-bb81-fd2767eebb92 None admin] RBAC: Adding query filter params (name=admin) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:43.804386 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db86e01-675a-4986-bb81-fd2767eebb92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:43.806343 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db86e01-675a-4986-bb81-fd2767eebb92 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:43.816238 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 527/1084] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:27:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:27:43.823399 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db86e01-675a-4986-bb81-fd2767eebb92 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:43.891344 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:43.902634 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b762ea-357b-4a42-8c6b-938125c30e3a None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:43.929673 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db86e01-675a-4986-bb81-fd2767eebb92 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:43.938282 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab272d-95c3-4efd-9fa4-cdf5e505e6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:43.938932 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab272d-95c3-4efd-9fa4-cdf5e505e6cb None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:43.939222 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab272d-95c3-4efd-9fa4-cdf5e505e6cb None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:43.939505 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab272d-95c3-4efd-9fa4-cdf5e505e6cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:43.965042 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d3ece-eb46-487f-8f75-98adec1ebc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:43.965912 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d3ece-eb46-487f-8f75-98adec1ebc68 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:43.966224 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d3ece-eb46-487f-8f75-98adec1ebc68 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:43.966504 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d3ece-eb46-487f-8f75-98adec1ebc68 None admin] PATH_INFO: `/v3/users/7ddd8d7bd5da42438042a14c11698807` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:43.967697 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d3ece-eb46-487f-8f75-98adec1ebc68 None admin] RBAC: Authorizing `identity:get_user(user_id=7ddd8d7bd5da42438042a14c11698807)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:43.969132 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d3ece-eb46-487f-8f75-98adec1ebc68 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:43.971087 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 528/1085] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:27:43 2022] GET /identity/v3/users/7ddd8d7bd5da42438042a14c11698807 => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:27:43.972285 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e526cd-8c27-4dcc-be38-734e3e2ee20b None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:43.972582 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e526cd-8c27-4dcc-be38-734e3e2ee20b None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:43.972865 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e526cd-8c27-4dcc-be38-734e3e2ee20b None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:43.974081 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 529/1086] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:27:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:27:43.976500 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e526cd-8c27-4dcc-be38-734e3e2ee20b None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:43.980705 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:44.009435 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab272d-95c3-4efd-9fa4-cdf5e505e6cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:44.011031 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab272d-95c3-4efd-9fa4-cdf5e505e6cb None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:44.078378 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e526cd-8c27-4dcc-be38-734e3e2ee20b None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:44.096922 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:44.110755 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 558/1087] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:27:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 05 21:27:44.116071 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02566e06-c616-4f18-b92b-fbeb59c3bc8c None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:44.116071 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02566e06-c616-4f18-b92b-fbeb59c3bc8c None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:44.116071 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02566e06-c616-4f18-b92b-fbeb59c3bc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:44.116335 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e8911f-b927-4506-a23c-d2fbbedcbcbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:44.116335 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8911f-b927-4506-a23c-d2fbbedcbcbf None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:44.116335 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8911f-b927-4506-a23c-d2fbbedcbcbf None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:44.116335 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8911f-b927-4506-a23c-d2fbbedcbcbf None admin] PATH_INFO: `/v3/projects/a07e537c2d2e4f3aba0672bb31210209` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:44.116636 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e8911f-b927-4506-a23c-d2fbbedcbcbf None admin] RBAC: Authorizing `identity:get_project(project_id=a07e537c2d2e4f3aba0672bb31210209)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:44.117614 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e8911f-b927-4506-a23c-d2fbbedcbcbf None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:44.119495 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 530/1088] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:27:43 2022] GET /identity/v3/projects/a07e537c2d2e4f3aba0672bb31210209 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:27:44.120143 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e8911f-b927-4506-a23c-d2fbbedcbcbf None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:44.131382 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-02566e06-c616-4f18-b92b-fbeb59c3bc8c None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:27:44.132860 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-02566e06-c616-4f18-b92b-fbeb59c3bc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:27:44.194810 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:44.200551 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 559/1089] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:27:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:27:44.201555 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02566e06-c616-4f18-b92b-fbeb59c3bc8c None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:44.225681 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e8911f-b927-4506-a23c-d2fbbedcbcbf None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:44.260886 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8211149e-acb9-44e8-966e-601b6354e732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:44.261686 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211149e-acb9-44e8-966e-601b6354e732 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:44.261984 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211149e-acb9-44e8-966e-601b6354e732 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:44.262300 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211149e-acb9-44e8-966e-601b6354e732 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:44.272935 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8211149e-acb9-44e8-966e-601b6354e732 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:44.275044 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8211149e-acb9-44e8-966e-601b6354e732 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:44.292869 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-8211149e-acb9-44e8-966e-601b6354e732 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:44.292869 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:44.292869 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:44.292869 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:44.292869 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:44.292869 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:44.292869 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:44.292869 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:44.292869 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:44.292869 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:44.292869 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:44.292869 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:44.292869 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:27:44.292869 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:27:44.292869 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:27:44.293769 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:27:44.293769 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:44.293769 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:44.293769 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:44.293769 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:44.293769 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:44.293769 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:44.293769 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:44.293769 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:44.293769 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:44.293769 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:44.293769 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:44.293769 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:44.293769 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:44.293769 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:44.293769 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:44.293769 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:44.294985 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:27:44.294985 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:27:44.294985 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:44.294985 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:44.294985 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 531/1090] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:27:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:44.295485 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8211149e-acb9-44e8-966e-601b6354e732 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:44.317325 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02566e06-c616-4f18-b92b-fbeb59c3bc8c None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:44.333974 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:44.352953 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6d59b-8878-48f6-8440-c33ddcb799b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:44.353853 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6d59b-8878-48f6-8440-c33ddcb799b2 None admin] REQUEST_METHOD: `PUT` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:44.354173 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6d59b-8878-48f6-8440-c33ddcb799b2 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:44.354533 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6d59b-8878-48f6-8440-c33ddcb799b2 None admin] PATH_INFO: `/v3/projects/a07e537c2d2e4f3aba0672bb31210209/users/7ddd8d7bd5da42438042a14c11698807/roles/00090b1962654604b8e106a05d44d06a` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:44.356615 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6d59b-8878-48f6-8440-c33ddcb799b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=a07e537c2d2e4f3aba0672bb31210209, user_id=7ddd8d7bd5da42438042a14c11698807, role_id=00090b1962654604b8e106a05d44d06a)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:44.358078 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6d59b-8878-48f6-8440-c33ddcb799b2 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:44.395107 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8211149e-acb9-44e8-966e-601b6354e732 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:44.410316 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 560/1091] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:27:44 2022] PUT /identity/v3/projects/a07e537c2d2e4f3aba0672bb31210209/users/7ddd8d7bd5da42438042a14c11698807/roles/00090b1962654604b8e106a05d44d06a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:27:44.411139 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6d59b-8878-48f6-8440-c33ddcb799b2 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:44.420113 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:44.431460 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a7e98-ccbd-47b1-99e5-3e3ddbc415f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:44.432153 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a7e98-ccbd-47b1-99e5-3e3ddbc415f0 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:44.432452 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a7e98-ccbd-47b1-99e5-3e3ddbc415f0 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:44.432738 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a7e98-ccbd-47b1-99e5-3e3ddbc415f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:44.512512 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a7e98-ccbd-47b1-99e5-3e3ddbc415f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:44.514012 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a7e98-ccbd-47b1-99e5-3e3ddbc415f0 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:44.546871 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6d59b-8878-48f6-8440-c33ddcb799b2 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:44.595319 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d32eba-a739-40cc-869f-9458c33562d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:44.596007 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d32eba-a739-40cc-869f-9458c33562d6 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:44.596286 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d32eba-a739-40cc-869f-9458c33562d6 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:44.596567 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d32eba-a739-40cc-869f-9458c33562d6 None admin] PATH_INFO: `/v3/domains` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:44.597297 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d32eba-a739-40cc-869f-9458c33562d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:44.597609 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d32eba-a739-40cc-869f-9458c33562d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:44.599052 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d32eba-a739-40cc-869f-9458c33562d6 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:44.612001 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 561/1092] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:27:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:44.617374 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d32eba-a739-40cc-869f-9458c33562d6 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:44.632467 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 532/1093] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:27:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:27:44.638796 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a7e98-ccbd-47b1-99e5-3e3ddbc415f0 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:44.660660 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:44.663635 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:44.723719 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d32eba-a739-40cc-869f-9458c33562d6 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:44.744842 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a7e98-ccbd-47b1-99e5-3e3ddbc415f0 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:44.759876 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13047907-3e86-4dcb-aa8d-5a94aae1739d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:44.760697 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13047907-3e86-4dcb-aa8d-5a94aae1739d None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:44.760982 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13047907-3e86-4dcb-aa8d-5a94aae1739d None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:44.761254 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13047907-3e86-4dcb-aa8d-5a94aae1739d None admin] PATH_INFO: `/v3/projects/service` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:44.769264 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13047907-3e86-4dcb-aa8d-5a94aae1739d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:44.771200 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13047907-3e86-4dcb-aa8d-5a94aae1739d None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:44.781760 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191a67a-0d7b-491c-975e-e0c4d9d421d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:44.782599 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191a67a-0d7b-491c-975e-e0c4d9d421d6 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:44.782894 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191a67a-0d7b-491c-975e-e0c4d9d421d6 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:44.783179 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191a67a-0d7b-491c-975e-e0c4d9d421d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:44.785884 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-13047907-3e86-4dcb-aa8d-5a94aae1739d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:27:44.785884 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:44.785884 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:44.785884 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:44.785884 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:44.785884 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:44.785884 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:44.785884 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:44.785884 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:44.785884 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:44.785884 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:44.785884 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:44.785884 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:27:44.785884 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:27:44.785884 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:27:44.786965 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:27:44.786965 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:44.786965 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:44.786965 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:44.786965 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:44.786965 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:44.786965 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:44.786965 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:44.786965 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:44.786965 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:44.786965 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:44.786965 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:44.786965 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:44.786965 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:44.786965 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:44.786965 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:44.786965 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:44.788030 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:27:44.788030 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:27:44.788030 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:27:44.788030 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:27:44.788030 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:27:44.788030 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:27:44.788030 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:27:44.788030 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:27:44.792975 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 562/1094] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:27:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:27:44.793666 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13047907-3e86-4dcb-aa8d-5a94aae1739d None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:44.797525 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2191a67a-0d7b-491c-975e-e0c4d9d421d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:44.799045 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2191a67a-0d7b-491c-975e-e0c4d9d421d6 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:44.817184 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-2191a67a-0d7b-491c-975e-e0c4d9d421d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:44.817184 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:44.817184 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:44.817184 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:44.817184 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:44.817184 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:44.817184 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:44.817184 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:44.817184 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:44.817184 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:44.817184 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:44.817184 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:44.817184 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:27:44.817184 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:27:44.817184 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:27:44.818107 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:27:44.818107 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:44.818107 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:44.818107 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:44.818107 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:44.818107 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:44.818107 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:44.818107 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:44.818107 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:44.818107 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:44.818107 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:44.818107 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:44.818107 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:44.818107 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:44.818107 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:44.818107 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:44.818107 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:44.819108 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:27:44.819108 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:27:44.819108 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:27:44.819108 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:44.819108 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 533/1095] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:27:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:27:44.824358 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191a67a-0d7b-491c-975e-e0c4d9d421d6 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:44.901021 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:44.905660 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13047907-3e86-4dcb-aa8d-5a94aae1739d None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:44.911997 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:44.936395 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191a67a-0d7b-491c-975e-e0c4d9d421d6 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:44.942059 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3fb56e-a84a-4141-ab88-9f7a6e4ca27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:44.944399 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fb56e-a84a-4141-ab88-9f7a6e4ca27d None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:44.944399 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fb56e-a84a-4141-ab88-9f7a6e4ca27d None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:44.944399 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fb56e-a84a-4141-ab88-9f7a6e4ca27d None admin] PATH_INFO: `/v3/projects` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:44.944399 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3fb56e-a84a-4141-ab88-9f7a6e4ca27d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:44.944399 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3fb56e-a84a-4141-ab88-9f7a6e4ca27d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:44.945958 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3fb56e-a84a-4141-ab88-9f7a6e4ca27d None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:44.959029 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 563/1096] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:27:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:27:44.965377 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3fb56e-a84a-4141-ab88-9f7a6e4ca27d None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:44.974419 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34900de5-4323-4586-becd-3afe6f2a1b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:44.975093 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34900de5-4323-4586-becd-3afe6f2a1b58 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:44.975380 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34900de5-4323-4586-becd-3afe6f2a1b58 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:44.975662 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34900de5-4323-4586-becd-3afe6f2a1b58 None admin] PATH_INFO: `/v3/domains` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:44.976390 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34900de5-4323-4586-becd-3afe6f2a1b58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:44.976698 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34900de5-4323-4586-becd-3afe6f2a1b58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:44.978374 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34900de5-4323-4586-becd-3afe6f2a1b58 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:44.989763 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 534/1097] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:27:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:27:45.080365 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3fb56e-a84a-4141-ab88-9f7a6e4ca27d None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:45.119029 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c4ac04-2b21-426f-8f0f-8a5a7a608793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:45.119709 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4ac04-2b21-426f-8f0f-8a5a7a608793 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:45.120000 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4ac04-2b21-426f-8f0f-8a5a7a608793 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:45.120284 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4ac04-2b21-426f-8f0f-8a5a7a608793 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:45.121137 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c4ac04-2b21-426f-8f0f-8a5a7a608793 None admin] RBAC: Adding query filter params (role.id=dd398730a074417fbbd43b27d2ea03d4, scope.project.id=7fe768315f5c43f487f71f043f11b8b8, user.id=941ed10dfafc4bd48896843da26c9175) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:45.121458 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c4ac04-2b21-426f-8f0f-8a5a7a608793 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:45.122980 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c4ac04-2b21-426f-8f0f-8a5a7a608793 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:45.137491 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 564/1098] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:27:44 2022] GET /identity/v3/role_assignments?user.id=941ed10dfafc4bd48896843da26c9175&scope.project.id=7fe768315f5c43f487f71f043f11b8b8&role.id=dd398730a074417fbbd43b27d2ea03d4 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:27:46.488197 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4075e2-ed16-471e-8db9-9c1b9aadd449 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:46.489054 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4075e2-ed16-471e-8db9-9c1b9aadd449 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:46.489054 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4075e2-ed16-471e-8db9-9c1b9aadd449 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:46.490204 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 535/1099] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:27:46.496028 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb566347-6a8b-4a7e-8df8-a1a46915ea25 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:46.496463 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb566347-6a8b-4a7e-8df8-a1a46915ea25 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:46.496591 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb566347-6a8b-4a7e-8df8-a1a46915ea25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:46.513875 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-eb566347-6a8b-4a7e-8df8-a1a46915ea25 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:27:46.515126 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-eb566347-6a8b-4a7e-8df8-a1a46915ea25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:27:46.532127 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:46.584704 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 565/1100] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:27:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:27:46.610594 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4075e2-ed16-471e-8db9-9c1b9aadd449 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:46.718870 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4075e2-ed16-471e-8db9-9c1b9aadd449 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:46.757143 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79308b0a-9123-4fe2-870d-ed01c7ba6ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:46.757876 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79308b0a-9123-4fe2-870d-ed01c7ba6ed3 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:46.758239 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79308b0a-9123-4fe2-870d-ed01c7ba6ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:46.758525 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79308b0a-9123-4fe2-870d-ed01c7ba6ed3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:46.761201 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:46.771518 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79308b0a-9123-4fe2-870d-ed01c7ba6ed3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:27:46.780569 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-79308b0a-9123-4fe2-870d-ed01c7ba6ed3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:27:46.780569 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:27:46.780569 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:27:46.780569 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:27:46.780569 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:27:46.780569 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:27:46.780569 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:27:46.780569 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:27:46.780569 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:27:46.780569 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:27:46.780569 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:27:46.780569 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:27:46.780569 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:27:46.780569 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:27:46.780569 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:27:46.780569 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:27:46.781642 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:27:46.781642 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:27:46.781642 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:27:46.781642 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:27:46.781642 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:27:46.781642 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:27:46.781642 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:27:46.781642 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:27:46.781642 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:27:46.781642 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:27:46.781642 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:27:46.781642 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:27:46.781642 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:27:46.781642 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:27:46.781642 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:27:46.781642 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:27:46.782864 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:27:46.782864 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:27:46.782864 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:27:46.782864 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:27:46.782864 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:27:46.782864 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:27:46.782864 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:27:46.782864 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:27:46.782864 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:27:46.782864 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:27:46.782864 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:27:46.782864 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:27:46.782864 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 536/1101] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:27:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:27:46.787827 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb566347-6a8b-4a7e-8df8-a1a46915ea25 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:46.904055 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb566347-6a8b-4a7e-8df8-a1a46915ea25 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:46.938557 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a36fa-e155-44c4-9c22-e4d752a894a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:46.939201 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a36fa-e155-44c4-9c22-e4d752a894a6 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:46.939513 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a36fa-e155-44c4-9c22-e4d752a894a6 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:46.939759 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a36fa-e155-44c4-9c22-e4d752a894a6 None admin] PATH_INFO: `/v3/roles` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:46.940497 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a36fa-e155-44c4-9c22-e4d752a894a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:46.940804 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a36fa-e155-44c4-9c22-e4d752a894a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:46.942190 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a36fa-e155-44c4-9c22-e4d752a894a6 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:46.950735 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 566/1102] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:27:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:46.957323 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79308b0a-9123-4fe2-870d-ed01c7ba6ed3 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:47.089010 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79308b0a-9123-4fe2-870d-ed01c7ba6ed3 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:47.132341 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f57489b-8bff-4274-8c6d-5eec8671517b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:47.134305 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57489b-8bff-4274-8c6d-5eec8671517b None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:47.134780 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57489b-8bff-4274-8c6d-5eec8671517b None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:47.135240 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57489b-8bff-4274-8c6d-5eec8671517b None admin] PATH_INFO: `/v3/users/7ddd8d7bd5da42438042a14c11698807` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:47.137155 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f57489b-8bff-4274-8c6d-5eec8671517b None admin] RBAC: Authorizing `identity:get_user(user_id=7ddd8d7bd5da42438042a14c11698807)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:47.139401 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f57489b-8bff-4274-8c6d-5eec8671517b None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:47.141822 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 537/1103] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:27:46 2022] GET /identity/v3/users/7ddd8d7bd5da42438042a14c11698807 => generated 285 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:47.147607 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a36fa-e155-44c4-9c22-e4d752a894a6 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:47.163849 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:47.249125 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a36fa-e155-44c4-9c22-e4d752a894a6 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:47.282836 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c7fc8-bcb9-40a4-8da3-48ea9982aca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:47.283477 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c7fc8-bcb9-40a4-8da3-48ea9982aca8 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:47.283763 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c7fc8-bcb9-40a4-8da3-48ea9982aca8 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:47.284044 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c7fc8-bcb9-40a4-8da3-48ea9982aca8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:47.353744 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c7fc8-bcb9-40a4-8da3-48ea9982aca8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:47.355146 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c7fc8-bcb9-40a4-8da3-48ea9982aca8 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:47.370442 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:47.453247 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 567/1104] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:27:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:27:47.460543 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f57489b-8bff-4274-8c6d-5eec8671517b None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:47.524023 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:47.567014 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f57489b-8bff-4274-8c6d-5eec8671517b None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:47.603394 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561947f0-6a88-43b0-9de5-8156d19ba5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:47.604309 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561947f0-6a88-43b0-9de5-8156d19ba5d8 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:47.604553 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561947f0-6a88-43b0-9de5-8156d19ba5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:47.604836 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561947f0-6a88-43b0-9de5-8156d19ba5d8 None admin] PATH_INFO: `/v3/projects/a07e537c2d2e4f3aba0672bb31210209` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:47.606018 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561947f0-6a88-43b0-9de5-8156d19ba5d8 None admin] RBAC: Authorizing `identity:get_project(project_id=a07e537c2d2e4f3aba0672bb31210209)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:47.607545 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561947f0-6a88-43b0-9de5-8156d19ba5d8 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:47.609264 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 538/1105] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:27:47 2022] GET /identity/v3/projects/a07e537c2d2e4f3aba0672bb31210209 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:47.615439 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c7fc8-bcb9-40a4-8da3-48ea9982aca8 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:47.733814 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c7fc8-bcb9-40a4-8da3-48ea9982aca8 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:47.754819 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:47.781045 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac14bd7b-57ee-49ce-a9de-6caccbd499d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:47.781699 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14bd7b-57ee-49ce-a9de-6caccbd499d5 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:47.782059 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14bd7b-57ee-49ce-a9de-6caccbd499d5 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:47.782385 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14bd7b-57ee-49ce-a9de-6caccbd499d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:47.783212 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac14bd7b-57ee-49ce-a9de-6caccbd499d5 None admin] RBAC: Adding query filter params (role.id=00090b1962654604b8e106a05d44d06a, scope.project.id=a07e537c2d2e4f3aba0672bb31210209, user.id=7ddd8d7bd5da42438042a14c11698807) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:47.783527 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac14bd7b-57ee-49ce-a9de-6caccbd499d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:47.785041 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac14bd7b-57ee-49ce-a9de-6caccbd499d5 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:47.793467 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 568/1106] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:27:47 2022] GET /identity/v3/role_assignments?user.id=7ddd8d7bd5da42438042a14c11698807&scope.project.id=a07e537c2d2e4f3aba0672bb31210209&role.id=00090b1962654604b8e106a05d44d06a => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:50.610294 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5879c9-394d-4288-9490-17080d4a3533 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:50.610737 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5879c9-394d-4288-9490-17080d4a3533 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:50.610843 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5879c9-394d-4288-9490-17080d4a3533 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:50.612228 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 539/1107] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:27:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:27:50.617339 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788ec1f-02db-434c-86d2-8532801f7ae7 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:50.617967 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788ec1f-02db-434c-86d2-8532801f7ae7 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:50.617967 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788ec1f-02db-434c-86d2-8532801f7ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:50.635202 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-9788ec1f-02db-434c-86d2-8532801f7ae7 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:27:50.636385 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-9788ec1f-02db-434c-86d2-8532801f7ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:27:50.700362 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 569/1108] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:27:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:27:50.726084 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5879c9-394d-4288-9490-17080d4a3533 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:50.825458 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5879c9-394d-4288-9490-17080d4a3533 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:50.854475 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:50.859211 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ceca6-0e6c-4d20-907f-d0052f49384f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:50.860004 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ceca6-0e6c-4d20-907f-d0052f49384f None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:50.860296 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ceca6-0e6c-4d20-907f-d0052f49384f None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:50.860580 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ceca6-0e6c-4d20-907f-d0052f49384f None admin] PATH_INFO: `/v3/domains/default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:50.861750 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1ceca6-0e6c-4d20-907f-d0052f49384f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:50.863224 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1ceca6-0e6c-4d20-907f-d0052f49384f None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:50.864829 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 540/1109] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:27:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:50.871013 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9788ec1f-02db-434c-86d2-8532801f7ae7 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:50.967776 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9788ec1f-02db-434c-86d2-8532801f7ae7 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:50.976815 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:51.001153 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359fe64-f8ef-4d57-b91e-42806bb3ff24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:51.001815 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359fe64-f8ef-4d57-b91e-42806bb3ff24 None admin] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:51.002101 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359fe64-f8ef-4d57-b91e-42806bb3ff24 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:51.002413 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359fe64-f8ef-4d57-b91e-42806bb3ff24 None admin] PATH_INFO: `/v3/users` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:51.003124 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359fe64-f8ef-4d57-b91e-42806bb3ff24 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:51.004550 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359fe64-f8ef-4d57-b91e-42806bb3ff24 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:51.104318 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 570/1110] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:27:50 2022] POST /identity/v3/users => generated 286 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:27:53.155585 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a3e28-0922-4247-99a4-b4e30c76add9 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:53.156134 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a3e28-0922-4247-99a4-b4e30c76add9 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:53.156134 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a3e28-0922-4247-99a4-b4e30c76add9 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:53.157532 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 541/1111] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:27:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:27:53.162915 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ba271-db88-446c-8bac-b69b3fa22533 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:53.163329 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ba271-db88-446c-8bac-b69b3fa22533 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:53.163475 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ba271-db88-446c-8bac-b69b3fa22533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:53.181468 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-a77ba271-db88-446c-8bac-b69b3fa22533 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:27:53.182678 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-a77ba271-db88-446c-8bac-b69b3fa22533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:27:53.247515 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 571/1112] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:27:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:27:53.271461 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a3e28-0922-4247-99a4-b4e30c76add9 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:53.373085 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a3e28-0922-4247-99a4-b4e30c76add9 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:53.406756 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998949db-6c4c-4c03-8dd1-c8a1187889bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:53.407552 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998949db-6c4c-4c03-8dd1-c8a1187889bd None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:53.407842 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998949db-6c4c-4c03-8dd1-c8a1187889bd None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:53.408126 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998949db-6c4c-4c03-8dd1-c8a1187889bd None admin] PATH_INFO: `/v3/roles/6413bac7cc9a42cf83968dd26a3ccc34` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:53.409609 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998949db-6c4c-4c03-8dd1-c8a1187889bd None admin] RBAC: Authorizing `identity:get_role(role_id=6413bac7cc9a42cf83968dd26a3ccc34)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:53.411023 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998949db-6c4c-4c03-8dd1-c8a1187889bd None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:53.412391 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 542/1113] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:27:53 2022] GET /identity/v3/roles/6413bac7cc9a42cf83968dd26a3ccc34 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:53.418418 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ba271-db88-446c-8bac-b69b3fa22533 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:53.508580 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:53.515203 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ba271-db88-446c-8bac-b69b3fa22533 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:53.548954 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269a257-bf3b-40a0-a2b5-eb7d0ee59a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:53.549809 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269a257-bf3b-40a0-a2b5-eb7d0ee59a09 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:53.550093 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269a257-bf3b-40a0-a2b5-eb7d0ee59a09 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:53.550395 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269a257-bf3b-40a0-a2b5-eb7d0ee59a09 None admin] PATH_INFO: `/v3/users/05c90283c3da49fda2acc9019ce17d26` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:53.563716 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269a257-bf3b-40a0-a2b5-eb7d0ee59a09 None admin] RBAC: Authorizing `identity:get_user(user_id=05c90283c3da49fda2acc9019ce17d26)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:53.566396 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269a257-bf3b-40a0-a2b5-eb7d0ee59a09 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:53.567643 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 572/1114] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:27:53 2022] GET /identity/v3/users/05c90283c3da49fda2acc9019ce17d26 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:53.573697 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998949db-6c4c-4c03-8dd1-c8a1187889bd None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:53.639769 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:53.673108 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998949db-6c4c-4c03-8dd1-c8a1187889bd None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:53.706394 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a215cc6-6ce3-40d2-a4d5-c69c5d2cdbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:53.707042 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a215cc6-6ce3-40d2-a4d5-c69c5d2cdbf1 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:53.707337 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a215cc6-6ce3-40d2-a4d5-c69c5d2cdbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:53.707627 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a215cc6-6ce3-40d2-a4d5-c69c5d2cdbf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:53.774407 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a215cc6-6ce3-40d2-a4d5-c69c5d2cdbf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:53.775968 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a215cc6-6ce3-40d2-a4d5-c69c5d2cdbf1 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:53.839385 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:53.872324 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 543/1115] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:27:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:27:53.878202 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269a257-bf3b-40a0-a2b5-eb7d0ee59a09 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:53.980132 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269a257-bf3b-40a0-a2b5-eb7d0ee59a09 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:54.013922 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c19fc9-bfca-4b7b-8e91-efeba78590b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:54.014797 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c19fc9-bfca-4b7b-8e91-efeba78590b6 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:54.015085 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c19fc9-bfca-4b7b-8e91-efeba78590b6 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:54.015365 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c19fc9-bfca-4b7b-8e91-efeba78590b6 None admin] PATH_INFO: `/v3/projects/a07e537c2d2e4f3aba0672bb31210209` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:54.016539 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c19fc9-bfca-4b7b-8e91-efeba78590b6 None admin] RBAC: Authorizing `identity:get_project(project_id=a07e537c2d2e4f3aba0672bb31210209)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:54.017972 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c19fc9-bfca-4b7b-8e91-efeba78590b6 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:54.019681 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 573/1116] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:27:53 2022] GET /identity/v3/projects/a07e537c2d2e4f3aba0672bb31210209 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:54.025798 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a215cc6-6ce3-40d2-a4d5-c69c5d2cdbf1 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:54.123222 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a215cc6-6ce3-40d2-a4d5-c69c5d2cdbf1 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:54.156221 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3bd176-379d-4b88-9084-9eed531e0741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:54.156866 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3bd176-379d-4b88-9084-9eed531e0741 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:54.157155 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3bd176-379d-4b88-9084-9eed531e0741 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:54.157433 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3bd176-379d-4b88-9084-9eed531e0741 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:54.158284 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3bd176-379d-4b88-9084-9eed531e0741 None admin] RBAC: Adding query filter params (role.id=6413bac7cc9a42cf83968dd26a3ccc34, scope.project.id=a07e537c2d2e4f3aba0672bb31210209, user.id=05c90283c3da49fda2acc9019ce17d26) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:54.158601 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3bd176-379d-4b88-9084-9eed531e0741 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:54.160017 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3bd176-379d-4b88-9084-9eed531e0741 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:54.165887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 544/1117] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:27:54 2022] GET /identity/v3/role_assignments?user.id=05c90283c3da49fda2acc9019ce17d26&scope.project.id=a07e537c2d2e4f3aba0672bb31210209&role.id=6413bac7cc9a42cf83968dd26a3ccc34 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:56.161430 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3a568-e4a6-47c0-bbc8-68f76e277b8c None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:56.161991 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3a568-e4a6-47c0-bbc8-68f76e277b8c None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:56.161991 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3a568-e4a6-47c0-bbc8-68f76e277b8c None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:56.163371 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 574/1118] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:27:56.169126 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb45eeb-f9e9-4f81-a0c7-724081714d37 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:56.169548 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb45eeb-f9e9-4f81-a0c7-724081714d37 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:56.169694 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb45eeb-f9e9-4f81-a0c7-724081714d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:56.186348 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-3fb45eeb-f9e9-4f81-a0c7-724081714d37 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:27:56.187542 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-3fb45eeb-f9e9-4f81-a0c7-724081714d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:27:56.213424 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:56.254039 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 545/1119] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:27:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:27:56.278900 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc3a568-e4a6-47c0-bbc8-68f76e277b8c None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:56.300862 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:56.379376 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc3a568-e4a6-47c0-bbc8-68f76e277b8c None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:56.412465 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1766131f-4214-41f3-8fc6-fa341a7f7e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:56.413251 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766131f-4214-41f3-8fc6-fa341a7f7e64 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:56.413539 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766131f-4214-41f3-8fc6-fa341a7f7e64 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:56.413819 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766131f-4214-41f3-8fc6-fa341a7f7e64 None admin] PATH_INFO: `/v3/roles/6413bac7cc9a42cf83968dd26a3ccc34` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:56.415897 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1766131f-4214-41f3-8fc6-fa341a7f7e64 None admin] RBAC: Authorizing `identity:get_role(role_id=6413bac7cc9a42cf83968dd26a3ccc34)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:56.417269 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1766131f-4214-41f3-8fc6-fa341a7f7e64 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:56.418665 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 575/1120] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:27:56 2022] GET /identity/v3/roles/6413bac7cc9a42cf83968dd26a3ccc34 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:56.424464 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb45eeb-f9e9-4f81-a0c7-724081714d37 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:56.527652 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb45eeb-f9e9-4f81-a0c7-724081714d37 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:56.560144 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88060151-5417-47f2-852e-8949113c3147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:56.561012 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88060151-5417-47f2-852e-8949113c3147 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:56.561298 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88060151-5417-47f2-852e-8949113c3147 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:56.561574 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88060151-5417-47f2-852e-8949113c3147 None admin] PATH_INFO: `/v3/users/05c90283c3da49fda2acc9019ce17d26` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:56.562775 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88060151-5417-47f2-852e-8949113c3147 None admin] RBAC: Authorizing `identity:get_user(user_id=05c90283c3da49fda2acc9019ce17d26)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:56.564213 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88060151-5417-47f2-852e-8949113c3147 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:56.565854 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 546/1121] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:27:56 2022] GET /identity/v3/users/05c90283c3da49fda2acc9019ce17d26 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:56.572256 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1766131f-4214-41f3-8fc6-fa341a7f7e64 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:56.658943 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:56.674517 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1766131f-4214-41f3-8fc6-fa341a7f7e64 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:56.707783 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428961b-65dd-4da5-9d47-fbd2013fab20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:56.708889 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428961b-65dd-4da5-9d47-fbd2013fab20 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:56.709176 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428961b-65dd-4da5-9d47-fbd2013fab20 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:56.709458 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428961b-65dd-4da5-9d47-fbd2013fab20 None admin] PATH_INFO: `/v3/projects/a07e537c2d2e4f3aba0672bb31210209` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:56.710660 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0428961b-65dd-4da5-9d47-fbd2013fab20 None admin] RBAC: Authorizing `identity:get_project(project_id=a07e537c2d2e4f3aba0672bb31210209)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:56.712722 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0428961b-65dd-4da5-9d47-fbd2013fab20 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:56.714455 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 576/1122] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:27:56 2022] GET /identity/v3/projects/a07e537c2d2e4f3aba0672bb31210209 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:56.720508 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88060151-5417-47f2-852e-8949113c3147 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:56.749977 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:56.822893 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88060151-5417-47f2-852e-8949113c3147 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:56.859195 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e56fa26-6232-4e8b-be6e-293b3067a6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:56.860080 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56fa26-6232-4e8b-be6e-293b3067a6e9 None admin] REQUEST_METHOD: `PUT` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:56.860375 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56fa26-6232-4e8b-be6e-293b3067a6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:56.860659 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56fa26-6232-4e8b-be6e-293b3067a6e9 None admin] PATH_INFO: `/v3/projects/a07e537c2d2e4f3aba0672bb31210209/users/05c90283c3da49fda2acc9019ce17d26/roles/6413bac7cc9a42cf83968dd26a3ccc34` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:56.862888 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e56fa26-6232-4e8b-be6e-293b3067a6e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=a07e537c2d2e4f3aba0672bb31210209, user_id=05c90283c3da49fda2acc9019ce17d26, role_id=6413bac7cc9a42cf83968dd26a3ccc34)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:56.864324 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e56fa26-6232-4e8b-be6e-293b3067a6e9 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:56.932794 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 547/1123] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:27:56 2022] PUT /identity/v3/projects/a07e537c2d2e4f3aba0672bb31210209/users/05c90283c3da49fda2acc9019ce17d26/roles/6413bac7cc9a42cf83968dd26a3ccc34 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:27:58.917233 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73d10b-1bf0-4a4e-9bd7-e325aab929ba None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:58.917777 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73d10b-1bf0-4a4e-9bd7-e325aab929ba None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:58.917777 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73d10b-1bf0-4a4e-9bd7-e325aab929ba None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:58.919136 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 577/1124] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:27:58.924169 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c5e74-3e8c-45a1-a68e-c9c2237bfc9a None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:58.924549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c5e74-3e8c-45a1-a68e-c9c2237bfc9a None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:58.924739 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c5e74-3e8c-45a1-a68e-c9c2237bfc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:58.941621 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-d24c5e74-3e8c-45a1-a68e-c9c2237bfc9a None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:27:58.942833 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-d24c5e74-3e8c-45a1-a68e-c9c2237bfc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:27:59.007664 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 548/1125] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:27:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:27:59.030391 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73d10b-1bf0-4a4e-9bd7-e325aab929ba None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:59.130684 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73d10b-1bf0-4a4e-9bd7-e325aab929ba None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:59.172187 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468182bd-d97c-4718-a8a0-d14b77f1f4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:59.172971 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468182bd-d97c-4718-a8a0-d14b77f1f4cc None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:59.173257 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468182bd-d97c-4718-a8a0-d14b77f1f4cc None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:59.173536 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468182bd-d97c-4718-a8a0-d14b77f1f4cc None admin] PATH_INFO: `/v3/roles/6413bac7cc9a42cf83968dd26a3ccc34` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:59.175033 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468182bd-d97c-4718-a8a0-d14b77f1f4cc None admin] RBAC: Authorizing `identity:get_role(role_id=6413bac7cc9a42cf83968dd26a3ccc34)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:59.176439 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468182bd-d97c-4718-a8a0-d14b77f1f4cc None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:59.177800 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 578/1126] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:27:59 2022] GET /identity/v3/roles/6413bac7cc9a42cf83968dd26a3ccc34 => generated 223 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:59.183842 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c5e74-3e8c-45a1-a68e-c9c2237bfc9a None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:59.204221 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:59.280345 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c5e74-3e8c-45a1-a68e-c9c2237bfc9a None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:59.313538 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0f29c-c04c-4162-8ca6-e9a2ad4be0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:59.314417 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0f29c-c04c-4162-8ca6-e9a2ad4be0a9 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:59.314704 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0f29c-c04c-4162-8ca6-e9a2ad4be0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:59.314984 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0f29c-c04c-4162-8ca6-e9a2ad4be0a9 None admin] PATH_INFO: `/v3/users/05c90283c3da49fda2acc9019ce17d26` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:59.316161 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb0f29c-c04c-4162-8ca6-e9a2ad4be0a9 None admin] RBAC: Authorizing `identity:get_user(user_id=05c90283c3da49fda2acc9019ce17d26)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:59.317593 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb0f29c-c04c-4162-8ca6-e9a2ad4be0a9 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:59.319234 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 549/1127] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:27:59 2022] GET /identity/v3/users/05c90283c3da49fda2acc9019ce17d26 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:59.325274 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468182bd-d97c-4718-a8a0-d14b77f1f4cc None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:59.350938 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:59.424676 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468182bd-d97c-4718-a8a0-d14b77f1f4cc None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:59.458308 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b1fbf4-1765-458a-8ab0-24439a4614ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:59.459202 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1fbf4-1765-458a-8ab0-24439a4614ac None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:59.459488 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1fbf4-1765-458a-8ab0-24439a4614ac None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:59.459765 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1fbf4-1765-458a-8ab0-24439a4614ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:59.525807 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b1fbf4-1765-458a-8ab0-24439a4614ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:59.527285 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b1fbf4-1765-458a-8ab0-24439a4614ac None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:59.550319 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:59.623941 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 579/1128] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:27:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:27:59.629829 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0f29c-c04c-4162-8ca6-e9a2ad4be0a9 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:59.717343 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:59.728796 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0f29c-c04c-4162-8ca6-e9a2ad4be0a9 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:59.762254 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc95818-fd5d-4eea-9be8-9bc5e8997d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:59.763114 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc95818-fd5d-4eea-9be8-9bc5e8997d51 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:59.763405 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc95818-fd5d-4eea-9be8-9bc5e8997d51 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:59.763689 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc95818-fd5d-4eea-9be8-9bc5e8997d51 None admin] PATH_INFO: `/v3/projects/a07e537c2d2e4f3aba0672bb31210209` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:59.764873 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc95818-fd5d-4eea-9be8-9bc5e8997d51 None admin] RBAC: Authorizing `identity:get_project(project_id=a07e537c2d2e4f3aba0672bb31210209)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:59.766349 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc95818-fd5d-4eea-9be8-9bc5e8997d51 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:59.768038 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 550/1129] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:27:59 2022] GET /identity/v3/projects/a07e537c2d2e4f3aba0672bb31210209 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:27:59.774745 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b1fbf4-1765-458a-8ab0-24439a4614ac None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:27:59.872216 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b1fbf4-1765-458a-8ab0-24439a4614ac None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:27:59.895233 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:27:59.905938 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b40212-886a-4fab-9cda-966ef67f6011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:27:59.908177 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b40212-886a-4fab-9cda-966ef67f6011 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:27:59.908177 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b40212-886a-4fab-9cda-966ef67f6011 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:27:59.908177 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b40212-886a-4fab-9cda-966ef67f6011 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:27:59.908177 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b40212-886a-4fab-9cda-966ef67f6011 None admin] RBAC: Adding query filter params (role.id=6413bac7cc9a42cf83968dd26a3ccc34, scope.project.id=a07e537c2d2e4f3aba0672bb31210209, user.id=05c90283c3da49fda2acc9019ce17d26) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:27:59.908519 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b40212-886a-4fab-9cda-966ef67f6011 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:27:59.909774 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b40212-886a-4fab-9cda-966ef67f6011 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:27:59.915683 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 580/1130] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:27:59 2022] GET /identity/v3/role_assignments?user.id=05c90283c3da49fda2acc9019ce17d26&scope.project.id=a07e537c2d2e4f3aba0672bb31210209&role.id=6413bac7cc9a42cf83968dd26a3ccc34 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:28:01.995587 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5695c9-14de-43cd-a54f-692946a6ef84 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:01.996195 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5695c9-14de-43cd-a54f-692946a6ef84 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:01.996195 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5695c9-14de-43cd-a54f-692946a6ef84 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:01.997529 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 551/1131] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:28:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:28:02.002760 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef5dbf-c6bd-45e4-9429-6026e8206dc7 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:02.003169 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef5dbf-c6bd-45e4-9429-6026e8206dc7 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:02.003315 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef5dbf-c6bd-45e4-9429-6026e8206dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:02.020135 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-9eef5dbf-c6bd-45e4-9429-6026e8206dc7 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:02.021316 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-9eef5dbf-c6bd-45e4-9429-6026e8206dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:02.086948 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 581/1132] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:28:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:28:02.110071 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5695c9-14de-43cd-a54f-692946a6ef84 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:02.209610 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5695c9-14de-43cd-a54f-692946a6ef84 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:02.242037 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ee911-bf29-4880-9a9e-a1a5ea6fa5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:02.243365 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ee911-bf29-4880-9a9e-a1a5ea6fa5e2 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:02.243651 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ee911-bf29-4880-9a9e-a1a5ea6fa5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:02.243932 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ee911-bf29-4880-9a9e-a1a5ea6fa5e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:02.245109 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ee911-bf29-4880-9a9e-a1a5ea6fa5e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:02.246634 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ee911-bf29-4880-9a9e-a1a5ea6fa5e2 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:02.248179 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 552/1133] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:28:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:28:02.253874 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef5dbf-c6bd-45e4-9429-6026e8206dc7 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:02.353082 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef5dbf-c6bd-45e4-9429-6026e8206dc7 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:02.370332 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:02.387057 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c99f9-9639-4532-8705-106066494d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:02.387712 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c99f9-9639-4532-8705-106066494d35 None admin] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:02.388001 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c99f9-9639-4532-8705-106066494d35 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:02.388282 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c99f9-9639-4532-8705-106066494d35 None admin] PATH_INFO: `/v3/projects` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:02.389001 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9c99f9-9639-4532-8705-106066494d35 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:02.390584 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9c99f9-9639-4532-8705-106066494d35 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:02.453664 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 582/1134] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Jul 5 21:28:02 2022] POST /identity/v3/projects => generated 311 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:04.526635 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82d52e-18ce-4292-bbd3-003e3608b1c7 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:04.527192 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82d52e-18ce-4292-bbd3-003e3608b1c7 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:04.527192 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82d52e-18ce-4292-bbd3-003e3608b1c7 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:04.528564 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 553/1135] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:28:04.533763 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a91cce-fb89-4241-bbe5-089c4395d267 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:04.534218 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a91cce-fb89-4241-bbe5-089c4395d267 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:04.534360 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a91cce-fb89-4241-bbe5-089c4395d267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:04.552072 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-05a91cce-fb89-4241-bbe5-089c4395d267 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:04.553282 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-05a91cce-fb89-4241-bbe5-089c4395d267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:04.619554 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 583/1136] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:28:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:28:04.644110 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b82d52e-18ce-4292-bbd3-003e3608b1c7 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:04.669883 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:04.745136 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b82d52e-18ce-4292-bbd3-003e3608b1c7 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:04.779236 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b20e10c-58f2-4cfb-b852-a9f64881dc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:04.779965 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20e10c-58f2-4cfb-b852-a9f64881dc3b None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:04.780250 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20e10c-58f2-4cfb-b852-a9f64881dc3b None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:04.780529 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20e10c-58f2-4cfb-b852-a9f64881dc3b None admin] PATH_INFO: `/v3/domains/default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:04.781692 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b20e10c-58f2-4cfb-b852-a9f64881dc3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:04.783153 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b20e10c-58f2-4cfb-b852-a9f64881dc3b None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:04.784749 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 554/1137] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:28:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:28:04.791031 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a91cce-fb89-4241-bbe5-089c4395d267 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:04.884218 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:04.887166 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a91cce-fb89-4241-bbe5-089c4395d267 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:04.920221 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e07247b-b8e0-43c5-8f56-66aa06af4c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:04.920884 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07247b-b8e0-43c5-8f56-66aa06af4c55 None admin] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:04.921172 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07247b-b8e0-43c5-8f56-66aa06af4c55 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:04.921450 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07247b-b8e0-43c5-8f56-66aa06af4c55 None admin] PATH_INFO: `/v3/users` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:04.922174 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e07247b-b8e0-43c5-8f56-66aa06af4c55 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:04.923610 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e07247b-b8e0-43c5-8f56-66aa06af4c55 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:05.024221 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 584/1138] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:28:04 2022] POST /identity/v3/users => generated 286 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:07.099280 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab279c-ad2f-44eb-807a-0762de1c1ce2 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:07.099839 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab279c-ad2f-44eb-807a-0762de1c1ce2 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:07.099941 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab279c-ad2f-44eb-807a-0762de1c1ce2 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:07.101238 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 555/1139] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:28:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:28:07.106468 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f693652-50bc-4cd5-a629-33bba2972e38 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:07.106861 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f693652-50bc-4cd5-a629-33bba2972e38 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:07.107037 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f693652-50bc-4cd5-a629-33bba2972e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:07.123596 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-6f693652-50bc-4cd5-a629-33bba2972e38 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:07.124795 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-6f693652-50bc-4cd5-a629-33bba2972e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:07.190121 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 585/1140] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:28:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:28:07.215201 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab279c-ad2f-44eb-807a-0762de1c1ce2 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:07.305782 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:07.315047 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab279c-ad2f-44eb-807a-0762de1c1ce2 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:07.348513 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f950545-7ae7-4a45-ad14-5c32f2b1cd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:07.349342 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f950545-7ae7-4a45-ad14-5c32f2b1cd99 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:07.349580 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f950545-7ae7-4a45-ad14-5c32f2b1cd99 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:07.349858 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f950545-7ae7-4a45-ad14-5c32f2b1cd99 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:07.359749 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f950545-7ae7-4a45-ad14-5c32f2b1cd99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:28:07.367986 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-1f950545-7ae7-4a45-ad14-5c32f2b1cd99 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:28:07.367986 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:28:07.367986 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:28:07.367986 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:28:07.367986 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:28:07.367986 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:28:07.367986 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:28:07.367986 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:28:07.367986 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:28:07.367986 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:28:07.367986 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:28:07.367986 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:28:07.367986 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:28:07.367986 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:28:07.367986 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:28:07.367986 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:28:07.368964 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:28:07.368964 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:28:07.368964 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:28:07.368964 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:28:07.368964 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:28:07.368964 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:28:07.368964 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:28:07.368964 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:28:07.368964 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:28:07.368964 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:28:07.368964 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:28:07.368964 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:28:07.368964 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:28:07.368964 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:28:07.368964 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:28:07.368964 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:28:07.369897 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:28:07.369897 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:28:07.369897 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:28:07.369897 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:28:07.369897 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:28:07.369897 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:28:07.369897 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:28:07.369897 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:28:07.369897 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:28:07.369897 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:28:07.369897 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:28:07.369897 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:28:07.369897 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 556/1141] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:28:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:28:07.375183 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f693652-50bc-4cd5-a629-33bba2972e38 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:07.456686 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:07.471145 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f693652-50bc-4cd5-a629-33bba2972e38 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:07.504818 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda61b7-dd2e-4d2f-baa9-22ccca2b62be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:07.505487 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda61b7-dd2e-4d2f-baa9-22ccca2b62be None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:07.505777 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda61b7-dd2e-4d2f-baa9-22ccca2b62be None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:07.506064 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda61b7-dd2e-4d2f-baa9-22ccca2b62be None admin] PATH_INFO: `/v3/roles` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:07.506892 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bda61b7-dd2e-4d2f-baa9-22ccca2b62be None admin] RBAC: Adding query filter params (name=admin) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:28:07.507204 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bda61b7-dd2e-4d2f-baa9-22ccca2b62be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:07.509193 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bda61b7-dd2e-4d2f-baa9-22ccca2b62be None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:07.517592 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 586/1142] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:28:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:28:07.523267 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f950545-7ae7-4a45-ad14-5c32f2b1cd99 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:07.626310 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f950545-7ae7-4a45-ad14-5c32f2b1cd99 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:07.659650 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc3a97-237f-4f6a-94b9-8abcd7c70036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:07.660524 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc3a97-237f-4f6a-94b9-8abcd7c70036 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:07.660818 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc3a97-237f-4f6a-94b9-8abcd7c70036 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:07.661102 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc3a97-237f-4f6a-94b9-8abcd7c70036 None admin] PATH_INFO: `/v3/users/1732c7fd0da44397a760b585d3aea82a` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:07.674739 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc3a97-237f-4f6a-94b9-8abcd7c70036 None admin] RBAC: Authorizing `identity:get_user(user_id=1732c7fd0da44397a760b585d3aea82a)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:07.676196 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc3a97-237f-4f6a-94b9-8abcd7c70036 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:07.677858 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 557/1143] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:28:07 2022] GET /identity/v3/users/1732c7fd0da44397a760b585d3aea82a => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:28:07.684407 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda61b7-dd2e-4d2f-baa9-22ccca2b62be None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:07.781803 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda61b7-dd2e-4d2f-baa9-22ccca2b62be None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:07.814666 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c99f3-6618-4300-8ae9-86b71c638fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:07.815302 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c99f3-6618-4300-8ae9-86b71c638fde None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:07.815588 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c99f3-6618-4300-8ae9-86b71c638fde None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:07.815870 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c99f3-6618-4300-8ae9-86b71c638fde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:07.832938 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:07.880981 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110c99f3-6618-4300-8ae9-86b71c638fde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:07.882387 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110c99f3-6618-4300-8ae9-86b71c638fde None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:07.984976 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 587/1144] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:28:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:28:07.990908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc3a97-237f-4f6a-94b9-8abcd7c70036 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:08.002999 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:08.089509 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc3a97-237f-4f6a-94b9-8abcd7c70036 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:08.122257 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab79be0-6e43-41cb-941b-529a739d3ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:08.123109 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab79be0-6e43-41cb-941b-529a739d3ce3 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:08.123391 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab79be0-6e43-41cb-941b-529a739d3ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:08.123666 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab79be0-6e43-41cb-941b-529a739d3ce3 None admin] PATH_INFO: `/v3/projects/b00e12ab02134437a317448975f91dad` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:08.124830 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab79be0-6e43-41cb-941b-529a739d3ce3 None admin] RBAC: Authorizing `identity:get_project(project_id=b00e12ab02134437a317448975f91dad)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:08.126289 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab79be0-6e43-41cb-941b-529a739d3ce3 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:08.127970 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 558/1145] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:28:07 2022] GET /identity/v3/projects/b00e12ab02134437a317448975f91dad => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:28:08.134110 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c99f3-6618-4300-8ae9-86b71c638fde None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:08.181866 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:08.230899 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c99f3-6618-4300-8ae9-86b71c638fde None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:08.264234 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5b855-dd98-4647-a808-41e4fc8b3e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:08.264873 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5b855-dd98-4647-a808-41e4fc8b3e0d None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:08.265159 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5b855-dd98-4647-a808-41e4fc8b3e0d None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:08.265438 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5b855-dd98-4647-a808-41e4fc8b3e0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:08.266292 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b5b855-dd98-4647-a808-41e4fc8b3e0d None admin] RBAC: Adding query filter params (role.id=00090b1962654604b8e106a05d44d06a, scope.project.id=b00e12ab02134437a317448975f91dad, user.id=1732c7fd0da44397a760b585d3aea82a) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:28:08.266608 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b5b855-dd98-4647-a808-41e4fc8b3e0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:08.268039 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b5b855-dd98-4647-a808-41e4fc8b3e0d None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:08.273335 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 588/1146] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:28:08 2022] GET /identity/v3/role_assignments?user.id=1732c7fd0da44397a760b585d3aea82a&scope.project.id=b00e12ab02134437a317448975f91dad&role.id=00090b1962654604b8e106a05d44d06a => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:28:10.289052 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419f8d7-cc98-4bda-b0dd-48a0714c63ec None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:10.290112 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419f8d7-cc98-4bda-b0dd-48a0714c63ec None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:10.290112 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419f8d7-cc98-4bda-b0dd-48a0714c63ec None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:10.291564 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 559/1147] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:28:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:28:10.296858 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1cbfe-8da2-48a1-b6bd-d7c265eb372f None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:10.297298 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1cbfe-8da2-48a1-b6bd-d7c265eb372f None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:10.297407 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1cbfe-8da2-48a1-b6bd-d7c265eb372f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:10.314301 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-e3e1cbfe-8da2-48a1-b6bd-d7c265eb372f None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:10.315473 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-e3e1cbfe-8da2-48a1-b6bd-d7c265eb372f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:10.389796 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 589/1148] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:28:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:28:10.413499 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a419f8d7-cc98-4bda-b0dd-48a0714c63ec None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:10.506079 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:10.531752 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a419f8d7-cc98-4bda-b0dd-48a0714c63ec None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:10.570749 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e1f70-bca1-4e44-bf26-7225b362d6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:10.571561 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e1f70-bca1-4e44-bf26-7225b362d6ca None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:10.571853 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e1f70-bca1-4e44-bf26-7225b362d6ca None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:10.572139 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e1f70-bca1-4e44-bf26-7225b362d6ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:10.582832 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e1f70-bca1-4e44-bf26-7225b362d6ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:28:10.592111 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-0e6e1f70-bca1-4e44-bf26-7225b362d6ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:28:10.592111 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:28:10.592111 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:28:10.592111 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:28:10.592111 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:28:10.592111 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:28:10.592111 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:28:10.592111 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:28:10.592111 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:28:10.592111 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:28:10.592111 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:28:10.592111 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:28:10.592111 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:28:10.592111 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:28:10.592111 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:28:10.592111 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:28:10.593225 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:28:10.593225 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:28:10.593225 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:28:10.593225 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:28:10.593225 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:28:10.593225 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:28:10.593225 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:28:10.593225 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:28:10.593225 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:28:10.593225 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:28:10.593225 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:28:10.593225 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:28:10.593225 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:28:10.593225 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:28:10.593225 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:28:10.593225 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:28:10.594254 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:28:10.594254 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:28:10.594254 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:28:10.594254 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:28:10.594254 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:28:10.594254 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:28:10.594254 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:28:10.594254 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:28:10.594254 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:28:10.594254 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:28:10.594254 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:28:10.594254 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:28:10.594254 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 560/1149] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:28:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:28:10.600805 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e1cbfe-8da2-48a1-b6bd-d7c265eb372f None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:10.649892 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:10.714355 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e1cbfe-8da2-48a1-b6bd-d7c265eb372f None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:10.749077 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd42db2-91da-4f2b-bd12-7ee8a777e2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:10.749744 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd42db2-91da-4f2b-bd12-7ee8a777e2cb None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:10.750035 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd42db2-91da-4f2b-bd12-7ee8a777e2cb None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:10.750346 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd42db2-91da-4f2b-bd12-7ee8a777e2cb None admin] PATH_INFO: `/v3/roles` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:10.751099 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd42db2-91da-4f2b-bd12-7ee8a777e2cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:28:10.751409 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd42db2-91da-4f2b-bd12-7ee8a777e2cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:10.752794 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd42db2-91da-4f2b-bd12-7ee8a777e2cb None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:10.763250 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 590/1150] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:28:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:28:10.769110 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e1f70-bca1-4e44-bf26-7225b362d6ca None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:10.871583 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e1f70-bca1-4e44-bf26-7225b362d6ca None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:10.906682 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a21eb5-8147-4eb2-8ead-44a5a74c9d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:10.907563 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a21eb5-8147-4eb2-8ead-44a5a74c9d64 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:10.907851 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a21eb5-8147-4eb2-8ead-44a5a74c9d64 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:10.908130 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a21eb5-8147-4eb2-8ead-44a5a74c9d64 None admin] PATH_INFO: `/v3/users/1732c7fd0da44397a760b585d3aea82a` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:10.909335 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a21eb5-8147-4eb2-8ead-44a5a74c9d64 None admin] RBAC: Authorizing `identity:get_user(user_id=1732c7fd0da44397a760b585d3aea82a)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:10.910821 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a21eb5-8147-4eb2-8ead-44a5a74c9d64 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:10.912471 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 561/1151] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:28:10 2022] GET /identity/v3/users/1732c7fd0da44397a760b585d3aea82a => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:28:10.918739 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd42db2-91da-4f2b-bd12-7ee8a777e2cb None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:11.032711 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd42db2-91da-4f2b-bd12-7ee8a777e2cb None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:11.035960 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:11.071350 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69237985-bd45-4fcb-b5be-261d9630f4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:11.072464 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69237985-bd45-4fcb-b5be-261d9630f4cb None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:11.073028 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69237985-bd45-4fcb-b5be-261d9630f4cb None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:11.073309 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69237985-bd45-4fcb-b5be-261d9630f4cb None admin] PATH_INFO: `/v3/projects/b00e12ab02134437a317448975f91dad` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:11.074529 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69237985-bd45-4fcb-b5be-261d9630f4cb None admin] RBAC: Authorizing `identity:get_project(project_id=b00e12ab02134437a317448975f91dad)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:11.075976 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69237985-bd45-4fcb-b5be-261d9630f4cb None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:11.077704 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 591/1152] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:28:10 2022] GET /identity/v3/projects/b00e12ab02134437a317448975f91dad => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:28:11.083984 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a21eb5-8147-4eb2-8ead-44a5a74c9d64 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:11.093534 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:11.182627 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a21eb5-8147-4eb2-8ead-44a5a74c9d64 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:11.215733 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9981b8-eeb2-4123-b343-d67194d12385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:11.216624 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9981b8-eeb2-4123-b343-d67194d12385 None admin] REQUEST_METHOD: `PUT` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:11.216916 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9981b8-eeb2-4123-b343-d67194d12385 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:11.217200 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9981b8-eeb2-4123-b343-d67194d12385 None admin] PATH_INFO: `/v3/projects/b00e12ab02134437a317448975f91dad/users/1732c7fd0da44397a760b585d3aea82a/roles/00090b1962654604b8e106a05d44d06a` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:11.219221 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9981b8-eeb2-4123-b343-d67194d12385 None admin] RBAC: Authorizing `identity:create_grant(project_id=b00e12ab02134437a317448975f91dad, user_id=1732c7fd0da44397a760b585d3aea82a, role_id=00090b1962654604b8e106a05d44d06a)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:11.220684 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9981b8-eeb2-4123-b343-d67194d12385 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:11.293886 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 562/1153] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:28:11 2022] PUT /identity/v3/projects/b00e12ab02134437a317448975f91dad/users/1732c7fd0da44397a760b585d3aea82a/roles/00090b1962654604b8e106a05d44d06a => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:28:13.317432 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7dc92-cbfc-426c-9abd-ca49fb2fc350 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:13.317970 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7dc92-cbfc-426c-9abd-ca49fb2fc350 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:13.317970 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7dc92-cbfc-426c-9abd-ca49fb2fc350 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:13.319412 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 592/1154] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:28:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:28:13.324704 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6e96b-697e-4d4e-8b9a-3ba5e796cea4 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:13.325098 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6e96b-697e-4d4e-8b9a-3ba5e796cea4 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:13.325269 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6e96b-697e-4d4e-8b9a-3ba5e796cea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:13.342586 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-33e6e96b-697e-4d4e-8b9a-3ba5e796cea4 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:13.343768 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-33e6e96b-697e-4d4e-8b9a-3ba5e796cea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:13.401903 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:13.409131 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 563/1155] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:28:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:28:13.433623 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7dc92-cbfc-426c-9abd-ca49fb2fc350 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:13.534337 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7dc92-cbfc-426c-9abd-ca49fb2fc350 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:13.567088 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe326ae-bbe4-4022-b267-ea6290864886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:13.567927 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe326ae-bbe4-4022-b267-ea6290864886 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:13.568170 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe326ae-bbe4-4022-b267-ea6290864886 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:13.568452 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe326ae-bbe4-4022-b267-ea6290864886 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:13.578992 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe326ae-bbe4-4022-b267-ea6290864886 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:28:13.587628 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-ffe326ae-bbe4-4022-b267-ea6290864886 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:28:13.587628 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:28:13.587628 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:28:13.587628 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:28:13.587628 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:28:13.587628 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:28:13.587628 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:28:13.587628 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:28:13.587628 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:28:13.587628 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:28:13.587628 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:28:13.587628 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:28:13.587628 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:28:13.587628 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:28:13.587628 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:28:13.587628 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:28:13.588724 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:28:13.588724 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:28:13.588724 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:28:13.588724 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:28:13.588724 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:28:13.588724 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:28:13.588724 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:28:13.588724 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:28:13.588724 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:28:13.588724 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:28:13.588724 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:28:13.588724 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:28:13.588724 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:28:13.588724 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:28:13.588724 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:28:13.588724 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:28:13.589653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:28:13.589653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:28:13.589653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:28:13.589653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:28:13.589653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:28:13.589653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:28:13.589653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:28:13.589653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:28:13.589653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:28:13.589653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:28:13.589653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:28:13.589653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:28:13.589653 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 593/1156] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:28:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:28:13.594850 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e6e96b-697e-4d4e-8b9a-3ba5e796cea4 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:13.691343 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e6e96b-697e-4d4e-8b9a-3ba5e796cea4 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:13.725051 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fdf56a-3cce-45f3-8ce7-151eb88412fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:13.725721 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdf56a-3cce-45f3-8ce7-151eb88412fd None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:13.726011 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdf56a-3cce-45f3-8ce7-151eb88412fd None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:13.726324 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdf56a-3cce-45f3-8ce7-151eb88412fd None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:13.727123 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fdf56a-3cce-45f3-8ce7-151eb88412fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:28:13.727449 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fdf56a-3cce-45f3-8ce7-151eb88412fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:13.728820 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fdf56a-3cce-45f3-8ce7-151eb88412fd None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:13.736665 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 564/1157] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:28:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:28:13.742288 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe326ae-bbe4-4022-b267-ea6290864886 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:13.773510 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:13.842070 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe326ae-bbe4-4022-b267-ea6290864886 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:13.874458 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd39e73-3b6d-4749-b62a-6e63a8b301b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:13.875311 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd39e73-3b6d-4749-b62a-6e63a8b301b8 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:13.875597 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd39e73-3b6d-4749-b62a-6e63a8b301b8 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:13.875880 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd39e73-3b6d-4749-b62a-6e63a8b301b8 None admin] PATH_INFO: `/v3/users/1732c7fd0da44397a760b585d3aea82a` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:13.877053 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd39e73-3b6d-4749-b62a-6e63a8b301b8 None admin] RBAC: Authorizing `identity:get_user(user_id=1732c7fd0da44397a760b585d3aea82a)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:13.878524 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd39e73-3b6d-4749-b62a-6e63a8b301b8 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:13.880138 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 594/1158] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:28:13 2022] GET /identity/v3/users/1732c7fd0da44397a760b585d3aea82a => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:28:13.886296 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fdf56a-3cce-45f3-8ce7-151eb88412fd None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:13.943739 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:13.985243 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fdf56a-3cce-45f3-8ce7-151eb88412fd None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:14.017851 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c5e72-cbbb-4509-846d-083d349ac597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:14.018522 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c5e72-cbbb-4509-846d-083d349ac597 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:14.018818 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c5e72-cbbb-4509-846d-083d349ac597 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:14.019104 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c5e72-cbbb-4509-846d-083d349ac597 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:14.084500 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c5e72-cbbb-4509-846d-083d349ac597 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:14.085950 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c5e72-cbbb-4509-846d-083d349ac597 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:14.141030 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:14.182810 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 565/1159] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:28:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:28:14.188698 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd39e73-3b6d-4749-b62a-6e63a8b301b8 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:14.284416 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:14.287299 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd39e73-3b6d-4749-b62a-6e63a8b301b8 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:14.321555 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b81f179-db27-4f05-9a9a-a61c6594501f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:14.322508 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81f179-db27-4f05-9a9a-a61c6594501f None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:14.322797 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81f179-db27-4f05-9a9a-a61c6594501f None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:14.323080 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81f179-db27-4f05-9a9a-a61c6594501f None admin] PATH_INFO: `/v3/projects/b00e12ab02134437a317448975f91dad` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:14.324294 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b81f179-db27-4f05-9a9a-a61c6594501f None admin] RBAC: Authorizing `identity:get_project(project_id=b00e12ab02134437a317448975f91dad)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:14.325738 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b81f179-db27-4f05-9a9a-a61c6594501f None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:14.327474 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 595/1160] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:28:14 2022] GET /identity/v3/projects/b00e12ab02134437a317448975f91dad => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:28:14.333558 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c5e72-cbbb-4509-846d-083d349ac597 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:14.431747 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c5e72-cbbb-4509-846d-083d349ac597 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:14.472496 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b0641-3fb0-49a6-a059-50ba57e381d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:14.473147 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b0641-3fb0-49a6-a059-50ba57e381d1 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:14.473435 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b0641-3fb0-49a6-a059-50ba57e381d1 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:14.473717 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b0641-3fb0-49a6-a059-50ba57e381d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:14.474569 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57b0641-3fb0-49a6-a059-50ba57e381d1 None admin] RBAC: Adding query filter params (role.id=00090b1962654604b8e106a05d44d06a, scope.project.id=b00e12ab02134437a317448975f91dad, user.id=1732c7fd0da44397a760b585d3aea82a) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:28:14.474887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57b0641-3fb0-49a6-a059-50ba57e381d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:14.476326 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57b0641-3fb0-49a6-a059-50ba57e381d1 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:14.482214 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 566/1161] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:28:14 2022] GET /identity/v3/role_assignments?user.id=1732c7fd0da44397a760b585d3aea82a&scope.project.id=b00e12ab02134437a317448975f91dad&role.id=00090b1962654604b8e106a05d44d06a => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:28:16.511308 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af570d50-f067-4326-ac34-d186a71f1e8e None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:16.511879 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af570d50-f067-4326-ac34-d186a71f1e8e None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:16.511879 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af570d50-f067-4326-ac34-d186a71f1e8e None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:16.513226 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 596/1162] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:28:16.518361 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c56635-b693-4868-962e-fc8df3115946 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:16.518779 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c56635-b693-4868-962e-fc8df3115946 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:16.518928 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c56635-b693-4868-962e-fc8df3115946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:16.535493 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-91c56635-b693-4868-962e-fc8df3115946 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:16.536674 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-91c56635-b693-4868-962e-fc8df3115946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:16.552717 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:16.602752 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 567/1163] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:28:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:28:16.625755 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af570d50-f067-4326-ac34-d186a71f1e8e None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:16.725933 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af570d50-f067-4326-ac34-d186a71f1e8e None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:16.760358 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc822ad-8c6e-497b-9507-23b03a4b8b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:16.760994 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc822ad-8c6e-497b-9507-23b03a4b8b7b None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:16.761284 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc822ad-8c6e-497b-9507-23b03a4b8b7b None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:16.761613 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc822ad-8c6e-497b-9507-23b03a4b8b7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:16.799835 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:16.831697 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc822ad-8c6e-497b-9507-23b03a4b8b7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:16.833166 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc822ad-8c6e-497b-9507-23b03a4b8b7b None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:16.929446 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 597/1164] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:28:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:28:16.935555 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c56635-b693-4868-962e-fc8df3115946 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:17.032338 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c56635-b693-4868-962e-fc8df3115946 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:17.065573 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa196b1-81be-42b3-a64f-d4066a2f04a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:17.066389 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa196b1-81be-42b3-a64f-d4066a2f04a5 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:17.066681 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa196b1-81be-42b3-a64f-d4066a2f04a5 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:17.066964 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa196b1-81be-42b3-a64f-d4066a2f04a5 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:17.074168 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa196b1-81be-42b3-a64f-d4066a2f04a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:17.075628 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa196b1-81be-42b3-a64f-d4066a2f04a5 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:17.089936 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-7aa196b1-81be-42b3-a64f-d4066a2f04a5 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 05 21:28:17.089936 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:28:17.089936 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 05 21:28:17.089936 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 05 21:28:17.089936 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:28:17.089936 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:28:17.089936 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:28:17.089936 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:28:17.089936 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 05 21:28:17.089936 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:28:17.089936 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:28:17.089936 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:28:17.089936 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:28:17.089936 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:28:17.089936 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:28:17.089936 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:28:17.089936 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:28:17.091203 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:28:17.091203 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:28:17.091203 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:28:17.091203 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:28:17.091203 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:28:17.091203 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:28:17.091203 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:28:17.091203 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:28:17.091203 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:28:17.091203 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:28:17.091203 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:28:17.091203 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:28:17.091203 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:28:17.091203 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:28:17.091203 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:28:17.091203 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:28:17.092266 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:28:17.092266 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:28:17.092266 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:28:17.092266 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:28:17.092266 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:28:17.092266 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:28:17.092266 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:28:17.092266 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:28:17.092266 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:28:17.092266 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:28:17.092266 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 05 21:28:17.092266 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:28:17.092266 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 05 21:28:17.092266 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:28:17.092266 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 568/1165] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Jul 5 21:28:16 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:28:17.096977 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc822ad-8c6e-497b-9507-23b03a4b8b7b None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:17.162949 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:17.195112 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc822ad-8c6e-497b-9507-23b03a4b8b7b None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:17.228988 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34748f75-0edd-48c6-87b9-87a72061ce37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:17.229632 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34748f75-0edd-48c6-87b9-87a72061ce37 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:17.229918 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34748f75-0edd-48c6-87b9-87a72061ce37 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:17.230228 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34748f75-0edd-48c6-87b9-87a72061ce37 None admin] PATH_INFO: `/v3/domains` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:17.230944 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34748f75-0edd-48c6-87b9-87a72061ce37 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:28:17.231253 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34748f75-0edd-48c6-87b9-87a72061ce37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:17.232618 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34748f75-0edd-48c6-87b9-87a72061ce37 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:17.239615 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 598/1166] 10.222.0.30 () {56 vars in 1115 bytes} [Tue Jul 5 21:28:17 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:28:19.243740 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111b5e4-de25-4153-831b-753f7a1e6923 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:19.244291 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111b5e4-de25-4153-831b-753f7a1e6923 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:19.244291 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111b5e4-de25-4153-831b-753f7a1e6923 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:19.245679 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 569/1167] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:28:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:28:19.250809 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f50c0-34a8-43ae-9474-045dabfbcdbc None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:19.251210 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f50c0-34a8-43ae-9474-045dabfbcdbc None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:19.251372 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f50c0-34a8-43ae-9474-045dabfbcdbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:19.268436 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-4f0f50c0-34a8-43ae-9474-045dabfbcdbc None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:19.269621 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-4f0f50c0-34a8-43ae-9474-045dabfbcdbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:19.336002 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 599/1168] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:28:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:28:19.359073 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d111b5e4-de25-4153-831b-753f7a1e6923 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:19.374834 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:19.460830 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d111b5e4-de25-4153-831b-753f7a1e6923 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:19.494597 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd9b55-1eac-4ac9-b335-276454a0e038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:19.495194 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd9b55-1eac-4ac9-b335-276454a0e038 None admin] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:19.495482 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd9b55-1eac-4ac9-b335-276454a0e038 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:19.495763 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd9b55-1eac-4ac9-b335-276454a0e038 None admin] PATH_INFO: `/v3/domains` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:19.496504 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfd9b55-1eac-4ac9-b335-276454a0e038 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:19.497869 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfd9b55-1eac-4ac9-b335-276454a0e038 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:19.568261 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 570/1169] 10.222.0.30 () {60 vars in 1138 bytes} [Tue Jul 5 21:28:19 2022] POST /identity/v3/domains => generated 267 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:28:21.598879 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1310fc0-170f-4809-8b41-58d1353d0264 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:21.599326 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1310fc0-170f-4809-8b41-58d1353d0264 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:21.599439 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1310fc0-170f-4809-8b41-58d1353d0264 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:21.600815 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 600/1170] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:28:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:28:21.606318 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85302db1-e9d5-4f19-99a2-07fbce6e4180 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:21.606764 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85302db1-e9d5-4f19-99a2-07fbce6e4180 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:21.606891 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85302db1-e9d5-4f19-99a2-07fbce6e4180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:21.623846 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-85302db1-e9d5-4f19-99a2-07fbce6e4180 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:21.625053 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-85302db1-e9d5-4f19-99a2-07fbce6e4180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:21.689873 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 571/1171] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:28:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:28:21.714498 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1310fc0-170f-4809-8b41-58d1353d0264 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:21.774676 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:21.812380 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1310fc0-170f-4809-8b41-58d1353d0264 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:21.845518 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17616b-72f6-4b94-a7ae-70b4cff3c83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:21.846341 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17616b-72f6-4b94-a7ae-70b4cff3c83a None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:21.846621 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17616b-72f6-4b94-a7ae-70b4cff3c83a None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:21.846897 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17616b-72f6-4b94-a7ae-70b4cff3c83a None admin] PATH_INFO: `/v3/domains/00d09c139dff4132b492b9bf95900287` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:21.857325 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da17616b-72f6-4b94-a7ae-70b4cff3c83a None admin] RBAC: Authorizing `identity:get_domain(domain_id=00d09c139dff4132b492b9bf95900287)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:21.858795 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da17616b-72f6-4b94-a7ae-70b4cff3c83a None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:21.860400 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 601/1172] 10.222.0.30 () {56 vars in 1183 bytes} [Tue Jul 5 21:28:21 2022] GET /identity/v3/domains/00d09c139dff4132b492b9bf95900287 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:28:21.866381 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85302db1-e9d5-4f19-99a2-07fbce6e4180 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:21.869172 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:21.965208 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85302db1-e9d5-4f19-99a2-07fbce6e4180 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:21.998782 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5725164-151a-4347-973c-d60ba6913d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:21.999437 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5725164-151a-4347-973c-d60ba6913d7f None admin] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:21.999730 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5725164-151a-4347-973c-d60ba6913d7f None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:22.000015 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5725164-151a-4347-973c-d60ba6913d7f None admin] PATH_INFO: `/v3/projects` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:22.000730 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5725164-151a-4347-973c-d60ba6913d7f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:22.002190 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5725164-151a-4347-973c-d60ba6913d7f None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:22.111204 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 572/1173] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Jul 5 21:28:21 2022] POST /identity/v3/projects => generated 361 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:28:24.192776 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf0337b-ac1b-409e-8a88-2380ac3c11b5 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:24.193333 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf0337b-ac1b-409e-8a88-2380ac3c11b5 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:24.193333 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf0337b-ac1b-409e-8a88-2380ac3c11b5 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:24.194725 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 602/1174] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:28:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:28:24.200569 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec03b08-a57d-4e50-b9fd-7f87abe62bf5 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:24.200957 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec03b08-a57d-4e50-b9fd-7f87abe62bf5 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:24.201145 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec03b08-a57d-4e50-b9fd-7f87abe62bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:24.218702 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-5ec03b08-a57d-4e50-b9fd-7f87abe62bf5 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:24.219942 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-5ec03b08-a57d-4e50-b9fd-7f87abe62bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:24.268439 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:24.285745 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 573/1175] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:28:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:28:24.310482 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf0337b-ac1b-409e-8a88-2380ac3c11b5 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:24.410101 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf0337b-ac1b-409e-8a88-2380ac3c11b5 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:24.431940 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:24.443001 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4493acb5-8156-451d-8374-c79cd41016d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:24.443788 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493acb5-8156-451d-8374-c79cd41016d0 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:24.444073 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493acb5-8156-451d-8374-c79cd41016d0 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:24.444347 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493acb5-8156-451d-8374-c79cd41016d0 None admin] PATH_INFO: `/v3/domains/00d09c139dff4132b492b9bf95900287` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:24.445506 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4493acb5-8156-451d-8374-c79cd41016d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=00d09c139dff4132b492b9bf95900287)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:24.447636 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4493acb5-8156-451d-8374-c79cd41016d0 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:24.449244 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 603/1176] 10.222.0.30 () {56 vars in 1183 bytes} [Tue Jul 5 21:28:24 2022] GET /identity/v3/domains/00d09c139dff4132b492b9bf95900287 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:28:24.454965 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec03b08-a57d-4e50-b9fd-7f87abe62bf5 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:24.556797 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec03b08-a57d-4e50-b9fd-7f87abe62bf5 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:24.590876 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f4e6c-b3f0-4078-aeeb-8a78c2c1803a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:24.591548 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f4e6c-b3f0-4078-aeeb-8a78c2c1803a None admin] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:24.591838 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f4e6c-b3f0-4078-aeeb-8a78c2c1803a None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:24.592119 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f4e6c-b3f0-4078-aeeb-8a78c2c1803a None admin] PATH_INFO: `/v3/users` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:24.592823 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f4e6c-b3f0-4078-aeeb-8a78c2c1803a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:24.594372 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f4e6c-b3f0-4078-aeeb-8a78c2c1803a None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:24.675107 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 574/1177] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:28:24 2022] POST /identity/v3/users => generated 311 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:28:26.753048 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593cdf45-f0e1-4882-be71-147c7c6f49c8 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:26.753565 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593cdf45-f0e1-4882-be71-147c7c6f49c8 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:26.753681 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593cdf45-f0e1-4882-be71-147c7c6f49c8 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:26.755024 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 604/1178] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:28:26.760843 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f995a-483d-448a-8019-9eed616e657e None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:26.761284 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f995a-483d-448a-8019-9eed616e657e None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:26.761384 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f995a-483d-448a-8019-9eed616e657e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:26.778461 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-478f995a-483d-448a-8019-9eed616e657e None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:26.779647 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-478f995a-483d-448a-8019-9eed616e657e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:26.812846 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:26.845330 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 575/1179] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:28:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:28:26.869448 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593cdf45-f0e1-4882-be71-147c7c6f49c8 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:26.969044 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593cdf45-f0e1-4882-be71-147c7c6f49c8 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:27.001467 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386d480-2f9b-4823-9362-b5da1290b26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:27.002274 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386d480-2f9b-4823-9362-b5da1290b26b None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:27.002563 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386d480-2f9b-4823-9362-b5da1290b26b None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:27.002843 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386d480-2f9b-4823-9362-b5da1290b26b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:27.013694 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386d480-2f9b-4823-9362-b5da1290b26b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:28:27.021358 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-5386d480-2f9b-4823-9362-b5da1290b26b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:28:27.021358 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:28:27.021358 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:28:27.021358 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:28:27.021358 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:28:27.021358 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:28:27.021358 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:28:27.021358 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:28:27.021358 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:28:27.021358 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:28:27.021358 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:28:27.021358 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:28:27.021358 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:28:27.021358 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:28:27.021358 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:28:27.021358 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:28:27.022484 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:28:27.022484 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:28:27.022484 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:28:27.022484 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:28:27.022484 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:28:27.022484 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:28:27.022484 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:28:27.022484 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:28:27.022484 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:28:27.022484 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:28:27.022484 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:28:27.022484 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:28:27.022484 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:28:27.022484 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:28:27.022484 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:28:27.022484 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:28:27.023539 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:28:27.023539 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:28:27.023539 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:28:27.023539 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:28:27.023539 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:28:27.023539 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:28:27.023539 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:28:27.023539 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:28:27.023539 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:28:27.023539 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:28:27.023539 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:28:27.023539 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:28:27.023539 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 605/1180] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:28:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:28:27.028694 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f995a-483d-448a-8019-9eed616e657e None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:27.126226 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f995a-483d-448a-8019-9eed616e657e None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:27.159688 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc8be0-0920-43d0-bb7f-1d3c23998896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:27.160373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc8be0-0920-43d0-bb7f-1d3c23998896 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:27.160668 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc8be0-0920-43d0-bb7f-1d3c23998896 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:27.160954 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc8be0-0920-43d0-bb7f-1d3c23998896 None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:27.161715 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc8be0-0920-43d0-bb7f-1d3c23998896 None admin] RBAC: Adding query filter params (name=admin) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:28:27.162034 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc8be0-0920-43d0-bb7f-1d3c23998896 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:27.163467 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc8be0-0920-43d0-bb7f-1d3c23998896 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:27.171999 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 576/1181] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:28:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:28:27.177786 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386d480-2f9b-4823-9362-b5da1290b26b None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:27.227092 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:27.276188 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386d480-2f9b-4823-9362-b5da1290b26b None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:27.310019 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efae34a-962a-499d-9a80-d378a19bddcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:27.310906 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efae34a-962a-499d-9a80-d378a19bddcd None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:27.311194 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efae34a-962a-499d-9a80-d378a19bddcd None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:27.311468 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efae34a-962a-499d-9a80-d378a19bddcd None admin] PATH_INFO: `/v3/users/b7b064bc7459491c829d6fb16fbb0822` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:27.364525 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efae34a-962a-499d-9a80-d378a19bddcd None admin] RBAC: Authorizing `identity:get_user(user_id=b7b064bc7459491c829d6fb16fbb0822)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:27.365985 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efae34a-962a-499d-9a80-d378a19bddcd None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:27.367711 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 606/1182] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:28:27 2022] GET /identity/v3/users/b7b064bc7459491c829d6fb16fbb0822 => generated 311 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:28:27.374097 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc8be0-0920-43d0-bb7f-1d3c23998896 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:27.405318 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:27.474718 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc8be0-0920-43d0-bb7f-1d3c23998896 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:27.508722 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7df4c9-64d6-4dcb-af11-eb11a57a6a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:27.509685 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7df4c9-64d6-4dcb-af11-eb11a57a6a29 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:27.509978 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7df4c9-64d6-4dcb-af11-eb11a57a6a29 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:27.510295 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7df4c9-64d6-4dcb-af11-eb11a57a6a29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:27.576186 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7df4c9-64d6-4dcb-af11-eb11a57a6a29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:27.577655 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7df4c9-64d6-4dcb-af11-eb11a57a6a29 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:27.607597 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:27.674660 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 577/1183] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:28:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 05 21:28:27.680511 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efae34a-962a-499d-9a80-d378a19bddcd None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:27.779372 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efae34a-962a-499d-9a80-d378a19bddcd None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:27.789264 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:27.814299 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c75970-e424-41ad-9f19-e5bf919b23e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:27.815170 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c75970-e424-41ad-9f19-e5bf919b23e3 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:27.815458 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c75970-e424-41ad-9f19-e5bf919b23e3 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:27.815751 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c75970-e424-41ad-9f19-e5bf919b23e3 None admin] PATH_INFO: `/v3/projects/3c95ed974c054c60b11eaa4cd9e744d6` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:27.816917 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c75970-e424-41ad-9f19-e5bf919b23e3 None admin] RBAC: Authorizing `identity:get_project(project_id=3c95ed974c054c60b11eaa4cd9e744d6)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:27.818420 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c75970-e424-41ad-9f19-e5bf919b23e3 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:27.820099 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 607/1184] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:28:27 2022] GET /identity/v3/projects/3c95ed974c054c60b11eaa4cd9e744d6 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:28:27.826266 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7df4c9-64d6-4dcb-af11-eb11a57a6a29 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:27.923834 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7df4c9-64d6-4dcb-af11-eb11a57a6a29 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:27.952163 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:27.956887 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36fa23-2d80-4191-844a-4ad3aea8a35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:27.957543 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36fa23-2d80-4191-844a-4ad3aea8a35c None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:27.957834 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36fa23-2d80-4191-844a-4ad3aea8a35c None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:27.958118 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36fa23-2d80-4191-844a-4ad3aea8a35c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:27.958978 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36fa23-2d80-4191-844a-4ad3aea8a35c None admin] RBAC: Adding query filter params (role.id=00090b1962654604b8e106a05d44d06a, scope.project.id=3c95ed974c054c60b11eaa4cd9e744d6, user.id=b7b064bc7459491c829d6fb16fbb0822) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:28:27.959556 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36fa23-2d80-4191-844a-4ad3aea8a35c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:27.963395 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36fa23-2d80-4191-844a-4ad3aea8a35c None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:27.967169 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 578/1185] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:28:27 2022] GET /identity/v3/role_assignments?user.id=b7b064bc7459491c829d6fb16fbb0822&scope.project.id=3c95ed974c054c60b11eaa4cd9e744d6&role.id=00090b1962654604b8e106a05d44d06a => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:28:29.958677 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27516e-008e-4133-bfa3-f4f41f270f4c None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:29.959210 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27516e-008e-4133-bfa3-f4f41f270f4c None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:29.959210 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27516e-008e-4133-bfa3-f4f41f270f4c None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:29.960848 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 608/1186] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:28:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:28:29.966281 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af18bd-9a20-4155-84c8-9de973aa5a4d None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:29.966714 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af18bd-9a20-4155-84c8-9de973aa5a4d None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:29.966847 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af18bd-9a20-4155-84c8-9de973aa5a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:29.983600 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-39af18bd-9a20-4155-84c8-9de973aa5a4d None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:29.984778 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-39af18bd-9a20-4155-84c8-9de973aa5a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:30.050767 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 579/1187] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:28:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:28:30.074853 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd27516e-008e-4133-bfa3-f4f41f270f4c None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:30.174874 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd27516e-008e-4133-bfa3-f4f41f270f4c None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:30.207748 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10599cd-f8ae-4af7-b435-5002b454c8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:30.208518 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10599cd-f8ae-4af7-b435-5002b454c8d7 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:30.208849 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10599cd-f8ae-4af7-b435-5002b454c8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:30.209078 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10599cd-f8ae-4af7-b435-5002b454c8d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:30.219224 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10599cd-f8ae-4af7-b435-5002b454c8d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:28:30.226766 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-e10599cd-f8ae-4af7-b435-5002b454c8d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:28:30.226766 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:28:30.226766 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:28:30.226766 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:28:30.226766 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:28:30.226766 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:28:30.226766 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:28:30.226766 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:28:30.226766 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:28:30.226766 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:28:30.226766 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:28:30.226766 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:28:30.226766 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:28:30.226766 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:28:30.226766 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:28:30.226766 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:28:30.228506 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:28:30.228506 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:28:30.228506 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:28:30.228506 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:28:30.228506 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:28:30.228506 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:28:30.228506 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:28:30.228506 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:28:30.228506 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:28:30.228506 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:28:30.228506 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:28:30.228506 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:28:30.228506 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:28:30.228506 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:28:30.228506 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:28:30.228506 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:28:30.229358 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:28:30.229358 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:28:30.229358 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:28:30.229358 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:28:30.229358 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:28:30.229358 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:28:30.229358 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:28:30.229358 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:28:30.229358 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:28:30.229358 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:28:30.229358 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:28:30.229358 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:28:30.229358 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 609/1188] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:28:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:28:30.234537 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af18bd-9a20-4155-84c8-9de973aa5a4d None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:30.330260 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af18bd-9a20-4155-84c8-9de973aa5a4d None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:30.355299 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:30.363612 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2991b838-08e3-4d9f-9689-db89c282eec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:30.364275 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991b838-08e3-4d9f-9689-db89c282eec5 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:30.364561 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991b838-08e3-4d9f-9689-db89c282eec5 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:30.364841 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991b838-08e3-4d9f-9689-db89c282eec5 None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:30.365580 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2991b838-08e3-4d9f-9689-db89c282eec5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:28:30.365889 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2991b838-08e3-4d9f-9689-db89c282eec5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:30.367291 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2991b838-08e3-4d9f-9689-db89c282eec5 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:30.375634 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 580/1189] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:28:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:28:30.381629 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10599cd-f8ae-4af7-b435-5002b454c8d7 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:30.417029 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:30.480722 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10599cd-f8ae-4af7-b435-5002b454c8d7 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:30.513631 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cbea0f-6df5-49e3-822b-6a19b40dffae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:30.514518 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbea0f-6df5-49e3-822b-6a19b40dffae None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:30.514805 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbea0f-6df5-49e3-822b-6a19b40dffae None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:30.515084 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbea0f-6df5-49e3-822b-6a19b40dffae None admin] PATH_INFO: `/v3/users/b7b064bc7459491c829d6fb16fbb0822` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:30.516267 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cbea0f-6df5-49e3-822b-6a19b40dffae None admin] RBAC: Authorizing `identity:get_user(user_id=b7b064bc7459491c829d6fb16fbb0822)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:30.517707 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cbea0f-6df5-49e3-822b-6a19b40dffae None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:30.519345 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 610/1190] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:28:30 2022] GET /identity/v3/users/b7b064bc7459491c829d6fb16fbb0822 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:28:30.525789 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2991b838-08e3-4d9f-9689-db89c282eec5 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:30.623782 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2991b838-08e3-4d9f-9689-db89c282eec5 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:30.656473 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5c61c-9d5d-445d-aaa1-44a9d0527f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:30.657330 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5c61c-9d5d-445d-aaa1-44a9d0527f31 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:30.657620 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5c61c-9d5d-445d-aaa1-44a9d0527f31 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:30.657901 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5c61c-9d5d-445d-aaa1-44a9d0527f31 None admin] PATH_INFO: `/v3/projects/3c95ed974c054c60b11eaa4cd9e744d6` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:30.659108 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc5c61c-9d5d-445d-aaa1-44a9d0527f31 None admin] RBAC: Authorizing `identity:get_project(project_id=3c95ed974c054c60b11eaa4cd9e744d6)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:30.660556 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc5c61c-9d5d-445d-aaa1-44a9d0527f31 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:30.662266 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 581/1191] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:28:30 2022] GET /identity/v3/projects/3c95ed974c054c60b11eaa4cd9e744d6 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:28:30.668825 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cbea0f-6df5-49e3-822b-6a19b40dffae None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:30.765767 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cbea0f-6df5-49e3-822b-6a19b40dffae None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:30.768012 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:30.798695 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd4624a-b7db-4aac-ab0b-d5b1f35e71c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:30.799569 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4624a-b7db-4aac-ab0b-d5b1f35e71c8 None admin] REQUEST_METHOD: `PUT` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:30.799856 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4624a-b7db-4aac-ab0b-d5b1f35e71c8 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:30.800135 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4624a-b7db-4aac-ab0b-d5b1f35e71c8 None admin] PATH_INFO: `/v3/projects/3c95ed974c054c60b11eaa4cd9e744d6/users/b7b064bc7459491c829d6fb16fbb0822/roles/00090b1962654604b8e106a05d44d06a` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:30.802086 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd4624a-b7db-4aac-ab0b-d5b1f35e71c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=3c95ed974c054c60b11eaa4cd9e744d6, user_id=b7b064bc7459491c829d6fb16fbb0822, role_id=00090b1962654604b8e106a05d44d06a)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:30.803609 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd4624a-b7db-4aac-ab0b-d5b1f35e71c8 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:30.861757 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 611/1192] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:28:30 2022] PUT /identity/v3/projects/3c95ed974c054c60b11eaa4cd9e744d6/users/b7b064bc7459491c829d6fb16fbb0822/roles/00090b1962654604b8e106a05d44d06a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:28:32.869546 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97feb7-f9f7-475d-8a0b-98150f6e0c4e None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:32.870147 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97feb7-f9f7-475d-8a0b-98150f6e0c4e None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:32.870147 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97feb7-f9f7-475d-8a0b-98150f6e0c4e None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:32.871477 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 582/1193] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:28:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:28:32.876663 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2cdff-8b3f-4f5b-9222-ae593fc1605c None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:32.877093 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2cdff-8b3f-4f5b-9222-ae593fc1605c None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:32.877223 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2cdff-8b3f-4f5b-9222-ae593fc1605c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:32.894308 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-d6e2cdff-8b3f-4f5b-9222-ae593fc1605c None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:28:32.895493 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-d6e2cdff-8b3f-4f5b-9222-ae593fc1605c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:28:32.960705 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 612/1194] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:28:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:28:32.984251 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97feb7-f9f7-475d-8a0b-98150f6e0c4e None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:33.040898 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:33.085467 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97feb7-f9f7-475d-8a0b-98150f6e0c4e None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:33.118151 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563a8c7-9c88-4259-af12-2ca1ca5c5238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:33.119717 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563a8c7-9c88-4259-af12-2ca1ca5c5238 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:33.119957 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563a8c7-9c88-4259-af12-2ca1ca5c5238 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:33.120239 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563a8c7-9c88-4259-af12-2ca1ca5c5238 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:33.130261 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8563a8c7-9c88-4259-af12-2ca1ca5c5238 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:28:33.138389 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-8563a8c7-9c88-4259-af12-2ca1ca5c5238 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:28:33.138389 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:28:33.138389 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:28:33.138389 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:28:33.138389 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:28:33.138389 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:28:33.138389 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:28:33.138389 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:28:33.138389 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:28:33.138389 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:28:33.138389 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:28:33.138389 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:28:33.138389 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:28:33.138389 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:28:33.138389 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:28:33.138389 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:28:33.139551 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:28:33.139551 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:28:33.139551 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:28:33.139551 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:28:33.139551 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:28:33.139551 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:28:33.139551 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:28:33.139551 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:28:33.139551 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:28:33.139551 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:28:33.139551 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:28:33.139551 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:28:33.139551 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:28:33.139551 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:28:33.139551 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:28:33.139551 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:28:33.140552 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:28:33.140552 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:28:33.140552 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:28:33.140552 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:28:33.140552 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:28:33.140552 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:28:33.140552 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:28:33.140552 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:28:33.140552 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:28:33.140552 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:28:33.140552 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:28:33.140552 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:28:33.140552 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 583/1195] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:28:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:28:33.145582 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e2cdff-8b3f-4f5b-9222-ae593fc1605c None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:33.236839 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:33.244009 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e2cdff-8b3f-4f5b-9222-ae593fc1605c None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:33.276875 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ccfe21-bacf-4582-8170-61d94584de28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:33.277542 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ccfe21-bacf-4582-8170-61d94584de28 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:33.277833 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ccfe21-bacf-4582-8170-61d94584de28 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:33.278118 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ccfe21-bacf-4582-8170-61d94584de28 None admin] PATH_INFO: `/v3/roles` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:33.278894 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ccfe21-bacf-4582-8170-61d94584de28 None admin] RBAC: Adding query filter params (name=admin) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:28:33.279208 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ccfe21-bacf-4582-8170-61d94584de28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:33.280621 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ccfe21-bacf-4582-8170-61d94584de28 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:33.289250 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 613/1196] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:28:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:28:33.295611 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563a8c7-9c88-4259-af12-2ca1ca5c5238 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:33.397162 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563a8c7-9c88-4259-af12-2ca1ca5c5238 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:33.413079 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:33.432726 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a1bba-83a3-47c1-b63b-b9b6c5c2e12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:33.433602 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a1bba-83a3-47c1-b63b-b9b6c5c2e12a None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:33.433905 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a1bba-83a3-47c1-b63b-b9b6c5c2e12a None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:33.434211 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a1bba-83a3-47c1-b63b-b9b6c5c2e12a None admin] PATH_INFO: `/v3/users/b7b064bc7459491c829d6fb16fbb0822` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:33.435417 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0a1bba-83a3-47c1-b63b-b9b6c5c2e12a None admin] RBAC: Authorizing `identity:get_user(user_id=b7b064bc7459491c829d6fb16fbb0822)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:33.436879 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0a1bba-83a3-47c1-b63b-b9b6c5c2e12a None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:33.438575 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 584/1197] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:28:33 2022] GET /identity/v3/users/b7b064bc7459491c829d6fb16fbb0822 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:28:33.444432 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ccfe21-bacf-4582-8170-61d94584de28 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:33.544712 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ccfe21-bacf-4582-8170-61d94584de28 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:33.577985 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c7995-74e5-4c0a-ab62-3c0bb4a15c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:33.578664 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c7995-74e5-4c0a-ab62-3c0bb4a15c6a None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:33.578952 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c7995-74e5-4c0a-ab62-3c0bb4a15c6a None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:33.579234 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c7995-74e5-4c0a-ab62-3c0bb4a15c6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:33.604619 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:33.645284 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c7995-74e5-4c0a-ab62-3c0bb4a15c6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:33.646786 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c7995-74e5-4c0a-ab62-3c0bb4a15c6a None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:33.744361 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 614/1198] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:28:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:28:33.750273 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a1bba-83a3-47c1-b63b-b9b6c5c2e12a None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:33.848361 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a1bba-83a3-47c1-b63b-b9b6c5c2e12a None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:33.880781 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4dc3c-3166-4c38-b43f-468726d76835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:33.881631 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4dc3c-3166-4c38-b43f-468726d76835 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:33.881917 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4dc3c-3166-4c38-b43f-468726d76835 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:33.882222 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4dc3c-3166-4c38-b43f-468726d76835 None admin] PATH_INFO: `/v3/projects/3c95ed974c054c60b11eaa4cd9e744d6` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:33.883384 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4dc3c-3166-4c38-b43f-468726d76835 None admin] RBAC: Authorizing `identity:get_project(project_id=3c95ed974c054c60b11eaa4cd9e744d6)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:33.884971 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4dc3c-3166-4c38-b43f-468726d76835 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:33.886674 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 585/1199] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:28:33 2022] GET /identity/v3/projects/3c95ed974c054c60b11eaa4cd9e744d6 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:28:33.892650 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c7995-74e5-4c0a-ab62-3c0bb4a15c6a None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:28:33.947375 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:33.990041 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c7995-74e5-4c0a-ab62-3c0bb4a15c6a None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:28:34.023611 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c123bc-d6c4-4430-aef6-2d9f8f732e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:28:34.024207 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c123bc-d6c4-4430-aef6-2d9f8f732e12 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:28:34.025058 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c123bc-d6c4-4430-aef6-2d9f8f732e12 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:28:34.025347 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c123bc-d6c4-4430-aef6-2d9f8f732e12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:28:34.026202 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c123bc-d6c4-4430-aef6-2d9f8f732e12 None admin] RBAC: Adding query filter params (role.id=00090b1962654604b8e106a05d44d06a, scope.project.id=3c95ed974c054c60b11eaa4cd9e744d6, user.id=b7b064bc7459491c829d6fb16fbb0822) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:28:34.026520 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c123bc-d6c4-4430-aef6-2d9f8f732e12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:28:34.027953 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c123bc-d6c4-4430-aef6-2d9f8f732e12 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:28:34.033697 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 615/1200] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:28:33 2022] GET /identity/v3/role_assignments?user.id=b7b064bc7459491c829d6fb16fbb0822&scope.project.id=3c95ed974c054c60b11eaa4cd9e744d6&role.id=00090b1962654604b8e106a05d44d06a => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:28:43.876788 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=74 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:28:44.031104 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=40 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:50.074564 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8bbb9d-eb05-48b2-88b4-5468048ef17e None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:50.075208 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8bbb9d-eb05-48b2-88b4-5468048ef17e None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:50.075208 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8bbb9d-eb05-48b2-88b4-5468048ef17e None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:50.076491 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 586/1201] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:29:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:29:50.081785 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91829479-5ba4-4bcf-8ff6-655e8b297733 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:50.084846 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91829479-5ba4-4bcf-8ff6-655e8b297733 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:50.084846 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91829479-5ba4-4bcf-8ff6-655e8b297733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:50.099705 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-91829479-5ba4-4bcf-8ff6-655e8b297733 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:50.100904 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-91829479-5ba4-4bcf-8ff6-655e8b297733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:50.168981 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 616/1202] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:29:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:29:50.194104 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8bbb9d-eb05-48b2-88b4-5468048ef17e None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:50.298427 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8bbb9d-eb05-48b2-88b4-5468048ef17e None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:50.332504 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe80a64-4226-4688-8c1e-a74c257c6e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:50.333248 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe80a64-4226-4688-8c1e-a74c257c6e86 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:50.333539 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe80a64-4226-4688-8c1e-a74c257c6e86 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:50.333821 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe80a64-4226-4688-8c1e-a74c257c6e86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:50.344550 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe80a64-4226-4688-8c1e-a74c257c6e86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:50.346107 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe80a64-4226-4688-8c1e-a74c257c6e86 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:50.364383 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-1fe80a64-4226-4688-8c1e-a74c257c6e86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:29:50.364383 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:29:50.364383 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:29:50.364383 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:29:50.364383 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:29:50.364383 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:29:50.364383 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:29:50.364383 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:29:50.364383 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:29:50.364383 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:29:50.364383 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:29:50.364383 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:29:50.364383 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:29:50.364383 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:29:50.364383 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:29:50.365582 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:29:50.365582 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:29:50.365582 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:29:50.365582 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:29:50.365582 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:29:50.365582 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:29:50.365582 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:29:50.365582 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:29:50.365582 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:29:50.365582 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:29:50.365582 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:29:50.365582 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:29:50.365582 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:29:50.365582 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:29:50.365582 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:29:50.365582 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:29:50.365582 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:29:50.366797 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:29:50.366797 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:29:50.366797 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:29:50.366797 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:29:50.366797 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 587/1203] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:29:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:29:50.372320 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91829479-5ba4-4bcf-8ff6-655e8b297733 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:50.472430 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91829479-5ba4-4bcf-8ff6-655e8b297733 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:50.501062 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:50.506833 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4bc7b8-b044-4f52-a031-9c75b3165c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:50.507581 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4bc7b8-b044-4f52-a031-9c75b3165c3d None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:50.507814 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4bc7b8-b044-4f52-a031-9c75b3165c3d None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:50.508099 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4bc7b8-b044-4f52-a031-9c75b3165c3d None admin] PATH_INFO: `/v3/domains` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:50.508823 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4bc7b8-b044-4f52-a031-9c75b3165c3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:29:50.509137 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4bc7b8-b044-4f52-a031-9c75b3165c3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:50.510600 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4bc7b8-b044-4f52-a031-9c75b3165c3d None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:50.521934 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 617/1204] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:29:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:29:50.528219 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe80a64-4226-4688-8c1e-a74c257c6e86 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:50.583873 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:50.632580 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe80a64-4226-4688-8c1e-a74c257c6e86 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:50.665626 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e00674-ca00-48ef-8d39-4b5a0db8be78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:50.666334 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e00674-ca00-48ef-8d39-4b5a0db8be78 None admin] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:50.666626 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e00674-ca00-48ef-8d39-4b5a0db8be78 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:50.667516 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e00674-ca00-48ef-8d39-4b5a0db8be78 None admin] PATH_INFO: `/v3/users` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:50.668219 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e00674-ca00-48ef-8d39-4b5a0db8be78 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:50.669704 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e00674-ca00-48ef-8d39-4b5a0db8be78 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:50.759660 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 588/1205] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:29:50 2022] POST /identity/v3/users => generated 251 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:29:52.824183 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf459d-e1f2-4dc5-ad40-728ad47c73b1 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:52.824708 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf459d-e1f2-4dc5-ad40-728ad47c73b1 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:52.824708 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf459d-e1f2-4dc5-ad40-728ad47c73b1 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:52.826059 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 618/1206] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:29:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:29:52.831146 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de62a2e-9ec8-47ef-8986-54cbb4102888 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:52.835801 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de62a2e-9ec8-47ef-8986-54cbb4102888 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:52.835801 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de62a2e-9ec8-47ef-8986-54cbb4102888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:52.849754 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-9de62a2e-9ec8-47ef-8986-54cbb4102888 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:52.851113 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-9de62a2e-9ec8-47ef-8986-54cbb4102888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:52.918856 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 589/1207] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:29:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:29:52.942740 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cf459d-e1f2-4dc5-ad40-728ad47c73b1 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:53.044045 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cf459d-e1f2-4dc5-ad40-728ad47c73b1 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:53.076920 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5194d010-2b5d-40fe-986a-4c44d0e01928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:53.077650 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194d010-2b5d-40fe-986a-4c44d0e01928 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:53.077935 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194d010-2b5d-40fe-986a-4c44d0e01928 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:53.078240 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194d010-2b5d-40fe-986a-4c44d0e01928 None admin] PATH_INFO: `/v3/roles/service` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:53.090244 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5194d010-2b5d-40fe-986a-4c44d0e01928 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:29:53.098058 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-5194d010-2b5d-40fe-986a-4c44d0e01928 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:29:53.098058 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:29:53.098058 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:29:53.098058 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:29:53.098058 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:29:53.098058 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:29:53.098058 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:29:53.098058 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:29:53.098058 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:29:53.098058 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:29:53.098058 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:29:53.098058 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:29:53.098058 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:29:53.098058 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:29:53.098058 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:29:53.098058 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:29:53.099186 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:29:53.099186 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:29:53.099186 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:29:53.099186 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:29:53.099186 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:29:53.099186 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:29:53.099186 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:29:53.099186 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:29:53.099186 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:29:53.099186 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:29:53.099186 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:29:53.099186 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:29:53.099186 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:29:53.099186 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:29:53.099186 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:29:53.099186 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:29:53.100235 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:29:53.100235 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:29:53.100235 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:29:53.100235 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:29:53.100235 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:29:53.100235 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:29:53.100235 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:29:53.100235 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:29:53.100235 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:29:53.100235 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:29:53.100235 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:29:53.100235 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:29:53.100235 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 619/1208] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:29:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:29:53.105953 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de62a2e-9ec8-47ef-8986-54cbb4102888 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:53.144966 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:53.206444 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de62a2e-9ec8-47ef-8986-54cbb4102888 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:53.240981 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cce926-b410-4729-8e31-1e38e8e82d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:53.241653 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cce926-b410-4729-8e31-1e38e8e82d26 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:53.241941 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cce926-b410-4729-8e31-1e38e8e82d26 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:53.242249 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cce926-b410-4729-8e31-1e38e8e82d26 None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:53.243003 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cce926-b410-4729-8e31-1e38e8e82d26 None admin] RBAC: Adding query filter params (name=service) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:29:53.243317 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cce926-b410-4729-8e31-1e38e8e82d26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:53.244705 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cce926-b410-4729-8e31-1e38e8e82d26 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:53.252837 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 590/1209] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:29:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:29:53.258758 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5194d010-2b5d-40fe-986a-4c44d0e01928 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:53.310939 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:53.360872 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5194d010-2b5d-40fe-986a-4c44d0e01928 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:53.395494 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343c639-b1cc-475a-8c6a-1d7b9db175e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:53.396451 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343c639-b1cc-475a-8c6a-1d7b9db175e8 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:53.397311 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343c639-b1cc-475a-8c6a-1d7b9db175e8 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:53.397595 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343c639-b1cc-475a-8c6a-1d7b9db175e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:53.408711 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8343c639-b1cc-475a-8c6a-1d7b9db175e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:53.410215 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8343c639-b1cc-475a-8c6a-1d7b9db175e8 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:53.428256 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-8343c639-b1cc-475a-8c6a-1d7b9db175e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:29:53.428256 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:29:53.428256 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:29:53.428256 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:29:53.428256 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:29:53.428256 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:29:53.428256 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:29:53.428256 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:29:53.428256 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:29:53.428256 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:29:53.428256 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:29:53.428256 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:29:53.428256 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:29:53.428256 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:29:53.428256 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:29:53.431276 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:29:53.431276 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:29:53.431276 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:29:53.431276 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:29:53.431276 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:29:53.431276 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:29:53.431276 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:29:53.431276 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:29:53.431276 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:29:53.431276 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:29:53.431276 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:29:53.431276 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:29:53.431276 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:29:53.431276 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:29:53.431276 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:29:53.431276 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:29:53.431276 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:29:53.432475 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:29:53.432475 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:29:53.432475 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:29:53.432475 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:29:53.432475 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 620/1210] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:29:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:29:53.435711 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cce926-b410-4729-8e31-1e38e8e82d26 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:53.531833 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:53.539331 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cce926-b410-4729-8e31-1e38e8e82d26 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:53.576580 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7d1c4-e295-4f69-8542-a0675c090d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:53.577258 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7d1c4-e295-4f69-8542-a0675c090d11 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:53.577550 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7d1c4-e295-4f69-8542-a0675c090d11 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:53.577834 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7d1c4-e295-4f69-8542-a0675c090d11 None admin] PATH_INFO: `/v3/domains` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:53.578602 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f7d1c4-e295-4f69-8542-a0675c090d11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:29:53.578917 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f7d1c4-e295-4f69-8542-a0675c090d11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:53.580308 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f7d1c4-e295-4f69-8542-a0675c090d11 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:53.593130 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 591/1211] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:29:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:29:53.599237 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343c639-b1cc-475a-8c6a-1d7b9db175e8 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:53.718890 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343c639-b1cc-475a-8c6a-1d7b9db175e8 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:53.720594 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:53.754736 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce23e7-2516-4080-a321-eaaf6522ad6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:53.755543 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce23e7-2516-4080-a321-eaaf6522ad6e None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:53.755832 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce23e7-2516-4080-a321-eaaf6522ad6e None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:53.756113 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce23e7-2516-4080-a321-eaaf6522ad6e None admin] PATH_INFO: `/v3/users/placement` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:53.764044 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce23e7-2516-4080-a321-eaaf6522ad6e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:53.765497 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce23e7-2516-4080-a321-eaaf6522ad6e None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:53.780547 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-b1ce23e7-2516-4080-a321-eaaf6522ad6e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 21:29:53.780547 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:29:53.780547 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:29:53.780547 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:29:53.780547 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:29:53.780547 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:29:53.780547 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:29:53.780547 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:29:53.780547 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:29:53.780547 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:29:53.780547 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:29:53.780547 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:29:53.780547 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:29:53.780547 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:29:53.780547 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:29:53.780547 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:29:53.781708 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:29:53.781708 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:29:53.781708 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:29:53.781708 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:29:53.781708 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:29:53.781708 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:29:53.781708 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:29:53.781708 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:29:53.781708 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:29:53.781708 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:29:53.781708 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:29:53.781708 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:29:53.781708 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:29:53.781708 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:29:53.781708 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:29:53.781708 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:29:53.781708 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:29:53.781708 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:29:53.782938 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:29:53.782938 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:29:53.782938 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:29:53.782938 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:29:53.782938 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:29:53.782938 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:29:53.782938 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:29:53.782938 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:29:53.782938 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 21:29:53.782938 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:29:53.782938 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 621/1212] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:29:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:29:53.787716 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7d1c4-e295-4f69-8542-a0675c090d11 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:53.891360 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7d1c4-e295-4f69-8542-a0675c090d11 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:53.925825 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b736b8f7-122a-4191-9ff6-3c04ef539781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:53.926527 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736b8f7-122a-4191-9ff6-3c04ef539781 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:53.926820 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736b8f7-122a-4191-9ff6-3c04ef539781 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:53.927104 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736b8f7-122a-4191-9ff6-3c04ef539781 None admin] PATH_INFO: `/v3/users` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:53.927943 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b736b8f7-122a-4191-9ff6-3c04ef539781 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:29:53.928264 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b736b8f7-122a-4191-9ff6-3c04ef539781 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:53.929710 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b736b8f7-122a-4191-9ff6-3c04ef539781 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:53.947697 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 592/1213] 10.222.0.30 () {56 vars in 1143 bytes} [Tue Jul 5 21:29:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:29:53.953685 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce23e7-2516-4080-a321-eaaf6522ad6e None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:54.055270 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce23e7-2516-4080-a321-eaaf6522ad6e None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:54.089385 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd4dd6-9fe4-4647-9549-d5263711cf58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:54.090047 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd4dd6-9fe4-4647-9549-d5263711cf58 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:54.090406 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd4dd6-9fe4-4647-9549-d5263711cf58 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:54.094268 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd4dd6-9fe4-4647-9549-d5263711cf58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:54.122065 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:54.160594 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd4dd6-9fe4-4647-9549-d5263711cf58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:54.162036 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd4dd6-9fe4-4647-9549-d5263711cf58 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:54.259951 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 622/1214] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:29:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:29:54.266394 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b736b8f7-122a-4191-9ff6-3c04ef539781 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:54.286147 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:54.368456 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b736b8f7-122a-4191-9ff6-3c04ef539781 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:54.403234 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ff077-5d1f-4b8d-821a-0071dc6a3667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:54.404021 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ff077-5d1f-4b8d-821a-0071dc6a3667 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:54.404313 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ff077-5d1f-4b8d-821a-0071dc6a3667 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:54.404595 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ff077-5d1f-4b8d-821a-0071dc6a3667 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:54.414438 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ff077-5d1f-4b8d-821a-0071dc6a3667 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:54.415889 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ff077-5d1f-4b8d-821a-0071dc6a3667 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:54.433648 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-e89ff077-5d1f-4b8d-821a-0071dc6a3667 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:29:54.433648 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:29:54.433648 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:29:54.433648 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:29:54.433648 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:29:54.433648 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:29:54.433648 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:29:54.433648 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:29:54.433648 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:29:54.433648 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:29:54.433648 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:29:54.433648 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:29:54.433648 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:29:54.433648 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:29:54.433648 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:29:54.437656 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:29:54.437656 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:29:54.437656 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:29:54.437656 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:29:54.437656 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:29:54.437656 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:29:54.437656 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:29:54.437656 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:29:54.437656 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:29:54.437656 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:29:54.437656 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:29:54.437656 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:29:54.437656 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:29:54.437656 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:29:54.437656 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:29:54.437656 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:29:54.437656 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:29:54.438804 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:29:54.438804 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:29:54.438804 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:29:54.438804 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:29:54.438804 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 593/1215] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:29:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:29:54.440624 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd4dd6-9fe4-4647-9549-d5263711cf58 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:54.503506 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:54.542679 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd4dd6-9fe4-4647-9549-d5263711cf58 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:54.577045 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a6a63-f770-4da4-9b59-c34042efa137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:54.577707 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a6a63-f770-4da4-9b59-c34042efa137 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:54.577992 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a6a63-f770-4da4-9b59-c34042efa137 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:54.578367 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a6a63-f770-4da4-9b59-c34042efa137 None admin] PATH_INFO: `/v3/domains` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:54.579081 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a6a63-f770-4da4-9b59-c34042efa137 None admin] RBAC: Adding query filter params (name=Default) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:29:54.579387 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a6a63-f770-4da4-9b59-c34042efa137 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:54.580764 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a6a63-f770-4da4-9b59-c34042efa137 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:54.593122 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 623/1216] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:29:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:29:54.599029 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ff077-5d1f-4b8d-821a-0071dc6a3667 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:54.668844 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:54.700172 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ff077-5d1f-4b8d-821a-0071dc6a3667 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:54.734741 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c77e4-c9a0-4d11-b01d-322b6be2b3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:54.735570 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c77e4-c9a0-4d11-b01d-322b6be2b3eb None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:54.735863 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c77e4-c9a0-4d11-b01d-322b6be2b3eb None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:54.736149 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c77e4-c9a0-4d11-b01d-322b6be2b3eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:54.743600 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c77e4-c9a0-4d11-b01d-322b6be2b3eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:54.745496 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c77e4-c9a0-4d11-b01d-322b6be2b3eb None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:54.759826 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-fe2c77e4-c9a0-4d11-b01d-322b6be2b3eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:29:54.759826 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:29:54.759826 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:29:54.759826 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:29:54.759826 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:29:54.759826 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:29:54.759826 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:29:54.759826 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:29:54.759826 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:29:54.759826 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:29:54.759826 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:29:54.759826 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:29:54.759826 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:29:54.759826 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:29:54.759826 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:29:54.761637 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:29:54.761637 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:29:54.761637 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:29:54.761637 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:29:54.761637 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:29:54.761637 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:29:54.761637 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:29:54.761637 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:29:54.761637 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:29:54.761637 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:29:54.761637 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:29:54.761637 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:29:54.761637 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:29:54.761637 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:29:54.761637 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:29:54.761637 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:29:54.761637 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:29:54.762826 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:29:54.762826 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:29:54.762826 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:29:54.762826 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:29:54.762826 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:29:54.762826 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:29:54.762826 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:29:54.762826 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:29:54.762826 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 594/1217] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:29:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:29:54.767902 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a6a63-f770-4da4-9b59-c34042efa137 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:54.873060 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a6a63-f770-4da4-9b59-c34042efa137 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:54.895835 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:54.907279 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2113148c-d764-4c34-9bf0-723db285dc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:54.907944 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113148c-d764-4c34-9bf0-723db285dc70 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:54.908236 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113148c-d764-4c34-9bf0-723db285dc70 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:54.908541 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113148c-d764-4c34-9bf0-723db285dc70 None admin] PATH_INFO: `/v3/projects` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:54.909338 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2113148c-d764-4c34-9bf0-723db285dc70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:29:54.909648 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2113148c-d764-4c34-9bf0-723db285dc70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:54.911114 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2113148c-d764-4c34-9bf0-723db285dc70 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:54.923119 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 624/1218] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:29:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:29:54.929300 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c77e4-c9a0-4d11-b01d-322b6be2b3eb None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:55.030215 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c77e4-c9a0-4d11-b01d-322b6be2b3eb None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:55.059771 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:55.065549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44476a17-15bb-4608-9b3d-80507ee9b2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:55.086264 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44476a17-15bb-4608-9b3d-80507ee9b2a4 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:55.086264 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44476a17-15bb-4608-9b3d-80507ee9b2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:55.086264 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44476a17-15bb-4608-9b3d-80507ee9b2a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:55.086264 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44476a17-15bb-4608-9b3d-80507ee9b2a4 None admin] RBAC: Adding query filter params (role.id=1cb72e4884a744f99a3df0dc628f7493, scope.project.id=7fe768315f5c43f487f71f043f11b8b8, user.id=a81dc86423cc42ddad57b10c04808176) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:29:55.086264 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44476a17-15bb-4608-9b3d-80507ee9b2a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:55.086713 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44476a17-15bb-4608-9b3d-80507ee9b2a4 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:55.086713 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 595/1219] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:29:54 2022] GET /identity/v3/role_assignments?user.id=a81dc86423cc42ddad57b10c04808176&scope.project.id=7fe768315f5c43f487f71f043f11b8b8&role.id=1cb72e4884a744f99a3df0dc628f7493 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:29:57.104848 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409d8f4-ee1c-4f96-8526-00a8487337c5 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:57.105446 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409d8f4-ee1c-4f96-8526-00a8487337c5 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:57.105549 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409d8f4-ee1c-4f96-8526-00a8487337c5 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:57.106929 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 625/1220] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:29:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:29:57.112181 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42fcd4-c61e-4d21-b4a4-eb8e580e0557 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:57.112579 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42fcd4-c61e-4d21-b4a4-eb8e580e0557 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:57.112785 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42fcd4-c61e-4d21-b4a4-eb8e580e0557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:57.130408 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-ce42fcd4-c61e-4d21-b4a4-eb8e580e0557 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:29:57.131699 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-ce42fcd4-c61e-4d21-b4a4-eb8e580e0557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:29:57.199373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 596/1221] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:29:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:29:57.223057 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409d8f4-ee1c-4f96-8526-00a8487337c5 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:57.325950 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409d8f4-ee1c-4f96-8526-00a8487337c5 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:57.359887 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25389d-5929-4b18-9339-f66b8052a081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:57.360600 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25389d-5929-4b18-9339-f66b8052a081 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:57.360886 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25389d-5929-4b18-9339-f66b8052a081 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:57.361165 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25389d-5929-4b18-9339-f66b8052a081 None admin] PATH_INFO: `/v3/roles/service` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:57.373358 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db25389d-5929-4b18-9339-f66b8052a081 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:29:57.383803 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-db25389d-5929-4b18-9339-f66b8052a081 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:29:57.383803 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:29:57.383803 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:29:57.383803 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:29:57.383803 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:29:57.383803 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:29:57.383803 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:29:57.383803 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:29:57.383803 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:29:57.383803 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:29:57.383803 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:29:57.383803 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:29:57.383803 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:29:57.383803 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:29:57.383803 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:29:57.383803 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:29:57.385111 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:29:57.385111 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:29:57.385111 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:29:57.385111 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:29:57.385111 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:29:57.385111 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:29:57.385111 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:29:57.385111 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:29:57.385111 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:29:57.385111 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:29:57.385111 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:29:57.385111 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:29:57.385111 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:29:57.385111 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:29:57.385111 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:29:57.385111 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:29:57.386882 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:29:57.386882 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:29:57.386882 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:29:57.386882 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:29:57.386882 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:29:57.386882 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:29:57.386882 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:29:57.386882 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:29:57.386882 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:29:57.386882 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:29:57.386882 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:29:57.386882 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:29:57.386882 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 626/1222] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:29:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:29:57.392706 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce42fcd4-c61e-4d21-b4a4-eb8e580e0557 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:57.491494 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce42fcd4-c61e-4d21-b4a4-eb8e580e0557 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:57.515501 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:57.526265 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b989f9a1-242e-4d5b-8bd8-9c9fa32f7832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:57.526932 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989f9a1-242e-4d5b-8bd8-9c9fa32f7832 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:57.527220 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989f9a1-242e-4d5b-8bd8-9c9fa32f7832 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:57.527506 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989f9a1-242e-4d5b-8bd8-9c9fa32f7832 None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:57.528328 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b989f9a1-242e-4d5b-8bd8-9c9fa32f7832 None admin] RBAC: Adding query filter params (name=service) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:29:57.528643 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b989f9a1-242e-4d5b-8bd8-9c9fa32f7832 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:57.530174 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b989f9a1-242e-4d5b-8bd8-9c9fa32f7832 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:57.539144 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 597/1223] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:29:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:29:57.544643 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25389d-5929-4b18-9339-f66b8052a081 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:57.591229 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:57.647300 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25389d-5929-4b18-9339-f66b8052a081 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:57.680226 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708fda40-5485-46cd-b25e-f3f1ef7f88be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:57.681017 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708fda40-5485-46cd-b25e-f3f1ef7f88be None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:57.681309 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708fda40-5485-46cd-b25e-f3f1ef7f88be None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:57.681590 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708fda40-5485-46cd-b25e-f3f1ef7f88be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:57.693118 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708fda40-5485-46cd-b25e-f3f1ef7f88be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:57.694637 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708fda40-5485-46cd-b25e-f3f1ef7f88be None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:57.713267 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-708fda40-5485-46cd-b25e-f3f1ef7f88be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:29:57.713267 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:29:57.713267 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:29:57.713267 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:29:57.713267 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:29:57.713267 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:29:57.713267 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:29:57.713267 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:29:57.713267 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:29:57.713267 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:29:57.713267 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:29:57.713267 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:29:57.713267 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:29:57.713267 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:29:57.713267 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:29:57.714508 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:29:57.714508 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:29:57.714508 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:29:57.714508 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:29:57.714508 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:29:57.714508 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:29:57.714508 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:29:57.714508 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:29:57.714508 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:29:57.714508 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:29:57.714508 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:29:57.714508 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:29:57.714508 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:29:57.714508 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:29:57.714508 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:29:57.714508 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:29:57.714508 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:29:57.715625 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:29:57.715625 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:29:57.715625 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:29:57.715625 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:29:57.715625 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 627/1224] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:29:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:29:57.720735 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b989f9a1-242e-4d5b-8bd8-9c9fa32f7832 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:57.820685 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b989f9a1-242e-4d5b-8bd8-9c9fa32f7832 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:57.853754 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c0680-6bb3-4f6a-9098-9f4c7e3818ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:57.855137 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c0680-6bb3-4f6a-9098-9f4c7e3818ea None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:57.855428 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c0680-6bb3-4f6a-9098-9f4c7e3818ea None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:57.855710 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c0680-6bb3-4f6a-9098-9f4c7e3818ea None admin] PATH_INFO: `/v3/domains` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:57.856436 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c0680-6bb3-4f6a-9098-9f4c7e3818ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:29:57.856749 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c0680-6bb3-4f6a-9098-9f4c7e3818ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:57.858147 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c0680-6bb3-4f6a-9098-9f4c7e3818ea None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:57.870852 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 598/1225] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:29:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:29:57.876636 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708fda40-5485-46cd-b25e-f3f1ef7f88be None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:57.973352 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:57.980515 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708fda40-5485-46cd-b25e-f3f1ef7f88be None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:58.016760 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61eaad-85d7-4098-bcd6-c78edf5c166f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:58.017557 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61eaad-85d7-4098-bcd6-c78edf5c166f None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:58.017848 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61eaad-85d7-4098-bcd6-c78edf5c166f None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:58.018185 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61eaad-85d7-4098-bcd6-c78edf5c166f None admin] PATH_INFO: `/v3/users/placement` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:58.025104 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f61eaad-85d7-4098-bcd6-c78edf5c166f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:58.027121 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f61eaad-85d7-4098-bcd6-c78edf5c166f None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:58.042145 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-9f61eaad-85d7-4098-bcd6-c78edf5c166f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 21:29:58.042145 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:29:58.042145 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:29:58.042145 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:29:58.042145 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:29:58.042145 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:29:58.042145 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:29:58.042145 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:29:58.042145 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:29:58.042145 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:29:58.042145 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:29:58.042145 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:29:58.042145 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:29:58.042145 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:29:58.042145 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:29:58.042145 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:29:58.043288 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:29:58.043288 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:29:58.043288 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:29:58.043288 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:29:58.043288 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:29:58.043288 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:29:58.043288 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:29:58.043288 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:29:58.043288 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:29:58.043288 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:29:58.043288 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:29:58.043288 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:29:58.043288 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:29:58.043288 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:29:58.043288 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:29:58.043288 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:29:58.043288 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:29:58.043288 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:29:58.049147 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:29:58.049147 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:29:58.049147 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:29:58.049147 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:29:58.049147 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:29:58.049147 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:29:58.049147 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:29:58.049147 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:29:58.049147 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 21:29:58.049147 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:29:58.049147 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 628/1226] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:29:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:29:58.049736 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c0680-6bb3-4f6a-9098-9f4c7e3818ea None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:58.097022 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:58.149719 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c0680-6bb3-4f6a-9098-9f4c7e3818ea None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:58.184444 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510499f-06d2-4071-8631-6056301daef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:58.185113 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510499f-06d2-4071-8631-6056301daef7 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:58.185399 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510499f-06d2-4071-8631-6056301daef7 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:58.185681 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510499f-06d2-4071-8631-6056301daef7 None admin] PATH_INFO: `/v3/users` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:58.186547 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d510499f-06d2-4071-8631-6056301daef7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:29:58.186861 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d510499f-06d2-4071-8631-6056301daef7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:58.188300 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d510499f-06d2-4071-8631-6056301daef7 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:58.206039 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 599/1227] 10.222.0.30 () {56 vars in 1143 bytes} [Tue Jul 5 21:29:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:29:58.212385 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61eaad-85d7-4098-bcd6-c78edf5c166f None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:58.312616 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61eaad-85d7-4098-bcd6-c78edf5c166f None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:58.346871 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19862c71-00e1-47e6-a824-2bd673d705ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:58.347663 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19862c71-00e1-47e6-a824-2bd673d705ca None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:58.347950 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19862c71-00e1-47e6-a824-2bd673d705ca None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:58.348273 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19862c71-00e1-47e6-a824-2bd673d705ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:58.359092 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19862c71-00e1-47e6-a824-2bd673d705ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:58.360608 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19862c71-00e1-47e6-a824-2bd673d705ca None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:58.378504 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-19862c71-00e1-47e6-a824-2bd673d705ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:29:58.378504 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:29:58.378504 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:29:58.378504 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:29:58.378504 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:29:58.378504 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:29:58.378504 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:29:58.378504 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:29:58.378504 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:29:58.378504 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:29:58.378504 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:29:58.378504 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:29:58.378504 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:29:58.378504 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:29:58.378504 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:29:58.379601 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:29:58.379601 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:29:58.379601 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:29:58.379601 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:29:58.379601 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:29:58.379601 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:29:58.379601 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:29:58.379601 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:29:58.379601 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:29:58.379601 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:29:58.379601 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:29:58.379601 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:29:58.379601 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:29:58.379601 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:29:58.379601 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:29:58.379601 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:29:58.379601 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:29:58.380907 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:29:58.380907 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:29:58.380907 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:29:58.380907 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:29:58.380907 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 629/1228] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:29:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:29:58.385506 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510499f-06d2-4071-8631-6056301daef7 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:58.484462 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510499f-06d2-4071-8631-6056301daef7 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:58.486781 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:58.518022 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19ee4a-358c-45eb-9bb2-01e6c9d5306e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:58.518727 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19ee4a-358c-45eb-9bb2-01e6c9d5306e None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:58.519017 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19ee4a-358c-45eb-9bb2-01e6c9d5306e None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:58.519300 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19ee4a-358c-45eb-9bb2-01e6c9d5306e None admin] PATH_INFO: `/v3/domains` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:58.520027 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19ee4a-358c-45eb-9bb2-01e6c9d5306e None admin] RBAC: Adding query filter params (name=Default) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:29:58.520340 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19ee4a-358c-45eb-9bb2-01e6c9d5306e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:58.521719 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19ee4a-358c-45eb-9bb2-01e6c9d5306e None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:58.532908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 600/1229] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:29:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:29:58.538655 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19862c71-00e1-47e6-a824-2bd673d705ca None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:58.547883 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:58.639024 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19862c71-00e1-47e6-a824-2bd673d705ca None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:58.674582 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be665a44-dd9b-4406-aea8-502630e26b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:58.675364 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be665a44-dd9b-4406-aea8-502630e26b98 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:58.675654 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be665a44-dd9b-4406-aea8-502630e26b98 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:58.675938 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be665a44-dd9b-4406-aea8-502630e26b98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:58.682791 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be665a44-dd9b-4406-aea8-502630e26b98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:58.684238 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be665a44-dd9b-4406-aea8-502630e26b98 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:58.698156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-be665a44-dd9b-4406-aea8-502630e26b98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:29:58.698156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:29:58.698156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:29:58.698156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:29:58.698156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:29:58.698156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:29:58.698156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:29:58.698156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:29:58.698156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:29:58.698156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:29:58.698156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:29:58.698156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:29:58.698156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:29:58.698156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:29:58.698156 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:29:58.699196 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:29:58.699196 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:29:58.699196 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:29:58.699196 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:29:58.699196 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:29:58.699196 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:29:58.699196 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:29:58.699196 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:29:58.699196 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:29:58.699196 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:29:58.699196 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:29:58.699196 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:29:58.699196 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:29:58.699196 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:29:58.699196 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:29:58.699196 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:29:58.699196 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:29:58.700350 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:29:58.700350 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:29:58.700350 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:29:58.700350 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:29:58.700350 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:29:58.700350 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:29:58.700350 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:29:58.700350 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:29:58.700350 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 630/1230] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:29:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:29:58.707019 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19ee4a-358c-45eb-9bb2-01e6c9d5306e None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:58.808622 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19ee4a-358c-45eb-9bb2-01e6c9d5306e None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:58.842612 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0f011-4d1c-4634-bbb3-b556e7827807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:58.843211 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0f011-4d1c-4634-bbb3-b556e7827807 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:58.843498 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0f011-4d1c-4634-bbb3-b556e7827807 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:58.843774 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0f011-4d1c-4634-bbb3-b556e7827807 None admin] PATH_INFO: `/v3/projects` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:58.844574 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f0f011-4d1c-4634-bbb3-b556e7827807 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:29:58.844873 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f0f011-4d1c-4634-bbb3-b556e7827807 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:58.846359 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f0f011-4d1c-4634-bbb3-b556e7827807 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:58.859031 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 601/1231] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:29:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:29:58.864945 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be665a44-dd9b-4406-aea8-502630e26b98 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:29:58.928597 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:29:58.964503 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be665a44-dd9b-4406-aea8-502630e26b98 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:29:58.996913 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffe1b5d-c525-4d36-91e5-55ce03a4e52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:29:58.997784 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe1b5d-c525-4d36-91e5-55ce03a4e52f None admin] REQUEST_METHOD: `PUT` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:29:58.998067 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe1b5d-c525-4d36-91e5-55ce03a4e52f None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:29:58.998370 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe1b5d-c525-4d36-91e5-55ce03a4e52f None admin] PATH_INFO: `/v3/projects/7fe768315f5c43f487f71f043f11b8b8/users/a81dc86423cc42ddad57b10c04808176/roles/1cb72e4884a744f99a3df0dc628f7493` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:29:59.012785 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffe1b5d-c525-4d36-91e5-55ce03a4e52f None admin] RBAC: Authorizing `identity:create_grant(project_id=7fe768315f5c43f487f71f043f11b8b8, user_id=a81dc86423cc42ddad57b10c04808176, role_id=1cb72e4884a744f99a3df0dc628f7493)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:29:59.016745 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffe1b5d-c525-4d36-91e5-55ce03a4e52f None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:29:59.104703 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 631/1232] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:29:58 2022] PUT /identity/v3/projects/7fe768315f5c43f487f71f043f11b8b8/users/a81dc86423cc42ddad57b10c04808176/roles/1cb72e4884a744f99a3df0dc628f7493 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:30:01.124496 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03042a4-deb4-4dc6-8894-86a573bf7f89 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:01.125052 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03042a4-deb4-4dc6-8894-86a573bf7f89 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:01.125052 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03042a4-deb4-4dc6-8894-86a573bf7f89 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:01.126485 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 602/1233] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:30:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:30:01.131650 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed3ed3-0551-4087-9a03-149ea7fae2cb None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:01.132070 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed3ed3-0551-4087-9a03-149ea7fae2cb None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:01.132212 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed3ed3-0551-4087-9a03-149ea7fae2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:01.148813 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-f0ed3ed3-0551-4087-9a03-149ea7fae2cb None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:30:01.149992 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-f0ed3ed3-0551-4087-9a03-149ea7fae2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:01.217819 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 632/1234] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:30:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:30:01.241634 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03042a4-deb4-4dc6-8894-86a573bf7f89 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:01.268186 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:01.343378 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03042a4-deb4-4dc6-8894-86a573bf7f89 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:01.378824 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbbb14a-bae2-4d05-8a06-3483a6df4b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:01.379568 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbb14a-bae2-4d05-8a06-3483a6df4b8a None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:01.379858 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbb14a-bae2-4d05-8a06-3483a6df4b8a None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:01.380137 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbb14a-bae2-4d05-8a06-3483a6df4b8a None admin] PATH_INFO: `/v3/roles/service` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:01.390567 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbbb14a-bae2-4d05-8a06-3483a6df4b8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:30:01.398359 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-efbbb14a-bae2-4d05-8a06-3483a6df4b8a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:30:01.398359 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:30:01.398359 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:30:01.398359 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:30:01.398359 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:30:01.398359 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:30:01.398359 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:30:01.398359 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:30:01.398359 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:30:01.398359 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:30:01.398359 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:30:01.398359 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:30:01.398359 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:30:01.398359 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:30:01.398359 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:30:01.398359 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:30:01.399429 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:30:01.399429 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:30:01.399429 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:30:01.399429 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:30:01.399429 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:30:01.399429 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:30:01.399429 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:30:01.399429 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:30:01.399429 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:30:01.399429 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:30:01.399429 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:30:01.399429 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:30:01.399429 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:30:01.399429 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:30:01.399429 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:30:01.399429 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:30:01.400661 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:30:01.400661 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:30:01.400661 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:30:01.400661 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:30:01.400661 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:30:01.400661 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:30:01.400661 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:30:01.400661 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:30:01.400661 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:30:01.400661 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:30:01.400661 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:30:01.400661 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:30:01.400661 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 603/1235] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:30:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:30:01.405668 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed3ed3-0551-4087-9a03-149ea7fae2cb None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:01.452085 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:01.504140 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed3ed3-0551-4087-9a03-149ea7fae2cb None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:01.537121 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d152cf-c34a-42fe-9afc-c22061befd9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:01.537783 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d152cf-c34a-42fe-9afc-c22061befd9f None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:01.538072 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d152cf-c34a-42fe-9afc-c22061befd9f None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:01.538380 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d152cf-c34a-42fe-9afc-c22061befd9f None admin] PATH_INFO: `/v3/roles` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:01.539120 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d152cf-c34a-42fe-9afc-c22061befd9f None admin] RBAC: Adding query filter params (name=service) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:30:01.539431 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d152cf-c34a-42fe-9afc-c22061befd9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:01.540811 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d152cf-c34a-42fe-9afc-c22061befd9f None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:01.549642 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 633/1236] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:30:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:30:01.555666 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbbb14a-bae2-4d05-8a06-3483a6df4b8a None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:01.641290 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:01.656994 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbbb14a-bae2-4d05-8a06-3483a6df4b8a None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:01.689982 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e0903-9af0-4678-8db8-f02f3ce475b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:01.690831 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e0903-9af0-4678-8db8-f02f3ce475b7 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:01.691122 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e0903-9af0-4678-8db8-f02f3ce475b7 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:01.691403 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e0903-9af0-4678-8db8-f02f3ce475b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:01.701299 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e0903-9af0-4678-8db8-f02f3ce475b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:01.702807 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e0903-9af0-4678-8db8-f02f3ce475b7 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:01.720960 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-de5e0903-9af0-4678-8db8-f02f3ce475b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:30:01.720960 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:30:01.720960 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:30:01.720960 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:30:01.720960 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:30:01.720960 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:30:01.720960 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:30:01.720960 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:30:01.720960 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:30:01.720960 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:30:01.720960 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:30:01.720960 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:30:01.720960 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:30:01.720960 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:30:01.720960 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:30:01.721908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:30:01.721908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:30:01.721908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:30:01.721908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:30:01.721908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:30:01.721908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:30:01.721908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:30:01.721908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:30:01.721908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:30:01.721908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:30:01.721908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:30:01.721908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:30:01.721908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:30:01.721908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:30:01.721908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:30:01.721908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:30:01.721908 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:30:01.723094 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:30:01.723094 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:30:01.723094 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:30:01.723094 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:30:01.723094 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 604/1237] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:30:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:30:01.728083 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d152cf-c34a-42fe-9afc-c22061befd9f None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:01.828528 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d152cf-c34a-42fe-9afc-c22061befd9f None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:01.837788 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:01.863138 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c68f39a-667f-47a2-ad85-7f553bec102a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:01.863817 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68f39a-667f-47a2-ad85-7f553bec102a None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:01.864099 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68f39a-667f-47a2-ad85-7f553bec102a None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:01.864370 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68f39a-667f-47a2-ad85-7f553bec102a None admin] PATH_INFO: `/v3/domains` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:01.865085 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c68f39a-667f-47a2-ad85-7f553bec102a None admin] RBAC: Adding query filter params (name=Default) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:30:01.865389 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c68f39a-667f-47a2-ad85-7f553bec102a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:01.866878 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c68f39a-667f-47a2-ad85-7f553bec102a None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:01.877854 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 634/1238] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:30:01.883543 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e0903-9af0-4678-8db8-f02f3ce475b7 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:01.984759 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e0903-9af0-4678-8db8-f02f3ce475b7 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:02.018356 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65556a9b-cd54-442c-89ee-69ba6ec43d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:02.019153 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65556a9b-cd54-442c-89ee-69ba6ec43d4f None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:02.019439 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65556a9b-cd54-442c-89ee-69ba6ec43d4f None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:02.019717 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65556a9b-cd54-442c-89ee-69ba6ec43d4f None admin] PATH_INFO: `/v3/users/placement` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:02.022467 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:02.027469 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65556a9b-cd54-442c-89ee-69ba6ec43d4f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:02.028952 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65556a9b-cd54-442c-89ee-69ba6ec43d4f None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:02.043427 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-65556a9b-cd54-442c-89ee-69ba6ec43d4f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 21:30:02.043427 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:30:02.043427 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:30:02.043427 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:30:02.043427 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:30:02.043427 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:30:02.043427 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:30:02.043427 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:30:02.043427 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:30:02.043427 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:30:02.043427 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:30:02.043427 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:30:02.043427 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:30:02.043427 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:30:02.043427 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:30:02.043427 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:30:02.044549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:30:02.044549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:30:02.044549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:30:02.044549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:30:02.044549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:30:02.044549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:30:02.044549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:30:02.044549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:30:02.044549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:30:02.044549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:30:02.044549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:30:02.044549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:30:02.044549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:30:02.044549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:30:02.044549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:30:02.044549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:30:02.044549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:30:02.044549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:30:02.045609 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:30:02.045609 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:30:02.045609 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:30:02.045609 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:30:02.045609 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:30:02.045609 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:30:02.045609 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:30:02.045609 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:30:02.045609 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 21:30:02.045609 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:30:02.045609 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 605/1239] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:30:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:30:02.050490 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c68f39a-667f-47a2-ad85-7f553bec102a None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:02.149268 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c68f39a-667f-47a2-ad85-7f553bec102a None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:02.182827 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562fbe4-0f49-4241-bffa-227eed6a923c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:02.183504 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562fbe4-0f49-4241-bffa-227eed6a923c None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:02.183792 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562fbe4-0f49-4241-bffa-227eed6a923c None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:02.184068 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562fbe4-0f49-4241-bffa-227eed6a923c None admin] PATH_INFO: `/v3/users` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:02.184893 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7562fbe4-0f49-4241-bffa-227eed6a923c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:30:02.185203 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7562fbe4-0f49-4241-bffa-227eed6a923c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:02.186668 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7562fbe4-0f49-4241-bffa-227eed6a923c None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:02.204031 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 635/1240] 10.222.0.30 () {56 vars in 1143 bytes} [Tue Jul 5 21:30:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:30:02.209869 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65556a9b-cd54-442c-89ee-69ba6ec43d4f None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:02.310657 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65556a9b-cd54-442c-89ee-69ba6ec43d4f None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:02.344770 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf79a9-459b-4481-8dcc-a1570cbabb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:02.345451 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf79a9-459b-4481-8dcc-a1570cbabb9a None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:02.345741 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf79a9-459b-4481-8dcc-a1570cbabb9a None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:02.346023 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf79a9-459b-4481-8dcc-a1570cbabb9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:02.407546 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:02.413993 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf79a9-459b-4481-8dcc-a1570cbabb9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:02.415515 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf79a9-459b-4481-8dcc-a1570cbabb9a None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:02.514532 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 606/1241] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:30:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:30:02.520568 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562fbe4-0f49-4241-bffa-227eed6a923c None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:02.549599 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:02.622874 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562fbe4-0f49-4241-bffa-227eed6a923c None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:02.656931 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78a429-168e-4141-803e-d78e59870808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:02.657725 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78a429-168e-4141-803e-d78e59870808 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:02.658016 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78a429-168e-4141-803e-d78e59870808 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:02.658331 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78a429-168e-4141-803e-d78e59870808 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:02.668986 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78a429-168e-4141-803e-d78e59870808 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:02.670631 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78a429-168e-4141-803e-d78e59870808 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:02.687927 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-9b78a429-168e-4141-803e-d78e59870808 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:30:02.687927 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:30:02.687927 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:30:02.687927 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:30:02.687927 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:30:02.687927 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:30:02.687927 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:30:02.687927 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:30:02.687927 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:30:02.687927 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:30:02.687927 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:30:02.687927 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:30:02.687927 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:30:02.687927 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:30:02.687927 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:30:02.688991 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:30:02.688991 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:30:02.688991 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:30:02.688991 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:30:02.688991 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:30:02.688991 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:30:02.688991 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:30:02.688991 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:30:02.688991 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:30:02.688991 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:30:02.688991 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:30:02.688991 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:30:02.688991 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:30:02.688991 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:30:02.688991 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:30:02.688991 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:30:02.688991 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:30:02.689996 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:30:02.689996 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:30:02.689996 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:30:02.689996 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:30:02.689996 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 636/1242] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:30:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:30:02.695005 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf79a9-459b-4481-8dcc-a1570cbabb9a None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:02.803444 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:02.810056 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf79a9-459b-4481-8dcc-a1570cbabb9a None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:02.846000 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1645629-c19b-4296-bcf3-53e6facd35e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:02.846647 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1645629-c19b-4296-bcf3-53e6facd35e6 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:02.846939 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1645629-c19b-4296-bcf3-53e6facd35e6 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:02.847223 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1645629-c19b-4296-bcf3-53e6facd35e6 None admin] PATH_INFO: `/v3/domains` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:02.847961 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1645629-c19b-4296-bcf3-53e6facd35e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:30:02.848274 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1645629-c19b-4296-bcf3-53e6facd35e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:02.849690 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1645629-c19b-4296-bcf3-53e6facd35e6 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:02.861647 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 607/1243] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:30:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:30:02.867585 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78a429-168e-4141-803e-d78e59870808 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:02.948608 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:02.971000 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78a429-168e-4141-803e-d78e59870808 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:03.006106 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b53013-22f5-427c-820c-fd2357f53c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:03.007191 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b53013-22f5-427c-820c-fd2357f53c5a None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:03.007654 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b53013-22f5-427c-820c-fd2357f53c5a None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:03.008388 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b53013-22f5-427c-820c-fd2357f53c5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:03.015359 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b53013-22f5-427c-820c-fd2357f53c5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:03.016883 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b53013-22f5-427c-820c-fd2357f53c5a None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:03.030796 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-39b53013-22f5-427c-820c-fd2357f53c5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:30:03.030796 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:30:03.030796 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:30:03.030796 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:30:03.030796 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:30:03.030796 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:30:03.030796 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:30:03.030796 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:30:03.030796 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:30:03.030796 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:30:03.030796 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:30:03.030796 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:30:03.030796 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:30:03.030796 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:30:03.030796 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:30:03.031908 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:30:03.031908 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:30:03.031908 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:30:03.031908 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:30:03.031908 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:30:03.031908 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:30:03.031908 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:30:03.031908 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:30:03.031908 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:30:03.031908 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:30:03.031908 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:30:03.031908 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:30:03.031908 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:30:03.031908 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:30:03.031908 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:30:03.031908 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:30:03.031908 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:30:03.032856 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:30:03.032856 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:30:03.032856 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:30:03.032856 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:30:03.032856 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:30:03.032856 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:30:03.032856 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:30:03.032856 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:30:03.032856 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 637/1244] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:30:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:30:03.037857 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1645629-c19b-4296-bcf3-53e6facd35e6 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:03.139110 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1645629-c19b-4296-bcf3-53e6facd35e6 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:03.172921 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c9af7-ee5d-4026-a8cf-24ef58148c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:03.173597 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c9af7-ee5d-4026-a8cf-24ef58148c1a None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:03.173889 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c9af7-ee5d-4026-a8cf-24ef58148c1a None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:03.174208 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c9af7-ee5d-4026-a8cf-24ef58148c1a None admin] PATH_INFO: `/v3/projects` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:03.175011 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c9af7-ee5d-4026-a8cf-24ef58148c1a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:30:03.175328 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c9af7-ee5d-4026-a8cf-24ef58148c1a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:03.176773 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c9af7-ee5d-4026-a8cf-24ef58148c1a None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:03.189509 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 608/1245] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:30:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:30:03.195514 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b53013-22f5-427c-820c-fd2357f53c5a None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:03.302647 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b53013-22f5-427c-820c-fd2357f53c5a None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:03.336885 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed36f59-88d9-4a3c-8a2b-0a0018c1ac92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:03.337798 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed36f59-88d9-4a3c-8a2b-0a0018c1ac92 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:03.341173 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed36f59-88d9-4a3c-8a2b-0a0018c1ac92 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:03.341173 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed36f59-88d9-4a3c-8a2b-0a0018c1ac92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:03.341173 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed36f59-88d9-4a3c-8a2b-0a0018c1ac92 None admin] RBAC: Adding query filter params (role.id=1cb72e4884a744f99a3df0dc628f7493, scope.project.id=7fe768315f5c43f487f71f043f11b8b8, user.id=a81dc86423cc42ddad57b10c04808176) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:30:03.341173 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed36f59-88d9-4a3c-8a2b-0a0018c1ac92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:03.341173 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed36f59-88d9-4a3c-8a2b-0a0018c1ac92 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:03.346980 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 638/1246] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:30:03 2022] GET /identity/v3/role_assignments?user.id=a81dc86423cc42ddad57b10c04808176&scope.project.id=7fe768315f5c43f487f71f043f11b8b8&role.id=1cb72e4884a744f99a3df0dc628f7493 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:30:05.487950 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1022c0b-8fcc-4668-b4f0-bf23549cf8d7 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:05.488501 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1022c0b-8fcc-4668-b4f0-bf23549cf8d7 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:05.488501 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1022c0b-8fcc-4668-b4f0-bf23549cf8d7 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:05.489940 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 609/1247] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:30:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:30:05.495850 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965fc74-36f5-46e8-a00e-9bea3511873b None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:05.496296 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965fc74-36f5-46e8-a00e-9bea3511873b None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:05.501623 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965fc74-36f5-46e8-a00e-9bea3511873b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:05.501623 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:05.514364 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-0965fc74-36f5-46e8-a00e-9bea3511873b None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:30:05.515711 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-0965fc74-36f5-46e8-a00e-9bea3511873b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:05.583645 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 639/1248] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:30:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:30:05.608410 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1022c0b-8fcc-4668-b4f0-bf23549cf8d7 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:05.631095 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:05.715656 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1022c0b-8fcc-4668-b4f0-bf23549cf8d7 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:05.753467 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8919e8f4-c12e-4186-b104-eeff80ed5bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:05.754203 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919e8f4-c12e-4186-b104-eeff80ed5bd0 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:05.754493 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919e8f4-c12e-4186-b104-eeff80ed5bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:05.754771 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919e8f4-c12e-4186-b104-eeff80ed5bd0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:05.767223 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8919e8f4-c12e-4186-b104-eeff80ed5bd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:30:05.774968 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-8919e8f4-c12e-4186-b104-eeff80ed5bd0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:30:05.774968 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:30:05.774968 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:30:05.774968 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:30:05.774968 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:30:05.774968 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:30:05.774968 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:30:05.774968 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:30:05.774968 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:30:05.774968 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:30:05.774968 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:30:05.774968 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:30:05.774968 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:30:05.774968 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:30:05.774968 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:30:05.774968 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:30:05.776049 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:30:05.776049 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:30:05.776049 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:30:05.776049 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:30:05.776049 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:30:05.776049 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:30:05.776049 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:30:05.776049 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:30:05.776049 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:30:05.776049 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:30:05.776049 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:30:05.776049 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:30:05.776049 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:30:05.776049 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:30:05.776049 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:30:05.776049 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:30:05.777260 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:30:05.777260 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:30:05.777260 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:30:05.777260 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:30:05.777260 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:30:05.777260 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:30:05.777260 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:30:05.777260 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:30:05.777260 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:30:05.777260 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:30:05.777260 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:30:05.777260 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:30:05.777260 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 610/1249] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:30:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:30:05.782727 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0965fc74-36f5-46e8-a00e-9bea3511873b None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:05.882230 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0965fc74-36f5-46e8-a00e-9bea3511873b None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:05.912901 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:05.917990 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359c1d2-2577-4e77-8d46-064cba0e597a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:05.930951 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359c1d2-2577-4e77-8d46-064cba0e597a None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:05.930951 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359c1d2-2577-4e77-8d46-064cba0e597a None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:05.930951 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359c1d2-2577-4e77-8d46-064cba0e597a None admin] PATH_INFO: `/v3/roles` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:05.930951 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8359c1d2-2577-4e77-8d46-064cba0e597a None admin] RBAC: Adding query filter params (name=admin) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:30:05.930951 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8359c1d2-2577-4e77-8d46-064cba0e597a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:05.930951 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8359c1d2-2577-4e77-8d46-064cba0e597a None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:05.931461 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 640/1250] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:30:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:30:05.935797 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8919e8f4-c12e-4186-b104-eeff80ed5bd0 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:06.016161 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:06.040318 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8919e8f4-c12e-4186-b104-eeff80ed5bd0 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:06.076156 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b4710-346f-4b9d-afc8-0430e8a2c8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:06.076960 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b4710-346f-4b9d-afc8-0430e8a2c8dd None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:06.077247 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b4710-346f-4b9d-afc8-0430e8a2c8dd None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:06.077528 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b4710-346f-4b9d-afc8-0430e8a2c8dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:06.087899 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b4710-346f-4b9d-afc8-0430e8a2c8dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:06.089994 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b4710-346f-4b9d-afc8-0430e8a2c8dd None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:06.107720 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-aa5b4710-346f-4b9d-afc8-0430e8a2c8dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:30:06.107720 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:30:06.107720 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:30:06.107720 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:30:06.107720 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:30:06.107720 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:30:06.107720 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:30:06.107720 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:30:06.107720 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:30:06.107720 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:30:06.107720 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:30:06.107720 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:30:06.107720 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:30:06.107720 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:30:06.107720 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:30:06.108840 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:30:06.108840 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:30:06.108840 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:30:06.108840 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:30:06.108840 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:30:06.108840 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:30:06.108840 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:30:06.108840 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:30:06.108840 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:30:06.108840 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:30:06.108840 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:30:06.108840 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:30:06.108840 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:30:06.108840 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:30:06.108840 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:30:06.108840 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:30:06.108840 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:30:06.109731 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:30:06.109731 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:30:06.109731 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:30:06.109731 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:30:06.110663 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 611/1251] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:30:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:30:06.114786 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359c1d2-2577-4e77-8d46-064cba0e597a None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:06.224678 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359c1d2-2577-4e77-8d46-064cba0e597a None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:06.263902 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abea6d8-88dc-4f81-997d-05016177c83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:06.264576 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abea6d8-88dc-4f81-997d-05016177c83f None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:06.264866 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abea6d8-88dc-4f81-997d-05016177c83f None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:06.265148 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abea6d8-88dc-4f81-997d-05016177c83f None admin] PATH_INFO: `/v3/domains` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:06.265868 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abea6d8-88dc-4f81-997d-05016177c83f None admin] RBAC: Adding query filter params (name=Default) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:30:06.266305 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abea6d8-88dc-4f81-997d-05016177c83f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:06.267592 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abea6d8-88dc-4f81-997d-05016177c83f None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:06.279774 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 641/1252] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:30:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:30:06.285430 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b4710-346f-4b9d-afc8-0430e8a2c8dd None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:06.387605 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b4710-346f-4b9d-afc8-0430e8a2c8dd None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:06.413781 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:06.421627 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a16dfb-4751-41c0-8f77-6de1bd622d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:06.422487 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a16dfb-4751-41c0-8f77-6de1bd622d48 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:06.422782 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a16dfb-4751-41c0-8f77-6de1bd622d48 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:06.423071 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a16dfb-4751-41c0-8f77-6de1bd622d48 None admin] PATH_INFO: `/v3/users/placement` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:06.430204 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a16dfb-4751-41c0-8f77-6de1bd622d48 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:06.431664 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a16dfb-4751-41c0-8f77-6de1bd622d48 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:06.447140 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-08a16dfb-4751-41c0-8f77-6de1bd622d48 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 21:30:06.447140 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:30:06.447140 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:30:06.447140 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:30:06.447140 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:30:06.447140 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:30:06.447140 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:30:06.447140 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:30:06.447140 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:30:06.447140 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:30:06.447140 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:30:06.447140 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:30:06.447140 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:30:06.447140 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:30:06.447140 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:30:06.447140 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:30:06.453003 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:30:06.453003 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:30:06.453003 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:30:06.453003 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:30:06.453003 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:30:06.453003 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:30:06.453003 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:30:06.453003 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:30:06.453003 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:30:06.453003 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:30:06.453003 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:30:06.453003 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:30:06.453003 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:30:06.453003 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:30:06.453003 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:30:06.453003 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:30:06.453003 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:30:06.453003 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:30:06.454082 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:30:06.454082 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:30:06.454082 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:30:06.454082 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:30:06.454082 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:30:06.454082 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:30:06.454082 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:30:06.454082 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:30:06.454082 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 21:30:06.454082 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:30:06.454082 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 612/1253] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:30:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:30:06.454858 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abea6d8-88dc-4f81-997d-05016177c83f None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:06.511339 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:06.556301 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abea6d8-88dc-4f81-997d-05016177c83f None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:06.590951 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a1f01a-0590-437d-8cde-3ecc992a0dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:06.591625 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1f01a-0590-437d-8cde-3ecc992a0dbc None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:06.591917 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1f01a-0590-437d-8cde-3ecc992a0dbc None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:06.592196 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1f01a-0590-437d-8cde-3ecc992a0dbc None admin] PATH_INFO: `/v3/users` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:06.593073 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a1f01a-0590-437d-8cde-3ecc992a0dbc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:30:06.593355 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a1f01a-0590-437d-8cde-3ecc992a0dbc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:06.594830 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a1f01a-0590-437d-8cde-3ecc992a0dbc None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:06.612432 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 642/1254] 10.222.0.30 () {56 vars in 1143 bytes} [Tue Jul 5 21:30:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:30:06.618339 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a16dfb-4751-41c0-8f77-6de1bd622d48 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:06.719041 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a16dfb-4751-41c0-8f77-6de1bd622d48 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:06.756373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65e657-30d7-41ed-9860-cfc770e7666e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:06.757072 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65e657-30d7-41ed-9860-cfc770e7666e None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:06.757483 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65e657-30d7-41ed-9860-cfc770e7666e None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:06.757772 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65e657-30d7-41ed-9860-cfc770e7666e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:06.814179 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:06.826614 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa65e657-30d7-41ed-9860-cfc770e7666e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:06.828061 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa65e657-30d7-41ed-9860-cfc770e7666e None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:06.927758 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 613/1255] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:30:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:30:06.934179 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a1f01a-0590-437d-8cde-3ecc992a0dbc None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:07.037415 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a1f01a-0590-437d-8cde-3ecc992a0dbc None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:07.050506 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:07.071690 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b0bf2-93cd-4e74-b175-5dccdf291237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:07.072413 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b0bf2-93cd-4e74-b175-5dccdf291237 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:07.072699 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b0bf2-93cd-4e74-b175-5dccdf291237 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:07.073539 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b0bf2-93cd-4e74-b175-5dccdf291237 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:07.083436 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b0bf2-93cd-4e74-b175-5dccdf291237 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:07.084892 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b0bf2-93cd-4e74-b175-5dccdf291237 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:07.103208 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-768b0bf2-93cd-4e74-b175-5dccdf291237 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:30:07.103208 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:30:07.103208 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:30:07.103208 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:30:07.103208 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:30:07.103208 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:30:07.103208 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:30:07.103208 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:30:07.103208 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:30:07.103208 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:30:07.103208 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:30:07.103208 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:30:07.103208 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:30:07.103208 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:30:07.103208 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:30:07.104385 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:30:07.104385 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:30:07.104385 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:30:07.104385 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:30:07.104385 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:30:07.104385 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:30:07.104385 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:30:07.104385 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:30:07.104385 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:30:07.104385 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:30:07.104385 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:30:07.104385 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:30:07.104385 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:30:07.104385 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:30:07.104385 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:30:07.104385 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:30:07.104385 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:30:07.110163 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:30:07.110163 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:30:07.110163 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:30:07.110163 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:30:07.110163 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 643/1256] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:30:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:30:07.110487 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65e657-30d7-41ed-9860-cfc770e7666e None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:07.197688 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:07.210313 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65e657-30d7-41ed-9860-cfc770e7666e None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:07.246340 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba993e2-1e92-4b19-9084-45cf4350542c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:07.247000 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba993e2-1e92-4b19-9084-45cf4350542c None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:07.247289 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba993e2-1e92-4b19-9084-45cf4350542c None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:07.247590 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba993e2-1e92-4b19-9084-45cf4350542c None admin] PATH_INFO: `/v3/domains` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:07.248308 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba993e2-1e92-4b19-9084-45cf4350542c None admin] RBAC: Adding query filter params (name=Default) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:30:07.248621 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba993e2-1e92-4b19-9084-45cf4350542c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:07.250000 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba993e2-1e92-4b19-9084-45cf4350542c None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:07.262082 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 614/1257] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:30:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:30:07.267735 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b0bf2-93cd-4e74-b175-5dccdf291237 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:07.368892 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b0bf2-93cd-4e74-b175-5dccdf291237 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:07.402791 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b0e7e-9d9c-4341-85e1-ff7c814b9b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:07.403580 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b0e7e-9d9c-4341-85e1-ff7c814b9b43 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:07.403868 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b0e7e-9d9c-4341-85e1-ff7c814b9b43 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:07.404148 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b0e7e-9d9c-4341-85e1-ff7c814b9b43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:07.411015 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b0e7e-9d9c-4341-85e1-ff7c814b9b43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:07.415588 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b0e7e-9d9c-4341-85e1-ff7c814b9b43 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:07.427230 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-b44b0e7e-9d9c-4341-85e1-ff7c814b9b43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:30:07.427230 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:30:07.427230 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:30:07.427230 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:30:07.427230 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:30:07.427230 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:30:07.427230 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:30:07.427230 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:30:07.427230 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:30:07.427230 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:30:07.427230 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:30:07.427230 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:30:07.427230 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:30:07.427230 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:30:07.427230 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:30:07.428286 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:30:07.428286 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:30:07.428286 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:30:07.428286 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:30:07.428286 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:30:07.428286 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:30:07.428286 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:30:07.428286 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:30:07.428286 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:30:07.428286 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:30:07.428286 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:30:07.428286 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:30:07.428286 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:30:07.428286 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:30:07.428286 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:30:07.428286 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:30:07.428286 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:30:07.429589 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:30:07.429589 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:30:07.429589 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:30:07.429589 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:30:07.429589 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:30:07.429589 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:30:07.429589 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:30:07.429589 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:30:07.429589 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 644/1258] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:30:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:30:07.434925 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba993e2-1e92-4b19-9084-45cf4350542c None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:07.535640 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba993e2-1e92-4b19-9084-45cf4350542c None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:07.570100 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3aae32-6723-4d8a-821e-32e19de517f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:07.570803 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3aae32-6723-4d8a-821e-32e19de517f9 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:07.571097 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3aae32-6723-4d8a-821e-32e19de517f9 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:07.571385 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3aae32-6723-4d8a-821e-32e19de517f9 None admin] PATH_INFO: `/v3/projects` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:07.572215 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3aae32-6723-4d8a-821e-32e19de517f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:30:07.572533 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3aae32-6723-4d8a-821e-32e19de517f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:07.574024 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3aae32-6723-4d8a-821e-32e19de517f9 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:07.586371 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 615/1259] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:30:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:30:07.592829 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b0e7e-9d9c-4341-85e1-ff7c814b9b43 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:07.618530 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:07.690450 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b0e7e-9d9c-4341-85e1-ff7c814b9b43 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:07.725071 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbdc981-6d10-4974-8742-fdbb9a8fef2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:07.725727 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdc981-6d10-4974-8742-fdbb9a8fef2a None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:07.726015 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdc981-6d10-4974-8742-fdbb9a8fef2a None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:07.726327 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdc981-6d10-4974-8742-fdbb9a8fef2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:07.727167 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbdc981-6d10-4974-8742-fdbb9a8fef2a None admin] RBAC: Adding query filter params (role.id=00090b1962654604b8e106a05d44d06a, scope.project.id=7fe768315f5c43f487f71f043f11b8b8, user.id=a81dc86423cc42ddad57b10c04808176) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:30:07.729977 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbdc981-6d10-4974-8742-fdbb9a8fef2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:07.729977 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbdc981-6d10-4974-8742-fdbb9a8fef2a None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:07.735250 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 645/1260] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:30:07 2022] GET /identity/v3/role_assignments?user.id=a81dc86423cc42ddad57b10c04808176&scope.project.id=7fe768315f5c43f487f71f043f11b8b8&role.id=00090b1962654604b8e106a05d44d06a => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:30:09.736385 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daee0b9-e75b-47de-b051-951a72793552 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:09.736944 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daee0b9-e75b-47de-b051-951a72793552 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:09.736944 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daee0b9-e75b-47de-b051-951a72793552 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:09.738350 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 616/1261] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:30:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:30:09.743630 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707383c-e1f8-4e54-b66a-7bfdd23c2fdc None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:09.744079 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707383c-e1f8-4e54-b66a-7bfdd23c2fdc None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:09.744233 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707383c-e1f8-4e54-b66a-7bfdd23c2fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:09.761609 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-c707383c-e1f8-4e54-b66a-7bfdd23c2fdc None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:30:09.762832 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-c707383c-e1f8-4e54-b66a-7bfdd23c2fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:09.828913 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 646/1262] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:30:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:30:09.851724 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daee0b9-e75b-47de-b051-951a72793552 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:09.863115 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:09.954642 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daee0b9-e75b-47de-b051-951a72793552 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:09.989268 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8bd8c-a045-40bf-a522-50ddacc23025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:09.990060 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8bd8c-a045-40bf-a522-50ddacc23025 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:09.990380 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8bd8c-a045-40bf-a522-50ddacc23025 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:09.990666 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8bd8c-a045-40bf-a522-50ddacc23025 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:10.000761 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f8bd8c-a045-40bf-a522-50ddacc23025 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:30:10.008337 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-57f8bd8c-a045-40bf-a522-50ddacc23025 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:30:10.008337 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:30:10.008337 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:30:10.008337 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:30:10.008337 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:30:10.008337 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:30:10.008337 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:30:10.008337 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:30:10.008337 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:30:10.008337 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:30:10.008337 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:30:10.008337 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:30:10.008337 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:30:10.008337 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:30:10.008337 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:30:10.008337 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:30:10.010248 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:30:10.010248 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:30:10.010248 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:30:10.010248 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:30:10.010248 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:30:10.010248 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:30:10.010248 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:30:10.010248 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:30:10.010248 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:30:10.010248 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:30:10.010248 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:30:10.010248 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:30:10.010248 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:30:10.010248 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:30:10.010248 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:30:10.010248 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:30:10.011395 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:30:10.011395 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:30:10.011395 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:30:10.011395 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:30:10.011395 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:30:10.011395 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:30:10.011395 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:30:10.011395 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:30:10.011395 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:30:10.011395 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:30:10.011395 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:30:10.011395 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:30:10.011395 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 617/1263] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:30:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:30:10.015853 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c707383c-e1f8-4e54-b66a-7bfdd23c2fdc None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:10.034795 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:10.115582 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c707383c-e1f8-4e54-b66a-7bfdd23c2fdc None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:10.152903 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d2bd8-4c63-41f8-9311-00b6644fb52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:10.153810 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d2bd8-4c63-41f8-9311-00b6644fb52a None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:10.154254 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d2bd8-4c63-41f8-9311-00b6644fb52a None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:10.154668 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d2bd8-4c63-41f8-9311-00b6644fb52a None admin] PATH_INFO: `/v3/roles` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:10.155820 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d2bd8-4c63-41f8-9311-00b6644fb52a None admin] RBAC: Adding query filter params (name=admin) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:30:10.156249 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d2bd8-4c63-41f8-9311-00b6644fb52a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:10.158311 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d2bd8-4c63-41f8-9311-00b6644fb52a None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:10.168602 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 647/1264] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:30:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:30:10.174503 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8bd8c-a045-40bf-a522-50ddacc23025 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:10.241921 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:10.275121 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8bd8c-a045-40bf-a522-50ddacc23025 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:10.309302 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ce7ae-683d-47d0-8dee-318d6affc0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:10.310369 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ce7ae-683d-47d0-8dee-318d6affc0fe None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:10.311103 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ce7ae-683d-47d0-8dee-318d6affc0fe None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:10.311392 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ce7ae-683d-47d0-8dee-318d6affc0fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:10.322000 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ce7ae-683d-47d0-8dee-318d6affc0fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:10.324301 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ce7ae-683d-47d0-8dee-318d6affc0fe None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:10.342317 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-4e4ce7ae-683d-47d0-8dee-318d6affc0fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:30:10.342317 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:30:10.342317 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:30:10.342317 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:30:10.342317 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:30:10.342317 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:30:10.342317 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:30:10.342317 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:30:10.342317 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:30:10.342317 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:30:10.342317 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:30:10.342317 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:30:10.342317 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:30:10.342317 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:30:10.342317 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:30:10.347893 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:30:10.347893 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:30:10.347893 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:30:10.347893 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:30:10.347893 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:30:10.347893 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:30:10.347893 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:30:10.347893 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:30:10.347893 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:30:10.347893 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:30:10.347893 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:30:10.347893 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:30:10.347893 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:30:10.347893 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:30:10.347893 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:30:10.347893 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:30:10.347893 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:30:10.349046 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:30:10.349046 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:30:10.349046 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:30:10.349046 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:30:10.349046 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 618/1265] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:30:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:30:10.349757 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d2bd8-4c63-41f8-9311-00b6644fb52a None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:10.432277 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:10.451850 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d2bd8-4c63-41f8-9311-00b6644fb52a None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:10.489417 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d30531-8db8-41e3-8c1e-bba1c23c805b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:10.490085 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d30531-8db8-41e3-8c1e-bba1c23c805b None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:10.490413 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d30531-8db8-41e3-8c1e-bba1c23c805b None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:10.490697 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d30531-8db8-41e3-8c1e-bba1c23c805b None admin] PATH_INFO: `/v3/domains` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:10.491479 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d30531-8db8-41e3-8c1e-bba1c23c805b None admin] RBAC: Adding query filter params (name=Default) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:30:10.491795 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d30531-8db8-41e3-8c1e-bba1c23c805b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:10.493190 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d30531-8db8-41e3-8c1e-bba1c23c805b None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:10.505518 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 648/1266] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:30:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:30:10.511974 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ce7ae-683d-47d0-8dee-318d6affc0fe None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:10.615973 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ce7ae-683d-47d0-8dee-318d6affc0fe None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:10.636160 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:10.649965 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd7ab4-ca60-429f-82a6-552819e0314c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:10.650787 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd7ab4-ca60-429f-82a6-552819e0314c None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:10.651165 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd7ab4-ca60-429f-82a6-552819e0314c None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:10.651604 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd7ab4-ca60-429f-82a6-552819e0314c None admin] PATH_INFO: `/v3/users/placement` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:10.658945 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd7ab4-ca60-429f-82a6-552819e0314c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:10.660377 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd7ab4-ca60-429f-82a6-552819e0314c None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:10.674520 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-9bcd7ab4-ca60-429f-82a6-552819e0314c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 21:30:10.674520 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:30:10.674520 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:30:10.674520 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:30:10.674520 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:30:10.674520 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:30:10.674520 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:30:10.674520 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:30:10.674520 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:30:10.674520 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:30:10.674520 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:30:10.674520 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:30:10.674520 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:30:10.674520 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:30:10.674520 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:30:10.674520 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:30:10.675727 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:30:10.675727 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:30:10.675727 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:30:10.675727 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:30:10.675727 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:30:10.675727 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:30:10.675727 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:30:10.675727 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:30:10.675727 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:30:10.675727 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:30:10.675727 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:30:10.675727 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:30:10.675727 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:30:10.675727 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:30:10.675727 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:30:10.675727 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:30:10.675727 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:30:10.675727 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:30:10.676891 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:30:10.676891 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:30:10.676891 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:30:10.676891 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:30:10.676891 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:30:10.676891 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:30:10.676891 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:30:10.676891 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:30:10.676891 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 21:30:10.676891 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:30:10.676891 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 619/1267] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:30:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:30:10.681997 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d30531-8db8-41e3-8c1e-bba1c23c805b None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:10.783208 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d30531-8db8-41e3-8c1e-bba1c23c805b None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:10.818055 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874209c3-3e96-4a43-828f-446da15d9b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:10.818763 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874209c3-3e96-4a43-828f-446da15d9b28 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:10.819053 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874209c3-3e96-4a43-828f-446da15d9b28 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:10.819338 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874209c3-3e96-4a43-828f-446da15d9b28 None admin] PATH_INFO: `/v3/users` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:10.820176 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874209c3-3e96-4a43-828f-446da15d9b28 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:30:10.820492 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874209c3-3e96-4a43-828f-446da15d9b28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:10.821925 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874209c3-3e96-4a43-828f-446da15d9b28 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:10.831499 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:10.841077 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 649/1268] 10.222.0.30 () {56 vars in 1143 bytes} [Tue Jul 5 21:30:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:30:10.846950 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd7ab4-ca60-429f-82a6-552819e0314c None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:10.949454 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd7ab4-ca60-429f-82a6-552819e0314c None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:10.983797 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083fadc-eea7-4726-89ce-5fa18e6f635a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:10.984586 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083fadc-eea7-4726-89ce-5fa18e6f635a None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:10.984872 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083fadc-eea7-4726-89ce-5fa18e6f635a None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:10.985149 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083fadc-eea7-4726-89ce-5fa18e6f635a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:10.996227 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083fadc-eea7-4726-89ce-5fa18e6f635a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:11.001190 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083fadc-eea7-4726-89ce-5fa18e6f635a None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:11.015253 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-f083fadc-eea7-4726-89ce-5fa18e6f635a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:30:11.015253 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:30:11.015253 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:30:11.015253 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:30:11.015253 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:30:11.015253 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:30:11.015253 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:30:11.015253 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:30:11.015253 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:30:11.015253 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:30:11.015253 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:30:11.015253 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:30:11.015253 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:30:11.015253 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:30:11.015253 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:30:11.016203 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:30:11.016203 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:30:11.016203 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:30:11.016203 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:30:11.016203 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:30:11.016203 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:30:11.016203 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:30:11.016203 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:30:11.016203 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:30:11.016203 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:30:11.016203 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:30:11.016203 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:30:11.016203 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:30:11.016203 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:30:11.016203 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:30:11.016203 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:30:11.016203 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:30:11.017161 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:30:11.017161 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:30:11.017161 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:30:11.017161 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:30:11.017161 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 620/1269] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:30:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:30:11.022301 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874209c3-3e96-4a43-828f-446da15d9b28 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:11.122934 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874209c3-3e96-4a43-828f-446da15d9b28 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:11.158178 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b8b68-ce79-4c03-9ab1-24d596f297cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:11.158842 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b8b68-ce79-4c03-9ab1-24d596f297cd None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:11.159135 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b8b68-ce79-4c03-9ab1-24d596f297cd None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:11.159416 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b8b68-ce79-4c03-9ab1-24d596f297cd None admin] PATH_INFO: `/v3/domains` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:11.160135 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b8b68-ce79-4c03-9ab1-24d596f297cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:30:11.160447 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b8b68-ce79-4c03-9ab1-24d596f297cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:11.161824 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b8b68-ce79-4c03-9ab1-24d596f297cd None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:11.173132 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 650/1270] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:30:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:30:11.178920 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083fadc-eea7-4726-89ce-5fa18e6f635a None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:11.210724 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:11.282791 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083fadc-eea7-4726-89ce-5fa18e6f635a None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:11.316879 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d992bd-ed21-48b9-8d36-a3d18cd74638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:11.317866 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d992bd-ed21-48b9-8d36-a3d18cd74638 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:11.318183 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d992bd-ed21-48b9-8d36-a3d18cd74638 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:11.318463 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d992bd-ed21-48b9-8d36-a3d18cd74638 None admin] PATH_INFO: `/v3/projects/service` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:11.325761 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d992bd-ed21-48b9-8d36-a3d18cd74638 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:11.327235 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d992bd-ed21-48b9-8d36-a3d18cd74638 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:11.342271 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-76d992bd-ed21-48b9-8d36-a3d18cd74638 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:30:11.342271 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:30:11.342271 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:30:11.342271 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:30:11.342271 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:30:11.342271 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:30:11.342271 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:30:11.342271 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:30:11.342271 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:30:11.342271 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:30:11.342271 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:30:11.342271 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:30:11.342271 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:30:11.342271 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:30:11.342271 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:30:11.343345 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:30:11.343345 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:30:11.343345 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:30:11.343345 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:30:11.343345 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:30:11.343345 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:30:11.343345 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:30:11.343345 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:30:11.343345 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:30:11.343345 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:30:11.343345 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:30:11.343345 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:30:11.343345 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:30:11.343345 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:30:11.343345 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:30:11.343345 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:30:11.343345 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:30:11.344275 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:30:11.344275 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:30:11.344275 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:30:11.344275 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:30:11.344275 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:30:11.344275 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:30:11.344275 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:30:11.344275 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:30:11.344275 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 621/1271] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:30:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:30:11.350227 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b8b68-ce79-4c03-9ab1-24d596f297cd None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:11.411624 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:11.453306 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b8b68-ce79-4c03-9ab1-24d596f297cd None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:11.486688 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6625fd12-fbab-4892-b6f8-b303430e3017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:11.487363 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625fd12-fbab-4892-b6f8-b303430e3017 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:11.487652 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625fd12-fbab-4892-b6f8-b303430e3017 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:11.487932 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625fd12-fbab-4892-b6f8-b303430e3017 None admin] PATH_INFO: `/v3/projects` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:11.488720 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6625fd12-fbab-4892-b6f8-b303430e3017 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:30:11.489031 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6625fd12-fbab-4892-b6f8-b303430e3017 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:11.490480 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6625fd12-fbab-4892-b6f8-b303430e3017 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:11.502864 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 651/1272] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:30:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:30:11.508847 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d992bd-ed21-48b9-8d36-a3d18cd74638 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:11.600484 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:11.609193 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d992bd-ed21-48b9-8d36-a3d18cd74638 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:11.643983 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d37387-069d-4741-b3c2-c6e0549124e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:11.644878 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d37387-069d-4741-b3c2-c6e0549124e3 None admin] REQUEST_METHOD: `PUT` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:11.645169 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d37387-069d-4741-b3c2-c6e0549124e3 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:11.645451 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d37387-069d-4741-b3c2-c6e0549124e3 None admin] PATH_INFO: `/v3/projects/7fe768315f5c43f487f71f043f11b8b8/users/a81dc86423cc42ddad57b10c04808176/roles/00090b1962654604b8e106a05d44d06a` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:11.647437 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d37387-069d-4741-b3c2-c6e0549124e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=7fe768315f5c43f487f71f043f11b8b8, user_id=a81dc86423cc42ddad57b10c04808176, role_id=00090b1962654604b8e106a05d44d06a)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:11.648878 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d37387-069d-4741-b3c2-c6e0549124e3 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:11.743794 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 622/1273] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:30:11 2022] PUT /identity/v3/projects/7fe768315f5c43f487f71f043f11b8b8/users/a81dc86423cc42ddad57b10c04808176/roles/00090b1962654604b8e106a05d44d06a => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:30:13.854647 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0176003-3c36-44c7-93b5-70c5d1d0a8c1 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:13.855152 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0176003-3c36-44c7-93b5-70c5d1d0a8c1 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:13.855256 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0176003-3c36-44c7-93b5-70c5d1d0a8c1 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:13.856701 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 652/1274] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:30:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:30:13.862106 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1a049-9617-4496-b2e4-d09c764cb4ef None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:13.862583 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1a049-9617-4496-b2e4-d09c764cb4ef None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:13.862716 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1a049-9617-4496-b2e4-d09c764cb4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:13.881922 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-b6b1a049-9617-4496-b2e4-d09c764cb4ef None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:30:13.883198 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-b6b1a049-9617-4496-b2e4-d09c764cb4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:13.962000 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 623/1275] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:30:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:30:13.996975 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0176003-3c36-44c7-93b5-70c5d1d0a8c1 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:14.116970 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0176003-3c36-44c7-93b5-70c5d1d0a8c1 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:14.136305 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:14.157497 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ee2ba-f33a-43bf-84ea-05ab8807baba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:14.158333 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ee2ba-f33a-43bf-84ea-05ab8807baba None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:14.158633 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ee2ba-f33a-43bf-84ea-05ab8807baba None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:14.158916 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ee2ba-f33a-43bf-84ea-05ab8807baba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:14.169991 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ee2ba-f33a-43bf-84ea-05ab8807baba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:30:14.177762 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-478ee2ba-f33a-43bf-84ea-05ab8807baba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:30:14.177762 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:30:14.177762 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:30:14.177762 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:30:14.177762 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:30:14.177762 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:30:14.177762 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:30:14.177762 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:30:14.177762 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:30:14.177762 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:30:14.177762 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:30:14.177762 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:30:14.177762 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:30:14.177762 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:30:14.177762 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:30:14.177762 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:30:14.178904 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:30:14.178904 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:30:14.178904 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:30:14.178904 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:30:14.178904 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:30:14.178904 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:30:14.178904 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:30:14.178904 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:30:14.178904 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:30:14.178904 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:30:14.178904 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:30:14.178904 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:30:14.178904 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:30:14.178904 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:30:14.178904 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:30:14.178904 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:30:14.179931 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:30:14.179931 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:30:14.179931 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:30:14.179931 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:30:14.179931 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:30:14.179931 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:30:14.179931 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:30:14.179931 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:30:14.179931 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:30:14.179931 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:30:14.179931 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:30:14.179931 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:30:14.179931 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 653/1276] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:30:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:30:14.185902 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1a049-9617-4496-b2e4-d09c764cb4ef None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:14.266826 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:14.285062 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1a049-9617-4496-b2e4-d09c764cb4ef None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:14.320534 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98025827-b754-4bc4-9d97-fc76d12a8422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:14.321419 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98025827-b754-4bc4-9d97-fc76d12a8422 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:14.322085 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98025827-b754-4bc4-9d97-fc76d12a8422 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:14.322533 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98025827-b754-4bc4-9d97-fc76d12a8422 None admin] PATH_INFO: `/v3/roles` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:14.323879 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98025827-b754-4bc4-9d97-fc76d12a8422 None admin] RBAC: Adding query filter params (name=admin) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:30:14.324201 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98025827-b754-4bc4-9d97-fc76d12a8422 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:14.325723 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98025827-b754-4bc4-9d97-fc76d12a8422 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:14.334442 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 624/1277] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:30:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:30:14.340845 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ee2ba-f33a-43bf-84ea-05ab8807baba None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:14.443253 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ee2ba-f33a-43bf-84ea-05ab8807baba None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:14.476602 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c0e9a-997f-41d6-9911-5a736d40ec21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:14.477401 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c0e9a-997f-41d6-9911-5a736d40ec21 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:14.477688 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c0e9a-997f-41d6-9911-5a736d40ec21 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:14.477966 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c0e9a-997f-41d6-9911-5a736d40ec21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:14.489266 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c0e9a-997f-41d6-9911-5a736d40ec21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:14.490770 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c0e9a-997f-41d6-9911-5a736d40ec21 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:14.507691 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-ae3c0e9a-997f-41d6-9911-5a736d40ec21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:30:14.507691 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:30:14.507691 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:30:14.507691 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:30:14.507691 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:30:14.507691 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:30:14.507691 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:30:14.507691 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:30:14.507691 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:30:14.507691 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:30:14.507691 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:30:14.507691 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:30:14.507691 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:30:14.507691 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:30:14.507691 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:30:14.508787 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:30:14.508787 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:30:14.508787 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:30:14.508787 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:30:14.508787 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:30:14.508787 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:30:14.508787 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:30:14.508787 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:30:14.508787 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:30:14.508787 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:30:14.508787 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:30:14.508787 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:30:14.508787 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:30:14.508787 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:30:14.508787 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:30:14.508787 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:30:14.508787 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:30:14.510082 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:30:14.510082 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:30:14.510082 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:30:14.510082 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:30:14.510082 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 654/1278] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:30:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:30:14.514937 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98025827-b754-4bc4-9d97-fc76d12a8422 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:14.618256 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98025827-b754-4bc4-9d97-fc76d12a8422 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:14.654193 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d95f7-6da3-456a-8674-b2320b1f8031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:14.655321 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d95f7-6da3-456a-8674-b2320b1f8031 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:14.655814 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d95f7-6da3-456a-8674-b2320b1f8031 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:14.656336 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d95f7-6da3-456a-8674-b2320b1f8031 None admin] PATH_INFO: `/v3/domains` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:14.657676 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3d95f7-6da3-456a-8674-b2320b1f8031 None admin] RBAC: Adding query filter params (name=Default) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:30:14.658043 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3d95f7-6da3-456a-8674-b2320b1f8031 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:14.659483 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3d95f7-6da3-456a-8674-b2320b1f8031 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:14.673889 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 625/1279] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:30:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:30:14.679495 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c0e9a-997f-41d6-9911-5a736d40ec21 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:14.710396 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:14.782027 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c0e9a-997f-41d6-9911-5a736d40ec21 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:14.815261 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb78a11-69d7-4362-bfa8-b6fabe1ad70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:14.816091 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb78a11-69d7-4362-bfa8-b6fabe1ad70a None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:14.816482 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb78a11-69d7-4362-bfa8-b6fabe1ad70a None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:14.816768 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb78a11-69d7-4362-bfa8-b6fabe1ad70a None admin] PATH_INFO: `/v3/users/placement` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:14.824862 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb78a11-69d7-4362-bfa8-b6fabe1ad70a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:14.826336 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb78a11-69d7-4362-bfa8-b6fabe1ad70a None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:14.842298 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-0bb78a11-69d7-4362-bfa8-b6fabe1ad70a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 21:30:14.842298 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:30:14.842298 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:30:14.842298 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:30:14.842298 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:30:14.842298 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:30:14.842298 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:30:14.842298 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:30:14.842298 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:30:14.842298 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:30:14.842298 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:30:14.842298 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:30:14.842298 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:30:14.842298 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:30:14.842298 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:30:14.842298 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:30:14.843600 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:30:14.843600 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:30:14.843600 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:30:14.843600 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:30:14.843600 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:30:14.843600 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:30:14.843600 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:30:14.843600 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:30:14.843600 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:30:14.843600 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:30:14.843600 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:30:14.843600 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:30:14.843600 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:30:14.843600 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:30:14.843600 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:30:14.843600 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:30:14.843600 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:30:14.843600 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:30:14.844648 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:30:14.844648 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:30:14.844648 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:30:14.844648 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:30:14.844648 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:30:14.844648 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:30:14.844648 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:30:14.844648 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:30:14.844648 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 21:30:14.844648 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:30:14.844648 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 655/1280] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:30:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:30:14.849441 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d95f7-6da3-456a-8674-b2320b1f8031 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:14.853276 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:14.950010 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d95f7-6da3-456a-8674-b2320b1f8031 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:14.986825 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92debcef-1f6f-44d5-acfe-715d7b2a45d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:14.987433 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92debcef-1f6f-44d5-acfe-715d7b2a45d6 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:14.987723 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92debcef-1f6f-44d5-acfe-715d7b2a45d6 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:14.988055 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92debcef-1f6f-44d5-acfe-715d7b2a45d6 None admin] PATH_INFO: `/v3/users` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:14.988891 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92debcef-1f6f-44d5-acfe-715d7b2a45d6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:30:14.989205 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92debcef-1f6f-44d5-acfe-715d7b2a45d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:14.990776 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92debcef-1f6f-44d5-acfe-715d7b2a45d6 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:15.008209 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 626/1281] 10.222.0.30 () {56 vars in 1143 bytes} [Tue Jul 5 21:30:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:30:15.014716 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb78a11-69d7-4362-bfa8-b6fabe1ad70a None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:15.105470 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:15.114773 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb78a11-69d7-4362-bfa8-b6fabe1ad70a None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:15.147892 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4e0a6-7077-456a-a03d-26d699dee481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:15.148581 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4e0a6-7077-456a-a03d-26d699dee481 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:15.148874 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4e0a6-7077-456a-a03d-26d699dee481 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:15.149151 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4e0a6-7077-456a-a03d-26d699dee481 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:15.218919 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e4e0a6-7077-456a-a03d-26d699dee481 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:15.220377 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e4e0a6-7077-456a-a03d-26d699dee481 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:15.310608 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:15.320881 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 656/1282] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:30:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:30:15.327767 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92debcef-1f6f-44d5-acfe-715d7b2a45d6 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:15.393205 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:15.431593 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92debcef-1f6f-44d5-acfe-715d7b2a45d6 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:15.465646 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088edb3b-98a6-410f-977f-64f6aefb22c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:15.466479 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088edb3b-98a6-410f-977f-64f6aefb22c5 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:15.466773 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088edb3b-98a6-410f-977f-64f6aefb22c5 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:15.467139 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088edb3b-98a6-410f-977f-64f6aefb22c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:15.477665 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088edb3b-98a6-410f-977f-64f6aefb22c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:15.479249 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088edb3b-98a6-410f-977f-64f6aefb22c5 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:15.497311 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-088edb3b-98a6-410f-977f-64f6aefb22c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:30:15.497311 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:30:15.497311 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:30:15.497311 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:30:15.497311 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:30:15.497311 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:30:15.497311 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:30:15.497311 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:30:15.497311 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:30:15.497311 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:30:15.497311 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:30:15.497311 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:30:15.497311 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:30:15.497311 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:30:15.497311 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:30:15.498368 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:30:15.498368 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:30:15.498368 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:30:15.498368 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:30:15.498368 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:30:15.498368 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:30:15.498368 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:30:15.498368 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:30:15.498368 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:30:15.498368 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:30:15.498368 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:30:15.498368 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:30:15.498368 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:30:15.498368 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:30:15.498368 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:30:15.498368 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:30:15.498368 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:30:15.499616 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:30:15.499616 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:30:15.499616 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:30:15.499616 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:30:15.499616 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 627/1283] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:30:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:30:15.504335 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4e0a6-7077-456a-a03d-26d699dee481 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:15.606881 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4e0a6-7077-456a-a03d-26d699dee481 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:15.642866 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64893519-dbf2-409d-9d84-63df98760279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:15.643531 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64893519-dbf2-409d-9d84-63df98760279 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:15.643820 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64893519-dbf2-409d-9d84-63df98760279 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:15.644103 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64893519-dbf2-409d-9d84-63df98760279 None admin] PATH_INFO: `/v3/domains` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:15.644889 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64893519-dbf2-409d-9d84-63df98760279 None admin] RBAC: Adding query filter params (name=Default) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:30:15.645217 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64893519-dbf2-409d-9d84-63df98760279 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:15.646648 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64893519-dbf2-409d-9d84-63df98760279 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:15.657740 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 657/1284] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:30:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:30:15.663515 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088edb3b-98a6-410f-977f-64f6aefb22c5 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:15.764850 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088edb3b-98a6-410f-977f-64f6aefb22c5 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:15.778254 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:15.798198 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2eb3f-3cab-4d90-863e-e13e135c0027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:15.798995 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2eb3f-3cab-4d90-863e-e13e135c0027 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:15.799285 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2eb3f-3cab-4d90-863e-e13e135c0027 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:15.799571 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2eb3f-3cab-4d90-863e-e13e135c0027 None admin] PATH_INFO: `/v3/projects/service` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:15.806060 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade2eb3f-3cab-4d90-863e-e13e135c0027 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:15.808128 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade2eb3f-3cab-4d90-863e-e13e135c0027 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:15.823025 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application [None req-ade2eb3f-3cab-4d90-863e-e13e135c0027 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:30:15.823025 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:30:15.823025 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:30:15.823025 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:30:15.823025 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:30:15.823025 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:30:15.823025 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:30:15.823025 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:30:15.823025 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:30:15.823025 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:30:15.823025 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:30:15.823025 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:30:15.823025 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:30:15.823025 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:30:15.823025 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:30:15.824049 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:30:15.824049 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:30:15.824049 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:30:15.824049 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:30:15.824049 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:30:15.824049 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:30:15.824049 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:30:15.824049 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:30:15.824049 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application with Lock( Jul 05 21:30:15.824049 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:30:15.824049 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:30:15.824049 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:30:15.824049 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:30:15.824049 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:30:15.824049 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:30:15.824049 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:30:15.824049 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:30:15.825082 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:30:15.825082 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:30:15.825082 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:30:15.825082 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:30:15.825082 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:30:15.825082 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:30:15.825082 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:30:15.825082 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: ERROR keystone.server.flask.application Jul 05 21:30:15.825082 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 628/1285] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:30:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:30:15.830494 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64893519-dbf2-409d-9d84-63df98760279 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:15.880490 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:15.928627 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64893519-dbf2-409d-9d84-63df98760279 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:15.960665 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee6ce4-4741-481a-9d2c-4a25263c0620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:15.961324 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee6ce4-4741-481a-9d2c-4a25263c0620 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:15.961612 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee6ce4-4741-481a-9d2c-4a25263c0620 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:15.961889 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee6ce4-4741-481a-9d2c-4a25263c0620 None admin] PATH_INFO: `/v3/projects` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:15.962962 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee6ce4-4741-481a-9d2c-4a25263c0620 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:30:15.963271 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee6ce4-4741-481a-9d2c-4a25263c0620 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:15.965224 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee6ce4-4741-481a-9d2c-4a25263c0620 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:15.976806 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 658/1286] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:30:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:30:15.983749 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2eb3f-3cab-4d90-863e-e13e135c0027 None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:16.086809 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2eb3f-3cab-4d90-863e-e13e135c0027 None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:16.121870 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae89763-6b6d-45d8-bf95-ddd055d4c847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:16.122551 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae89763-6b6d-45d8-bf95-ddd055d4c847 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:16.122842 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae89763-6b6d-45d8-bf95-ddd055d4c847 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:16.123123 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae89763-6b6d-45d8-bf95-ddd055d4c847 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:16.123951 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae89763-6b6d-45d8-bf95-ddd055d4c847 None admin] RBAC: Adding query filter params (role.id=00090b1962654604b8e106a05d44d06a, scope.project.id=7fe768315f5c43f487f71f043f11b8b8, user.id=a81dc86423cc42ddad57b10c04808176) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:30:16.124267 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae89763-6b6d-45d8-bf95-ddd055d4c847 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:16.125758 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae89763-6b6d-45d8-bf95-ddd055d4c847 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:16.131548 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 629/1287] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:30:15 2022] GET /identity/v3/role_assignments?user.id=a81dc86423cc42ddad57b10c04808176&scope.project.id=7fe768315f5c43f487f71f043f11b8b8&role.id=00090b1962654604b8e106a05d44d06a => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:30:18.190272 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029841f7-5ac8-42f7-98a9-36827feb6ffc None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:18.190830 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029841f7-5ac8-42f7-98a9-36827feb6ffc None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:18.190830 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029841f7-5ac8-42f7-98a9-36827feb6ffc None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:18.192213 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 659/1288] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:30:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:30:18.197739 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb244311-9693-4e83-b3b6-418ff2acba4c None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:18.198150 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb244311-9693-4e83-b3b6-418ff2acba4c None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:18.198369 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb244311-9693-4e83-b3b6-418ff2acba4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:18.215918 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-bb244311-9693-4e83-b3b6-418ff2acba4c None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:30:18.217108 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-bb244311-9693-4e83-b3b6-418ff2acba4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:18.246805 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:18.283937 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 630/1289] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:30:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:30:18.306591 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029841f7-5ac8-42f7-98a9-36827feb6ffc None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:18.411775 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029841f7-5ac8-42f7-98a9-36827feb6ffc None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:18.423382 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:18.447095 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286509a7-7bfd-4d2f-8a1e-dbd608a850a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:18.447931 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286509a7-7bfd-4d2f-8a1e-dbd608a850a2 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:18.448386 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286509a7-7bfd-4d2f-8a1e-dbd608a850a2 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:18.448757 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286509a7-7bfd-4d2f-8a1e-dbd608a850a2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:18.449420 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286509a7-7bfd-4d2f-8a1e-dbd608a850a2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:18.450895 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286509a7-7bfd-4d2f-8a1e-dbd608a850a2 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:18.463225 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-286509a7-7bfd-4d2f-8a1e-dbd608a850a2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 21:30:18.463225 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:30:18.463225 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:30:18.463225 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:30:18.463225 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:30:18.463225 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:30:18.463225 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:30:18.463225 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:30:18.463225 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 21:30:18.463225 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:30:18.463225 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:30:18.463225 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:30:18.463225 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:30:18.463225 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:30:18.463225 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:30:18.463225 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:30:18.463225 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:30:18.464532 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:30:18.464532 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:30:18.464532 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:30:18.464532 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:30:18.464532 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:30:18.464532 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:30:18.464532 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:30:18.464532 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:30:18.464532 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:30:18.464532 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:30:18.464532 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:30:18.464532 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:30:18.464532 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:30:18.464532 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:30:18.464532 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:30:18.464532 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:30:18.465639 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:30:18.465639 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:30:18.465639 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:30:18.465639 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:30:18.465639 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:30:18.465639 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:30:18.465639 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:30:18.465639 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:30:18.465639 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:30:18.465639 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:30:18.465639 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:30:18.465639 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:30:18.465639 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 21:30:18.465639 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:30:18.465639 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 660/1290] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Jul 5 21:30:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:30:18.470870 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb244311-9693-4e83-b3b6-418ff2acba4c None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:18.570667 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb244311-9693-4e83-b3b6-418ff2acba4c None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:18.608460 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa2216-6183-4950-8722-c30640ac1795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:18.609136 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa2216-6183-4950-8722-c30640ac1795 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:18.609427 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa2216-6183-4950-8722-c30640ac1795 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:18.609706 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa2216-6183-4950-8722-c30640ac1795 None admin] PATH_INFO: `/v3/services` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:18.610491 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa2216-6183-4950-8722-c30640ac1795 None admin] RBAC: Adding query filter params (name=placement) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:30:18.610804 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa2216-6183-4950-8722-c30640ac1795 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:18.612193 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa2216-6183-4950-8722-c30640ac1795 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:18.618288 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 631/1291] 10.222.0.30 () {56 vars in 1116 bytes} [Tue Jul 5 21:30:18 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:30:18.623263 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286509a7-7bfd-4d2f-8a1e-dbd608a850a2 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:18.723888 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286509a7-7bfd-4d2f-8a1e-dbd608a850a2 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:18.758120 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04afe8b-64d6-4a4e-ad8d-bf30d01ea56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:18.758852 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04afe8b-64d6-4a4e-ad8d-bf30d01ea56a None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:18.759144 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04afe8b-64d6-4a4e-ad8d-bf30d01ea56a None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:18.759484 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04afe8b-64d6-4a4e-ad8d-bf30d01ea56a None admin] PATH_INFO: `/v3/services` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:18.760316 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04afe8b-64d6-4a4e-ad8d-bf30d01ea56a None admin] RBAC: Adding query filter params (type=placement) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:30:18.760630 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04afe8b-64d6-4a4e-ad8d-bf30d01ea56a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:18.761995 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04afe8b-64d6-4a4e-ad8d-bf30d01ea56a None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:18.766958 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 661/1292] 10.222.0.30 () {56 vars in 1116 bytes} [Tue Jul 5 21:30:18 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:30:20.824033 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51fcaa-0fee-4eb2-9178-46f2ecc828db None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:20.824627 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51fcaa-0fee-4eb2-9178-46f2ecc828db None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:20.824627 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51fcaa-0fee-4eb2-9178-46f2ecc828db None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:20.825920 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 632/1293] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:30:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:30:20.831232 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743ca97-f81c-43bb-9f49-edfa3ada7374 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:20.831770 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743ca97-f81c-43bb-9f49-edfa3ada7374 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:20.831880 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743ca97-f81c-43bb-9f49-edfa3ada7374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:20.849656 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-c743ca97-f81c-43bb-9f49-edfa3ada7374 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:30:20.850915 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-c743ca97-f81c-43bb-9f49-edfa3ada7374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:20.880153 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:20.916249 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 662/1294] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:30:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:30:20.939397 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c51fcaa-0fee-4eb2-9178-46f2ecc828db None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:20.971272 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:21.043428 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c51fcaa-0fee-4eb2-9178-46f2ecc828db None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:21.077180 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30290800-5710-45eb-82eb-8abd289e958e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:21.077779 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30290800-5710-45eb-82eb-8abd289e958e None admin] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:21.078067 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30290800-5710-45eb-82eb-8abd289e958e None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:21.078375 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30290800-5710-45eb-82eb-8abd289e958e None admin] PATH_INFO: `/v3/services` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:21.079141 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30290800-5710-45eb-82eb-8abd289e958e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:21.080512 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30290800-5710-45eb-82eb-8abd289e958e None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:21.167746 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 633/1295] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Jul 5 21:30:20 2022] POST /identity/v3/services => generated 246 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:30:23.216865 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca04639-dccb-4e08-80b8-98393060f4ad None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:23.217413 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca04639-dccb-4e08-80b8-98393060f4ad None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:23.217413 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca04639-dccb-4e08-80b8-98393060f4ad None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:23.219036 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 663/1296] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:30:23.224576 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11dec8-1c1e-4d02-9b26-31d2dcb72c52 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:23.225044 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11dec8-1c1e-4d02-9b26-31d2dcb72c52 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:23.225143 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11dec8-1c1e-4d02-9b26-31d2dcb72c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:23.242101 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-8c11dec8-1c1e-4d02-9b26-31d2dcb72c52 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:30:23.243331 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-8c11dec8-1c1e-4d02-9b26-31d2dcb72c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:23.316891 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 634/1297] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:30:23 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:30:23.341001 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca04639-dccb-4e08-80b8-98393060f4ad None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:23.444509 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca04639-dccb-4e08-80b8-98393060f4ad None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:23.478549 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc210c-a719-4185-987d-fc6ffe652dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:23.479831 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc210c-a719-4185-987d-fc6ffe652dc7 None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:23.480268 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc210c-a719-4185-987d-fc6ffe652dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:23.480555 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc210c-a719-4185-987d-fc6ffe652dc7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:23.481211 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedc210c-a719-4185-987d-fc6ffe652dc7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:23.482638 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedc210c-a719-4185-987d-fc6ffe652dc7 None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:23.494620 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-fedc210c-a719-4185-987d-fc6ffe652dc7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 21:30:23.494620 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:30:23.494620 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:30:23.494620 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:30:23.494620 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:30:23.494620 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:30:23.494620 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:30:23.494620 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:30:23.494620 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 21:30:23.494620 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:30:23.494620 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:30:23.494620 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:30:23.494620 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:30:23.494620 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:30:23.494620 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:30:23.494620 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:30:23.494620 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:30:23.496422 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:30:23.496422 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:30:23.496422 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:30:23.496422 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:30:23.496422 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:30:23.496422 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:30:23.496422 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:30:23.496422 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:30:23.496422 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:30:23.496422 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:30:23.496422 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:30:23.496422 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:30:23.496422 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:30:23.496422 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:30:23.496422 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:30:23.496422 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:30:23.497624 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:30:23.497624 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:30:23.497624 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:30:23.497624 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:30:23.497624 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:30:23.497624 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:30:23.497624 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:30:23.497624 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:30:23.497624 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:30:23.497624 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:30:23.497624 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:30:23.497624 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:30:23.497624 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 21:30:23.497624 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:30:23.497624 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 664/1298] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Jul 5 21:30:23 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:30:23.502823 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11dec8-1c1e-4d02-9b26-31d2dcb72c52 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:23.521127 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:23.600625 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11dec8-1c1e-4d02-9b26-31d2dcb72c52 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:23.635606 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1101f-75c1-49a1-a3fa-b08d88e5316f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:23.636320 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1101f-75c1-49a1-a3fa-b08d88e5316f None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:23.636616 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1101f-75c1-49a1-a3fa-b08d88e5316f None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:23.636894 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1101f-75c1-49a1-a3fa-b08d88e5316f None admin] PATH_INFO: `/v3/services` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:23.637599 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1101f-75c1-49a1-a3fa-b08d88e5316f None admin] RBAC: Adding query filter params (name=placement) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:30:23.637905 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1101f-75c1-49a1-a3fa-b08d88e5316f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:23.639319 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1101f-75c1-49a1-a3fa-b08d88e5316f None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:23.645434 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 635/1299] 10.222.0.30 () {56 vars in 1116 bytes} [Tue Jul 5 21:30:23 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:30:23.650338 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc210c-a719-4185-987d-fc6ffe652dc7 None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:23.683747 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:23.753136 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc210c-a719-4185-987d-fc6ffe652dc7 None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:23.787394 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375c435-415d-4e79-a83e-719ce541d64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:23.788045 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375c435-415d-4e79-a83e-719ce541d64d None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:23.788330 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375c435-415d-4e79-a83e-719ce541d64d None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:23.788608 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375c435-415d-4e79-a83e-719ce541d64d None admin] PATH_INFO: `/v3/endpoints` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:23.789430 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f375c435-415d-4e79-a83e-719ce541d64d None admin] RBAC: Adding query filter params (interface=public, service_id=a1967975ed6c48279d34d975006b9409, region_id=RegionOne) {{(pid=172890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:30:23.789743 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f375c435-415d-4e79-a83e-719ce541d64d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:23.791139 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f375c435-415d-4e79-a83e-719ce541d64d None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:23.796901 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 665/1300] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Jul 5 21:30:23 2022] GET /identity/v3/endpoints?service_id=a1967975ed6c48279d34d975006b9409&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:30:23.802679 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1101f-75c1-49a1-a3fa-b08d88e5316f None admin] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:23.885718 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:23.904051 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1101f-75c1-49a1-a3fa-b08d88e5316f None admin] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:23.937689 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc4f74-1d76-4079-8b8f-39bbf3f28475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:23.938382 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc4f74-1d76-4079-8b8f-39bbf3f28475 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:23.938671 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc4f74-1d76-4079-8b8f-39bbf3f28475 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:23.938950 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc4f74-1d76-4079-8b8f-39bbf3f28475 None admin] PATH_INFO: `/v3/services` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:23.939628 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dc4f74-1d76-4079-8b8f-39bbf3f28475 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:23.941046 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dc4f74-1d76-4079-8b8f-39bbf3f28475 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:23.949602 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 636/1301] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Jul 5 21:30:23 2022] GET /identity/v3/services => generated 2191 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:30:26.000549 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70667c34-71ca-43e8-b410-77cfea85a6e0 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:26.001093 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70667c34-71ca-43e8-b410-77cfea85a6e0 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:26.001093 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70667c34-71ca-43e8-b410-77cfea85a6e0 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:26.002536 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 666/1302] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:30:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:30:26.007601 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06229c5e-c625-4f39-abbe-6b0d851c660d None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:26.008027 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06229c5e-c625-4f39-abbe-6b0d851c660d None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:26.008163 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06229c5e-c625-4f39-abbe-6b0d851c660d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:26.025243 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-06229c5e-c625-4f39-abbe-6b0d851c660d None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:30:26.026455 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-06229c5e-c625-4f39-abbe-6b0d851c660d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:30:26.093992 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 637/1303] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:30:26 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:30:26.117599 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70667c34-71ca-43e8-b410-77cfea85a6e0 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:26.213543 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:26.220734 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70667c34-71ca-43e8-b410-77cfea85a6e0 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:26.254885 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c776f-9048-4527-9a26-9b7707a0f78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:26.255612 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c776f-9048-4527-9a26-9b7707a0f78b None admin] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:26.255900 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c776f-9048-4527-9a26-9b7707a0f78b None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:26.256177 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c776f-9048-4527-9a26-9b7707a0f78b None admin] PATH_INFO: `/v3/services/placement` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:26.256864 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c776f-9048-4527-9a26-9b7707a0f78b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:26.258272 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c776f-9048-4527-9a26-9b7707a0f78b None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:26.270261 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application [None req-267c776f-9048-4527-9a26-9b7707a0f78b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 21:30:26.270261 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:30:26.270261 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:30:26.270261 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:30:26.270261 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:30:26.270261 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:30:26.270261 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:30:26.270261 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:30:26.270261 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 21:30:26.270261 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:30:26.270261 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:30:26.270261 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:30:26.270261 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:30:26.270261 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:30:26.270261 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:30:26.270261 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:30:26.270261 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:30:26.271905 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:30:26.271905 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:30:26.271905 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:30:26.271905 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:30:26.271905 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:30:26.271905 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:30:26.271905 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:30:26.271905 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:30:26.271905 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:30:26.271905 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:30:26.271905 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:30:26.271905 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:30:26.271905 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:30:26.271905 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:30:26.271905 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:30:26.271905 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:30:26.273112 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:30:26.273112 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application with Lock( Jul 05 21:30:26.273112 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:30:26.273112 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:30:26.273112 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:30:26.273112 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:30:26.273112 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:30:26.273112 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:30:26.273112 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:30:26.273112 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:30:26.273112 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:30:26.273112 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:30:26.273112 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 21:30:26.273112 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: ERROR keystone.server.flask.application Jul 05 21:30:26.273112 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 667/1304] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Jul 5 21:30:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:30:26.278210 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06229c5e-c625-4f39-abbe-6b0d851c660d None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:26.353794 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:26.376199 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06229c5e-c625-4f39-abbe-6b0d851c660d None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:26.409832 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c7563-0870-4461-bc99-edfb6caf3b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:26.410536 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c7563-0870-4461-bc99-edfb6caf3b38 None admin] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:26.410824 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c7563-0870-4461-bc99-edfb6caf3b38 None admin] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:26.411105 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c7563-0870-4461-bc99-edfb6caf3b38 None admin] PATH_INFO: `/v3/services` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:26.411811 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8c7563-0870-4461-bc99-edfb6caf3b38 None admin] RBAC: Adding query filter params (name=placement) {{(pid=172889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:30:26.412120 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8c7563-0870-4461-bc99-edfb6caf3b38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:26.413546 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8c7563-0870-4461-bc99-edfb6caf3b38 None admin] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:26.420172 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 638/1305] 10.222.0.30 () {56 vars in 1116 bytes} [Tue Jul 5 21:30:26 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:30:26.425559 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c776f-9048-4527-9a26-9b7707a0f78b None admin] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:30:26.528277 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c776f-9048-4527-9a26-9b7707a0f78b None admin] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:30:26.561410 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38439f28-caa6-4041-bd33-8188abbc653b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f7b68cdb43a4c0b96cd3cbfc39bee35', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:30:26.562080 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38439f28-caa6-4041-bd33-8188abbc653b None admin] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:30:26.562415 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38439f28-caa6-4041-bd33-8188abbc653b None admin] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:30:26.562681 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38439f28-caa6-4041-bd33-8188abbc653b None admin] PATH_INFO: `/v3/endpoints` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:30:26.563426 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38439f28-caa6-4041-bd33-8188abbc653b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:30:26.564808 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38439f28-caa6-4041-bd33-8188abbc653b None admin] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:30:26.641790 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 668/1306] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Jul 5 21:30:26 2022] POST /identity/v3/endpoints => generated 331 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:30:36.420500 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=30 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:30:36.636545 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:36:50.067868 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d76f43-1177-48df-9d05-aa628f95d69b None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:36:50.068474 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d76f43-1177-48df-9d05-aa628f95d69b None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:36:50.068474 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d76f43-1177-48df-9d05-aa628f95d69b None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:36:50.070212 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 639/1307] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:36:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:36:50.076562 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc0479-4a43-4e70-9723-45bcce6b421a None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:36:50.077611 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc0479-4a43-4e70-9723-45bcce6b421a None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:36:50.078097 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc0479-4a43-4e70-9723-45bcce6b421a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:36:50.249834 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-63cc0479-4a43-4e70-9723-45bcce6b421a None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:36:50.251267 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-63cc0479-4a43-4e70-9723-45bcce6b421a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:36:50.485252 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 669/1308] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:36:50.547906 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55edefa-bc86-4d3e-8ccf-3a657f611a54 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:36:50.548256 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55edefa-bc86-4d3e-8ccf-3a657f611a54 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:36:50.548667 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55edefa-bc86-4d3e-8ccf-3a657f611a54 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:36:50.552607 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 640/1309] 10.222.0.30 () {54 vars in 964 bytes} [Tue Jul 5 21:36:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:36:50.576706 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2623c66-5799-4091-a34a-f5d6d6fe1130 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:36:50.577003 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2623c66-5799-4091-a34a-f5d6d6fe1130 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:36:50.577288 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2623c66-5799-4091-a34a-f5d6d6fe1130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:36:50.725543 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-e2623c66-5799-4091-a34a-f5d6d6fe1130 None None] MFA Rules not processed for user `5eefecdea1014aedad4c2a49686a7a89`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:36:50.727380 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-e2623c66-5799-4091-a34a-f5d6d6fe1130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:36:50.777646 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:36:50.884628 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 670/1310] 10.222.0.30 () {58 vars in 1061 bytes} [Tue Jul 5 21:36:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:36:50.894858 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55edefa-bc86-4d3e-8ccf-3a657f611a54 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:36:50.896746 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-f55edefa-bc86-4d3e-8ccf-3a657f611a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:36:51.143122 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55edefa-bc86-4d3e-8ccf-3a657f611a54 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:36:51.309650 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddab3d5-47f9-4bbb-b437-6c8e2965302d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5eefecdea1014aedad4c2a49686a7a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fe768315f5c43f487f71f043f11b8b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:36:51.310281 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddab3d5-47f9-4bbb-b437-6c8e2965302d service neutron] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:36:51.310573 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddab3d5-47f9-4bbb-b437-6c8e2965302d service neutron] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:36:51.310859 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddab3d5-47f9-4bbb-b437-6c8e2965302d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:36:51.312604 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-fddab3d5-47f9-4bbb-b437-6c8e2965302d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:36:51.415058 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:36:51.512976 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddab3d5-47f9-4bbb-b437-6c8e2965302d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:36:51.514552 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddab3d5-47f9-4bbb-b437-6c8e2965302d service neutron] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:36:51.544758 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 641/1311] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:36:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 650 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:36:54.299709 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c90aeb-c34b-49ed-b954-c9a1a8d2bcdd None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:36:54.300364 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c90aeb-c34b-49ed-b954-c9a1a8d2bcdd None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:36:54.300364 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c90aeb-c34b-49ed-b954-c9a1a8d2bcdd None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:36:54.301691 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 671/1312] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:36:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:36:54.307547 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ad0bf-aca2-4116-afbd-dde7f2ae15a2 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:36:54.308016 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ad0bf-aca2-4116-afbd-dde7f2ae15a2 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:36:54.308135 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ad0bf-aca2-4116-afbd-dde7f2ae15a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:36:54.388834 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-477ad0bf-aca2-4116-afbd-dde7f2ae15a2 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:36:54.390058 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-477ad0bf-aca2-4116-afbd-dde7f2ae15a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:36:54.489618 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 642/1313] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:36:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:36:54.527678 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c90aeb-c34b-49ed-b954-c9a1a8d2bcdd None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:36:54.529221 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-12c90aeb-c34b-49ed-b954-c9a1a8d2bcdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:36:54.641458 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c90aeb-c34b-49ed-b954-c9a1a8d2bcdd None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:36:54.712080 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:36:54.714592 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad43392-ca88-4192-b9e7-f45bcb17b60b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5eefecdea1014aedad4c2a49686a7a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fe768315f5c43f487f71f043f11b8b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:36:54.715241 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad43392-ca88-4192-b9e7-f45bcb17b60b service neutron] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:36:54.715529 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad43392-ca88-4192-b9e7-f45bcb17b60b service neutron] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:36:54.715840 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad43392-ca88-4192-b9e7-f45bcb17b60b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:36:54.717591 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-5ad43392-ca88-4192-b9e7-f45bcb17b60b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:36:54.826751 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad43392-ca88-4192-b9e7-f45bcb17b60b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:36:54.828159 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad43392-ca88-4192-b9e7-f45bcb17b60b service neutron] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:36:54.846765 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 672/1314] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:36:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:36:57.379829 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c45b8-271e-4a30-b2ce-adc10a0e0518 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:36:57.380364 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c45b8-271e-4a30-b2ce-adc10a0e0518 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:36:57.380364 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c45b8-271e-4a30-b2ce-adc10a0e0518 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:36:57.381778 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 643/1315] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:36:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:36:57.388137 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d52d3-fd95-48ed-9db8-3c8e822b4460 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:36:57.388555 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d52d3-fd95-48ed-9db8-3c8e822b4460 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:36:57.388728 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d52d3-fd95-48ed-9db8-3c8e822b4460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:36:57.454374 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-604d52d3-fd95-48ed-9db8-3c8e822b4460 None None] MFA Rules not processed for user `2476d97d512545ff9b00e593487ef5fa`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:36:57.455598 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-604d52d3-fd95-48ed-9db8-3c8e822b4460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:36:57.506681 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:36:57.550078 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 673/1316] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:36:57 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:36:57.590111 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c45b8-271e-4a30-b2ce-adc10a0e0518 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:36:57.591702 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-f77c45b8-271e-4a30-b2ce-adc10a0e0518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:36:57.601925 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:36:57.695786 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c45b8-271e-4a30-b2ce-adc10a0e0518 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:36:57.771586 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeaa711-4109-47a2-900a-47fcc44dc7e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5eefecdea1014aedad4c2a49686a7a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fe768315f5c43f487f71f043f11b8b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:36:57.772248 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeaa711-4109-47a2-900a-47fcc44dc7e1 service neutron] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:36:57.772544 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeaa711-4109-47a2-900a-47fcc44dc7e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:36:57.772834 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeaa711-4109-47a2-900a-47fcc44dc7e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:36:57.774551 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-9aeaa711-4109-47a2-900a-47fcc44dc7e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:36:57.837143 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:36:57.885543 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeaa711-4109-47a2-900a-47fcc44dc7e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:36:57.887028 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeaa711-4109-47a2-900a-47fcc44dc7e1 service neutron] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:36:57.905019 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 644/1317] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:36:57 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:37:00.675685 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288adb1-00a7-4520-8258-27c295cb5be3 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:00.676249 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288adb1-00a7-4520-8258-27c295cb5be3 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:00.676349 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288adb1-00a7-4520-8258-27c295cb5be3 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:00.677966 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 674/1318] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:37:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:37:00.683704 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8653d9-7e1e-4038-a528-babb505263f5 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:00.684110 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8653d9-7e1e-4038-a528-babb505263f5 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:00.684270 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8653d9-7e1e-4038-a528-babb505263f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:00.748040 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-ec8653d9-7e1e-4038-a528-babb505263f5 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:37:00.749269 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-ec8653d9-7e1e-4038-a528-babb505263f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:37:00.844793 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 645/1319] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:37:00 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:37:00.900403 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8262fe-5e09-45a4-8aa8-e6d229858a13 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:00.900707 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8262fe-5e09-45a4-8aa8-e6d229858a13 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:00.900986 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8262fe-5e09-45a4-8aa8-e6d229858a13 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:00.902422 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 675/1320] 10.222.0.30 () {54 vars in 964 bytes} [Tue Jul 5 21:37:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:37:00.908542 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ffd1c-68ac-49da-9560-696ce880827e None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:00.908870 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ffd1c-68ac-49da-9560-696ce880827e None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:00.909158 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ffd1c-68ac-49da-9560-696ce880827e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:00.930807 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:37:00.986859 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-3d5ffd1c-68ac-49da-9560-696ce880827e None None] MFA Rules not processed for user `5eefecdea1014aedad4c2a49686a7a89`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:37:00.988103 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-3d5ffd1c-68ac-49da-9560-696ce880827e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:37:01.066549 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 646/1321] 10.222.0.30 () {58 vars in 1061 bytes} [Tue Jul 5 21:37:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:37:01.075730 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8262fe-5e09-45a4-8aa8-e6d229858a13 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:37:01.077250 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-3c8262fe-5e09-45a4-8aa8-e6d229858a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:37:01.180336 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8262fe-5e09-45a4-8aa8-e6d229858a13 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:37:01.252382 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4fc893-5d86-4b43-8309-67e0fa028e06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5eefecdea1014aedad4c2a49686a7a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fe768315f5c43f487f71f043f11b8b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:37:01.253032 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4fc893-5d86-4b43-8309-67e0fa028e06 service neutron] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:01.253320 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4fc893-5d86-4b43-8309-67e0fa028e06 service neutron] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:01.253602 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4fc893-5d86-4b43-8309-67e0fa028e06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:01.255307 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-fe4fc893-5d86-4b43-8309-67e0fa028e06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:37:01.262850 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:37:01.363524 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4fc893-5d86-4b43-8309-67e0fa028e06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:37:01.364966 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4fc893-5d86-4b43-8309-67e0fa028e06 service neutron] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:37:01.383340 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 676/1322] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:37:01 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:37:04.872685 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63915a1c-b154-4862-86cb-5d03b30c6ef6 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:04.873195 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63915a1c-b154-4862-86cb-5d03b30c6ef6 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:04.873195 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63915a1c-b154-4862-86cb-5d03b30c6ef6 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:04.874731 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 647/1323] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:37:04.880076 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba896f-d34e-47ed-95cd-253ebe9b943c None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:04.880540 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba896f-d34e-47ed-95cd-253ebe9b943c None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:04.880756 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba896f-d34e-47ed-95cd-253ebe9b943c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:04.946396 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-08ba896f-d34e-47ed-95cd-253ebe9b943c None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:37:04.947622 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-08ba896f-d34e-47ed-95cd-253ebe9b943c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:37:05.007778 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:37:05.049958 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 677/1324] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:37:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:37:05.087523 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63915a1c-b154-4862-86cb-5d03b30c6ef6 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:37:05.089117 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-63915a1c-b154-4862-86cb-5d03b30c6ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:37:05.205180 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63915a1c-b154-4862-86cb-5d03b30c6ef6 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:37:05.218892 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:37:05.285431 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5716b8a-d432-4c73-a18d-21ada73d1045 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5eefecdea1014aedad4c2a49686a7a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fe768315f5c43f487f71f043f11b8b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:37:05.286098 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5716b8a-d432-4c73-a18d-21ada73d1045 service neutron] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:05.286422 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5716b8a-d432-4c73-a18d-21ada73d1045 service neutron] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:05.286711 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5716b8a-d432-4c73-a18d-21ada73d1045 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:05.288403 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-a5716b8a-d432-4c73-a18d-21ada73d1045 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:37:05.397502 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5716b8a-d432-4c73-a18d-21ada73d1045 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:37:05.399108 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5716b8a-d432-4c73-a18d-21ada73d1045 service neutron] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:37:05.417771 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 648/1325] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:37:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 21:37:07.532506 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc56971a-5236-4921-a184-2199af098207 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:07.533039 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc56971a-5236-4921-a184-2199af098207 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:07.533039 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc56971a-5236-4921-a184-2199af098207 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:07.534478 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 678/1326] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:37:07.540012 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b2892-4367-429e-afd4-2bc7dfe1b61d None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:07.540473 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b2892-4367-429e-afd4-2bc7dfe1b61d None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:07.540623 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b2892-4367-429e-afd4-2bc7dfe1b61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:07.592337 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:37:07.620344 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-db5b2892-4367-429e-afd4-2bc7dfe1b61d None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:37:07.620344 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-db5b2892-4367-429e-afd4-2bc7dfe1b61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:37:07.717240 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 649/1327] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:37:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:37:07.752997 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc56971a-5236-4921-a184-2199af098207 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:37:07.754567 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-dc56971a-5236-4921-a184-2199af098207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:37:07.863142 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc56971a-5236-4921-a184-2199af098207 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:37:07.938665 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8678d-256f-42dc-be14-1d684766d5d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5eefecdea1014aedad4c2a49686a7a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fe768315f5c43f487f71f043f11b8b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:37:07.939319 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8678d-256f-42dc-be14-1d684766d5d7 service neutron] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:07.939638 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8678d-256f-42dc-be14-1d684766d5d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:07.939946 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8678d-256f-42dc-be14-1d684766d5d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:07.941646 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-46f8678d-256f-42dc-be14-1d684766d5d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:37:07.959082 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:37:08.049948 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f8678d-256f-42dc-be14-1d684766d5d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:37:08.051432 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f8678d-256f-42dc-be14-1d684766d5d7 service neutron] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:37:08.070556 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 679/1328] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:37:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:37:10.143233 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002cdc95-39c2-450d-9efa-3600c8f37fcf None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:10.143826 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002cdc95-39c2-450d-9efa-3600c8f37fcf None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:10.143826 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002cdc95-39c2-450d-9efa-3600c8f37fcf None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:10.145187 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 650/1329] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:37:10.150898 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf40281-cecb-4dd8-86fa-bc0724a85bb9 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:10.151416 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf40281-cecb-4dd8-86fa-bc0724a85bb9 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:10.151552 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf40281-cecb-4dd8-86fa-bc0724a85bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:10.215193 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-eaf40281-cecb-4dd8-86fa-bc0724a85bb9 None None] MFA Rules not processed for user `2476d97d512545ff9b00e593487ef5fa`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:37:10.216413 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-eaf40281-cecb-4dd8-86fa-bc0724a85bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:37:10.283823 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:37:10.317717 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 680/1330] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:37:10 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:37:10.356071 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002cdc95-39c2-450d-9efa-3600c8f37fcf None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:37:10.357664 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-002cdc95-39c2-450d-9efa-3600c8f37fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:37:10.463013 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002cdc95-39c2-450d-9efa-3600c8f37fcf None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:37:10.483336 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:37:10.536721 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26998baf-3156-431d-96bc-6d752405fb07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5eefecdea1014aedad4c2a49686a7a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fe768315f5c43f487f71f043f11b8b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:37:10.537372 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26998baf-3156-431d-96bc-6d752405fb07 service neutron] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:10.537667 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26998baf-3156-431d-96bc-6d752405fb07 service neutron] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:10.537952 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26998baf-3156-431d-96bc-6d752405fb07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:10.540311 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-26998baf-3156-431d-96bc-6d752405fb07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:37:10.650796 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26998baf-3156-431d-96bc-6d752405fb07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:37:10.652249 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26998baf-3156-431d-96bc-6d752405fb07 service neutron] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:37:10.669971 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 651/1331] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:37:10 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 21:37:13.158489 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ff5cf-cf7c-4cbf-a499-84c8620cbeb2 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:13.159067 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ff5cf-cf7c-4cbf-a499-84c8620cbeb2 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:13.159067 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ff5cf-cf7c-4cbf-a499-84c8620cbeb2 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:13.160439 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 681/1332] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:37:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:37:13.165765 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889ffd5-ab5c-4147-b319-155bd81548c0 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:13.166224 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889ffd5-ab5c-4147-b319-155bd81548c0 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:13.166367 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889ffd5-ab5c-4147-b319-155bd81548c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:13.228256 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:37:13.231249 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-c889ffd5-ab5c-4147-b319-155bd81548c0 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:37:13.232516 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-c889ffd5-ab5c-4147-b319-155bd81548c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:37:13.329638 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 652/1333] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:37:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:37:13.365480 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ff5cf-cf7c-4cbf-a499-84c8620cbeb2 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:37:13.367593 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-4a3ff5cf-cf7c-4cbf-a499-84c8620cbeb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:37:13.471525 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ff5cf-cf7c-4cbf-a499-84c8620cbeb2 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:37:13.545290 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8852e1b4-d5a0-41ce-836b-8b72629c2f81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5eefecdea1014aedad4c2a49686a7a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fe768315f5c43f487f71f043f11b8b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:37:13.545935 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852e1b4-d5a0-41ce-836b-8b72629c2f81 service neutron] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:13.546256 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852e1b4-d5a0-41ce-836b-8b72629c2f81 service neutron] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:13.546535 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852e1b4-d5a0-41ce-836b-8b72629c2f81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:13.548248 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-8852e1b4-d5a0-41ce-836b-8b72629c2f81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:37:13.577017 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:37:13.658537 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8852e1b4-d5a0-41ce-836b-8b72629c2f81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:37:13.660017 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8852e1b4-d5a0-41ce-836b-8b72629c2f81 service neutron] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:37:13.678181 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 682/1334] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:37:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:37:15.770307 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19466abe-a490-485e-ae23-67aa2972ec19 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:15.770874 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19466abe-a490-485e-ae23-67aa2972ec19 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:15.770874 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19466abe-a490-485e-ae23-67aa2972ec19 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:15.772306 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 653/1335] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:37:15.777431 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4bd1f-4baf-43c8-b10d-f25612d4dd23 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:15.777868 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4bd1f-4baf-43c8-b10d-f25612d4dd23 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:15.778005 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4bd1f-4baf-43c8-b10d-f25612d4dd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:15.842018 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-f7e4bd1f-4baf-43c8-b10d-f25612d4dd23 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:37:15.843189 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-f7e4bd1f-4baf-43c8-b10d-f25612d4dd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:37:15.917183 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:37:15.938587 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 683/1336] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:37:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:37:15.979250 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19466abe-a490-485e-ae23-67aa2972ec19 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:37:15.980819 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-19466abe-a490-485e-ae23-67aa2972ec19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:37:16.084370 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19466abe-a490-485e-ae23-67aa2972ec19 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:37:16.112605 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:37:16.159385 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4991d26-65e3-45c8-9671-113c277957f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5eefecdea1014aedad4c2a49686a7a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fe768315f5c43f487f71f043f11b8b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:37:16.160035 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4991d26-65e3-45c8-9671-113c277957f7 service neutron] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:16.160325 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4991d26-65e3-45c8-9671-113c277957f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:16.160605 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4991d26-65e3-45c8-9671-113c277957f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:16.162285 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-f4991d26-65e3-45c8-9671-113c277957f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:37:16.270752 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4991d26-65e3-45c8-9671-113c277957f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:37:16.272205 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4991d26-65e3-45c8-9671-113c277957f7 service neutron] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:37:16.290703 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 654/1337] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:37:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:37:19.032902 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84499c9-8aac-4d59-b7e1-82d3d669c4d0 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:19.033458 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84499c9-8aac-4d59-b7e1-82d3d669c4d0 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:19.033458 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84499c9-8aac-4d59-b7e1-82d3d669c4d0 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:19.034855 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 684/1338] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:37:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:37:19.040212 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4596823-632d-4696-8d85-21770b593bce None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:19.040631 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4596823-632d-4696-8d85-21770b593bce None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:19.040792 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4596823-632d-4696-8d85-21770b593bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:19.106001 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-f4596823-632d-4696-8d85-21770b593bce None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:37:19.107258 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-f4596823-632d-4696-8d85-21770b593bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:37:19.115598 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:37:19.205111 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 655/1339] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:37:19 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:37:19.243056 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84499c9-8aac-4d59-b7e1-82d3d669c4d0 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:37:19.244602 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-c84499c9-8aac-4d59-b7e1-82d3d669c4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:37:19.350323 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84499c9-8aac-4d59-b7e1-82d3d669c4d0 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:37:19.424856 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40ba1f-397f-4247-9983-68b5adaa15ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5eefecdea1014aedad4c2a49686a7a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fe768315f5c43f487f71f043f11b8b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:37:19.425543 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40ba1f-397f-4247-9983-68b5adaa15ec service neutron] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:19.425824 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40ba1f-397f-4247-9983-68b5adaa15ec service neutron] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:19.426103 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40ba1f-397f-4247-9983-68b5adaa15ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:19.430808 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-4d40ba1f-397f-4247-9983-68b5adaa15ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:37:19.464412 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:37:19.538171 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d40ba1f-397f-4247-9983-68b5adaa15ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:37:19.540140 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d40ba1f-397f-4247-9983-68b5adaa15ec service neutron] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:37:19.558924 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 685/1340] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:37:19 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:37:23.864207 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8418fd-f1c0-4570-8b91-cd848e00fac3 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:23.864700 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8418fd-f1c0-4570-8b91-cd848e00fac3 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:23.864818 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8418fd-f1c0-4570-8b91-cd848e00fac3 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:23.866941 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 656/1341] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:37:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:37:23.872319 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f9664-6ecc-4311-ae90-39f22125fe57 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:23.872754 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f9664-6ecc-4311-ae90-39f22125fe57 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:23.872863 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f9664-6ecc-4311-ae90-39f22125fe57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:23.946440 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-7a7f9664-6ecc-4311-ae90-39f22125fe57 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:37:23.947704 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-7a7f9664-6ecc-4311-ae90-39f22125fe57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:37:24.047131 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=100 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:37:24.060665 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 686/1342] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:37:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:37:24.099659 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8418fd-f1c0-4570-8b91-cd848e00fac3 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:37:24.102490 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-2b8418fd-f1c0-4570-8b91-cd848e00fac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:37:24.201947 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8418fd-f1c0-4570-8b91-cd848e00fac3 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:37:24.205562 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c25eb-be20-4b80-a3c7-a81169295880 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5eefecdea1014aedad4c2a49686a7a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fe768315f5c43f487f71f043f11b8b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:37:24.206254 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c25eb-be20-4b80-a3c7-a81169295880 service neutron] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:24.206548 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c25eb-be20-4b80-a3c7-a81169295880 service neutron] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:24.206833 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c25eb-be20-4b80-a3c7-a81169295880 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:24.216740 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c25eb-be20-4b80-a3c7-a81169295880 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:37:24.218210 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c25eb-be20-4b80-a3c7-a81169295880 service neutron] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:37:24.228588 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 657/1343] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:37:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:37:27.285543 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625f4f4-88d6-458e-974a-ca19fe92a2a2 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:27.286152 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625f4f4-88d6-458e-974a-ca19fe92a2a2 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:27.286152 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625f4f4-88d6-458e-974a-ca19fe92a2a2 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:27.287551 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 687/1344] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:37:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:37:27.293920 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586b325-b33f-4eb4-9615-dcb33cac0523 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:27.294477 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586b325-b33f-4eb4-9615-dcb33cac0523 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:27.294696 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586b325-b33f-4eb4-9615-dcb33cac0523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:27.325586 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-0586b325-b33f-4eb4-9615-dcb33cac0523 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:37:27.326861 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-0586b325-b33f-4eb4-9615-dcb33cac0523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:37:27.356924 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:37:27.408676 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 658/1345] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:37:27 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:37:27.446924 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625f4f4-88d6-458e-974a-ca19fe92a2a2 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:37:27.457588 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625f4f4-88d6-458e-974a-ca19fe92a2a2 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:37:27.461662 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92af69-dd70-42d7-88a5-35a4d5219197 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5eefecdea1014aedad4c2a49686a7a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fe768315f5c43f487f71f043f11b8b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:37:27.462348 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92af69-dd70-42d7-88a5-35a4d5219197 service neutron] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:27.462639 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92af69-dd70-42d7-88a5-35a4d5219197 service neutron] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:27.462923 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92af69-dd70-42d7-88a5-35a4d5219197 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:27.472278 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d92af69-dd70-42d7-88a5-35a4d5219197 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:37:27.473722 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d92af69-dd70-42d7-88a5-35a4d5219197 service neutron] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:37:27.483826 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 688/1346] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:37:27 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:37:31.879094 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b51d40-129e-4e07-ba9c-bba914bf7cad None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:31.879700 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b51d40-129e-4e07-ba9c-bba914bf7cad None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:31.879700 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b51d40-129e-4e07-ba9c-bba914bf7cad None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:31.881042 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 659/1347] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:37:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:37:31.886549 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9909b-ee39-4f3b-be12-7c46b04ab0be None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:31.887024 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9909b-ee39-4f3b-be12-7c46b04ab0be None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:31.887154 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9909b-ee39-4f3b-be12-7c46b04ab0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:31.910814 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-90d9909b-ee39-4f3b-be12-7c46b04ab0be None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:37:31.910814 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-90d9909b-ee39-4f3b-be12-7c46b04ab0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:37:31.915482 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 689/1348] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:37:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:37:31.954788 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b51d40-129e-4e07-ba9c-bba914bf7cad None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:37:31.965578 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b51d40-129e-4e07-ba9c-bba914bf7cad None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:37:31.969133 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bacaced-20d1-4d5f-8bf3-3dbff42d8956 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5eefecdea1014aedad4c2a49686a7a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fe768315f5c43f487f71f043f11b8b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:37:31.969785 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacaced-20d1-4d5f-8bf3-3dbff42d8956 service neutron] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:31.970082 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacaced-20d1-4d5f-8bf3-3dbff42d8956 service neutron] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:31.970407 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacaced-20d1-4d5f-8bf3-3dbff42d8956 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:31.981315 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bacaced-20d1-4d5f-8bf3-3dbff42d8956 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:37:31.982833 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bacaced-20d1-4d5f-8bf3-3dbff42d8956 service neutron] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:37:31.993333 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 660/1349] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:37:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:37:37.079100 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a41aa-8e26-4ffe-b92e-28a970e46b01 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:37.079985 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a41aa-8e26-4ffe-b92e-28a970e46b01 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:37.080444 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a41aa-8e26-4ffe-b92e-28a970e46b01 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:37.082648 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 690/1350] 10.222.0.30 () {54 vars in 921 bytes} [Tue Jul 5 21:37:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:37:37.089841 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ad050-05cb-435c-bed3-287cabd3d4d1 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:37.090370 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ad050-05cb-435c-bed3-287cabd3d4d1 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:37.091238 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ad050-05cb-435c-bed3-287cabd3d4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:37.171954 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-c13ad050-05cb-435c-bed3-287cabd3d4d1 None None] MFA Rules not processed for user `a81dc86423cc42ddad57b10c04808176`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:37:37.173081 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-c13ad050-05cb-435c-bed3-287cabd3d4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:37:37.257918 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 661/1351] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Jul 5 21:37:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:37:41.598722 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a262e3-f3e0-4360-98d0-70901099ac3e None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:41.599615 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a262e3-f3e0-4360-98d0-70901099ac3e None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:41.599899 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a262e3-f3e0-4360-98d0-70901099ac3e None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:41.601682 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 691/1352] 10.222.0.30 () {54 vars in 921 bytes} [Tue Jul 5 21:37:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:37:41.606569 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634515a-c006-4684-8f57-c27e8805cca6 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:41.606984 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634515a-c006-4684-8f57-c27e8805cca6 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:41.607198 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634515a-c006-4684-8f57-c27e8805cca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:41.627057 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-5634515a-c006-4684-8f57-c27e8805cca6 None None] MFA Rules not processed for user `a81dc86423cc42ddad57b10c04808176`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:37:41.628373 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-5634515a-c006-4684-8f57-c27e8805cca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:37:41.637806 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 662/1353] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Jul 5 21:37:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:37:41.901016 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=13 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:37:43.043506 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10acca35-c539-4556-b3cc-395b2ca8e2f9 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:43.044118 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10acca35-c539-4556-b3cc-395b2ca8e2f9 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:43.044118 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10acca35-c539-4556-b3cc-395b2ca8e2f9 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:43.045426 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 692/1354] 10.222.0.30 () {54 vars in 921 bytes} [Tue Jul 5 21:37:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:37:43.050608 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5f193-8d02-40ca-96f3-2cda9adb0fe2 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:43.051363 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5f193-8d02-40ca-96f3-2cda9adb0fe2 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:43.051653 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5f193-8d02-40ca-96f3-2cda9adb0fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:43.069706 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-cff5f193-8d02-40ca-96f3-2cda9adb0fe2 None None] MFA Rules not processed for user `a81dc86423cc42ddad57b10c04808176`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:37:43.071141 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-cff5f193-8d02-40ca-96f3-2cda9adb0fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:37:43.079779 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 663/1355] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Jul 5 21:37:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:37:46.696897 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28598921-7782-4971-8a17-78e18e9441bb None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:46.697416 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28598921-7782-4971-8a17-78e18e9441bb None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:46.697512 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28598921-7782-4971-8a17-78e18e9441bb None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:46.703310 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 693/1356] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:37:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:37:46.704748 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c281b9-2ca8-495d-80a8-35cc4b81448d None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:46.705186 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c281b9-2ca8-495d-80a8-35cc4b81448d None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:46.705347 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c281b9-2ca8-495d-80a8-35cc4b81448d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:46.727139 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-a4c281b9-2ca8-495d-80a8-35cc4b81448d None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:37:46.730247 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-a4c281b9-2ca8-495d-80a8-35cc4b81448d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:37:46.744449 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 664/1357] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:37:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:37:46.798688 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf1114-33ff-462e-a8bc-4feff6bc90a3 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:46.799339 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf1114-33ff-462e-a8bc-4feff6bc90a3 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:46.799802 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf1114-33ff-462e-a8bc-4feff6bc90a3 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:46.802236 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 694/1358] 10.222.0.30 () {54 vars in 961 bytes} [Tue Jul 5 21:37:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:37:46.811175 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c35645-bce5-41d3-91e4-498ad4314b13 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:46.811704 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c35645-bce5-41d3-91e4-498ad4314b13 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:46.811989 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c35645-bce5-41d3-91e4-498ad4314b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:46.858036 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:37:46.866036 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-f3c35645-bce5-41d3-91e4-498ad4314b13 None None] MFA Rules not processed for user `941ed10dfafc4bd48896843da26c9175`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:37:46.867472 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-f3c35645-bce5-41d3-91e4-498ad4314b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:37:46.958433 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 665/1359] 10.222.0.30 () {58 vars in 1058 bytes} [Tue Jul 5 21:37:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:37:46.964213 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf1114-33ff-462e-a8bc-4feff6bc90a3 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:37:46.982267 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf1114-33ff-462e-a8bc-4feff6bc90a3 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:37:46.988102 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fe33ba-5b0d-482a-a396-cbad3b8dac6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '941ed10dfafc4bd48896843da26c9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fe768315f5c43f487f71f043f11b8b8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:37:46.988752 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe33ba-5b0d-482a-a396-cbad3b8dac6e service nova] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:46.989040 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe33ba-5b0d-482a-a396-cbad3b8dac6e service nova] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:46.989323 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe33ba-5b0d-482a-a396-cbad3b8dac6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:46.999108 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fe33ba-5b0d-482a-a396-cbad3b8dac6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:37:47.000722 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fe33ba-5b0d-482a-a396-cbad3b8dac6e service nova] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:37:47.023762 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 695/1360] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:37:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:37:49.281365 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac785f9-d542-4424-bf13-4e6a3735301f None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:49.281894 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac785f9-d542-4424-bf13-4e6a3735301f None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:49.281894 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac785f9-d542-4424-bf13-4e6a3735301f None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:49.287262 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 666/1361] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:37:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:37:49.289792 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2fd00-2089-4ac7-9aee-817d62fddeca None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:49.290262 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2fd00-2089-4ac7-9aee-817d62fddeca None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:49.290576 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2fd00-2089-4ac7-9aee-817d62fddeca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:49.311776 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-3fb2fd00-2089-4ac7-9aee-817d62fddeca None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:37:49.312983 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-3fb2fd00-2089-4ac7-9aee-817d62fddeca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:37:49.325650 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 696/1362] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:37:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:37:49.366978 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac785f9-d542-4424-bf13-4e6a3735301f None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:37:49.383669 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac785f9-d542-4424-bf13-4e6a3735301f None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:37:49.389942 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551df6d5-d5ac-4661-b3c3-f65d4c6ef2ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '941ed10dfafc4bd48896843da26c9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fe768315f5c43f487f71f043f11b8b8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:37:49.390743 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551df6d5-d5ac-4661-b3c3-f65d4c6ef2ae service nova] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:49.391135 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551df6d5-d5ac-4661-b3c3-f65d4c6ef2ae service nova] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:49.391517 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551df6d5-d5ac-4661-b3c3-f65d4c6ef2ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:49.401623 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551df6d5-d5ac-4661-b3c3-f65d4c6ef2ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:37:49.403475 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551df6d5-d5ac-4661-b3c3-f65d4c6ef2ae service nova] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:37:49.415267 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 667/1363] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:37:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:37:51.948355 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2c404-4dc5-46bc-bcc7-da24a038a739 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:51.948817 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2c404-4dc5-46bc-bcc7-da24a038a739 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:51.948911 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2c404-4dc5-46bc-bcc7-da24a038a739 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:51.950318 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 697/1364] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:37:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:37:51.955827 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb5be0-d296-44f0-9146-936e9ed4b214 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:51.956237 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb5be0-d296-44f0-9146-936e9ed4b214 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:51.956397 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb5be0-d296-44f0-9146-936e9ed4b214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:51.976014 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-8deb5be0-d296-44f0-9146-936e9ed4b214 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:37:51.977451 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-8deb5be0-d296-44f0-9146-936e9ed4b214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:37:51.985479 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 668/1365] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:37:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:37:52.032750 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33859dc8-32ee-4d49-9d86-385096c77849 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:52.033060 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33859dc8-32ee-4d49-9d86-385096c77849 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:52.033341 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33859dc8-32ee-4d49-9d86-385096c77849 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:52.035142 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 698/1366] 10.222.0.30 () {54 vars in 961 bytes} [Tue Jul 5 21:37:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:37:52.041128 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524f065-e8b3-487e-9fdf-3a2327855bbd None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:52.041418 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524f065-e8b3-487e-9fdf-3a2327855bbd None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:52.041700 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524f065-e8b3-487e-9fdf-3a2327855bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:52.061212 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-1524f065-e8b3-487e-9fdf-3a2327855bbd None None] MFA Rules not processed for user `941ed10dfafc4bd48896843da26c9175`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:37:52.062475 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-1524f065-e8b3-487e-9fdf-3a2327855bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:37:52.072578 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 669/1367] 10.222.0.30 () {58 vars in 1058 bytes} [Tue Jul 5 21:37:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:37:52.080352 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33859dc8-32ee-4d49-9d86-385096c77849 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:37:52.094816 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33859dc8-32ee-4d49-9d86-385096c77849 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:37:52.100778 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649958b2-8654-4df1-a933-18de8bb7cc49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '941ed10dfafc4bd48896843da26c9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fe768315f5c43f487f71f043f11b8b8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:37:52.101515 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649958b2-8654-4df1-a933-18de8bb7cc49 service nova] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:52.101868 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649958b2-8654-4df1-a933-18de8bb7cc49 service nova] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:52.102250 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649958b2-8654-4df1-a933-18de8bb7cc49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:52.110735 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649958b2-8654-4df1-a933-18de8bb7cc49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:37:52.112329 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649958b2-8654-4df1-a933-18de8bb7cc49 service nova] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:37:52.122638 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 699/1368] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:37:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:37:54.419055 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2175c9-6021-4b59-8a23-aa1307db7343 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:54.419637 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2175c9-6021-4b59-8a23-aa1307db7343 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:54.419932 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2175c9-6021-4b59-8a23-aa1307db7343 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:54.421471 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 670/1369] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:37:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:37:54.426818 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92edfba-6464-40f2-95e2-2c73ea8cf724 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:54.427251 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92edfba-6464-40f2-95e2-2c73ea8cf724 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:54.427383 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92edfba-6464-40f2-95e2-2c73ea8cf724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:54.446012 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-e92edfba-6464-40f2-95e2-2c73ea8cf724 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:37:54.447375 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-e92edfba-6464-40f2-95e2-2c73ea8cf724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:37:54.455617 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 700/1370] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:37:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:37:54.500035 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2175c9-6021-4b59-8a23-aa1307db7343 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:37:54.514782 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2175c9-6021-4b59-8a23-aa1307db7343 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:37:54.520278 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e71acf-e1d0-48ef-9134-725d3264f417 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '941ed10dfafc4bd48896843da26c9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fe768315f5c43f487f71f043f11b8b8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:37:54.520968 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e71acf-e1d0-48ef-9134-725d3264f417 service nova] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:54.521245 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e71acf-e1d0-48ef-9134-725d3264f417 service nova] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:54.521726 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e71acf-e1d0-48ef-9134-725d3264f417 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:54.530676 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e71acf-e1d0-48ef-9134-725d3264f417 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:37:54.532264 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e71acf-e1d0-48ef-9134-725d3264f417 service nova] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:37:54.542347 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 671/1371] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:37:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:37:54.994532 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b688be-d84b-446e-b95d-503b201b4641 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:54.994828 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b688be-d84b-446e-b95d-503b201b4641 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:54.995290 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b688be-d84b-446e-b95d-503b201b4641 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:54.997020 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 701/1372] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:37:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:37:55.002361 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f353e7-b79f-4a36-9b77-12ee5ab1f951 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:55.002653 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f353e7-b79f-4a36-9b77-12ee5ab1f951 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:55.003136 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f353e7-b79f-4a36-9b77-12ee5ab1f951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:55.021713 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-e4f353e7-b79f-4a36-9b77-12ee5ab1f951 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:37:55.023482 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-e4f353e7-b79f-4a36-9b77-12ee5ab1f951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:37:55.031419 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 672/1373] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:37:55.392722 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596860e-47cc-4ed9-8468-e5b288c4208a None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:55.392722 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596860e-47cc-4ed9-8468-e5b288c4208a None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:55.392722 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596860e-47cc-4ed9-8468-e5b288c4208a None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:55.392722 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 702/1374] 10.222.0.30 () {54 vars in 963 bytes} [Tue Jul 5 21:37:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:37:55.398149 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e8ce6-47c3-4f97-ab3e-d8a751b60e8f None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:55.398568 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e8ce6-47c3-4f97-ab3e-d8a751b60e8f None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:55.398950 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e8ce6-47c3-4f97-ab3e-d8a751b60e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:55.453333 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-064e8ce6-47c3-4f97-ab3e-d8a751b60e8f None None] MFA Rules not processed for user `8e88abf44b444872ad688677ddb437ac`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:37:55.455381 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-064e8ce6-47c3-4f97-ab3e-d8a751b60e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:37:55.520803 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 673/1375] 10.222.0.30 () {58 vars in 1060 bytes} [Tue Jul 5 21:37:55 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:37:55.528436 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b596860e-47cc-4ed9-8468-e5b288c4208a None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:37:55.539856 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b596860e-47cc-4ed9-8468-e5b288c4208a None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:37:55.543700 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde217a1-4cb6-41fc-9a18-cbdcc7f4442d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e88abf44b444872ad688677ddb437ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fe768315f5c43f487f71f043f11b8b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:37:55.544458 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde217a1-4cb6-41fc-9a18-cbdcc7f4442d service cinder] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:55.544853 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde217a1-4cb6-41fc-9a18-cbdcc7f4442d service cinder] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:55.545239 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde217a1-4cb6-41fc-9a18-cbdcc7f4442d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:55.560020 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde217a1-4cb6-41fc-9a18-cbdcc7f4442d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:37:55.561636 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde217a1-4cb6-41fc-9a18-cbdcc7f4442d service cinder] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:37:55.574566 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 703/1376] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:37:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:37:56.761502 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5096a4-e450-4bb1-8b50-ac04cb14a723 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:56.762030 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5096a4-e450-4bb1-8b50-ac04cb14a723 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:56.762118 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5096a4-e450-4bb1-8b50-ac04cb14a723 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:56.763556 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 674/1377] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:37:56.768952 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4acce-b040-4932-8e50-0f0a9c25a253 None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:56.769363 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4acce-b040-4932-8e50-0f0a9c25a253 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:56.769661 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4acce-b040-4932-8e50-0f0a9c25a253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:56.788440 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-33a4acce-b040-4932-8e50-0f0a9c25a253 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:37:56.789655 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-33a4acce-b040-4932-8e50-0f0a9c25a253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:37:56.797555 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 704/1378] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:37:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:37:56.841757 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5096a4-e450-4bb1-8b50-ac04cb14a723 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:37:56.857406 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5096a4-e450-4bb1-8b50-ac04cb14a723 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:37:56.863186 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff52bd-edda-4de7-8bc4-9b20b520511b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '941ed10dfafc4bd48896843da26c9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fe768315f5c43f487f71f043f11b8b8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:37:56.863840 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff52bd-edda-4de7-8bc4-9b20b520511b service nova] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:56.864156 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff52bd-edda-4de7-8bc4-9b20b520511b service nova] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:56.864440 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff52bd-edda-4de7-8bc4-9b20b520511b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:56.872888 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eff52bd-edda-4de7-8bc4-9b20b520511b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:37:56.874527 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eff52bd-edda-4de7-8bc4-9b20b520511b service nova] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:37:56.878440 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=100 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:37:56.885326 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 675/1379] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:37:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:37:59.050769 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0d51e-bf59-454c-a1d7-ef5626f71bd5 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:59.051316 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0d51e-bf59-454c-a1d7-ef5626f71bd5 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:59.051316 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0d51e-bf59-454c-a1d7-ef5626f71bd5 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:59.052701 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 705/1380] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:37:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:37:59.058465 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dfa6a7-868c-44bc-a842-75e4835f786c None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:59.058890 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dfa6a7-868c-44bc-a842-75e4835f786c None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:59.059040 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dfa6a7-868c-44bc-a842-75e4835f786c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:59.078349 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-81dfa6a7-868c-44bc-a842-75e4835f786c None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:37:59.079805 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-81dfa6a7-868c-44bc-a842-75e4835f786c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:37:59.088292 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 676/1381] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:37:59.135764 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f0d51e-bf59-454c-a1d7-ef5626f71bd5 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:37:59.150437 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f0d51e-bf59-454c-a1d7-ef5626f71bd5 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:37:59.165064 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa0b43-32ae-4cdc-8ee0-9d83ba63b377 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '941ed10dfafc4bd48896843da26c9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fe768315f5c43f487f71f043f11b8b8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:37:59.165749 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa0b43-32ae-4cdc-8ee0-9d83ba63b377 service nova] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:37:59.167076 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa0b43-32ae-4cdc-8ee0-9d83ba63b377 service nova] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:37:59.167076 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa0b43-32ae-4cdc-8ee0-9d83ba63b377 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:37:59.175916 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa0b43-32ae-4cdc-8ee0-9d83ba63b377 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:37:59.177609 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa0b43-32ae-4cdc-8ee0-9d83ba63b377 service nova] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:37:59.188547 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 706/1382] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:37:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:38:01.405323 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b626e-5555-4766-939a-9f88f119fff9 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:38:01.405849 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b626e-5555-4766-939a-9f88f119fff9 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:38:01.406087 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b626e-5555-4766-939a-9f88f119fff9 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:38:01.407680 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 677/1383] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:38:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:38:01.413978 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cf035-d1cb-4275-b702-437f5354cc1d None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:38:01.414489 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cf035-d1cb-4275-b702-437f5354cc1d None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:38:01.414610 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cf035-d1cb-4275-b702-437f5354cc1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:38:01.434014 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-ea8cf035-d1cb-4275-b702-437f5354cc1d None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:38:01.435246 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-ea8cf035-d1cb-4275-b702-437f5354cc1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:38:01.443506 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 707/1384] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:38:01.486201 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b626e-5555-4766-939a-9f88f119fff9 None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:38:01.501422 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b626e-5555-4766-939a-9f88f119fff9 None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:38:01.508146 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abda6f4-1aeb-41bf-ac34-02df57309700 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '941ed10dfafc4bd48896843da26c9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fe768315f5c43f487f71f043f11b8b8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:38:01.508824 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abda6f4-1aeb-41bf-ac34-02df57309700 service nova] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:38:01.509118 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abda6f4-1aeb-41bf-ac34-02df57309700 service nova] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:38:01.509406 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abda6f4-1aeb-41bf-ac34-02df57309700 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:38:01.518555 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abda6f4-1aeb-41bf-ac34-02df57309700 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:38:01.520154 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abda6f4-1aeb-41bf-ac34-02df57309700 service nova] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:38:01.530682 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 678/1385] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:38:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:38:03.639033 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212af5d-5143-4737-aeec-7909143d3879 None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:38:03.639611 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212af5d-5143-4737-aeec-7909143d3879 None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:38:03.639611 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212af5d-5143-4737-aeec-7909143d3879 None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:38:03.640976 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 708/1386] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:38:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:38:03.646072 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d64ca5-8054-46b4-98f6-04c4941bc9a2 None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:38:03.646535 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d64ca5-8054-46b4-98f6-04c4941bc9a2 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:38:03.646830 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d64ca5-8054-46b4-98f6-04c4941bc9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:38:03.665199 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-53d64ca5-8054-46b4-98f6-04c4941bc9a2 None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:38:03.666453 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-53d64ca5-8054-46b4-98f6-04c4941bc9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:38:03.674411 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 679/1387] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:38:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:38:03.719551 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f212af5d-5143-4737-aeec-7909143d3879 None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:38:03.735008 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f212af5d-5143-4737-aeec-7909143d3879 None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:38:03.740411 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f4052-b602-4710-a7da-4a749c43f80e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '941ed10dfafc4bd48896843da26c9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fe768315f5c43f487f71f043f11b8b8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:38:03.742071 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f4052-b602-4710-a7da-4a749c43f80e service nova] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:38:03.742389 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f4052-b602-4710-a7da-4a749c43f80e service nova] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:38:03.742671 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f4052-b602-4710-a7da-4a749c43f80e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:38:03.753045 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5f4052-b602-4710-a7da-4a749c43f80e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:38:03.756059 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5f4052-b602-4710-a7da-4a749c43f80e service nova] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:38:03.768018 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 709/1388] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:38:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:38:05.436168 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c5b71-49fd-4ef9-a3dc-3a0aff352e37 None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:38:05.436742 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c5b71-49fd-4ef9-a3dc-3a0aff352e37 None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:38:05.436742 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c5b71-49fd-4ef9-a3dc-3a0aff352e37 None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:38:05.438117 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 680/1389] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:38:05.443336 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5e862-3262-4de4-9d51-0b8cdd3a5dca None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:38:05.443882 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5e862-3262-4de4-9d51-0b8cdd3a5dca None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:38:05.444256 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5e862-3262-4de4-9d51-0b8cdd3a5dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:38:05.461910 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-89a5e862-3262-4de4-9d51-0b8cdd3a5dca None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:38:05.463154 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-89a5e862-3262-4de4-9d51-0b8cdd3a5dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:38:05.471134 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 710/1390] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:38:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:38:05.527667 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65a008-ddbb-414d-a64d-f0843a59447c None None] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:38:05.528030 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65a008-ddbb-414d-a64d-f0843a59447c None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:38:05.528381 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65a008-ddbb-414d-a64d-f0843a59447c None None] PATH_INFO: `/` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:38:05.529858 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 681/1391] 10.222.0.30 () {54 vars in 962 bytes} [Tue Jul 5 21:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:38:05.535041 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503bc01e-1fcb-47a1-b77a-fc0ec92bcbee None None] REQUEST_METHOD: `POST` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:38:05.535346 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503bc01e-1fcb-47a1-b77a-fc0ec92bcbee None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:38:05.535654 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503bc01e-1fcb-47a1-b77a-fc0ec92bcbee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:38:05.589242 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.auth.core [None req-503bc01e-1fcb-47a1-b77a-fc0ec92bcbee None None] MFA Rules not processed for user `9fab25f2362e4043a83964e177bbcb3e`. Rule list: `[]` (Enabled: `True`). {{(pid=172890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:38:05.590475 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.fernet_utils [None req-503bc01e-1fcb-47a1-b77a-fc0ec92bcbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:38:05.650891 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 711/1392] 10.222.0.30 () {58 vars in 1059 bytes} [Tue Jul 5 21:38:05 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:38:05.658444 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff65a008-ddbb-414d-a64d-f0843a59447c None None] Authenticating user token {{(pid=172889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:38:05.669916 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff65a008-ddbb-414d-a64d-f0843a59447c None None] Validating token access rules against request {{(pid=172889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:38:05.673480 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27691ecd-031d-4468-b8bd-c27106c645f9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fab25f2362e4043a83964e177bbcb3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fe768315f5c43f487f71f043f11b8b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:38:05.674141 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27691ecd-031d-4468-b8bd-c27106c645f9 service glance] REQUEST_METHOD: `GET` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:38:05.674450 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27691ecd-031d-4468-b8bd-c27106c645f9 service glance] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:38:05.674921 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27691ecd-031d-4468-b8bd-c27106c645f9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:38:05.684548 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27691ecd-031d-4468-b8bd-c27106c645f9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:38:05.686290 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27691ecd-031d-4468-b8bd-c27106c645f9 service glance] RBAC: Authorization granted {{(pid=172889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:38:05.696050 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 682/1393] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:38:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:38:05.996806 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3f7c4-7cd2-48a7-b2c8-91d3a1f4af3f None None] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:38:05.997100 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3f7c4-7cd2-48a7-b2c8-91d3a1f4af3f None None] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:38:05.997570 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3f7c4-7cd2-48a7-b2c8-91d3a1f4af3f None None] PATH_INFO: `/` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:38:05.998999 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 712/1394] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:38:06.004334 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887eb3d-ab1b-4b1c-923b-739bc754b9bc None None] REQUEST_METHOD: `POST` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:38:06.004639 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887eb3d-ab1b-4b1c-923b-739bc754b9bc None None] SCRIPT_NAME: `/identity` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:38:06.004926 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887eb3d-ab1b-4b1c-923b-739bc754b9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=172889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:38:06.022992 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.auth.core [None req-1887eb3d-ab1b-4b1c-923b-739bc754b9bc None None] MFA Rules not processed for user `8f7b68cdb43a4c0b96cd3cbfc39bee35`. Rule list: `[]` (Enabled: `True`). {{(pid=172889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:38:06.024211 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG keystone.common.fernet_utils [None req-1887eb3d-ab1b-4b1c-923b-739bc754b9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=172889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:38:06.032083 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: [pid: 172889|app: 0|req: 683/1395] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:38:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:38:06.076043 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3f7c4-7cd2-48a7-b2c8-91d3a1f4af3f None None] Authenticating user token {{(pid=172890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:38:06.090645 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3f7c4-7cd2-48a7-b2c8-91d3a1f4af3f None None] Validating token access rules against request {{(pid=172890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:38:06.096087 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538e7c1-28a0-4f33-98cb-1111eb79a1b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '941ed10dfafc4bd48896843da26c9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fe768315f5c43f487f71f043f11b8b8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=172890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:38:06.096730 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538e7c1-28a0-4f33-98cb-1111eb79a1b3 service nova] REQUEST_METHOD: `GET` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:38:06.097273 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538e7c1-28a0-4f33-98cb-1111eb79a1b3 service nova] SCRIPT_NAME: `/identity` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:38:06.097556 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538e7c1-28a0-4f33-98cb-1111eb79a1b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=172890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:38:06.106695 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4538e7c1-28a0-4f33-98cb-1111eb79a1b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:38:06.108294 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4538e7c1-28a0-4f33-98cb-1111eb79a1b3 service nova] RBAC: Authorization granted {{(pid=172890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:38:06.118600 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: [pid: 172890|app: 0|req: 713/1396] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:38:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:38:16.018076 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: DEBUG dbcounter [-] [172889] Writing DB stats keystone:SELECT=22 {{(pid=172889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:38:16.113531 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: DEBUG dbcounter [-] [172890] Writing DB stats keystone:SELECT=89 {{(pid=172890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:38:27.709840 dv-cinder-847335-3-iscsi devstack@keystone.service[172843]: Tue Jul 5 21:38:27 2022 - graceful shutdown triggered... Jul 05 21:38:27.710296 dv-cinder-847335-3-iscsi devstack@keystone.service[172889]: Gracefully killing worker 1 (pid: 172889)... Jul 05 21:38:27.709944 dv-cinder-847335-3-iscsi systemd[1]: Stopping Devstack devstack@keystone.service... Jul 05 21:38:27.710785 dv-cinder-847335-3-iscsi devstack@keystone.service[172890]: Gracefully killing worker 2 (pid: 172890)... Jul 05 21:38:28.710952 dv-cinder-847335-3-iscsi devstack@keystone.service[172843]: worker 1 buried after 1 seconds Jul 05 21:38:28.710952 dv-cinder-847335-3-iscsi devstack@keystone.service[172843]: worker 2 buried after 1 seconds Jul 05 21:38:28.710952 dv-cinder-847335-3-iscsi devstack@keystone.service[172843]: goodbye to uWSGI. Jul 05 21:38:28.712540 dv-cinder-847335-3-iscsi systemd[1]: devstack@keystone.service: Succeeded. Jul 05 21:38:28.713086 dv-cinder-847335-3-iscsi systemd[1]: Stopped Devstack devstack@keystone.service. Jul 05 21:43:46.837381 dv-cinder-847335-3-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jul 05 21:43:46.846417 dv-cinder-847335-3-iscsi devstack@keystone.service[244256]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 05 21:43:46.848392 dv-cinder-847335-3-iscsi devstack@keystone.service[244256]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 5 21:43:46 2022] *** Jul 05 21:43:46.848392 dv-cinder-847335-3-iscsi devstack@keystone.service[244256]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 05 21:43:46.848392 dv-cinder-847335-3-iscsi devstack@keystone.service[244256]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 05 21:43:46.848392 dv-cinder-847335-3-iscsi devstack@keystone.service[244256]: nodename: dv-cinder-847335-3-iscsi Jul 05 21:43:46.848392 dv-cinder-847335-3-iscsi devstack@keystone.service[244256]: machine: x86_64 Jul 05 21:43:46.848392 dv-cinder-847335-3-iscsi devstack@keystone.service[244256]: clock source: unix Jul 05 21:43:46.848392 dv-cinder-847335-3-iscsi devstack@keystone.service[244256]: pcre jit disabled Jul 05 21:43:46.848392 dv-cinder-847335-3-iscsi devstack@keystone.service[244256]: detected number of CPU cores: 4 Jul 05 21:43:46.848392 dv-cinder-847335-3-iscsi devstack@keystone.service[244256]: current working directory: / Jul 05 21:43:46.848392 dv-cinder-847335-3-iscsi devstack@keystone.service[244256]: detected binary path: /usr/bin/uwsgi-core Jul 05 21:43:46.848392 dv-cinder-847335-3-iscsi devstack@keystone.service[244256]: your processes number limit is 47680 Jul 05 21:43:46.848392 dv-cinder-847335-3-iscsi devstack@keystone.service[244256]: your memory page size is 4096 bytes Jul 05 21:43:46.848392 dv-cinder-847335-3-iscsi devstack@keystone.service[244256]: detected max file descriptor number: 2048 Jul 05 21:43:46.849367 dv-cinder-847335-3-iscsi devstack@keystone.service[244256]: lock engine: pthread robust mutexes Jul 05 21:43:46.849367 dv-cinder-847335-3-iscsi devstack@keystone.service[244256]: thunder lock: enabled Jul 05 21:43:46.849367 dv-cinder-847335-3-iscsi devstack@keystone.service[244256]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 05 21:43:46.849367 dv-cinder-847335-3-iscsi devstack@keystone.service[244256]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 05 21:43:46.894435 dv-cinder-847335-3-iscsi devstack@keystone.service[244256]: Python main interpreter initialized at 0x55a846b859c0 Jul 05 21:43:46.894435 dv-cinder-847335-3-iscsi devstack@keystone.service[244256]: python threads support enabled Jul 05 21:43:46.894435 dv-cinder-847335-3-iscsi devstack@keystone.service[244256]: your server socket listen backlog is limited to 100 connections Jul 05 21:43:46.894435 dv-cinder-847335-3-iscsi devstack@keystone.service[244256]: your mercy for graceful operations on workers is 90 seconds Jul 05 21:43:46.894853 dv-cinder-847335-3-iscsi devstack@keystone.service[244256]: mapped 403077 bytes (393 KB) for 2 cores Jul 05 21:43:46.894853 dv-cinder-847335-3-iscsi devstack@keystone.service[244256]: *** Operational MODE: preforking *** Jul 05 21:43:46.895149 dv-cinder-847335-3-iscsi devstack@keystone.service[244256]: *** uWSGI is running in multiple interpreter mode *** Jul 05 21:43:46.895149 dv-cinder-847335-3-iscsi devstack@keystone.service[244256]: spawned uWSGI master process (pid: 244256) Jul 05 21:43:46.895341 dv-cinder-847335-3-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jul 05 21:43:46.898159 dv-cinder-847335-3-iscsi devstack@keystone.service[244256]: spawned uWSGI worker 1 (pid: 244268, cores: 1) Jul 05 21:43:46.898159 dv-cinder-847335-3-iscsi devstack@keystone.service[244256]: spawned uWSGI worker 2 (pid: 244269, cores: 1) Jul 05 21:43:46.898159 dv-cinder-847335-3-iscsi devstack@keystone.service[244256]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 05 21:43:52.666919 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 21:43:52.666919 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: from cryptography.utils import int_from_bytes Jul 05 21:43:52.667802 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 21:43:52.667802 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: from cryptography.utils import int_from_bytes Jul 05 21:43:52.667964 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 21:43:52.667964 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: from cryptography.utils import int_from_bytes Jul 05 21:43:52.667964 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 21:43:52.667964 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: from cryptography.utils import int_from_bytes Jul 05 21:43:52.717493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 05 21:43:52.717717 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 05 21:43:52.717914 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] command line args: [] {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 05 21:43:52.718231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 05 21:43:52.718439 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ================================================================================ {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 05 21:43:52.718544 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 05 21:43:52.718699 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 05 21:43:52.718796 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] admin_token = **** {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.718885 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] command line args: [] {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 05 21:43:52.718999 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] config_dir = [] {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.719168 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 05 21:43:52.719281 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.719371 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ================================================================================ {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 05 21:43:52.719459 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] config_source = [] {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.719601 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] admin_token = **** {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.719697 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] debug = True {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.719855 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] config_dir = [] {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.719968 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.720162 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.720243 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] config_source = [] {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.720318 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.720394 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] debug = True {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.720476 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] insecure_debug = False {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.720641 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.720793 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.720885 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.721017 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] insecure_debug = False {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.721122 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.721275 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] list_limit = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.721372 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.721450 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] log_config_append = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.721527 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.721655 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.721776 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] list_limit = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.721892 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] log_dir = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.722008 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] log_config_append = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.722123 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] log_file = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.722285 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.722393 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.722496 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] log_dir = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.722585 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.722673 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] log_file = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.722761 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.722849 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.722936 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.723038 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.723127 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.723217 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.723304 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.723431 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.723613 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.723710 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.723799 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.723886 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.723974 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.724072 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.724188 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.724290 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.724424 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.724659 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.724762 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.724907 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.725058 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.725197 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] notification_format = cadf {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.725340 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.725479 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.725614 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.725754 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.725899 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.30/identity {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.726034 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] notification_format = cadf {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.726193 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] publish_errors = False {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.726335 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.726477 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.726612 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.727002 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.727143 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.30/identity {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.727279 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] publish_errors = False {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.727417 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.727550 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.727683 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.727816 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] standard_threads = False {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.727954 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.728088 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] strict_password_check = False {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.728227 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.728362 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.728494 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.728627 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] use_eventlog = False {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.728761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.728900 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] use_journal = False {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.728900 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] use_json = False {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.729152 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] standard_threads = False {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.729293 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] use_stderr = False {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.729428 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] strict_password_check = False {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.729561 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] use_syslog = False {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.729694 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.729833 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] watch_log_file = False {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.729967 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] use_eventlog = False {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.730100 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.730257 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] use_journal = False {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.730257 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] use_json = False {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.730513 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.730654 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] use_stderr = False {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.730787 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.730922 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] use_syslog = False {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.731049 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.731182 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] watch_log_file = False {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 21:43:52.731316 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.731457 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.731592 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.731725 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.731866 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.732001 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.732134 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.732274 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.732408 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.732543 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.732677 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.732819 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.732953 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.733093 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.733234 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.733368 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.733502 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.733636 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.733762 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.733900 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.734034 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.734188 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.734325 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.734460 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.734598 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.734747 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.734885 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.735020 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.735153 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.735287 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.735421 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.735560 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.735695 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.735829 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.735962 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.736096 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.736229 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.736368 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.736502 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.736644 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.736779 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.736913 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.737046 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.737184 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.737319 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.737453 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.737586 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.737720 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.737860 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.737988 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.738121 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.738281 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.738416 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.738550 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.738686 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.738821 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.738955 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.739088 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.739221 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.739355 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.739494 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.739627 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.739761 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.739895 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.740028 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.740161 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.740300 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.740434 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.740567 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.740694 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.740820 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.740953 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.741092 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.741226 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.741359 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.741493 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.741626 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.741753 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.741888 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.742022 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.742198 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.742338 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.742473 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.742606 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.742747 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.742881 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.743500 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.743629 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.743762 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.743896 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.744036 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.744170 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.744304 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.744438 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.744578 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.744705 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.744844 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.744978 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.745113 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.745246 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.745380 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.745507 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.745645 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.745645 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.745899 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.746033 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.746194 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.746330 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.746481 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.746635 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.746769 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.746897 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.747023 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.747160 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.747306 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.747447 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.747581 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.747752 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.747890 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.748045 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.748180 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.748314 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.748526 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.748656 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.748790 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.748918 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.749051 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.749185 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.749185 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.749446 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.749580 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.749714 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.749853 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.749987 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.750115 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.750292 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.750428 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.750568 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.750702 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.750829 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.750969 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] cache.enabled = True {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.751103 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.751244 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.751385 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.751519 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.751647 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.751773 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.751900 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.752033 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.752169 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.752303 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.752437 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.752573 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.752713 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] cache.enabled = True {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.752840 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.752986 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.753114 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.753241 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.753374 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.753509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.753636 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.753774 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.753908 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.753908 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.754166 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.754306 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.754434 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.754579 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.754713 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.754899 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.755032 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.755166 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.755300 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.755440 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.755569 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.755707 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.755835 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.755968 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.755968 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.756227 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.756354 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.756488 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.756621 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.756758 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.756889 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.757031 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.757165 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.757165 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.757418 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.757551 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.757685 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.757824 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.757958 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.758084 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.758227 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.758365 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] auth.external = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.758510 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.758794 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] auth.mapped = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.759434 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.759569 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.759698 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.759834 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.759962 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.760111 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] auth.password = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.760252 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.760386 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] auth.token = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.760386 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.760640 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.760769 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] catalog.caching = True {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.760918 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.761061 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.761196 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.761330 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.761471 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.761599 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.761733 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] auth.external = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.761874 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.762003 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] auth.mapped = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.762170 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.762170 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] credential.caching = True {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.762432 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.762577 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] credential.driver = sql {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.762717 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.762857 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.762986 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] auth.password = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.763126 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.763254 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] auth.token = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.763388 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.763524 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.763658 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.763793 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] catalog.caching = True {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.763928 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.764062 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.764062 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.764318 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.764453 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.764585 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.764585 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.764831 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.764831 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.765090 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.765231 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] credential.caching = True {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.765366 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.765501 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] credential.driver = sql {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.765634 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.765776 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.765917 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.766055 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.766229 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.766377 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.766513 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.766648 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.766785 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] federation.caching = True {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.766920 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.767055 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.767190 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.767333 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] federation.driver = sql {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.767333 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.767594 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.767729 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.767846 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.767973 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.768107 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.768243 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.768382 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.768510 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.768653 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.768787 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.768914 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.769053 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.769198 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.769382 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.769520 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.769655 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.769803 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] federation.caching = True {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.769948 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] identity.caching = True {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.770115 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.770272 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.770401 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] federation.driver = sql {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.770534 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.770662 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.770801 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.770935 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.771069 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.771197 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.771331 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] identity.driver = sql {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.771465 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.771605 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.771733 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.771860 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.771986 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.772119 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.772253 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.772467 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.772603 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.772737 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.772866 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.773000 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.773127 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] identity.caching = True {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.773263 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.773393 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.773520 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.773653 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.773787 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.773921 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.774073 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.774287 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.774436 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.774578 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] identity.driver = sql {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.774706 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.774839 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.774976 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.775118 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.775252 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.775381 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.775516 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.775516 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.775781 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.775781 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.776029 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.776029 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.776274 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.776408 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.776550 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.776684 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.776818 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.776953 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.777081 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.777213 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.777353 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.777481 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.777609 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.777752 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.777897 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.778034 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.778190 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.778326 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.778460 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.778595 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.778737 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.778882 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.779017 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.779151 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.779286 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.779413 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.779554 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.779701 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ldap.password = **** {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.779836 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.779964 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.780097 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.780231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.780358 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.780494 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.780622 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.780756 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.780890 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.781031 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.781165 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.781316 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.781445 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.781571 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.781705 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.781834 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.781961 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.782096 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.782284 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.782428 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.782569 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.782711 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.782847 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.782983 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.783117 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ldap.password = **** {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.783251 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.783386 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.783513 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.783640 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.783779 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ldap.user = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.783923 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.784058 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.784192 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.784330 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.784465 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.784601 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.784735 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.784863 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.784996 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.785124 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.785251 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.785386 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.785521 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.785649 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.785775 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.785902 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.786036 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.786196 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.786341 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.786469 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.786602 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.786729 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.786862 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.787002 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.787130 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ldap.user = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.787262 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.787396 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.787529 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.787663 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.787803 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.787931 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.788065 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.788199 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.788332 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.788467 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.788607 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.788741 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.788869 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.789001 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.789135 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.789269 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.789405 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.789539 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.789673 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.789824 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.789962 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.790102 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.790283 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.790418 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.790546 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.790689 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.790817 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.790952 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.791081 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] policy.driver = sql {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.791081 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.791334 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.791466 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.791600 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.791735 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.791870 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.791998 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] receipt.caching = True {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.792131 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.792259 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.792392 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.792528 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.792657 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.792790 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.792919 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.793058 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.793186 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.793326 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.793461 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.793588 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] resource.caching = True {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.793721 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.793854 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.793982 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.794140 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] resource.driver = sql {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.794272 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.794410 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.794538 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] policy.driver = sql {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.794671 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.794805 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.794941 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.795070 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.795204 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] revoke.caching = True {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.795332 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.795460 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.795602 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] receipt.caching = True {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.795743 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.795880 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.796008 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] role.cache_time = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.796144 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.796279 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] role.caching = True {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.796413 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.796562 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] role.driver = sql {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.796736 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.796887 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] role.list_limit = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.797017 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.797144 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.797271 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] resource.caching = True {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.797408 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.797544 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.797672 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.797805 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] resource.driver = sql {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.797945 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.798079 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.798306 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.798444 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.798573 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.798707 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.798841 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.798976 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] revoke.caching = True {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.799113 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.799241 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.799368 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.799513 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.799643 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.799786 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] role.cache_time = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.799926 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.800055 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] role.caching = True {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.800182 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.800310 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] role.driver = sql {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.800443 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.800578 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] role.list_limit = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.800578 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.800834 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.800968 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.801096 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.801222 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.801366 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.801366 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.801621 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.801750 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.801884 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.802018 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.802207 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.802345 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.802480 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.802609 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.802743 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.802878 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.803019 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.803153 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.803288 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.803415 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.803549 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.803677 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.803827 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.803975 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.804111 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.804238 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.804365 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.804492 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.804627 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.804755 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.804755 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.805007 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.805136 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.805263 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.805399 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] token.cache_time = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.806037 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.806200 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] token.caching = True {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.806331 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.806465 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.806599 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.806740 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] token.provider = fernet {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.806869 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.806997 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.807131 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.807260 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.807387 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.807527 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.807723 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.807863 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.807993 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.808121 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.808262 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.808399 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.808534 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.808668 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] trust.driver = sql {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.808796 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.808929 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.809058 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.809197 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.809334 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.809468 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.809596 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.809723 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.809861 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] token.cache_time = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.809989 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.810117 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] token.caching = True {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.810301 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.810437 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.810571 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.810712 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] token.provider = fernet {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.810841 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.810974 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.811109 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] database.connection = **** {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.811244 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.811384 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.811513 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.811646 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.811774 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.811907 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.812044 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.812173 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.812300 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.812427 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.812554 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] trust.driver = sql {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.812687 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.812823 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.812957 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.813091 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.813227 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.813361 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.813494 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.813631 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.813759 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.813885 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.814012 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.814162 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.814298 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.814442 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.814571 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.814571 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.814820 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.814954 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.815088 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] database.connection = **** {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.815224 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.815365 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.815493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.815626 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.815762 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.815891 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.816024 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=244269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 05 21:43:52.816159 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.816159 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.816159 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.816159 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.816159 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.816159 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.816159 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.816159 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.816159 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.817249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.817249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.817249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.817249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.817249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.817249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 21:43:52.817249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=244268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 05 21:43:52.835622 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=244269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:52.835859 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=244269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:52.836096 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=244269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:52.838701 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=244268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:52.838943 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=244268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:52.839175 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=244268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:52.844507 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=244269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:52.847773 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=244268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:52.873133 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=244269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:52.873365 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=244269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:52.874408 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=244268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:52.874648 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=244268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:52.927064 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=244268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:53.016842 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=244269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:53.052421 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=244269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:53.052643 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=244269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:53.068728 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=244268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:53.068973 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=244268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:53.117738 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=244269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:53.118054 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=244269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:53.118308 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=244269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:53.118607 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=244269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:53.118837 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=244269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:53.119059 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=244269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:53.119268 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=244268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:53.119505 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=244268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:53.119731 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=244268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:53.119954 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=244268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:53.120175 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=244268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:53.120396 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=244268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:53.144193 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=244269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:53.144346 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=244268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:53.144454 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=244269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:53.144603 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=244268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:53.144696 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=244269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:53.144798 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=244268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:53.144893 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=244269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:53.144992 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=244268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:53.145077 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=244269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:53.145223 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=244268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:53.145342 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=244269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:53.145436 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=244268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:53.145528 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=244269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:53.145779 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=244268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:53.156406 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=244269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:53.156911 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=244268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:53.169420 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=244269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:53.169653 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=244269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:53.169878 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=244269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:53.170099 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=244269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:53.170369 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=244269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:53.170571 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=244269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:53.170788 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=244269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:53.171356 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=244268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:53.171592 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=244268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:53.171820 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=244268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:53.172046 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=244268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:53.172267 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=244268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:53.172487 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=244268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:53.172706 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=244268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 21:43:53.188084 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.188216 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.188326 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 05 21:43:53.188418 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 05 21:43:53.188625 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.188832 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 05 21:43:53.188922 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.189096 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 05 21:43:53.189205 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.189356 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.189447 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.189617 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.189712 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.189875 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.189975 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.190155 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.201351 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.201631 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.201740 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.201902 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.202010 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.202233 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.202325 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.202528 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.210519 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=244269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:43:53.210805 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=244268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:43:53.214607 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=244269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:43:53.214889 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.214988 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=244268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:43:53.215176 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.215275 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.215457 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.215559 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.215743 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.215846 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.216005 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.216099 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.216275 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.216374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.216549 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.216647 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.216816 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.216908 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.217089 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.217187 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.217355 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.217453 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.217630 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.244488 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.245075 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.246099 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=244269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:43:53.246401 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.246755 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=244268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:43:53.247041 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.251664 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=244269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:43:53.251945 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.252344 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.252434 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=244268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:43:53.252661 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.252959 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.260382 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=244269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:43:53.260662 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.261071 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=244268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:43:53.261360 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.265146 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=244269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:43:53.265435 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.265720 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.265894 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=244268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:43:53.265986 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.266210 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.266304 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.266501 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.266594 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.266787 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.266878 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.267058 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.267156 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.267335 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.267614 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.267885 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.286414 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.286697 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.287406 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.287691 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.291434 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=244269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:43:53.292450 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=244268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:43:53.295159 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.295456 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.296119 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.296419 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.300572 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=244269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:43:53.301549 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=244268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:43:53.304247 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=244269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:43:53.305161 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=244268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:43:53.308471 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.308767 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.309055 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.309346 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.309447 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.309632 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.309731 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.309916 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.310020 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.310293 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.310582 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.310868 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.329070 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=244269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:43:53.329353 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.329624 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.329893 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.330242 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=244268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:43:53.330787 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.331068 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.331354 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.338407 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.340120 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.340275 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.340398 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.341998 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.342305 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.343648 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=244269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:43:53.343924 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.344201 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.344478 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.344764 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.345635 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=244268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:43:53.345924 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.346240 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.346529 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.346811 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.358984 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=244269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:43:53.359264 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.359551 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.359834 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.360117 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.361282 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=244268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:43:53.361568 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.361683 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.361853 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.361977 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.362146 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.362508 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.362871 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.363165 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.379860 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=244269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:43:53.381348 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=244268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:43:53.383139 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=244269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:43:53.384723 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=244268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:43:53.386617 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.388095 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.388363 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.389732 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.390008 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=244269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:43:53.390330 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.390671 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.391563 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=244268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:43:53.391849 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.392136 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.397949 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.400069 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.400343 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=244269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:43:53.401688 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=244268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:43:53.403601 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.404141 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.404540 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.404823 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.404964 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.405270 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.405563 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.405845 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.414606 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=244269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:43:53.415522 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.415749 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=244268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:43:53.415853 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.416043 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.416330 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.424132 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=244269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:43:53.424338 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=244268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 21:43:53.424440 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.424621 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.424714 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.424904 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.425006 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.425180 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.425281 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.425454 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.425548 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.425732 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.425835 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.426025 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.426123 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.426323 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.426426 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.426644 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.426926 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.427193 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.427461 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.427738 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=244269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.427854 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.428033 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.428330 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.428610 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.428916 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.429205 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=244268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 21:43:53.466377 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55a846b859c0 pid: 244269 (default app) Jul 05 21:43:53.469133 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55a846b859c0 pid: 244268 (default app) Jul 05 21:43:53.469816 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ace6b1-88ce-474c-87d5-70d9bdcba1a6 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:43:53.470110 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ace6b1-88ce-474c-87d5-70d9bdcba1a6 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:43:53.470417 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ace6b1-88ce-474c-87d5-70d9bdcba1a6 None None] PATH_INFO: `/v3` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:43:53.474632 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 791 bytes} [Tue Jul 5 21:43:53 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:02.001593 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423be14e-d090-4f98-a666-f230e7cf1d70 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:02.002163 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423be14e-d090-4f98-a666-f230e7cf1d70 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:02.002281 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423be14e-d090-4f98-a666-f230e7cf1d70 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:02.006552 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 1/2] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:02.012564 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bfc74-d499-4437-a502-41924c9b5402 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:02.012993 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bfc74-d499-4437-a502-41924c9b5402 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:02.013128 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bfc74-d499-4437-a502-41924c9b5402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:02.082752 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: INFO dbcounter [None req-9c2bfc74-d499-4437-a502-41924c9b5402 None None] Registered counter for database keystone Jul 05 21:44:02.104724 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG oslo_db.sqlalchemy.engines [None req-9c2bfc74-d499-4437-a502-41924c9b5402 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=244269) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 21:44:02.111470 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writer thread running {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 21:44:02.289258 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG passlib.handlers.bcrypt [None req-9c2bfc74-d499-4437-a502-41924c9b5402 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=244269) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 05 21:44:02.289790 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG passlib.handlers.bcrypt [None req-9c2bfc74-d499-4437-a502-41924c9b5402 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=244269) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 05 21:44:02.344851 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-9c2bfc74-d499-4437-a502-41924c9b5402 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:02.346535 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-9c2bfc74-d499-4437-a502-41924c9b5402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:02.470662 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 2/3] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 05 21:44:02.528491 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423be14e-d090-4f98-a666-f230e7cf1d70 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:02.599819 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: INFO dbcounter [None req-423be14e-d090-4f98-a666-f230e7cf1d70 None None] Registered counter for database keystone Jul 05 21:44:02.620164 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG oslo_db.sqlalchemy.engines [None req-423be14e-d090-4f98-a666-f230e7cf1d70 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=244268) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 21:44:02.626690 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writer thread running {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 21:44:02.748225 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423be14e-d090-4f98-a666-f230e7cf1d70 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:02.752560 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4687f0e-0c18-42e5-a12a-7fd553618c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '557b6303201840cf82d0fdc7c227e5e6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:02.753248 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4687f0e-0c18-42e5-a12a-7fd553618c6a admin admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:02.753542 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4687f0e-0c18-42e5-a12a-7fd553618c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:02.753831 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4687f0e-0c18-42e5-a12a-7fd553618c6a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:02.762921 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4687f0e-0c18-42e5-a12a-7fd553618c6a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:02.814685 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b4687f0e-0c18-42e5-a12a-7fd553618c6a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 05 21:44:02.814979 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4687f0e-0c18-42e5-a12a-7fd553618c6a admin admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:02.825423 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 2/4] 10.222.0.30 () {58 vars in 1324 bytes} [Tue Jul 5 21:44:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 21:44:02.831430 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bfc74-d499-4437-a502-41924c9b5402 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:02.846711 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bfc74-d499-4437-a502-41924c9b5402 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:02.851167 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d66cd4-5125-4946-8d4a-c9eb5867e553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '557b6303201840cf82d0fdc7c227e5e6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:02.852698 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d66cd4-5125-4946-8d4a-c9eb5867e553 admin admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:02.853059 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d66cd4-5125-4946-8d4a-c9eb5867e553 admin admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:02.853347 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d66cd4-5125-4946-8d4a-c9eb5867e553 admin admin] PATH_INFO: `/v3/projects/557b6303201840cf82d0fdc7c227e5e6` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:02.857505 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d66cd4-5125-4946-8d4a-c9eb5867e553 admin admin] RBAC: Authorizing `identity:get_project(project_id=557b6303201840cf82d0fdc7c227e5e6)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:02.908198 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: WARNING keystone.common.rbac_enforcer.enforcer [None req-45d66cd4-5125-4946-8d4a-c9eb5867e553 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 05 21:44:02.908557 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d66cd4-5125-4946-8d4a-c9eb5867e553 admin admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:02.913168 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 3/5] 10.222.0.30 () {56 vars in 1207 bytes} [Tue Jul 5 21:44:02 2022] GET /identity/v3/projects/557b6303201840cf82d0fdc7c227e5e6 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:44:04.929912 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc0a45-59aa-4446-b98f-4f733da0032d None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:04.931165 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc0a45-59aa-4446-b98f-4f733da0032d None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:04.931165 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc0a45-59aa-4446-b98f-4f733da0032d None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:04.935242 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 3/6] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:04.940686 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab7b5b-261d-4656-9414-5de445f13f20 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:04.941134 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab7b5b-261d-4656-9414-5de445f13f20 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:04.941242 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab7b5b-261d-4656-9414-5de445f13f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:04.960216 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-5eab7b5b-261d-4656-9414-5de445f13f20 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:04.961871 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-5eab7b5b-261d-4656-9414-5de445f13f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:04.969729 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 4/7] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 05 21:44:04.992241 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc0a45-59aa-4446-b98f-4f733da0032d None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:05.005426 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc0a45-59aa-4446-b98f-4f733da0032d None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:05.009779 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae6187-1ae6-4eaa-b945-e5549ef4c838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '557b6303201840cf82d0fdc7c227e5e6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:05.010459 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae6187-1ae6-4eaa-b945-e5549ef4c838 admin admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:05.010754 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae6187-1ae6-4eaa-b945-e5549ef4c838 admin admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:05.011040 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae6187-1ae6-4eaa-b945-e5549ef4c838 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:05.018855 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bae6187-1ae6-4eaa-b945-e5549ef4c838 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:05.020645 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bae6187-1ae6-4eaa-b945-e5549ef4c838 admin admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:05.029677 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 4/8] 10.222.0.30 () {58 vars in 1324 bytes} [Tue Jul 5 21:44:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 21:44:05.035085 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab7b5b-261d-4656-9414-5de445f13f20 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:05.044789 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab7b5b-261d-4656-9414-5de445f13f20 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:05.049516 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36389544-269e-457e-ba78-340a8202e342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '557b6303201840cf82d0fdc7c227e5e6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:05.050412 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36389544-269e-457e-ba78-340a8202e342 admin admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:05.050707 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36389544-269e-457e-ba78-340a8202e342 admin admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:05.050986 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36389544-269e-457e-ba78-340a8202e342 admin admin] PATH_INFO: `/v3/users/1e928873ee4f41c0a59c6b30ce6b0806` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:05.052401 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36389544-269e-457e-ba78-340a8202e342 admin admin] RBAC: Authorizing `identity:get_user(user_id=1e928873ee4f41c0a59c6b30ce6b0806)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:05.054275 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36389544-269e-457e-ba78-340a8202e342 admin admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:05.056866 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 5/9] 10.222.0.30 () {56 vars in 1198 bytes} [Tue Jul 5 21:44:05 2022] GET /identity/v3/users/1e928873ee4f41c0a59c6b30ce6b0806 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:07.157298 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fd623-2097-47e6-8974-6f75e51cad62 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:07.157875 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fd623-2097-47e6-8974-6f75e51cad62 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:07.157875 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fd623-2097-47e6-8974-6f75e51cad62 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:07.159271 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 5/10] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:07.164419 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e8047-856c-4009-b11c-9091f77b0ada None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:07.165445 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e8047-856c-4009-b11c-9091f77b0ada None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:07.165570 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e8047-856c-4009-b11c-9091f77b0ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:07.182625 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-405e8047-856c-4009-b11c-9091f77b0ada None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:07.183818 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-405e8047-856c-4009-b11c-9091f77b0ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:07.198661 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929885e7-d814-4ab7-bd74-fdb10f51598b None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:07.198958 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929885e7-d814-4ab7-bd74-fdb10f51598b None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:07.199253 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929885e7-d814-4ab7-bd74-fdb10f51598b None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:07.200614 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 6/11] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:44:07.205757 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce4f38-7e60-4fec-aef0-48ed740c62cb None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:07.206048 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce4f38-7e60-4fec-aef0-48ed740c62cb None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:07.206357 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce4f38-7e60-4fec-aef0-48ed740c62cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:07.247518 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG passlib.handlers.bcrypt [None req-dcce4f38-7e60-4fec-aef0-48ed740c62cb None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=244268) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 05 21:44:07.247958 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG passlib.handlers.bcrypt [None req-dcce4f38-7e60-4fec-aef0-48ed740c62cb None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=244268) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 05 21:44:07.265928 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 6/12] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:44:07.288851 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e8047-856c-4009-b11c-9091f77b0ada None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:07.294074 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-dcce4f38-7e60-4fec-aef0-48ed740c62cb None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:07.295818 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-dcce4f38-7e60-4fec-aef0-48ed740c62cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:07.312717 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:07.397015 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e8047-856c-4009-b11c-9091f77b0ada None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:07.403930 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 7/13] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:44:07.426403 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce4f38-7e60-4fec-aef0-48ed740c62cb None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:07.432919 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb4833-cf7d-48c0-a936-3d41fdca6e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:07.433753 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb4833-cf7d-48c0-a936-3d41fdca6e73 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:07.434048 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb4833-cf7d-48c0-a936-3d41fdca6e73 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:07.434486 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb4833-cf7d-48c0-a936-3d41fdca6e73 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:07.447866 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb4833-cf7d-48c0-a936-3d41fdca6e73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:44:07.459490 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-07eb4833-cf7d-48c0-a936-3d41fdca6e73 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:44:07.459490 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:44:07.459490 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:44:07.459490 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:44:07.459490 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:44:07.459490 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:44:07.459490 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:44:07.459490 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:44:07.459490 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:44:07.459490 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:44:07.459490 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:44:07.459490 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:44:07.459490 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:44:07.459490 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:44:07.459490 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:44:07.459490 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:44:07.460701 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:44:07.460701 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:44:07.460701 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:44:07.460701 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:44:07.460701 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:44:07.460701 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:44:07.460701 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:44:07.460701 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:44:07.460701 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:44:07.460701 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:44:07.460701 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:44:07.460701 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:44:07.460701 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:44:07.460701 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:44:07.460701 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:44:07.460701 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:44:07.462985 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:44:07.462985 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:44:07.462985 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:44:07.462985 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:44:07.462985 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:44:07.462985 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:44:07.462985 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:44:07.462985 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:44:07.462985 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:44:07.462985 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:44:07.462985 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:44:07.462985 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:44:07.462985 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 7/14] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:44:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:44:07.467920 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb4833-cf7d-48c0-a936-3d41fdca6e73 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:07.534479 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce4f38-7e60-4fec-aef0-48ed740c62cb None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:07.536765 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:07.555118 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:07.574431 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac255ad2-a76b-470c-b5c7-e7ec12e07dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:07.575186 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb4833-cf7d-48c0-a936-3d41fdca6e73 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:07.575354 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac255ad2-a76b-470c-b5c7-e7ec12e07dd9 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:07.575646 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac255ad2-a76b-470c-b5c7-e7ec12e07dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:07.575928 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac255ad2-a76b-470c-b5c7-e7ec12e07dd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:07.609325 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb812357-54d6-44ac-bcf4-a3a4e7c57a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:07.609998 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb812357-54d6-44ac-bcf4-a3a4e7c57a8d None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:07.610317 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb812357-54d6-44ac-bcf4-a3a4e7c57a8d None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:07.610600 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb812357-54d6-44ac-bcf4-a3a4e7c57a8d None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:07.611363 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb812357-54d6-44ac-bcf4-a3a4e7c57a8d None admin] RBAC: Adding query filter params (name=admin) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:07.611672 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb812357-54d6-44ac-bcf4-a3a4e7c57a8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:07.613232 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb812357-54d6-44ac-bcf4-a3a4e7c57a8d None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:07.625776 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 8/15] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:44:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:44:07.631585 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb812357-54d6-44ac-bcf4-a3a4e7c57a8d None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:07.645323 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac255ad2-a76b-470c-b5c7-e7ec12e07dd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:07.646896 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac255ad2-a76b-470c-b5c7-e7ec12e07dd9 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:07.736652 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb812357-54d6-44ac-bcf4-a3a4e7c57a8d None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:07.748067 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 8/16] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:44:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 21:44:07.753582 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac255ad2-a76b-470c-b5c7-e7ec12e07dd9 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:07.756258 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:07.771587 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc940a6a-2b5f-4e6f-8e1f-cd87048889f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:07.772517 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc940a6a-2b5f-4e6f-8e1f-cd87048889f7 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:07.772855 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc940a6a-2b5f-4e6f-8e1f-cd87048889f7 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:07.773137 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc940a6a-2b5f-4e6f-8e1f-cd87048889f7 None admin] PATH_INFO: `/v3/users/1e928873ee4f41c0a59c6b30ce6b0806` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:07.774414 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc940a6a-2b5f-4e6f-8e1f-cd87048889f7 None admin] RBAC: Authorizing `identity:get_user(user_id=1e928873ee4f41c0a59c6b30ce6b0806)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:07.775876 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc940a6a-2b5f-4e6f-8e1f-cd87048889f7 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:07.777737 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 9/17] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:44:07 2022] GET /identity/v3/users/1e928873ee4f41c0a59c6b30ce6b0806 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:44:07.782950 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc940a6a-2b5f-4e6f-8e1f-cd87048889f7 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:07.797291 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:07.855613 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac255ad2-a76b-470c-b5c7-e7ec12e07dd9 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:07.885246 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc940a6a-2b5f-4e6f-8e1f-cd87048889f7 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:07.889648 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295b333-f8ed-456d-a88c-713be50abb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:07.890475 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295b333-f8ed-456d-a88c-713be50abb97 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:07.890766 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295b333-f8ed-456d-a88c-713be50abb97 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:07.891045 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295b333-f8ed-456d-a88c-713be50abb97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:07.909937 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1295b333-f8ed-456d-a88c-713be50abb97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:07.911570 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1295b333-f8ed-456d-a88c-713be50abb97 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:07.923130 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a8b0e6-3eb8-435d-9f7e-6889089c5567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:07.923933 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8b0e6-3eb8-435d-9f7e-6889089c5567 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:07.924221 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8b0e6-3eb8-435d-9f7e-6889089c5567 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:07.924505 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8b0e6-3eb8-435d-9f7e-6889089c5567 None admin] PATH_INFO: `/v3/domains/default` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:07.925701 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a8b0e6-3eb8-435d-9f7e-6889089c5567 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:07.927164 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a8b0e6-3eb8-435d-9f7e-6889089c5567 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:07.928771 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 10/18] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:44:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:44:07.933365 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-1295b333-f8ed-456d-a88c-713be50abb97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:44:07.933365 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:44:07.933365 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:44:07.933365 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:44:07.933365 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:44:07.933365 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:44:07.933365 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:44:07.933365 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:44:07.933365 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:44:07.933365 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:44:07.933365 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:44:07.933365 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:44:07.933365 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:44:07.933365 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:44:07.933365 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:44:07.934626 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:44:07.934626 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:44:07.934626 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:44:07.934626 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:44:07.934626 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:44:07.934626 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:44:07.934626 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:44:07.934626 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:44:07.934626 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:44:07.934626 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:44:07.934626 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:44:07.934626 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:44:07.934626 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:44:07.934626 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:44:07.934626 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:44:07.934626 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:44:07.934626 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:44:07.935894 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:44:07.935894 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:44:07.935894 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:44:07.935894 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:44:07.935894 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 9/19] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:44:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:44:07.936208 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a8b0e6-3eb8-435d-9f7e-6889089c5567 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:07.940445 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295b333-f8ed-456d-a88c-713be50abb97 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:08.000163 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:08.019326 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:08.039177 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a8b0e6-3eb8-435d-9f7e-6889089c5567 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:08.048954 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295b333-f8ed-456d-a88c-713be50abb97 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:08.073166 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2cc78-7926-48c0-b721-3f18b636a888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:08.073828 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2cc78-7926-48c0-b721-3f18b636a888 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:08.074115 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2cc78-7926-48c0-b721-3f18b636a888 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:08.074429 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2cc78-7926-48c0-b721-3f18b636a888 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:08.075275 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba2cc78-7926-48c0-b721-3f18b636a888 None admin] RBAC: Adding query filter params (role.id=e1c574c9973548ebb0e8d9e0656ccabd, scope.domain.id=default, user.id=1e928873ee4f41c0a59c6b30ce6b0806) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:08.075587 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba2cc78-7926-48c0-b721-3f18b636a888 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:08.077043 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba2cc78-7926-48c0-b721-3f18b636a888 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:08.083768 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 11/20] 10.222.0.30 () {56 vars in 1322 bytes} [Tue Jul 5 21:44:07 2022] GET /identity/v3/role_assignments?user.id=1e928873ee4f41c0a59c6b30ce6b0806&scope.domain.id=default&role.id=e1c574c9973548ebb0e8d9e0656ccabd => generated 233 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:44:08.084183 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c1830-8760-4d83-b303-aceb915a6670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:08.084860 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c1830-8760-4d83-b303-aceb915a6670 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:08.085156 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c1830-8760-4d83-b303-aceb915a6670 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:08.085443 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c1830-8760-4d83-b303-aceb915a6670 None admin] PATH_INFO: `/v3/domains` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:08.086257 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6c1830-8760-4d83-b303-aceb915a6670 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:08.087274 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6c1830-8760-4d83-b303-aceb915a6670 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:08.088724 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6c1830-8760-4d83-b303-aceb915a6670 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:08.109462 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 10/21] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:44:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:44:10.272139 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29a6c9-e853-4c16-b556-ec1131b8dd34 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:10.272706 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29a6c9-e853-4c16-b556-ec1131b8dd34 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:10.272706 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29a6c9-e853-4c16-b556-ec1131b8dd34 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:10.274764 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 12/22] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:10.288172 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac7987-bfa8-4620-baa1-dcfc9d62dc4c None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:10.288639 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac7987-bfa8-4620-baa1-dcfc9d62dc4c None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:10.288799 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac7987-bfa8-4620-baa1-dcfc9d62dc4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:10.315179 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-dfac7987-bfa8-4620-baa1-dcfc9d62dc4c None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:10.319762 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-dfac7987-bfa8-4620-baa1-dcfc9d62dc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:10.407241 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 11/23] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:44:10.445483 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29a6c9-e853-4c16-b556-ec1131b8dd34 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:10.606043 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29a6c9-e853-4c16-b556-ec1131b8dd34 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:10.650901 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4baf3-eb57-4b90-8646-30cfcc1cc6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:10.651735 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4baf3-eb57-4b90-8646-30cfcc1cc6cf None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:10.652031 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4baf3-eb57-4b90-8646-30cfcc1cc6cf None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:10.652317 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4baf3-eb57-4b90-8646-30cfcc1cc6cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:10.664812 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c4baf3-eb57-4b90-8646-30cfcc1cc6cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:44:10.672726 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-73c4baf3-eb57-4b90-8646-30cfcc1cc6cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:44:10.672726 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:44:10.672726 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:44:10.672726 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:44:10.672726 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:44:10.672726 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:44:10.672726 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:44:10.672726 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:44:10.672726 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:44:10.672726 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:44:10.672726 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:44:10.672726 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:44:10.672726 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:44:10.672726 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:44:10.672726 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:44:10.672726 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:44:10.673703 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:44:10.673703 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:44:10.673703 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:44:10.673703 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:44:10.673703 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:44:10.673703 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:44:10.673703 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:44:10.673703 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:44:10.673703 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:44:10.673703 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:44:10.673703 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:44:10.673703 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:44:10.673703 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:44:10.673703 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:44:10.673703 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:44:10.673703 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:44:10.674642 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:44:10.674642 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:44:10.674642 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:44:10.674642 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:44:10.674642 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:44:10.674642 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:44:10.674642 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:44:10.674642 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:44:10.674642 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:44:10.674642 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:44:10.674642 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:44:10.674642 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:44:10.674642 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 13/24] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:44:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:44:10.680769 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac7987-bfa8-4620-baa1-dcfc9d62dc4c None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:10.763062 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:10.764349 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535b04d-6c44-4839-b64a-6edadf0b33cb None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:10.764653 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535b04d-6c44-4839-b64a-6edadf0b33cb None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:10.764943 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535b04d-6c44-4839-b64a-6edadf0b33cb None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:10.768090 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 14/25] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:10.772232 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb5b05-aab9-441f-88be-5fda08a3a428 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:10.777042 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb5b05-aab9-441f-88be-5fda08a3a428 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:10.777042 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb5b05-aab9-441f-88be-5fda08a3a428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:10.784675 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:10.803272 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-eadb5b05-aab9-441f-88be-5fda08a3a428 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:10.804431 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-eadb5b05-aab9-441f-88be-5fda08a3a428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:10.861004 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac7987-bfa8-4620-baa1-dcfc9d62dc4c None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:10.948623 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 15/26] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:44:10.949488 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ec4b7-051c-4f62-8af1-096b9e9ba807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:10.949972 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56d897-b0f6-4874-813c-1313e5696f92 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:10.950215 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ec4b7-051c-4f62-8af1-096b9e9ba807 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:10.950327 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56d897-b0f6-4874-813c-1313e5696f92 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:10.950506 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ec4b7-051c-4f62-8af1-096b9e9ba807 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:10.950615 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56d897-b0f6-4874-813c-1313e5696f92 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:10.950803 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ec4b7-051c-4f62-8af1-096b9e9ba807 None admin] PATH_INFO: `/v3/roles` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:10.951662 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ec4b7-051c-4f62-8af1-096b9e9ba807 None admin] RBAC: Adding query filter params (name=admin) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:10.951983 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ec4b7-051c-4f62-8af1-096b9e9ba807 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:10.952090 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 16/27] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:10.953582 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ec4b7-051c-4f62-8af1-096b9e9ba807 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:10.958081 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a29848-1b5d-4309-82f5-ae0a4123673c None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:10.958408 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a29848-1b5d-4309-82f5-ae0a4123673c None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:10.958692 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a29848-1b5d-4309-82f5-ae0a4123673c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:10.980116 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 12/28] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:44:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:10.986532 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ec4b7-051c-4f62-8af1-096b9e9ba807 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:10.994357 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-c9a29848-1b5d-4309-82f5-ae0a4123673c None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:10.995599 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-c9a29848-1b5d-4309-82f5-ae0a4123673c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:11.109892 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 17/29] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:44:11.111107 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a29848-1b5d-4309-82f5-ae0a4123673c None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:11.134154 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ec4b7-051c-4f62-8af1-096b9e9ba807 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:11.143742 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:11.174234 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6e35b-48b1-4da8-a493-f0ea648f84ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:11.175285 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6e35b-48b1-4da8-a493-f0ea648f84ef None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:11.175682 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6e35b-48b1-4da8-a493-f0ea648f84ef None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:11.176070 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6e35b-48b1-4da8-a493-f0ea648f84ef None admin] PATH_INFO: `/v3/users/1e928873ee4f41c0a59c6b30ce6b0806` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:11.177836 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d6e35b-48b1-4da8-a493-f0ea648f84ef None admin] RBAC: Authorizing `identity:get_user(user_id=1e928873ee4f41c0a59c6b30ce6b0806)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:11.180002 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d6e35b-48b1-4da8-a493-f0ea648f84ef None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:11.182076 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 13/30] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:44:10 2022] GET /identity/v3/users/1e928873ee4f41c0a59c6b30ce6b0806 => generated 247 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:44:11.183719 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647377c-0236-4f85-941a-b1321f27ee37 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:11.184414 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647377c-0236-4f85-941a-b1321f27ee37 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:11.185058 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647377c-0236-4f85-941a-b1321f27ee37 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:11.191206 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 14/31] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:11.191206 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647377c-0236-4f85-941a-b1321f27ee37 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:11.219639 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:11.271347 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a29848-1b5d-4309-82f5-ae0a4123673c None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:11.310697 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ec949-9872-45d9-a61e-f5c4ad5a97e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:11.311509 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ec949-9872-45d9-a61e-f5c4ad5a97e7 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:11.311841 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ec949-9872-45d9-a61e-f5c4ad5a97e7 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:11.312130 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ec949-9872-45d9-a61e-f5c4ad5a97e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:11.326506 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ec949-9872-45d9-a61e-f5c4ad5a97e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:11.328572 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ec949-9872-45d9-a61e-f5c4ad5a97e7 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:11.331089 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647377c-0236-4f85-941a-b1321f27ee37 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:11.353712 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-f75ec949-9872-45d9-a61e-f5c4ad5a97e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:44:11.353712 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:44:11.353712 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:44:11.353712 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:44:11.353712 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:44:11.353712 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:44:11.353712 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:44:11.353712 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:44:11.353712 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:44:11.353712 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:44:11.353712 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:44:11.353712 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:44:11.353712 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:44:11.353712 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:44:11.353712 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:44:11.354713 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:44:11.354713 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:44:11.354713 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:44:11.354713 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:44:11.354713 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:44:11.354713 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:44:11.354713 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:44:11.354713 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:44:11.354713 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:44:11.354713 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:44:11.354713 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:44:11.354713 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:44:11.354713 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:44:11.354713 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:44:11.354713 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:44:11.354713 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:44:11.354713 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:44:11.355635 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:44:11.355635 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:44:11.355635 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:44:11.355635 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:44:11.355635 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 18/32] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:44:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:44:11.355930 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ec949-9872-45d9-a61e-f5c4ad5a97e7 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:11.378699 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1041c-4ae2-4051-a856-5a96b85aa7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:11.379308 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1041c-4ae2-4051-a856-5a96b85aa7ac None admin] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:11.380015 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1041c-4ae2-4051-a856-5a96b85aa7ac None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:11.380322 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1041c-4ae2-4051-a856-5a96b85aa7ac None admin] PATH_INFO: `/v3/roles` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:11.381159 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde1041c-4ae2-4051-a856-5a96b85aa7ac None admin] RBAC: Authorizing `identity:create_role()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:11.382655 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde1041c-4ae2-4051-a856-5a96b85aa7ac None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:11.470078 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ec949-9872-45d9-a61e-f5c4ad5a97e7 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:11.487283 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:11.508009 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478bc8e7-c442-41af-955b-448a125e75d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:11.509579 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bc8e7-c442-41af-955b-448a125e75d1 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:11.509929 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bc8e7-c442-41af-955b-448a125e75d1 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:11.510235 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bc8e7-c442-41af-955b-448a125e75d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:11.511487 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478bc8e7-c442-41af-955b-448a125e75d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:11.513049 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478bc8e7-c442-41af-955b-448a125e75d1 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:11.515071 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 19/33] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:44:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:11.516426 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf72a9-52e2-48d6-b4c5-3a0eb887e082 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:11.516716 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf72a9-52e2-48d6-b4c5-3a0eb887e082 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:11.517224 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf72a9-52e2-48d6-b4c5-3a0eb887e082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:11.534496 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-8aaf72a9-52e2-48d6-b4c5-3a0eb887e082 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:11.535710 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-8aaf72a9-52e2-48d6-b4c5-3a0eb887e082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:11.620668 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 20/34] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:44:11.621922 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf72a9-52e2-48d6-b4c5-3a0eb887e082 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:11.651932 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 15/35] 10.222.0.30 () {60 vars in 1131 bytes} [Tue Jul 5 21:44:11 2022] POST /identity/v3/roles => generated 219 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:44:11.658153 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1041c-4ae2-4051-a856-5a96b85aa7ac None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:11.762518 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:11.765936 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf72a9-52e2-48d6-b4c5-3a0eb887e082 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:11.785459 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:11.818513 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c747ad-a789-482c-8d1e-fa557e94bf70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:11.819228 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c747ad-a789-482c-8d1e-fa557e94bf70 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:11.819557 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c747ad-a789-482c-8d1e-fa557e94bf70 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:11.819898 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c747ad-a789-482c-8d1e-fa557e94bf70 None admin] PATH_INFO: `/v3/domains` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:11.820711 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c747ad-a789-482c-8d1e-fa557e94bf70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:11.821023 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c747ad-a789-482c-8d1e-fa557e94bf70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:11.822484 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c747ad-a789-482c-8d1e-fa557e94bf70 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:11.850957 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 21/36] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:44:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:11.851602 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c747ad-a789-482c-8d1e-fa557e94bf70 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:11.888874 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1041c-4ae2-4051-a856-5a96b85aa7ac None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:11.935101 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d502c-03d3-4be4-a294-7b3416c929e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:11.936325 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d502c-03d3-4be4-a294-7b3416c929e8 None admin] REQUEST_METHOD: `PUT` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:11.936695 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d502c-03d3-4be4-a294-7b3416c929e8 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:11.937220 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d502c-03d3-4be4-a294-7b3416c929e8 None admin] PATH_INFO: `/v3/domains/default/users/1e928873ee4f41c0a59c6b30ce6b0806/roles/e1c574c9973548ebb0e8d9e0656ccabd` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:11.940372 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d502c-03d3-4be4-a294-7b3416c929e8 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=1e928873ee4f41c0a59c6b30ce6b0806, role_id=e1c574c9973548ebb0e8d9e0656ccabd)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:11.943065 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d502c-03d3-4be4-a294-7b3416c929e8 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:11.990799 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c747ad-a789-482c-8d1e-fa557e94bf70 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:12.028895 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b951c2f-c925-47c7-bf89-ed9a222d938a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:12.029593 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b951c2f-c925-47c7-bf89-ed9a222d938a None admin] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:12.029890 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b951c2f-c925-47c7-bf89-ed9a222d938a None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:12.030204 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b951c2f-c925-47c7-bf89-ed9a222d938a None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:12.030974 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b951c2f-c925-47c7-bf89-ed9a222d938a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:12.032437 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b951c2f-c925-47c7-bf89-ed9a222d938a None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:12.049830 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 16/37] 10.222.0.30 () {58 vars in 1361 bytes} [Tue Jul 5 21:44:11 2022] PUT /identity/v3/domains/default/users/1e928873ee4f41c0a59c6b30ce6b0806/roles/e1c574c9973548ebb0e8d9e0656ccabd => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:44:12.051910 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d502c-03d3-4be4-a294-7b3416c929e8 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:12.163243 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:12.170536 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d502c-03d3-4be4-a294-7b3416c929e8 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:12.214918 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f8707-47ad-4e53-a796-5bc628dde783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:12.215663 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f8707-47ad-4e53-a796-5bc628dde783 None admin] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:12.215962 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f8707-47ad-4e53-a796-5bc628dde783 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:12.216248 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f8707-47ad-4e53-a796-5bc628dde783 None admin] PATH_INFO: `/v3/projects` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:12.217009 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4f8707-47ad-4e53-a796-5bc628dde783 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:12.218613 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4f8707-47ad-4e53-a796-5bc628dde783 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:12.326019 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 22/38] 10.222.0.30 () {60 vars in 1131 bytes} [Tue Jul 5 21:44:11 2022] POST /identity/v3/roles => generated 225 bytes in 471 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:44:12.326019 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0273597-f527-4331-8996-a46ee1410a0c None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:12.326019 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0273597-f527-4331-8996-a46ee1410a0c None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:12.326019 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0273597-f527-4331-8996-a46ee1410a0c None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:12.326019 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 23/39] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:12.326847 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72f425-6493-4446-b794-33a5338920b2 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:12.327107 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72f425-6493-4446-b794-33a5338920b2 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:12.327324 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72f425-6493-4446-b794-33a5338920b2 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:12.328662 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 24/40] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:12.335500 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d325b-8535-451a-a652-0fd25377f181 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:12.335807 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d325b-8535-451a-a652-0fd25377f181 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:12.336089 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d325b-8535-451a-a652-0fd25377f181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:12.337973 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 17/41] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Jul 5 21:44:12 2022] POST /identity/v3/projects => generated 301 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:44:12.339163 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7415066b-15c4-4e00-a878-11538be775d8 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:12.339729 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7415066b-15c4-4e00-a878-11538be775d8 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:12.340206 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7415066b-15c4-4e00-a878-11538be775d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:12.361896 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-7415066b-15c4-4e00-a878-11538be775d8 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:12.364170 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-7415066b-15c4-4e00-a878-11538be775d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:12.380017 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-db5d325b-8535-451a-a652-0fd25377f181 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:12.381734 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-db5d325b-8535-451a-a652-0fd25377f181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:12.443976 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:12.456705 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 18/42] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:44:12.501674 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 25/43] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:44:12.502732 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7415066b-15c4-4e00-a878-11538be775d8 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:12.525235 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5d325b-8535-451a-a652-0fd25377f181 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:12.599969 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:12.630319 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7415066b-15c4-4e00-a878-11538be775d8 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:12.653614 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5d325b-8535-451a-a652-0fd25377f181 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:12.675845 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491806d7-a459-4d90-87bf-bf93c872d651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:12.676802 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491806d7-a459-4d90-87bf-bf93c872d651 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:12.677099 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491806d7-a459-4d90-87bf-bf93c872d651 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:12.677391 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491806d7-a459-4d90-87bf-bf93c872d651 None admin] PATH_INFO: `/v3/domains/default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:12.678641 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491806d7-a459-4d90-87bf-bf93c872d651 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:12.680194 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491806d7-a459-4d90-87bf-bf93c872d651 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:12.682023 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 19/44] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:44:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:12.687783 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491806d7-a459-4d90-87bf-bf93c872d651 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:12.692182 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb99459-73ef-443a-8ef7-76556fe83e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:12.692904 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb99459-73ef-443a-8ef7-76556fe83e23 None admin] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:12.693205 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb99459-73ef-443a-8ef7-76556fe83e23 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:12.693495 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb99459-73ef-443a-8ef7-76556fe83e23 None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:12.694322 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb99459-73ef-443a-8ef7-76556fe83e23 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:12.696419 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb99459-73ef-443a-8ef7-76556fe83e23 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:12.777409 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 26/45] 10.222.0.30 () {60 vars in 1131 bytes} [Tue Jul 5 21:44:12 2022] POST /identity/v3/roles => generated 223 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:44:12.791172 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491806d7-a459-4d90-87bf-bf93c872d651 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:12.833069 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d093f8-17fc-4518-8863-8fc6dd6637ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:12.833963 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d093f8-17fc-4518-8863-8fc6dd6637ca None admin] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:12.834407 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d093f8-17fc-4518-8863-8fc6dd6637ca None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:12.834806 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d093f8-17fc-4518-8863-8fc6dd6637ca None admin] PATH_INFO: `/v3/projects` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:12.835664 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d093f8-17fc-4518-8863-8fc6dd6637ca None admin] RBAC: Authorizing `identity:create_project()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:12.837336 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d093f8-17fc-4518-8863-8fc6dd6637ca None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:12.919775 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:12.926891 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 20/46] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Jul 5 21:44:12 2022] POST /identity/v3/projects => generated 312 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:44:14.211241 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55eb29-0243-4f57-889e-4e4a099e4856 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:14.212026 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55eb29-0243-4f57-889e-4e4a099e4856 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:14.212026 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55eb29-0243-4f57-889e-4e4a099e4856 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:14.213252 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 27/47] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:14.218977 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40095c7-c1ca-455e-9b57-3ce3da20495c None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:14.227832 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40095c7-c1ca-455e-9b57-3ce3da20495c None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:14.227832 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40095c7-c1ca-455e-9b57-3ce3da20495c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:14.236662 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-e40095c7-c1ca-455e-9b57-3ce3da20495c None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:14.238168 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-e40095c7-c1ca-455e-9b57-3ce3da20495c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:14.303848 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 21/48] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:44:14.327422 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55eb29-0243-4f57-889e-4e4a099e4856 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:14.354153 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:14.431690 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55eb29-0243-4f57-889e-4e4a099e4856 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:14.465381 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d51133-1192-494b-8b2f-e0e793a9227a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:14.466113 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d51133-1192-494b-8b2f-e0e793a9227a None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:14.466430 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d51133-1192-494b-8b2f-e0e793a9227a None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:14.466714 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d51133-1192-494b-8b2f-e0e793a9227a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:14.476727 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d51133-1192-494b-8b2f-e0e793a9227a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:44:14.485367 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-41d51133-1192-494b-8b2f-e0e793a9227a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:44:14.485367 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:44:14.485367 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:44:14.485367 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:44:14.485367 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:44:14.485367 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:44:14.485367 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:44:14.485367 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:44:14.485367 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:44:14.485367 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:44:14.485367 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:44:14.485367 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:44:14.485367 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:44:14.485367 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:44:14.485367 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:44:14.485367 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:44:14.486539 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:44:14.486539 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:44:14.486539 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:44:14.486539 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:44:14.486539 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:44:14.486539 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:44:14.486539 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:44:14.486539 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:44:14.486539 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:44:14.486539 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:44:14.486539 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:44:14.486539 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:44:14.486539 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:44:14.486539 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:44:14.486539 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:44:14.486539 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:44:14.487463 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:44:14.487463 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:44:14.487463 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:44:14.487463 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:44:14.487463 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:44:14.487463 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:44:14.487463 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:44:14.487463 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:44:14.487463 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:44:14.487463 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:44:14.487463 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:44:14.487463 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:44:14.487463 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 28/49] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:44:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:44:14.492825 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40095c7-c1ca-455e-9b57-3ce3da20495c None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:14.593240 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40095c7-c1ca-455e-9b57-3ce3da20495c None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:14.621088 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:14.628961 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28ee2d-4c52-4639-82b1-f703c2d10892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:14.634113 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28ee2d-4c52-4639-82b1-f703c2d10892 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:14.634113 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28ee2d-4c52-4639-82b1-f703c2d10892 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:14.634113 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28ee2d-4c52-4639-82b1-f703c2d10892 None admin] PATH_INFO: `/v3/roles` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:14.634113 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba28ee2d-4c52-4639-82b1-f703c2d10892 None admin] RBAC: Adding query filter params (name=admin) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:14.634113 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba28ee2d-4c52-4639-82b1-f703c2d10892 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:14.634113 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba28ee2d-4c52-4639-82b1-f703c2d10892 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:14.642549 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 22/50] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:44:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:14.648329 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d51133-1192-494b-8b2f-e0e793a9227a None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:14.733285 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:14.749523 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d51133-1192-494b-8b2f-e0e793a9227a None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:14.783518 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be738ddb-fc8c-491b-a20a-ac64586f20e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:14.784403 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be738ddb-fc8c-491b-a20a-ac64586f20e0 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:14.784696 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be738ddb-fc8c-491b-a20a-ac64586f20e0 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:14.784981 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be738ddb-fc8c-491b-a20a-ac64586f20e0 None admin] PATH_INFO: `/v3/users/1e928873ee4f41c0a59c6b30ce6b0806` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:14.786221 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be738ddb-fc8c-491b-a20a-ac64586f20e0 None admin] RBAC: Authorizing `identity:get_user(user_id=1e928873ee4f41c0a59c6b30ce6b0806)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:14.787701 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be738ddb-fc8c-491b-a20a-ac64586f20e0 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:14.789868 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 29/51] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:44:14 2022] GET /identity/v3/users/1e928873ee4f41c0a59c6b30ce6b0806 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:14.795494 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28ee2d-4c52-4639-82b1-f703c2d10892 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:14.895929 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28ee2d-4c52-4639-82b1-f703c2d10892 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:14.929143 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9764ebfb-9e7f-4234-820b-94d4a5588f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:14.929963 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764ebfb-9e7f-4234-820b-94d4a5588f06 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:14.930826 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764ebfb-9e7f-4234-820b-94d4a5588f06 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:14.931112 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764ebfb-9e7f-4234-820b-94d4a5588f06 None admin] PATH_INFO: `/v3/domains/default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:14.932304 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9764ebfb-9e7f-4234-820b-94d4a5588f06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:14.933772 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9764ebfb-9e7f-4234-820b-94d4a5588f06 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:14.935445 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 23/52] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:44:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:14.941351 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be738ddb-fc8c-491b-a20a-ac64586f20e0 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:14.976240 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f17f7-b2b9-4138-872c-02ba155162ea None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:14.976543 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f17f7-b2b9-4138-872c-02ba155162ea None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:14.977362 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f17f7-b2b9-4138-872c-02ba155162ea None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:14.978836 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 24/53] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:44:14.983677 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab280086-d678-474b-80ea-ea8b4d1b69d5 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:14.983981 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab280086-d678-474b-80ea-ea8b4d1b69d5 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:14.984276 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab280086-d678-474b-80ea-ea8b4d1b69d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:15.001243 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-ab280086-d678-474b-80ea-ea8b4d1b69d5 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:15.002518 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-ab280086-d678-474b-80ea-ea8b4d1b69d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:15.046318 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be738ddb-fc8c-491b-a20a-ac64586f20e0 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:15.056914 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:15.070460 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 25/54] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:44:15.080889 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a8f56-2b9e-41e7-b8e4-86cf5fd1d969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:15.081558 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a8f56-2b9e-41e7-b8e4-86cf5fd1d969 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:15.081853 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a8f56-2b9e-41e7-b8e4-86cf5fd1d969 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:15.082154 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a8f56-2b9e-41e7-b8e4-86cf5fd1d969 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:15.083019 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a8f56-2b9e-41e7-b8e4-86cf5fd1d969 None admin] RBAC: Adding query filter params (role.id=e1c574c9973548ebb0e8d9e0656ccabd, scope.domain.id=default, user.id=1e928873ee4f41c0a59c6b30ce6b0806) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:15.083341 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a8f56-2b9e-41e7-b8e4-86cf5fd1d969 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:15.084816 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a8f56-2b9e-41e7-b8e4-86cf5fd1d969 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:15.090843 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 30/55] 10.222.0.30 () {56 vars in 1322 bytes} [Tue Jul 5 21:44:14 2022] GET /identity/v3/role_assignments?user.id=1e928873ee4f41c0a59c6b30ce6b0806&scope.domain.id=default&role.id=e1c574c9973548ebb0e8d9e0656ccabd => generated 530 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:15.095092 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab280086-d678-474b-80ea-ea8b4d1b69d5 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:15.313633 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab280086-d678-474b-80ea-ea8b4d1b69d5 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:15.347605 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7642e856-a8a9-429d-b7cb-d823b7d34e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:15.348413 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642e856-a8a9-429d-b7cb-d823b7d34e33 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:15.348701 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642e856-a8a9-429d-b7cb-d823b7d34e33 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:15.348981 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642e856-a8a9-429d-b7cb-d823b7d34e33 None admin] PATH_INFO: `/v3/domains/default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:15.350175 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7642e856-a8a9-429d-b7cb-d823b7d34e33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:15.351618 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7642e856-a8a9-429d-b7cb-d823b7d34e33 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:15.353601 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 26/56] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:44:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:15.359351 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a8f56-2b9e-41e7-b8e4-86cf5fd1d969 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:15.377872 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:15.458546 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a8f56-2b9e-41e7-b8e4-86cf5fd1d969 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:15.491993 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113cc85f-b2d3-40ff-9146-79a46cbf6cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:15.493450 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113cc85f-b2d3-40ff-9146-79a46cbf6cf2 None admin] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:15.493745 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113cc85f-b2d3-40ff-9146-79a46cbf6cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:15.494030 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113cc85f-b2d3-40ff-9146-79a46cbf6cf2 None admin] PATH_INFO: `/v3/projects` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:15.494787 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113cc85f-b2d3-40ff-9146-79a46cbf6cf2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:15.496238 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113cc85f-b2d3-40ff-9146-79a46cbf6cf2 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:15.576075 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 31/57] 10.222.0.30 () {60 vars in 1140 bytes} [Tue Jul 5 21:44:15 2022] POST /identity/v3/projects => generated 298 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:44:17.635898 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8976eef-73db-43a5-8508-ce84d44f38b4 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:17.636471 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8976eef-73db-43a5-8508-ce84d44f38b4 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:17.636471 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8976eef-73db-43a5-8508-ce84d44f38b4 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:17.637864 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 27/58] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:17.643041 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56505a32-fb2a-44a7-9a03-aaea4665fd0e None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:17.643485 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56505a32-fb2a-44a7-9a03-aaea4665fd0e None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:17.643617 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56505a32-fb2a-44a7-9a03-aaea4665fd0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:17.660933 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-56505a32-fb2a-44a7-9a03-aaea4665fd0e None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:17.662170 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-56505a32-fb2a-44a7-9a03-aaea4665fd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:17.723359 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:17.729048 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 32/59] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:44:17.753430 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8976eef-73db-43a5-8508-ce84d44f38b4 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:17.811275 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:17.855540 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8976eef-73db-43a5-8508-ce84d44f38b4 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:17.888487 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1226ac6-af9d-4f2a-884c-5f5a6f18c7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:17.889283 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1226ac6-af9d-4f2a-884c-5f5a6f18c7a2 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:17.889574 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1226ac6-af9d-4f2a-884c-5f5a6f18c7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:17.889858 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1226ac6-af9d-4f2a-884c-5f5a6f18c7a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:17.891072 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1226ac6-af9d-4f2a-884c-5f5a6f18c7a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:17.892523 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1226ac6-af9d-4f2a-884c-5f5a6f18c7a2 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:17.894137 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 28/60] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:44:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:17.900234 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56505a32-fb2a-44a7-9a03-aaea4665fd0e None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:17.996851 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56505a32-fb2a-44a7-9a03-aaea4665fd0e None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:18.030991 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e66e4b-5628-465b-977d-8aedd273f326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:18.031668 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e66e4b-5628-465b-977d-8aedd273f326 None admin] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:18.031964 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e66e4b-5628-465b-977d-8aedd273f326 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:18.032577 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e66e4b-5628-465b-977d-8aedd273f326 None admin] PATH_INFO: `/v3/users` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:18.033313 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e66e4b-5628-465b-977d-8aedd273f326 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:18.034818 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e66e4b-5628-465b-977d-8aedd273f326 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:18.150534 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 33/61] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:44:17 2022] POST /identity/v3/users => generated 275 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:44:21.251283 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e29c90-fff5-4ae2-b4e5-51dae2af31e7 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:21.251283 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e29c90-fff5-4ae2-b4e5-51dae2af31e7 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:21.251283 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e29c90-fff5-4ae2-b4e5-51dae2af31e7 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:21.251283 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 29/62] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:21.256658 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608351b-a6b0-4ffe-a3fe-f5a7dced10e7 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:21.257063 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608351b-a6b0-4ffe-a3fe-f5a7dced10e7 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:21.257226 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608351b-a6b0-4ffe-a3fe-f5a7dced10e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:21.278718 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-2608351b-a6b0-4ffe-a3fe-f5a7dced10e7 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:21.280258 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-2608351b-a6b0-4ffe-a3fe-f5a7dced10e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:21.352538 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:21.374050 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 34/63] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:44:21.405968 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e29c90-fff5-4ae2-b4e5-51dae2af31e7 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:21.531747 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d62b35-c589-4f24-968c-d61aa66b315e None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:21.532296 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d62b35-c589-4f24-968c-d61aa66b315e None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:21.532580 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d62b35-c589-4f24-968c-d61aa66b315e None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:21.534314 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 35/64] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:21.540797 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86f0cd-5741-40a1-a8a9-4dce79077bd3 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:21.541094 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86f0cd-5741-40a1-a8a9-4dce79077bd3 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:21.541564 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86f0cd-5741-40a1-a8a9-4dce79077bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:21.563219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e29c90-fff5-4ae2-b4e5-51dae2af31e7 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:21.580012 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-5f86f0cd-5741-40a1-a8a9-4dce79077bd3 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:21.583100 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-5f86f0cd-5741-40a1-a8a9-4dce79077bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:21.610498 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:21.634436 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c216d19-b889-47f5-95ef-97ee9c94101d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:21.635264 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c216d19-b889-47f5-95ef-97ee9c94101d None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:21.635563 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c216d19-b889-47f5-95ef-97ee9c94101d None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:21.635848 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c216d19-b889-47f5-95ef-97ee9c94101d None admin] PATH_INFO: `/v3/roles/member` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:21.671066 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c216d19-b889-47f5-95ef-97ee9c94101d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:44:21.685483 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 36/65] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:44:21.690181 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-6c216d19-b889-47f5-95ef-97ee9c94101d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:44:21.690181 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:44:21.690181 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:44:21.690181 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:44:21.690181 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:44:21.690181 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:44:21.690181 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:44:21.690181 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:44:21.690181 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:44:21.690181 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:44:21.690181 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:44:21.690181 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:44:21.690181 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:44:21.690181 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:44:21.690181 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:44:21.690181 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:44:21.691249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:44:21.691249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:44:21.691249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:44:21.691249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:44:21.691249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:44:21.691249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:44:21.691249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:44:21.691249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:44:21.691249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:44:21.691249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:44:21.691249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:44:21.691249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:44:21.691249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:44:21.691249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:44:21.691249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:44:21.691249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:44:21.692202 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:44:21.692202 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:44:21.692202 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:44:21.692202 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:44:21.692202 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:44:21.692202 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:44:21.692202 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:44:21.692202 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:44:21.692202 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:44:21.692202 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:44:21.692202 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:44:21.692202 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:44:21.692202 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 30/66] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:44:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:44:21.700079 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86f0cd-5741-40a1-a8a9-4dce79077bd3 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:21.765956 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c216d19-b889-47f5-95ef-97ee9c94101d None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:21.829613 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86f0cd-5741-40a1-a8a9-4dce79077bd3 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:21.845460 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:21.868929 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ddd575-9820-4374-87b7-80e02875a344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:21.869974 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddd575-9820-4374-87b7-80e02875a344 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:21.870307 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddd575-9820-4374-87b7-80e02875a344 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:21.870779 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddd575-9820-4374-87b7-80e02875a344 None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:21.871723 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ddd575-9820-4374-87b7-80e02875a344 None admin] RBAC: Adding query filter params (name=member) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:21.872210 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ddd575-9820-4374-87b7-80e02875a344 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:21.873790 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ddd575-9820-4374-87b7-80e02875a344 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:21.884715 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 37/67] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:44:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:21.886993 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f44cf-6082-4121-bc0b-dd685262d537 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:21.887620 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f44cf-6082-4121-bc0b-dd685262d537 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:21.888379 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f44cf-6082-4121-bc0b-dd685262d537 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:21.890307 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 38/68] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:21.892532 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab2b11-0aad-478b-b074-6e3d760ebc91 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:21.893012 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab2b11-0aad-478b-b074-6e3d760ebc91 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:21.893471 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab2b11-0aad-478b-b074-6e3d760ebc91 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:21.894288 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c216d19-b889-47f5-95ef-97ee9c94101d None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:21.895046 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 39/69] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:21.900174 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab2b11-0aad-478b-b074-6e3d760ebc91 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:21.933581 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cec974-cc7c-4013-b953-68af53ed4ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:21.934417 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cec974-cc7c-4013-b953-68af53ed4ea6 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:21.934723 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cec974-cc7c-4013-b953-68af53ed4ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:21.934997 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cec974-cc7c-4013-b953-68af53ed4ea6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:21.946416 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cec974-cc7c-4013-b953-68af53ed4ea6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:44:21.954266 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-65cec974-cc7c-4013-b953-68af53ed4ea6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:44:21.954266 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:44:21.954266 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:44:21.954266 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:44:21.954266 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:44:21.954266 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:44:21.954266 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:44:21.954266 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:44:21.954266 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:44:21.954266 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:44:21.954266 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:44:21.954266 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:44:21.954266 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:44:21.954266 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:44:21.954266 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:44:21.954266 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:44:21.955297 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:44:21.955297 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:44:21.955297 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:44:21.955297 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:44:21.955297 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:44:21.955297 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:44:21.955297 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:44:21.955297 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:44:21.955297 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:44:21.955297 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:44:21.955297 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:44:21.955297 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:44:21.955297 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:44:21.955297 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:44:21.955297 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:44:21.955297 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:44:21.956180 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:44:21.956180 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:44:21.956180 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:44:21.956180 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:44:21.956180 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:44:21.956180 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:44:21.956180 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:44:21.956180 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:44:21.956180 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:44:21.956180 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:44:21.956180 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:44:21.956180 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:44:21.960507 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 31/70] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:44:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:44:21.961663 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151334d-c6ed-4203-ab87-d1affa776bcc None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:21.961962 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151334d-c6ed-4203-ab87-d1affa776bcc None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:21.962285 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151334d-c6ed-4203-ab87-d1affa776bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:21.980037 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-9151334d-c6ed-4203-ab87-d1affa776bcc None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:21.981252 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-9151334d-c6ed-4203-ab87-d1affa776bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:22.018638 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab2b11-0aad-478b-b074-6e3d760ebc91 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:22.028963 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:22.056675 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ea439-f880-441e-bb92-4ee4ac9e6db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:22.056926 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 32/71] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:44:22.057776 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ea439-f880-441e-bb92-4ee4ac9e6db9 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:22.058080 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ea439-f880-441e-bb92-4ee4ac9e6db9 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:22.058524 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ea439-f880-441e-bb92-4ee4ac9e6db9 None admin] PATH_INFO: `/v3/users/c408cf8653cd44348de851d3fa6f8d63` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:22.063224 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223fe59-fa8e-4b2b-a8d5-3783b2619614 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:22.066524 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223fe59-fa8e-4b2b-a8d5-3783b2619614 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:22.067054 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223fe59-fa8e-4b2b-a8d5-3783b2619614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:22.075145 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9ea439-f880-441e-bb92-4ee4ac9e6db9 None admin] RBAC: Authorizing `identity:get_user(user_id=c408cf8653cd44348de851d3fa6f8d63)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:22.077885 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9ea439-f880-441e-bb92-4ee4ac9e6db9 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:22.080258 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 40/72] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:44:21 2022] GET /identity/v3/users/c408cf8653cd44348de851d3fa6f8d63 => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:22.081429 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ea439-f880-441e-bb92-4ee4ac9e6db9 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:22.088468 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-e223fe59-fa8e-4b2b-a8d5-3783b2619614 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:22.089698 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-e223fe59-fa8e-4b2b-a8d5-3783b2619614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:22.120291 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:22.170172 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 33/73] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:44:22.170172 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223fe59-fa8e-4b2b-a8d5-3783b2619614 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:22.200996 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ea439-f880-441e-bb92-4ee4ac9e6db9 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:22.236917 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa52034-473d-4517-ac99-f681aba25124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:22.237603 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa52034-473d-4517-ac99-f681aba25124 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:22.237897 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa52034-473d-4517-ac99-f681aba25124 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:22.238215 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa52034-473d-4517-ac99-f681aba25124 None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:22.238982 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa52034-473d-4517-ac99-f681aba25124 None admin] RBAC: Adding query filter params (name=admin) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:22.239300 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa52034-473d-4517-ac99-f681aba25124 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:22.240697 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa52034-473d-4517-ac99-f681aba25124 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:22.249320 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 41/74] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:44:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:22.254468 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa52034-473d-4517-ac99-f681aba25124 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:22.279011 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223fe59-fa8e-4b2b-a8d5-3783b2619614 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:22.281290 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:22.313094 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0b440-afe8-4bc8-9ab3-9d391bc772c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:22.313913 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0b440-afe8-4bc8-9ab3-9d391bc772c6 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:22.314246 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0b440-afe8-4bc8-9ab3-9d391bc772c6 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:22.314558 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0b440-afe8-4bc8-9ab3-9d391bc772c6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:22.325805 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d0b440-afe8-4bc8-9ab3-9d391bc772c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:44:22.333667 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-57d0b440-afe8-4bc8-9ab3-9d391bc772c6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:44:22.333667 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:44:22.333667 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:44:22.333667 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:44:22.333667 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:44:22.333667 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:44:22.333667 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:44:22.333667 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:44:22.333667 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:44:22.333667 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:44:22.333667 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:44:22.333667 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:44:22.333667 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:44:22.333667 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:44:22.333667 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:44:22.333667 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:44:22.334709 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:44:22.334709 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:44:22.334709 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:44:22.334709 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:44:22.334709 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:44:22.334709 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:44:22.334709 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:44:22.334709 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:44:22.334709 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:44:22.334709 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:44:22.334709 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:44:22.334709 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:44:22.334709 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:44:22.334709 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:44:22.334709 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:44:22.334709 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:44:22.340671 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:44:22.340671 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:44:22.340671 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:44:22.340671 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:44:22.340671 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:44:22.340671 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:44:22.340671 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:44:22.340671 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:44:22.340671 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:44:22.340671 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:44:22.340671 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:44:22.340671 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:44:22.340671 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 34/75] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:44:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:44:22.340671 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0b440-afe8-4bc8-9ab3-9d391bc772c6 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:22.349230 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:22.355985 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa52034-473d-4517-ac99-f681aba25124 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:22.391470 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d63b7-aa2d-4ae1-895f-1fb4fb7e0fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:22.392140 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d63b7-aa2d-4ae1-895f-1fb4fb7e0fd7 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:22.392490 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d63b7-aa2d-4ae1-895f-1fb4fb7e0fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:22.392785 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d63b7-aa2d-4ae1-895f-1fb4fb7e0fd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:22.443006 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0b440-afe8-4bc8-9ab3-9d391bc772c6 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:22.466485 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092d63b7-aa2d-4ae1-895f-1fb4fb7e0fd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:22.467980 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092d63b7-aa2d-4ae1-895f-1fb4fb7e0fd7 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:22.478461 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e02d2-f952-4c5d-8395-09e4b3689526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:22.479284 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e02d2-f952-4c5d-8395-09e4b3689526 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:22.479579 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e02d2-f952-4c5d-8395-09e4b3689526 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:22.479894 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e02d2-f952-4c5d-8395-09e4b3689526 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:22.490210 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88e02d2-f952-4c5d-8395-09e4b3689526 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:44:22.498374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-e88e02d2-f952-4c5d-8395-09e4b3689526 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:44:22.498374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:44:22.498374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:44:22.498374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:44:22.498374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:44:22.498374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:44:22.498374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:44:22.498374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:44:22.498374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:44:22.498374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:44:22.498374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:44:22.498374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:44:22.498374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:44:22.498374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:44:22.498374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:44:22.498374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:44:22.499531 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:44:22.499531 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:44:22.499531 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:44:22.499531 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:44:22.499531 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:44:22.499531 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:44:22.499531 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:44:22.499531 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:44:22.499531 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:44:22.499531 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:44:22.499531 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:44:22.499531 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:44:22.499531 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:44:22.499531 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:44:22.499531 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:44:22.499531 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:44:22.500550 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:44:22.500550 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:44:22.500550 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:44:22.500550 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:44:22.500550 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:44:22.500550 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:44:22.500550 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:44:22.500550 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:44:22.500550 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:44:22.500550 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:44:22.500550 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:44:22.500550 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:44:22.500550 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 35/76] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:44:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:44:22.501314 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cda8c-8a29-42e3-950a-84990453af86 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:22.501314 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cda8c-8a29-42e3-950a-84990453af86 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:22.501314 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cda8c-8a29-42e3-950a-84990453af86 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:22.502576 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 36/77] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:22.503650 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37cda8c-8a29-42e3-950a-84990453af86 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:22.530186 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:22.565335 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:22.572417 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 42/78] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:44:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:44:22.576774 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d63b7-aa2d-4ae1-895f-1fb4fb7e0fd7 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:22.613248 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37cda8c-8a29-42e3-950a-84990453af86 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:22.647572 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c70791-028c-4fb8-a62a-1637c29ee066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:22.648447 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c70791-028c-4fb8-a62a-1637c29ee066 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:22.649269 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c70791-028c-4fb8-a62a-1637c29ee066 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:22.649553 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c70791-028c-4fb8-a62a-1637c29ee066 None admin] PATH_INFO: `/v3/users/1e928873ee4f41c0a59c6b30ce6b0806` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:22.650793 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c70791-028c-4fb8-a62a-1637c29ee066 None admin] RBAC: Authorizing `identity:get_user(user_id=1e928873ee4f41c0a59c6b30ce6b0806)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:22.652265 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c70791-028c-4fb8-a62a-1637c29ee066 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:22.653897 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 37/79] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:44:22 2022] GET /identity/v3/users/1e928873ee4f41c0a59c6b30ce6b0806 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:22.659709 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6435a-dc79-4c8a-bde2-21049bf1bd22 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:22.660002 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6435a-dc79-4c8a-bde2-21049bf1bd22 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:22.660290 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6435a-dc79-4c8a-bde2-21049bf1bd22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:22.673659 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d63b7-aa2d-4ae1-895f-1fb4fb7e0fd7 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:22.676961 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-04e6435a-dc79-4c8a-bde2-21049bf1bd22 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:22.678202 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-04e6435a-dc79-4c8a-bde2-21049bf1bd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:22.711611 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c83811-5624-4529-8c42-357748f0a8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:22.712302 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c83811-5624-4529-8c42-357748f0a8a6 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:22.712596 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c83811-5624-4529-8c42-357748f0a8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:22.712886 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c83811-5624-4529-8c42-357748f0a8a6 None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:22.713661 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c83811-5624-4529-8c42-357748f0a8a6 None admin] RBAC: Adding query filter params (name=member) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:22.713979 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c83811-5624-4529-8c42-357748f0a8a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:22.715461 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c83811-5624-4529-8c42-357748f0a8a6 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:22.723646 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 43/80] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:44:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:22.723646 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c83811-5624-4529-8c42-357748f0a8a6 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:22.746862 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 38/81] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:44:22.747720 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6435a-dc79-4c8a-bde2-21049bf1bd22 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:22.776987 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:22.797449 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:22.839870 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c83811-5624-4529-8c42-357748f0a8a6 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:22.854146 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6435a-dc79-4c8a-bde2-21049bf1bd22 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:22.873755 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d145524d-d978-4de3-b686-0aa620fc1fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:22.874391 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145524d-d978-4de3-b686-0aa620fc1fe0 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:22.874684 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145524d-d978-4de3-b686-0aa620fc1fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:22.874971 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145524d-d978-4de3-b686-0aa620fc1fe0 None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:22.875738 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d145524d-d978-4de3-b686-0aa620fc1fe0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:22.876054 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d145524d-d978-4de3-b686-0aa620fc1fe0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:22.877462 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d145524d-d978-4de3-b686-0aa620fc1fe0 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:22.885993 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 44/82] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:44:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:22.889605 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fcf327-a4ff-43a1-a69e-0fbf3323c87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:22.890506 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fcf327-a4ff-43a1-a69e-0fbf3323c87b None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:22.890803 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fcf327-a4ff-43a1-a69e-0fbf3323c87b None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:22.891093 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fcf327-a4ff-43a1-a69e-0fbf3323c87b None admin] PATH_INFO: `/v3/projects/e8b08a08b5d3403b9697254998dfb18f` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:22.891271 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d145524d-d978-4de3-b686-0aa620fc1fe0 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:22.892327 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fcf327-a4ff-43a1-a69e-0fbf3323c87b None admin] RBAC: Authorizing `identity:get_project(project_id=e8b08a08b5d3403b9697254998dfb18f)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:22.893803 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fcf327-a4ff-43a1-a69e-0fbf3323c87b None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:22.900363 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 39/83] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:44:22 2022] GET /identity/v3/projects/e8b08a08b5d3403b9697254998dfb18f => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:22.900363 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fcf327-a4ff-43a1-a69e-0fbf3323c87b None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:22.986673 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:22.995174 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d145524d-d978-4de3-b686-0aa620fc1fe0 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:22.999504 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fcf327-a4ff-43a1-a69e-0fbf3323c87b None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:23.015810 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:23.030009 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f9720-156e-4d1e-91b3-80a341a8e5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:23.030724 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f9720-156e-4d1e-91b3-80a341a8e5f1 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:23.031018 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f9720-156e-4d1e-91b3-80a341a8e5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:23.031308 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f9720-156e-4d1e-91b3-80a341a8e5f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:23.032740 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73bf3c3-79bc-4061-bd18-00a098b01cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:23.033618 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73bf3c3-79bc-4061-bd18-00a098b01cd9 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:23.033913 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73bf3c3-79bc-4061-bd18-00a098b01cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:23.034231 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73bf3c3-79bc-4061-bd18-00a098b01cd9 None admin] PATH_INFO: `/v3/users/c408cf8653cd44348de851d3fa6f8d63` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:23.035544 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73bf3c3-79bc-4061-bd18-00a098b01cd9 None admin] RBAC: Authorizing `identity:get_user(user_id=c408cf8653cd44348de851d3fa6f8d63)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:23.036992 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73bf3c3-79bc-4061-bd18-00a098b01cd9 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:23.038713 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 40/84] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:44:22 2022] GET /identity/v3/users/c408cf8653cd44348de851d3fa6f8d63 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:23.040287 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73bf3c3-79bc-4061-bd18-00a098b01cd9 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:23.105528 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347f9720-156e-4d1e-91b3-80a341a8e5f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:23.107043 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347f9720-156e-4d1e-91b3-80a341a8e5f1 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:23.139962 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73bf3c3-79bc-4061-bd18-00a098b01cd9 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:23.176907 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7358cdf2-a93f-4c7f-8558-c36b58132528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:23.177862 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7358cdf2-a93f-4c7f-8558-c36b58132528 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:23.178251 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7358cdf2-a93f-4c7f-8558-c36b58132528 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:23.178586 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7358cdf2-a93f-4c7f-8558-c36b58132528 None admin] PATH_INFO: `/v3/domains/default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:23.180777 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7358cdf2-a93f-4c7f-8558-c36b58132528 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:23.182756 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7358cdf2-a93f-4c7f-8558-c36b58132528 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:23.185208 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 41/85] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:44:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:23.185903 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7358cdf2-a93f-4c7f-8558-c36b58132528 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:23.212810 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 45/86] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:44:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:44:23.213742 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f9720-156e-4d1e-91b3-80a341a8e5f1 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:23.214026 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:23.236764 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:23.291065 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7358cdf2-a93f-4c7f-8558-c36b58132528 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:23.316459 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f9720-156e-4d1e-91b3-80a341a8e5f1 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:23.325703 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af2026-fbe5-4d11-a9d8-6c5633722987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:23.326613 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af2026-fbe5-4d11-a9d8-6c5633722987 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:23.326907 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af2026-fbe5-4d11-a9d8-6c5633722987 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:23.327192 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af2026-fbe5-4d11-a9d8-6c5633722987 None admin] PATH_INFO: `/v3/users/c408cf8653cd44348de851d3fa6f8d63` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:23.328409 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af2026-fbe5-4d11-a9d8-6c5633722987 None admin] RBAC: Authorizing `identity:get_user(user_id=c408cf8653cd44348de851d3fa6f8d63)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:23.329884 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af2026-fbe5-4d11-a9d8-6c5633722987 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:23.331565 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 42/87] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:44:23 2022] GET /identity/v3/users/c408cf8653cd44348de851d3fa6f8d63 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:23.337785 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af2026-fbe5-4d11-a9d8-6c5633722987 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:23.350933 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b266726-b39c-42e7-abba-d27713fe8848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:23.351609 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b266726-b39c-42e7-abba-d27713fe8848 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:23.351984 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b266726-b39c-42e7-abba-d27713fe8848 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:23.352614 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b266726-b39c-42e7-abba-d27713fe8848 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:23.353368 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b266726-b39c-42e7-abba-d27713fe8848 None admin] RBAC: Adding query filter params (role.id=41a9e10d8ca34fa892f53bf450f29554, scope.project.id=e8b08a08b5d3403b9697254998dfb18f, user.id=c408cf8653cd44348de851d3fa6f8d63) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:23.353686 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b266726-b39c-42e7-abba-d27713fe8848 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:23.355176 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b266726-b39c-42e7-abba-d27713fe8848 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:23.360751 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 46/88] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:44:23 2022] GET /identity/v3/role_assignments?user.id=c408cf8653cd44348de851d3fa6f8d63&scope.project.id=e8b08a08b5d3403b9697254998dfb18f&role.id=41a9e10d8ca34fa892f53bf450f29554 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:23.361430 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b266726-b39c-42e7-abba-d27713fe8848 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:23.444809 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:23.452709 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af2026-fbe5-4d11-a9d8-6c5633722987 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:23.463953 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:23.480945 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b266726-b39c-42e7-abba-d27713fe8848 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:23.495083 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a25bbc5-add8-4d43-a259-711d1b436077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:23.496114 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25bbc5-add8-4d43-a259-711d1b436077 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:23.496608 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25bbc5-add8-4d43-a259-711d1b436077 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:23.497066 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25bbc5-add8-4d43-a259-711d1b436077 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:23.519777 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d6668-42c3-4ac5-bacd-92cb20deffab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:23.520478 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d6668-42c3-4ac5-bacd-92cb20deffab None admin] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:23.520775 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d6668-42c3-4ac5-bacd-92cb20deffab None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:23.521062 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d6668-42c3-4ac5-bacd-92cb20deffab None admin] PATH_INFO: `/v3/users` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:23.521866 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d6668-42c3-4ac5-bacd-92cb20deffab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:23.523385 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d6668-42c3-4ac5-bacd-92cb20deffab None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:23.580574 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a25bbc5-add8-4d43-a259-711d1b436077 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:23.582072 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a25bbc5-add8-4d43-a259-711d1b436077 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:23.591652 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 47/89] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:44:23 2022] POST /identity/v3/users => generated 289 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:44:23.592718 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d6668-42c3-4ac5-bacd-92cb20deffab None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:23.716747 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:23.725771 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 43/90] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:44:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:44:23.726466 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a25bbc5-add8-4d43-a259-711d1b436077 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:23.734346 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d6668-42c3-4ac5-bacd-92cb20deffab None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:23.777819 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced17d59-f612-44b3-9d77-51277a0390e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:23.779969 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced17d59-f612-44b3-9d77-51277a0390e8 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:23.780485 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced17d59-f612-44b3-9d77-51277a0390e8 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:23.780992 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced17d59-f612-44b3-9d77-51277a0390e8 None admin] PATH_INFO: `/v3/projects/e8b08a08b5d3403b9697254998dfb18f` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:23.782546 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced17d59-f612-44b3-9d77-51277a0390e8 None admin] RBAC: Authorizing `identity:get_project(project_id=e8b08a08b5d3403b9697254998dfb18f)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:23.784248 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced17d59-f612-44b3-9d77-51277a0390e8 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:23.786249 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 48/91] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:44:23 2022] GET /identity/v3/projects/e8b08a08b5d3403b9697254998dfb18f => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:23.787262 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced17d59-f612-44b3-9d77-51277a0390e8 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:23.801740 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:23.864175 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a25bbc5-add8-4d43-a259-711d1b436077 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:23.910227 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34815c-0a19-41f9-9f1f-3a6ac8377920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:23.910896 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34815c-0a19-41f9-9f1f-3a6ac8377920 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:23.911188 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34815c-0a19-41f9-9f1f-3a6ac8377920 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:23.911469 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34815c-0a19-41f9-9f1f-3a6ac8377920 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:23.929564 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced17d59-f612-44b3-9d77-51277a0390e8 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:23.973455 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d4e8af-0bf4-47f7-815d-0dcec03a8865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:23.974302 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4e8af-0bf4-47f7-815d-0dcec03a8865 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:23.974602 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4e8af-0bf4-47f7-815d-0dcec03a8865 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:23.975667 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4e8af-0bf4-47f7-815d-0dcec03a8865 None admin] PATH_INFO: `/v3/projects/b189e5e641e04cd98d98a238e646371a` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:23.978381 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d4e8af-0bf4-47f7-815d-0dcec03a8865 None admin] RBAC: Authorizing `identity:get_project(project_id=b189e5e641e04cd98d98a238e646371a)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:23.980125 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d4e8af-0bf4-47f7-815d-0dcec03a8865 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:23.981905 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 49/92] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:44:23 2022] GET /identity/v3/projects/b189e5e641e04cd98d98a238e646371a => generated 312 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:23.982722 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d4e8af-0bf4-47f7-815d-0dcec03a8865 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:23.993677 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:24.001594 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d34815c-0a19-41f9-9f1f-3a6ac8377920 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:24.003122 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d34815c-0a19-41f9-9f1f-3a6ac8377920 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:24.089159 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:24.119570 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d4e8af-0bf4-47f7-815d-0dcec03a8865 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:24.138523 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 44/93] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:44:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:44:24.139567 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34815c-0a19-41f9-9f1f-3a6ac8377920 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:24.163807 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ecbd7-200f-42aa-a380-058bfa310d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:24.165685 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ecbd7-200f-42aa-a380-058bfa310d5b None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:24.165993 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ecbd7-200f-42aa-a380-058bfa310d5b None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:24.166600 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ecbd7-200f-42aa-a380-058bfa310d5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:24.167751 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8ecbd7-200f-42aa-a380-058bfa310d5b None admin] RBAC: Adding query filter params (role.id=e1c574c9973548ebb0e8d9e0656ccabd, scope.project.id=e8b08a08b5d3403b9697254998dfb18f, user.id=1e928873ee4f41c0a59c6b30ce6b0806) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:24.168085 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8ecbd7-200f-42aa-a380-058bfa310d5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:24.170356 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8ecbd7-200f-42aa-a380-058bfa310d5b None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:24.178978 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 50/94] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:44:23 2022] GET /identity/v3/role_assignments?user.id=1e928873ee4f41c0a59c6b30ce6b0806&scope.project.id=e8b08a08b5d3403b9697254998dfb18f&role.id=e1c574c9973548ebb0e8d9e0656ccabd => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:24.180287 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ecbd7-200f-42aa-a380-058bfa310d5b None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:24.295405 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:24.299876 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ecbd7-200f-42aa-a380-058bfa310d5b None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:24.307865 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34815c-0a19-41f9-9f1f-3a6ac8377920 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:24.356868 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e80c1-2352-4170-a549-734a9d74af2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:24.357777 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e80c1-2352-4170-a549-734a9d74af2b None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:24.359611 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e80c1-2352-4170-a549-734a9d74af2b None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:24.359910 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e80c1-2352-4170-a549-734a9d74af2b None admin] PATH_INFO: `/v3/projects/e8b08a08b5d3403b9697254998dfb18f` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:24.362841 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e80c1-2352-4170-a549-734a9d74af2b None admin] RBAC: Authorizing `identity:get_project(project_id=e8b08a08b5d3403b9697254998dfb18f)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:24.364344 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e80c1-2352-4170-a549-734a9d74af2b None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:24.366202 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 51/95] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:44:24 2022] GET /identity/v3/projects/e8b08a08b5d3403b9697254998dfb18f => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:24.372596 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e80c1-2352-4170-a549-734a9d74af2b None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:24.381716 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df6893-74e3-4687-bc34-fa82f1bd52b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:24.382451 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df6893-74e3-4687-bc34-fa82f1bd52b9 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:24.382788 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df6893-74e3-4687-bc34-fa82f1bd52b9 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:24.383628 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df6893-74e3-4687-bc34-fa82f1bd52b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:24.384572 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df6893-74e3-4687-bc34-fa82f1bd52b9 None admin] RBAC: Adding query filter params (role.id=41a9e10d8ca34fa892f53bf450f29554, scope.project.id=b189e5e641e04cd98d98a238e646371a, user.id=c408cf8653cd44348de851d3fa6f8d63) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:24.384905 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df6893-74e3-4687-bc34-fa82f1bd52b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:24.386448 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df6893-74e3-4687-bc34-fa82f1bd52b9 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:24.410455 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:24.419113 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 45/96] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:44:24 2022] GET /identity/v3/role_assignments?user.id=c408cf8653cd44348de851d3fa6f8d63&scope.project.id=b189e5e641e04cd98d98a238e646371a&role.id=41a9e10d8ca34fa892f53bf450f29554 => generated 259 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:24.524187 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e80c1-2352-4170-a549-734a9d74af2b None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:24.564675 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2919b-e5b0-4981-8096-71165b4bf611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:24.565365 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2919b-e5b0-4981-8096-71165b4bf611 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:24.565662 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2919b-e5b0-4981-8096-71165b4bf611 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:24.565957 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2919b-e5b0-4981-8096-71165b4bf611 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:24.566863 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd2919b-e5b0-4981-8096-71165b4bf611 None admin] RBAC: Adding query filter params (role.id=9bd598b07a9942b7a91c3a372f3cf094, scope.project.id=e8b08a08b5d3403b9697254998dfb18f, user.id=c408cf8653cd44348de851d3fa6f8d63) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:24.567191 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd2919b-e5b0-4981-8096-71165b4bf611 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:24.568720 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd2919b-e5b0-4981-8096-71165b4bf611 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:24.575839 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 52/97] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:44:24 2022] GET /identity/v3/role_assignments?user.id=c408cf8653cd44348de851d3fa6f8d63&scope.project.id=e8b08a08b5d3403b9697254998dfb18f&role.id=9bd598b07a9942b7a91c3a372f3cf094 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:26.044770 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66283ef8-433f-410f-9802-90e6a5898638 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:26.045325 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66283ef8-433f-410f-9802-90e6a5898638 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:26.045427 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66283ef8-433f-410f-9802-90e6a5898638 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:26.046946 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 46/98] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:26.052224 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955a467-4df5-4b71-8606-ce69c6ee09f8 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:26.052661 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955a467-4df5-4b71-8606-ce69c6ee09f8 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:26.052853 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955a467-4df5-4b71-8606-ce69c6ee09f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:26.079132 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-a955a467-4df5-4b71-8606-ce69c6ee09f8 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:26.080354 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-a955a467-4df5-4b71-8606-ce69c6ee09f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:26.161045 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 53/99] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:44:26.193227 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66283ef8-433f-410f-9802-90e6a5898638 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:26.328585 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66283ef8-433f-410f-9802-90e6a5898638 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:26.366994 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff24af49-cdce-45a3-b5ae-f6ba2ca161cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:26.369267 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24af49-cdce-45a3-b5ae-f6ba2ca161cd None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:26.369788 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24af49-cdce-45a3-b5ae-f6ba2ca161cd None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:26.370324 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24af49-cdce-45a3-b5ae-f6ba2ca161cd None admin] PATH_INFO: `/v3/roles/member` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:26.382035 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff24af49-cdce-45a3-b5ae-f6ba2ca161cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:44:26.390937 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-ff24af49-cdce-45a3-b5ae-f6ba2ca161cd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:44:26.390937 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:44:26.390937 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:44:26.390937 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:44:26.390937 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:44:26.390937 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:44:26.390937 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:44:26.390937 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:44:26.390937 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:44:26.390937 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:44:26.390937 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:44:26.390937 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:44:26.390937 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:44:26.390937 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:44:26.390937 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:44:26.390937 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:44:26.392217 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:44:26.392217 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:44:26.392217 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:44:26.392217 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:44:26.392217 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:44:26.392217 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:44:26.392217 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:44:26.392217 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:44:26.392217 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:44:26.392217 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:44:26.392217 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:44:26.392217 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:44:26.392217 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:44:26.392217 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:44:26.392217 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:44:26.392217 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:44:26.393377 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:44:26.393377 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:44:26.393377 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:44:26.393377 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:44:26.393377 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:44:26.393377 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:44:26.393377 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:44:26.393377 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:44:26.393377 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:44:26.393377 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:44:26.393377 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:44:26.393377 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:44:26.395625 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 47/100] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:44:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:44:26.404075 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955a467-4df5-4b71-8606-ce69c6ee09f8 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:26.406472 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:26.531231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955a467-4df5-4b71-8606-ce69c6ee09f8 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:26.591528 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a01476d-a24d-4c8e-b16f-c2b50ec7165e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:26.592149 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01476d-a24d-4c8e-b16f-c2b50ec7165e None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:26.592447 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01476d-a24d-4c8e-b16f-c2b50ec7165e None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:26.592734 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01476d-a24d-4c8e-b16f-c2b50ec7165e None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:26.593522 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a01476d-a24d-4c8e-b16f-c2b50ec7165e None admin] RBAC: Adding query filter params (name=member) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:26.593834 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a01476d-a24d-4c8e-b16f-c2b50ec7165e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:26.595290 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a01476d-a24d-4c8e-b16f-c2b50ec7165e None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:26.608999 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 54/101] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:44:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:26.614199 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff24af49-cdce-45a3-b5ae-f6ba2ca161cd None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:26.647720 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:26.750678 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6748b4-aab3-4d65-89f1-6ff2b5b1ff91 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:26.750975 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6748b4-aab3-4d65-89f1-6ff2b5b1ff91 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:26.751507 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6748b4-aab3-4d65-89f1-6ff2b5b1ff91 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:26.753358 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 55/102] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:26.759565 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8acdc-0c4f-44c7-9b58-457757b8a106 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:26.760183 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8acdc-0c4f-44c7-9b58-457757b8a106 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:26.760696 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8acdc-0c4f-44c7-9b58-457757b8a106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:26.768719 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff24af49-cdce-45a3-b5ae-f6ba2ca161cd None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:26.787624 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-56d8acdc-0c4f-44c7-9b58-457757b8a106 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:26.789260 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-56d8acdc-0c4f-44c7-9b58-457757b8a106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:26.829142 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add0db4a-36f6-41ed-a96b-ecfa0f9b10b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:26.830519 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0db4a-36f6-41ed-a96b-ecfa0f9b10b2 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:26.831048 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0db4a-36f6-41ed-a96b-ecfa0f9b10b2 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:26.831557 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0db4a-36f6-41ed-a96b-ecfa0f9b10b2 None admin] PATH_INFO: `/v3/users/c408cf8653cd44348de851d3fa6f8d63` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:26.833320 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add0db4a-36f6-41ed-a96b-ecfa0f9b10b2 None admin] RBAC: Authorizing `identity:get_user(user_id=c408cf8653cd44348de851d3fa6f8d63)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:26.837157 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add0db4a-36f6-41ed-a96b-ecfa0f9b10b2 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:26.844568 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 48/103] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:44:26 2022] GET /identity/v3/users/c408cf8653cd44348de851d3fa6f8d63 => generated 275 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:26.850656 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add0db4a-36f6-41ed-a96b-ecfa0f9b10b2 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:26.878106 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:26.883331 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 56/104] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:44:26.909374 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8acdc-0c4f-44c7-9b58-457757b8a106 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:27.015268 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:27.035132 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add0db4a-36f6-41ed-a96b-ecfa0f9b10b2 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:27.039952 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8acdc-0c4f-44c7-9b58-457757b8a106 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:27.077808 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909a748-5401-4f08-801e-3122308a23a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:27.079479 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909a748-5401-4f08-801e-3122308a23a8 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:27.080004 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909a748-5401-4f08-801e-3122308a23a8 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:27.080513 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909a748-5401-4f08-801e-3122308a23a8 None admin] PATH_INFO: `/v3/projects/e8b08a08b5d3403b9697254998dfb18f` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:27.081965 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3909a748-5401-4f08-801e-3122308a23a8 None admin] RBAC: Authorizing `identity:get_project(project_id=e8b08a08b5d3403b9697254998dfb18f)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:27.083762 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3909a748-5401-4f08-801e-3122308a23a8 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:27.085803 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 49/105] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:44:26 2022] GET /identity/v3/projects/e8b08a08b5d3403b9697254998dfb18f => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:27.088348 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d0992-bbf9-44df-83ee-83ca9e43e9c8 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:27.088964 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d0992-bbf9-44df-83ee-83ca9e43e9c8 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:27.089477 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d0992-bbf9-44df-83ee-83ca9e43e9c8 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:27.091144 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 50/106] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:27.092079 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633d96e-b961-4df4-b8a4-78116175724a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:27.092709 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d0992-bbf9-44df-83ee-83ca9e43e9c8 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:27.092894 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633d96e-b961-4df4-b8a4-78116175724a None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:27.093378 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633d96e-b961-4df4-b8a4-78116175724a None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:27.093815 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633d96e-b961-4df4-b8a4-78116175724a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:27.119946 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5633d96e-b961-4df4-b8a4-78116175724a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:44:27.137726 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-5633d96e-b961-4df4-b8a4-78116175724a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:44:27.137726 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:44:27.137726 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:44:27.137726 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:44:27.137726 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:44:27.137726 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:44:27.137726 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:44:27.137726 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:44:27.137726 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:44:27.137726 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:44:27.137726 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:44:27.137726 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:44:27.137726 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:44:27.137726 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:44:27.137726 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:44:27.137726 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:44:27.138835 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:44:27.138835 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:44:27.138835 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:44:27.138835 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:44:27.138835 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:44:27.138835 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:44:27.138835 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:44:27.138835 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:44:27.138835 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:44:27.138835 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:44:27.138835 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:44:27.138835 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:44:27.138835 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:44:27.138835 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:44:27.138835 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:44:27.138835 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:44:27.139739 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:44:27.139739 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:44:27.139739 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:44:27.139739 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:44:27.139739 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:44:27.139739 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:44:27.139739 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:44:27.139739 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:44:27.139739 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:44:27.139739 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:44:27.139739 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:44:27.139739 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:44:27.139739 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 57/107] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:44:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:44:27.140484 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f4c95-04e1-4ce4-9e85-6c8d3a639e26 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:27.140569 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f4c95-04e1-4ce4-9e85-6c8d3a639e26 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:27.140854 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f4c95-04e1-4ce4-9e85-6c8d3a639e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:27.166625 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-dd0f4c95-04e1-4ce4-9e85-6c8d3a639e26 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:27.167864 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-dd0f4c95-04e1-4ce4-9e85-6c8d3a639e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:27.254498 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:27.261204 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d0992-bbf9-44df-83ee-83ca9e43e9c8 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:27.270268 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 58/108] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:44:27.271281 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f4c95-04e1-4ce4-9e85-6c8d3a639e26 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:27.329081 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1c87c-72ec-40b8-9add-edab2aa1ccae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:27.330461 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1c87c-72ec-40b8-9add-edab2aa1ccae None admin] REQUEST_METHOD: `PUT` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:27.331075 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1c87c-72ec-40b8-9add-edab2aa1ccae None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:27.331585 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1c87c-72ec-40b8-9add-edab2aa1ccae None admin] PATH_INFO: `/v3/projects/e8b08a08b5d3403b9697254998dfb18f/users/c408cf8653cd44348de851d3fa6f8d63/roles/41a9e10d8ca34fa892f53bf450f29554` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:27.333921 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1c87c-72ec-40b8-9add-edab2aa1ccae None admin] RBAC: Authorizing `identity:create_grant(project_id=e8b08a08b5d3403b9697254998dfb18f, user_id=c408cf8653cd44348de851d3fa6f8d63, role_id=41a9e10d8ca34fa892f53bf450f29554)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:27.335651 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1c87c-72ec-40b8-9add-edab2aa1ccae None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:27.401740 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f4c95-04e1-4ce4-9e85-6c8d3a639e26 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:27.412056 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 51/109] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:44:27 2022] PUT /identity/v3/projects/e8b08a08b5d3403b9697254998dfb18f/users/c408cf8653cd44348de851d3fa6f8d63/roles/41a9e10d8ca34fa892f53bf450f29554 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:44:27.421989 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053d6a1-5e12-4a6d-aaed-e932031ab4c2 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:27.422313 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053d6a1-5e12-4a6d-aaed-e932031ab4c2 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:27.422601 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053d6a1-5e12-4a6d-aaed-e932031ab4c2 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:27.425051 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 52/110] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:27.425884 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053d6a1-5e12-4a6d-aaed-e932031ab4c2 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:27.464299 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:27.473775 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a33b40-5bea-4677-86d1-14a143847feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:27.477678 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a33b40-5bea-4677-86d1-14a143847feb None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:27.477678 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a33b40-5bea-4677-86d1-14a143847feb None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:27.477678 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a33b40-5bea-4677-86d1-14a143847feb None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:27.479220 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a33b40-5bea-4677-86d1-14a143847feb None admin] RBAC: Adding query filter params (name=reader) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:27.479552 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a33b40-5bea-4677-86d1-14a143847feb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:27.484175 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a33b40-5bea-4677-86d1-14a143847feb None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:27.499717 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 59/111] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:44:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:27.501059 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52d3a7-dcf6-4089-883e-20b41eccf242 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:27.506023 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52d3a7-dcf6-4089-883e-20b41eccf242 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:27.506381 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52d3a7-dcf6-4089-883e-20b41eccf242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:27.534104 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-9a52d3a7-dcf6-4089-883e-20b41eccf242 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:27.535371 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-9a52d3a7-dcf6-4089-883e-20b41eccf242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:27.619775 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:27.651422 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053d6a1-5e12-4a6d-aaed-e932031ab4c2 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:27.663861 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 60/112] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:44:27.666249 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a52d3a7-dcf6-4089-883e-20b41eccf242 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:27.706256 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cbc024-d85f-41f6-bbb5-7a4c27de921e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:27.707514 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbc024-d85f-41f6-bbb5-7a4c27de921e None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:27.708032 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbc024-d85f-41f6-bbb5-7a4c27de921e None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:27.708547 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbc024-d85f-41f6-bbb5-7a4c27de921e None admin] PATH_INFO: `/v3/domains/default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:27.710078 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cbc024-d85f-41f6-bbb5-7a4c27de921e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:27.713105 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cbc024-d85f-41f6-bbb5-7a4c27de921e None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:27.716664 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 53/113] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:44:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:27.721406 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cbc024-d85f-41f6-bbb5-7a4c27de921e None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:27.816258 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a52d3a7-dcf6-4089-883e-20b41eccf242 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:27.830156 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:27.849878 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cbc024-d85f-41f6-bbb5-7a4c27de921e None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:27.854965 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d4690-247a-4da4-bbbd-2c9d99c979a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:27.856173 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d4690-247a-4da4-bbbd-2c9d99c979a2 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:27.856705 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d4690-247a-4da4-bbbd-2c9d99c979a2 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:27.857239 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d4690-247a-4da4-bbbd-2c9d99c979a2 None admin] PATH_INFO: `/v3/users/b7fb68849e434f6e9714946fc10ec3ec` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:27.872878 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587d4690-247a-4da4-bbbd-2c9d99c979a2 None admin] RBAC: Authorizing `identity:get_user(user_id=b7fb68849e434f6e9714946fc10ec3ec)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:27.874790 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587d4690-247a-4da4-bbbd-2c9d99c979a2 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:27.877277 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 61/114] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:44:27 2022] GET /identity/v3/users/b7fb68849e434f6e9714946fc10ec3ec => generated 289 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:27.878306 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d4690-247a-4da4-bbbd-2c9d99c979a2 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:27.888907 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa7ad9-dcad-4b50-b150-4a7893cf54be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:27.890000 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa7ad9-dcad-4b50-b150-4a7893cf54be None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:27.890566 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa7ad9-dcad-4b50-b150-4a7893cf54be None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:27.891074 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa7ad9-dcad-4b50-b150-4a7893cf54be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:27.904072 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa7ad9-dcad-4b50-b150-4a7893cf54be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:44:27.912933 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-97fa7ad9-dcad-4b50-b150-4a7893cf54be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:44:27.912933 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:44:27.912933 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:44:27.912933 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:44:27.912933 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:44:27.912933 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:44:27.912933 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:44:27.912933 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:44:27.912933 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:44:27.912933 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:44:27.912933 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:44:27.912933 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:44:27.912933 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:44:27.912933 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:44:27.912933 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:44:27.912933 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:44:27.913956 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:44:27.913956 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:44:27.913956 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:44:27.913956 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:44:27.913956 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:44:27.913956 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:44:27.913956 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:44:27.913956 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:44:27.913956 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:44:27.913956 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:44:27.913956 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:44:27.913956 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:44:27.913956 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:44:27.913956 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:44:27.913956 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:44:27.913956 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:44:27.915648 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:44:27.915648 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:44:27.915648 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:44:27.915648 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:44:27.915648 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:44:27.915648 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:44:27.915648 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:44:27.915648 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:44:27.915648 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:44:27.915648 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:44:27.915648 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:44:27.915648 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:44:27.917673 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:27.919059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 54/115] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:44:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:44:27.920196 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e75a71-33e2-4bc2-85e9-2731254a45e0 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:27.920500 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e75a71-33e2-4bc2-85e9-2731254a45e0 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:27.920791 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e75a71-33e2-4bc2-85e9-2731254a45e0 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:27.926415 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 55/116] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:27.944207 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e75a71-33e2-4bc2-85e9-2731254a45e0 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:27.991401 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d4690-247a-4da4-bbbd-2c9d99c979a2 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:28.029577 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4f2b1-dd97-4f46-86be-235752100edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:28.030314 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4f2b1-dd97-4f46-86be-235752100edd None admin] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:28.030619 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4f2b1-dd97-4f46-86be-235752100edd None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:28.030911 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4f2b1-dd97-4f46-86be-235752100edd None admin] PATH_INFO: `/v3/projects` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:28.031654 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce4f2b1-dd97-4f46-86be-235752100edd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:28.033226 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce4f2b1-dd97-4f46-86be-235752100edd None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:28.068973 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e75a71-33e2-4bc2-85e9-2731254a45e0 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:28.103434 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae941a-cc58-40ad-8bac-d95b1a0bafff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:28.104106 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae941a-cc58-40ad-8bac-d95b1a0bafff None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:28.104372 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae941a-cc58-40ad-8bac-d95b1a0bafff None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:28.104653 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae941a-cc58-40ad-8bac-d95b1a0bafff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:28.126182 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 62/117] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Jul 5 21:44:27 2022] POST /identity/v3/projects => generated 302 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:44:28.126182 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4f2b1-dd97-4f46-86be-235752100edd None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:28.129970 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:28.215340 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae941a-cc58-40ad-8bac-d95b1a0bafff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:28.217181 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae941a-cc58-40ad-8bac-d95b1a0bafff None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:28.239765 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:28.258308 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4f2b1-dd97-4f46-86be-235752100edd None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:28.298766 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df846915-2216-4bc8-992e-be8ea42dbc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:28.299675 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df846915-2216-4bc8-992e-be8ea42dbc16 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:28.300069 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df846915-2216-4bc8-992e-be8ea42dbc16 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:28.300426 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df846915-2216-4bc8-992e-be8ea42dbc16 None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:28.301274 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df846915-2216-4bc8-992e-be8ea42dbc16 None admin] RBAC: Adding query filter params (name=admin) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:28.301685 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df846915-2216-4bc8-992e-be8ea42dbc16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:28.303999 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df846915-2216-4bc8-992e-be8ea42dbc16 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:28.314157 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 63/118] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:44:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:28.315822 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933a8a3-2a06-4103-a39e-66dc8b5ff8e5 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:28.316599 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933a8a3-2a06-4103-a39e-66dc8b5ff8e5 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:28.317319 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933a8a3-2a06-4103-a39e-66dc8b5ff8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:28.338263 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-c933a8a3-2a06-4103-a39e-66dc8b5ff8e5 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:28.339209 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-c933a8a3-2a06-4103-a39e-66dc8b5ff8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:28.353210 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 56/119] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:44:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:44:28.354859 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b82251-490f-4142-9e84-c9248e8d3c96 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:28.354987 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b82251-490f-4142-9e84-c9248e8d3c96 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:28.355197 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b82251-490f-4142-9e84-c9248e8d3c96 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:28.358515 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 57/120] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:28.358515 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b82251-490f-4142-9e84-c9248e8d3c96 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:28.410724 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:28.438235 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 64/121] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:44:28.439178 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933a8a3-2a06-4103-a39e-66dc8b5ff8e5 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:28.494826 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b82251-490f-4142-9e84-c9248e8d3c96 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:28.532875 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c939114-1767-4807-a707-19cd1dc4af60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:28.533817 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c939114-1767-4807-a707-19cd1dc4af60 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:28.534182 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c939114-1767-4807-a707-19cd1dc4af60 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:28.534476 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c939114-1767-4807-a707-19cd1dc4af60 None admin] PATH_INFO: `/v3/users/1e928873ee4f41c0a59c6b30ce6b0806` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:28.535704 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c939114-1767-4807-a707-19cd1dc4af60 None admin] RBAC: Authorizing `identity:get_user(user_id=1e928873ee4f41c0a59c6b30ce6b0806)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:28.537234 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c939114-1767-4807-a707-19cd1dc4af60 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:28.539276 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 58/122] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:44:28 2022] GET /identity/v3/users/1e928873ee4f41c0a59c6b30ce6b0806 => generated 247 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:28.540614 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d4ba1-55e7-4e6d-9612-e669756dc6f7 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:28.540912 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d4ba1-55e7-4e6d-9612-e669756dc6f7 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:28.541202 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d4ba1-55e7-4e6d-9612-e669756dc6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:28.558456 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:28.564946 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-129d4ba1-55e7-4e6d-9612-e669756dc6f7 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:28.566808 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-129d4ba1-55e7-4e6d-9612-e669756dc6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:28.584085 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933a8a3-2a06-4103-a39e-66dc8b5ff8e5 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:28.622202 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c155ae3-8ccd-490e-b2d9-1bddc7250d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:28.623087 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c155ae3-8ccd-490e-b2d9-1bddc7250d7b None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:28.623573 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c155ae3-8ccd-490e-b2d9-1bddc7250d7b None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:28.624037 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c155ae3-8ccd-490e-b2d9-1bddc7250d7b None admin] PATH_INFO: `/v3/projects/e8b08a08b5d3403b9697254998dfb18f` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:28.625504 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c155ae3-8ccd-490e-b2d9-1bddc7250d7b None admin] RBAC: Authorizing `identity:get_project(project_id=e8b08a08b5d3403b9697254998dfb18f)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:28.627284 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c155ae3-8ccd-490e-b2d9-1bddc7250d7b None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:28.634165 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 65/123] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:44:28 2022] GET /identity/v3/projects/e8b08a08b5d3403b9697254998dfb18f => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:28.635309 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c155ae3-8ccd-490e-b2d9-1bddc7250d7b None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:28.656033 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 59/124] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:44:28.657462 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d4ba1-55e7-4e6d-9612-e669756dc6f7 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:28.721945 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:28.765771 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c155ae3-8ccd-490e-b2d9-1bddc7250d7b None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:28.800532 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d4ba1-55e7-4e6d-9612-e669756dc6f7 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:28.809729 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f92f29-1981-446f-9758-1347bd745c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:28.811004 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f92f29-1981-446f-9758-1347bd745c6f None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:28.811296 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f92f29-1981-446f-9758-1347bd745c6f None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:28.811580 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f92f29-1981-446f-9758-1347bd745c6f None admin] PATH_INFO: `/v3/roles/member` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:28.829068 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f92f29-1981-446f-9758-1347bd745c6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:44:28.838263 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-95f92f29-1981-446f-9758-1347bd745c6f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:44:28.838263 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:44:28.838263 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:44:28.838263 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:44:28.838263 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:44:28.838263 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:44:28.838263 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:44:28.838263 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:44:28.838263 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:44:28.838263 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:44:28.838263 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:44:28.838263 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:44:28.838263 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:44:28.838263 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:44:28.838263 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:44:28.838263 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:44:28.839329 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:44:28.839329 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:44:28.839329 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:44:28.839329 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:44:28.839329 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:44:28.839329 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:44:28.839329 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:44:28.839329 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:44:28.839329 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:44:28.839329 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:44:28.839329 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:44:28.839329 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:44:28.839329 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:44:28.839329 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:44:28.839329 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:44:28.839329 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:44:28.840211 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:44:28.840211 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:44:28.840211 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:44:28.840211 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:44:28.840211 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:44:28.840211 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:44:28.840211 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:44:28.840211 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:44:28.840211 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:44:28.840211 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:44:28.840211 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:44:28.840211 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:44:28.840211 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 66/125] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:44:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:44:28.842899 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f92f29-1981-446f-9758-1347bd745c6f None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:28.846862 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b052ccd-3001-4100-bb63-ef10503efc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:28.848713 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b052ccd-3001-4100-bb63-ef10503efc0c None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:28.849107 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b052ccd-3001-4100-bb63-ef10503efc0c None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:28.849426 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b052ccd-3001-4100-bb63-ef10503efc0c None admin] PATH_INFO: `/v3/projects/e8b08a08b5d3403b9697254998dfb18f` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:28.850758 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b052ccd-3001-4100-bb63-ef10503efc0c None admin] RBAC: Authorizing `identity:get_project(project_id=e8b08a08b5d3403b9697254998dfb18f)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:28.853037 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:28.854595 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b052ccd-3001-4100-bb63-ef10503efc0c None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:28.857596 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 60/126] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:44:28 2022] GET /identity/v3/projects/e8b08a08b5d3403b9697254998dfb18f => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:28.864744 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b052ccd-3001-4100-bb63-ef10503efc0c None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:28.971468 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b052ccd-3001-4100-bb63-ef10503efc0c None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:28.983786 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:28.985411 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f92f29-1981-446f-9758-1347bd745c6f None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:29.012467 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414019d-b0b6-43c6-8388-dfa9a4069c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:29.013627 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414019d-b0b6-43c6-8388-dfa9a4069c9f None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:29.014166 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414019d-b0b6-43c6-8388-dfa9a4069c9f None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:29.014652 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414019d-b0b6-43c6-8388-dfa9a4069c9f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:29.026914 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414019d-b0b6-43c6-8388-dfa9a4069c9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:44:29.033618 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac290881-eb38-44f4-9e51-7e3bd4066b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:29.034587 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac290881-eb38-44f4-9e51-7e3bd4066b08 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:29.035094 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac290881-eb38-44f4-9e51-7e3bd4066b08 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:29.035366 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-6414019d-b0b6-43c6-8388-dfa9a4069c9f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:44:29.035366 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:44:29.035366 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:44:29.035366 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:44:29.035366 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:44:29.035366 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:44:29.035366 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:44:29.035366 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:44:29.035366 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:44:29.035366 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:44:29.035366 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:44:29.035366 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:44:29.035366 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:44:29.035366 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:44:29.035366 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:44:29.035366 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:44:29.036328 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:44:29.036328 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:44:29.036328 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:44:29.036328 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:44:29.036328 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:44:29.036328 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:44:29.036328 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:44:29.036328 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:44:29.036328 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:44:29.036328 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:44:29.036328 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:44:29.036328 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:44:29.036328 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:44:29.036328 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:44:29.036328 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:44:29.036328 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:44:29.037220 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:44:29.037220 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:44:29.037220 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:44:29.037220 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:44:29.037220 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:44:29.037220 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:44:29.037220 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:44:29.037220 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:44:29.037220 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:44:29.037220 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:44:29.037220 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:44:29.037220 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:44:29.037220 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 61/127] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:44:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:44:29.037959 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414019d-b0b6-43c6-8388-dfa9a4069c9f None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:29.043993 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac290881-eb38-44f4-9e51-7e3bd4066b08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:29.043993 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac290881-eb38-44f4-9e51-7e3bd4066b08 None admin] RBAC: Adding query filter params (role.id=b4cc928f3fd4418b988335683cdad5f3, scope.project.id=e8b08a08b5d3403b9697254998dfb18f, user.id=b7fb68849e434f6e9714946fc10ec3ec) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:29.045268 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac290881-eb38-44f4-9e51-7e3bd4066b08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:29.046044 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac290881-eb38-44f4-9e51-7e3bd4066b08 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:29.055569 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 67/128] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:44:28 2022] GET /identity/v3/role_assignments?user.id=b7fb68849e434f6e9714946fc10ec3ec&scope.project.id=e8b08a08b5d3403b9697254998dfb18f&role.id=b4cc928f3fd4418b988335683cdad5f3 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:29.057131 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac290881-eb38-44f4-9e51-7e3bd4066b08 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:29.157663 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414019d-b0b6-43c6-8388-dfa9a4069c9f None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:29.162672 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:29.199083 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4666f-6ea7-4972-a18f-e405050b7724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:29.199777 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4666f-6ea7-4972-a18f-e405050b7724 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:29.200117 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4666f-6ea7-4972-a18f-e405050b7724 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:29.200407 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4666f-6ea7-4972-a18f-e405050b7724 None admin] PATH_INFO: `/v3/roles` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:29.201482 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d4666f-6ea7-4972-a18f-e405050b7724 None admin] RBAC: Adding query filter params (name=member) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:29.201772 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d4666f-6ea7-4972-a18f-e405050b7724 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:29.203227 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d4666f-6ea7-4972-a18f-e405050b7724 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:29.206270 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac290881-eb38-44f4-9e51-7e3bd4066b08 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:29.217489 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 62/129] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:44:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:29.218533 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4666f-6ea7-4972-a18f-e405050b7724 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:29.246754 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90147e2-8d61-452e-8ed1-6ff52881b230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:29.248168 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90147e2-8d61-452e-8ed1-6ff52881b230 None admin] REQUEST_METHOD: `PUT` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:29.248817 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90147e2-8d61-452e-8ed1-6ff52881b230 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:29.249333 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90147e2-8d61-452e-8ed1-6ff52881b230 None admin] PATH_INFO: `/v3/projects/e8b08a08b5d3403b9697254998dfb18f/users/1e928873ee4f41c0a59c6b30ce6b0806/roles/e1c574c9973548ebb0e8d9e0656ccabd` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:29.251872 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90147e2-8d61-452e-8ed1-6ff52881b230 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8b08a08b5d3403b9697254998dfb18f, user_id=1e928873ee4f41c0a59c6b30ce6b0806, role_id=e1c574c9973548ebb0e8d9e0656ccabd)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:29.253846 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90147e2-8d61-452e-8ed1-6ff52881b230 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:29.255847 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:29.339197 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4666f-6ea7-4972-a18f-e405050b7724 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:29.370753 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 68/130] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:44:29 2022] PUT /identity/v3/projects/e8b08a08b5d3403b9697254998dfb18f/users/1e928873ee4f41c0a59c6b30ce6b0806/roles/e1c574c9973548ebb0e8d9e0656ccabd => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:44:29.372464 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90147e2-8d61-452e-8ed1-6ff52881b230 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:29.406185 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f08bea-41c5-4a49-a91f-1453e36834f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:29.407949 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f08bea-41c5-4a49-a91f-1453e36834f8 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:29.416060 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f08bea-41c5-4a49-a91f-1453e36834f8 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:29.416474 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f08bea-41c5-4a49-a91f-1453e36834f8 None admin] PATH_INFO: `/v3/roles` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:29.417332 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f08bea-41c5-4a49-a91f-1453e36834f8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:29.418638 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f08bea-41c5-4a49-a91f-1453e36834f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:29.422249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f08bea-41c5-4a49-a91f-1453e36834f8 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:29.453216 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 63/131] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:44:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:29.461449 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f08bea-41c5-4a49-a91f-1453e36834f8 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:29.640611 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90147e2-8d61-452e-8ed1-6ff52881b230 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:29.667489 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:29.681163 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f08bea-41c5-4a49-a91f-1453e36834f8 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:29.715834 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:29.737219 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5af88-656a-46c2-a9a5-07e060b770c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:29.738204 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5af88-656a-46c2-a9a5-07e060b770c2 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:29.738500 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5af88-656a-46c2-a9a5-07e060b770c2 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:29.738845 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5af88-656a-46c2-a9a5-07e060b770c2 None admin] PATH_INFO: `/v3/users/c408cf8653cd44348de851d3fa6f8d63` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:29.743154 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c5af88-656a-46c2-a9a5-07e060b770c2 None admin] RBAC: Authorizing `identity:get_user(user_id=c408cf8653cd44348de851d3fa6f8d63)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:29.744750 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c5af88-656a-46c2-a9a5-07e060b770c2 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:29.746862 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 69/132] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:44:29 2022] GET /identity/v3/users/c408cf8653cd44348de851d3fa6f8d63 => generated 275 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:29.747744 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c2da04-1068-477f-bce5-95a3a40e6fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:29.748898 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c2da04-1068-477f-bce5-95a3a40e6fbd None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:29.749404 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c2da04-1068-477f-bce5-95a3a40e6fbd None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:29.749906 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c2da04-1068-477f-bce5-95a3a40e6fbd None admin] PATH_INFO: `/v3/users/c408cf8653cd44348de851d3fa6f8d63` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:29.752897 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c2da04-1068-477f-bce5-95a3a40e6fbd None admin] RBAC: Authorizing `identity:get_user(user_id=c408cf8653cd44348de851d3fa6f8d63)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:29.753384 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5af88-656a-46c2-a9a5-07e060b770c2 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:29.754952 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c2da04-1068-477f-bce5-95a3a40e6fbd None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:29.757369 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 64/133] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:44:29 2022] GET /identity/v3/users/c408cf8653cd44348de851d3fa6f8d63 => generated 275 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:29.764483 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c2da04-1068-477f-bce5-95a3a40e6fbd None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:29.924435 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5af88-656a-46c2-a9a5-07e060b770c2 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:29.984131 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c2da04-1068-477f-bce5-95a3a40e6fbd None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:29.995281 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1741e071-bb22-4ca8-ba13-4455c8fe5c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:29.996304 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741e071-bb22-4ca8-ba13-4455c8fe5c11 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:29.996442 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741e071-bb22-4ca8-ba13-4455c8fe5c11 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:29.996712 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741e071-bb22-4ca8-ba13-4455c8fe5c11 None admin] PATH_INFO: `/v3/projects/b189e5e641e04cd98d98a238e646371a` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:29.997952 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1741e071-bb22-4ca8-ba13-4455c8fe5c11 None admin] RBAC: Authorizing `identity:get_project(project_id=b189e5e641e04cd98d98a238e646371a)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:29.999469 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1741e071-bb22-4ca8-ba13-4455c8fe5c11 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:30.001218 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 70/134] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:44:29 2022] GET /identity/v3/projects/b189e5e641e04cd98d98a238e646371a => generated 312 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:30.002432 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7cd7e5-3289-499e-8a2f-1f0b17984290 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:30.002729 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7cd7e5-3289-499e-8a2f-1f0b17984290 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:30.003014 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7cd7e5-3289-499e-8a2f-1f0b17984290 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:30.004262 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 71/135] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:30.010791 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7cd7e5-3289-499e-8a2f-1f0b17984290 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:30.046560 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc764379-a289-46ec-8f50-63080e6059cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:30.047437 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc764379-a289-46ec-8f50-63080e6059cc None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:30.047725 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc764379-a289-46ec-8f50-63080e6059cc None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:30.048006 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc764379-a289-46ec-8f50-63080e6059cc None admin] PATH_INFO: `/v3/projects/e8b08a08b5d3403b9697254998dfb18f` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:30.049227 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc764379-a289-46ec-8f50-63080e6059cc None admin] RBAC: Authorizing `identity:get_project(project_id=e8b08a08b5d3403b9697254998dfb18f)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:30.050740 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc764379-a289-46ec-8f50-63080e6059cc None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:30.052692 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 65/136] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:44:29 2022] GET /identity/v3/projects/e8b08a08b5d3403b9697254998dfb18f => generated 298 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:44:30.053637 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e4b51-f9f4-4cfe-99a4-81f1f0929cc6 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:30.053931 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e4b51-f9f4-4cfe-99a4-81f1f0929cc6 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:30.054235 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e4b51-f9f4-4cfe-99a4-81f1f0929cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:30.087926 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-607e4b51-f9f4-4cfe-99a4-81f1f0929cc6 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:30.089997 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-607e4b51-f9f4-4cfe-99a4-81f1f0929cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:30.133783 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:30.150488 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:30.216897 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7cd7e5-3289-499e-8a2f-1f0b17984290 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:30.228968 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 66/137] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:44:30.229856 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e4b51-f9f4-4cfe-99a4-81f1f0929cc6 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:30.291860 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f50e0b-358b-4256-b0ea-c09335ceac9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:30.294742 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f50e0b-358b-4256-b0ea-c09335ceac9c None admin] REQUEST_METHOD: `PUT` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:30.295032 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f50e0b-358b-4256-b0ea-c09335ceac9c None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:30.295316 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f50e0b-358b-4256-b0ea-c09335ceac9c None admin] PATH_INFO: `/v3/projects/b189e5e641e04cd98d98a238e646371a/users/c408cf8653cd44348de851d3fa6f8d63/roles/41a9e10d8ca34fa892f53bf450f29554` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:30.301449 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f50e0b-358b-4256-b0ea-c09335ceac9c None admin] RBAC: Authorizing `identity:create_grant(project_id=b189e5e641e04cd98d98a238e646371a, user_id=c408cf8653cd44348de851d3fa6f8d63, role_id=41a9e10d8ca34fa892f53bf450f29554)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:30.303006 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f50e0b-358b-4256-b0ea-c09335ceac9c None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:30.373610 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e4b51-f9f4-4cfe-99a4-81f1f0929cc6 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:30.393104 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 72/138] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:44:30 2022] PUT /identity/v3/projects/b189e5e641e04cd98d98a238e646371a/users/c408cf8653cd44348de851d3fa6f8d63/roles/41a9e10d8ca34fa892f53bf450f29554 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:44:30.393825 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f50e0b-358b-4256-b0ea-c09335ceac9c None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:30.454455 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a98998-9284-423e-bfc4-2f210530d132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:30.456045 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a98998-9284-423e-bfc4-2f210530d132 None admin] REQUEST_METHOD: `PUT` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:30.456341 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a98998-9284-423e-bfc4-2f210530d132 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:30.456631 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a98998-9284-423e-bfc4-2f210530d132 None admin] PATH_INFO: `/v3/projects/e8b08a08b5d3403b9697254998dfb18f/users/c408cf8653cd44348de851d3fa6f8d63/roles/9bd598b07a9942b7a91c3a372f3cf094` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:30.463662 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a98998-9284-423e-bfc4-2f210530d132 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8b08a08b5d3403b9697254998dfb18f, user_id=c408cf8653cd44348de851d3fa6f8d63, role_id=9bd598b07a9942b7a91c3a372f3cf094)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:30.465159 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a98998-9284-423e-bfc4-2f210530d132 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:30.557807 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 67/139] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:44:30 2022] PUT /identity/v3/projects/e8b08a08b5d3403b9697254998dfb18f/users/c408cf8653cd44348de851d3fa6f8d63/roles/9bd598b07a9942b7a91c3a372f3cf094 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:44:30.563866 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f1f44-50fe-4a0f-b636-94642e163dde None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:30.563866 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f1f44-50fe-4a0f-b636-94642e163dde None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:30.563866 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f1f44-50fe-4a0f-b636-94642e163dde None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:30.563866 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 68/140] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:44:30.569045 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed65f8-dd26-4ea5-bb8a-824fb20dbdce None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:30.569394 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed65f8-dd26-4ea5-bb8a-824fb20dbdce None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:30.569619 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed65f8-dd26-4ea5-bb8a-824fb20dbdce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:30.573081 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f50e0b-358b-4256-b0ea-c09335ceac9c None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:30.591995 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-c3ed65f8-dd26-4ea5-bb8a-824fb20dbdce None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:30.593307 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-c3ed65f8-dd26-4ea5-bb8a-824fb20dbdce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:30.605468 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:30.611254 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:30.615813 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668c440-22a3-4e1d-ac5c-2832949a76b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:30.618485 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668c440-22a3-4e1d-ac5c-2832949a76b0 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:30.618485 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668c440-22a3-4e1d-ac5c-2832949a76b0 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:30.618485 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668c440-22a3-4e1d-ac5c-2832949a76b0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:30.630385 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668c440-22a3-4e1d-ac5c-2832949a76b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:44:30.639145 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-b668c440-22a3-4e1d-ac5c-2832949a76b0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:44:30.639145 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:44:30.639145 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:44:30.639145 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:44:30.639145 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:44:30.639145 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:44:30.639145 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:44:30.639145 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:44:30.639145 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:44:30.639145 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:44:30.639145 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:44:30.639145 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:44:30.639145 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:44:30.639145 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:44:30.639145 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:44:30.639145 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:44:30.640230 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:44:30.640230 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:44:30.640230 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:44:30.640230 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:44:30.640230 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:44:30.640230 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:44:30.640230 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:44:30.640230 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:44:30.640230 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:44:30.640230 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:44:30.640230 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:44:30.640230 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:44:30.640230 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:44:30.640230 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:44:30.640230 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:44:30.640230 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:44:30.641190 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:44:30.641190 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:44:30.641190 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:44:30.641190 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:44:30.641190 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:44:30.641190 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:44:30.641190 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:44:30.641190 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:44:30.641190 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:44:30.641190 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:44:30.641190 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:44:30.641190 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:44:30.642383 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 73/141] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:44:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:44:30.648953 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668c440-22a3-4e1d-ac5c-2832949a76b0 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:30.710284 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 69/142] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:44:30.754973 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ed65f8-dd26-4ea5-bb8a-824fb20dbdce None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:30.769980 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668c440-22a3-4e1d-ac5c-2832949a76b0 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:30.808826 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003e62d-c122-469d-9a20-3c4b24a59803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:30.809766 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003e62d-c122-469d-9a20-3c4b24a59803 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:30.810251 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003e62d-c122-469d-9a20-3c4b24a59803 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:30.810699 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003e62d-c122-469d-9a20-3c4b24a59803 None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:30.811618 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0003e62d-c122-469d-9a20-3c4b24a59803 None admin] RBAC: Adding query filter params (name=member) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:30.812082 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0003e62d-c122-469d-9a20-3c4b24a59803 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:30.813670 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0003e62d-c122-469d-9a20-3c4b24a59803 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:30.824690 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 74/143] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:44:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:30.829481 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003e62d-c122-469d-9a20-3c4b24a59803 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:30.883884 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:30.900725 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ed65f8-dd26-4ea5-bb8a-824fb20dbdce None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:30.938379 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab93d3-ad27-4728-b3af-22afac8c0738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:30.939515 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab93d3-ad27-4728-b3af-22afac8c0738 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:30.939963 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab93d3-ad27-4728-b3af-22afac8c0738 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:30.940297 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003e62d-c122-469d-9a20-3c4b24a59803 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:30.940589 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab93d3-ad27-4728-b3af-22afac8c0738 None admin] PATH_INFO: `/v3/domains/default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:30.942030 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab93d3-ad27-4728-b3af-22afac8c0738 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:30.943719 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab93d3-ad27-4728-b3af-22afac8c0738 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:30.945619 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 70/144] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:44:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:44:30.951311 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab93d3-ad27-4728-b3af-22afac8c0738 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:30.972518 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:30.979711 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda546d-6a98-4ef7-9480-a2c7797af96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:30.984227 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda546d-6a98-4ef7-9480-a2c7797af96e None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:30.984227 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda546d-6a98-4ef7-9480-a2c7797af96e None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:30.984227 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda546d-6a98-4ef7-9480-a2c7797af96e None admin] PATH_INFO: `/v3/users/c408cf8653cd44348de851d3fa6f8d63` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:30.984227 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeda546d-6a98-4ef7-9480-a2c7797af96e None admin] RBAC: Authorizing `identity:get_user(user_id=c408cf8653cd44348de851d3fa6f8d63)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:30.985598 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeda546d-6a98-4ef7-9480-a2c7797af96e None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:30.987381 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 75/145] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:44:30 2022] GET /identity/v3/users/c408cf8653cd44348de851d3fa6f8d63 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:44:30.993567 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda546d-6a98-4ef7-9480-a2c7797af96e None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:31.067467 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab93d3-ad27-4728-b3af-22afac8c0738 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:31.106382 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2df434-0e21-4ece-bf8c-ea022b44fb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:31.108561 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2df434-0e21-4ece-bf8c-ea022b44fb1d None admin] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:31.109072 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2df434-0e21-4ece-bf8c-ea022b44fb1d None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:31.110151 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2df434-0e21-4ece-bf8c-ea022b44fb1d None admin] PATH_INFO: `/v3/users` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:31.111136 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2df434-0e21-4ece-bf8c-ea022b44fb1d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:31.112893 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2df434-0e21-4ece-bf8c-ea022b44fb1d None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:31.159831 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda546d-6a98-4ef7-9480-a2c7797af96e None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:31.180010 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:31.198546 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab82d0d-beaa-4db3-9178-a3332d2bf4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:31.199466 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab82d0d-beaa-4db3-9178-a3332d2bf4c6 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:31.199937 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab82d0d-beaa-4db3-9178-a3332d2bf4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:31.200427 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab82d0d-beaa-4db3-9178-a3332d2bf4c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:31.222335 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 71/146] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:44:30 2022] POST /identity/v3/users => generated 283 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:44:31.295973 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab82d0d-beaa-4db3-9178-a3332d2bf4c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:31.298050 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab82d0d-beaa-4db3-9178-a3332d2bf4c6 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:31.436289 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 76/147] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:44:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 21:44:31.442204 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2df434-0e21-4ece-bf8c-ea022b44fb1d None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:31.536533 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:31.579567 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2df434-0e21-4ece-bf8c-ea022b44fb1d None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:31.615337 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9918a33-5769-424b-a9b3-f8215e8de20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:31.616215 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9918a33-5769-424b-a9b3-f8215e8de20d None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:31.616508 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9918a33-5769-424b-a9b3-f8215e8de20d None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:31.616795 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9918a33-5769-424b-a9b3-f8215e8de20d None admin] PATH_INFO: `/v3/projects/e8b08a08b5d3403b9697254998dfb18f` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:31.618596 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9918a33-5769-424b-a9b3-f8215e8de20d None admin] RBAC: Authorizing `identity:get_project(project_id=e8b08a08b5d3403b9697254998dfb18f)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:31.620186 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9918a33-5769-424b-a9b3-f8215e8de20d None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:31.625417 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 72/148] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:44:31 2022] GET /identity/v3/projects/e8b08a08b5d3403b9697254998dfb18f => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:31.628435 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab82d0d-beaa-4db3-9178-a3332d2bf4c6 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:31.658156 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:31.777765 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab82d0d-beaa-4db3-9178-a3332d2bf4c6 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:31.814732 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0aeb0a-be59-416c-8c5f-627a6bfad215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:31.815407 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0aeb0a-be59-416c-8c5f-627a6bfad215 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:31.815694 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0aeb0a-be59-416c-8c5f-627a6bfad215 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:31.815975 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0aeb0a-be59-416c-8c5f-627a6bfad215 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:31.816828 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0aeb0a-be59-416c-8c5f-627a6bfad215 None admin] RBAC: Adding query filter params (role.id=41a9e10d8ca34fa892f53bf450f29554, scope.project.id=e8b08a08b5d3403b9697254998dfb18f, user.id=c408cf8653cd44348de851d3fa6f8d63) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:31.817147 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0aeb0a-be59-416c-8c5f-627a6bfad215 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:31.820137 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0aeb0a-be59-416c-8c5f-627a6bfad215 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:31.827209 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 77/149] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:44:31 2022] GET /identity/v3/role_assignments?user.id=c408cf8653cd44348de851d3fa6f8d63&scope.project.id=e8b08a08b5d3403b9697254998dfb18f&role.id=41a9e10d8ca34fa892f53bf450f29554 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:32.079437 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47e08f-f68d-448e-abae-ff6dc9f0af03 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:32.079630 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47e08f-f68d-448e-abae-ff6dc9f0af03 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:32.079927 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47e08f-f68d-448e-abae-ff6dc9f0af03 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:32.081656 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 73/150] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:32.087752 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774613b-8b4f-4c83-b566-5d3556aecbbe None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:32.088044 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774613b-8b4f-4c83-b566-5d3556aecbbe None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:32.088326 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774613b-8b4f-4c83-b566-5d3556aecbbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:32.109639 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-c774613b-8b4f-4c83-b566-5d3556aecbbe None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:32.114627 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-c774613b-8b4f-4c83-b566-5d3556aecbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:32.199166 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 78/151] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:44:32.239466 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea47e08f-f68d-448e-abae-ff6dc9f0af03 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:32.363326 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea47e08f-f68d-448e-abae-ff6dc9f0af03 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:32.381141 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5577d9-a749-4e57-b525-b617fc775eec None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:32.381659 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5577d9-a749-4e57-b525-b617fc775eec None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:32.381756 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5577d9-a749-4e57-b525-b617fc775eec None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:32.383967 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 79/152] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:44:32.390377 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c6685-a4b7-4437-ba57-30f9e99444d5 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:32.390671 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c6685-a4b7-4437-ba57-30f9e99444d5 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:32.390960 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c6685-a4b7-4437-ba57-30f9e99444d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:32.415141 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-ed7c6685-a4b7-4437-ba57-30f9e99444d5 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:32.418710 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-ed7c6685-a4b7-4437-ba57-30f9e99444d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:32.423411 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:32.430805 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009d7dea-8299-4eed-a71d-ca2f91278646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:32.431697 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d7dea-8299-4eed-a71d-ca2f91278646 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:32.432032 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d7dea-8299-4eed-a71d-ca2f91278646 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:32.432255 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d7dea-8299-4eed-a71d-ca2f91278646 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:32.450942 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009d7dea-8299-4eed-a71d-ca2f91278646 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:44:32.462488 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:32.466872 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-009d7dea-8299-4eed-a71d-ca2f91278646 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:44:32.466872 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:44:32.466872 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:44:32.466872 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:44:32.466872 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:44:32.466872 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:44:32.466872 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:44:32.466872 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:44:32.466872 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:44:32.466872 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:44:32.466872 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:44:32.466872 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:44:32.466872 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:44:32.466872 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:44:32.466872 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:44:32.466872 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:44:32.467873 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:44:32.467873 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:44:32.467873 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:44:32.467873 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:44:32.467873 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:44:32.467873 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:44:32.467873 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:44:32.467873 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:44:32.467873 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:44:32.467873 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:44:32.467873 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:44:32.467873 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:44:32.467873 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:44:32.467873 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:44:32.467873 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:44:32.467873 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:44:32.468767 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:44:32.468767 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:44:32.468767 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:44:32.468767 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:44:32.468767 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:44:32.468767 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:44:32.468767 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:44:32.468767 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:44:32.468767 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:44:32.468767 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:44:32.468767 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:44:32.468767 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:44:32.469441 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 74/153] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:44:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:44:32.475532 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009d7dea-8299-4eed-a71d-ca2f91278646 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:32.557545 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 80/154] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:44:32.580713 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c6685-a4b7-4437-ba57-30f9e99444d5 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:32.672143 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009d7dea-8299-4eed-a71d-ca2f91278646 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:32.731104 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c6685-a4b7-4437-ba57-30f9e99444d5 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:32.749105 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce947420-3711-42cc-b46b-01a5fe7204f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:32.749851 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce947420-3711-42cc-b46b-01a5fe7204f1 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:32.750156 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce947420-3711-42cc-b46b-01a5fe7204f1 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:32.750447 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce947420-3711-42cc-b46b-01a5fe7204f1 None admin] PATH_INFO: `/v3/roles` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:32.751282 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce947420-3711-42cc-b46b-01a5fe7204f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:32.751597 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce947420-3711-42cc-b46b-01a5fe7204f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:32.753006 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce947420-3711-42cc-b46b-01a5fe7204f1 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:32.769411 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 75/155] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:44:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:32.775166 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce947420-3711-42cc-b46b-01a5fe7204f1 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:32.783373 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b47e4-3088-4b73-bf9d-12e8cd5ed853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:32.784207 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b47e4-3088-4b73-bf9d-12e8cd5ed853 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:32.784497 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b47e4-3088-4b73-bf9d-12e8cd5ed853 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:32.784779 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b47e4-3088-4b73-bf9d-12e8cd5ed853 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:32.804495 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:32.810711 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7b47e4-3088-4b73-bf9d-12e8cd5ed853 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:44:32.819863 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-8e7b47e4-3088-4b73-bf9d-12e8cd5ed853 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:44:32.819863 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:44:32.819863 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:44:32.819863 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:44:32.819863 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:44:32.819863 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:44:32.819863 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:44:32.819863 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:44:32.819863 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:44:32.819863 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:44:32.819863 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:44:32.819863 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:44:32.819863 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:44:32.819863 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:44:32.819863 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:44:32.819863 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:44:32.831245 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:44:32.831245 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:44:32.831245 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:44:32.831245 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:44:32.831245 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:44:32.831245 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:44:32.831245 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:44:32.831245 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:44:32.831245 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:44:32.831245 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:44:32.831245 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:44:32.831245 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:44:32.831245 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:44:32.831245 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:44:32.831245 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:44:32.831245 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:44:32.832144 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:44:32.832144 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:44:32.832144 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:44:32.832144 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:44:32.832144 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:44:32.832144 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:44:32.832144 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:44:32.832144 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:44:32.832144 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:44:32.832144 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:44:32.832144 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:44:32.832144 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:44:32.832144 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 81/156] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:44:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:44:32.834329 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b47e4-3088-4b73-bf9d-12e8cd5ed853 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:32.917444 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:32.970863 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b47e4-3088-4b73-bf9d-12e8cd5ed853 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:33.014211 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432fc5ba-d8a8-4ff2-af46-ad9847d82fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:33.015350 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432fc5ba-d8a8-4ff2-af46-ad9847d82fde None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:33.015812 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432fc5ba-d8a8-4ff2-af46-ad9847d82fde None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:33.016255 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432fc5ba-d8a8-4ff2-af46-ad9847d82fde None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:33.017278 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432fc5ba-d8a8-4ff2-af46-ad9847d82fde None admin] RBAC: Adding query filter params (name=reader) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:33.017756 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432fc5ba-d8a8-4ff2-af46-ad9847d82fde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:33.019573 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432fc5ba-d8a8-4ff2-af46-ad9847d82fde None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:33.032029 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 82/157] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:44:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:44:33.034156 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce947420-3711-42cc-b46b-01a5fe7204f1 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:33.043087 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432fc5ba-d8a8-4ff2-af46-ad9847d82fde None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:33.135582 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf323c73-9bb8-43f5-ae66-0fe126242121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:33.136482 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf323c73-9bb8-43f5-ae66-0fe126242121 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:33.136771 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf323c73-9bb8-43f5-ae66-0fe126242121 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:33.137052 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf323c73-9bb8-43f5-ae66-0fe126242121 None admin] PATH_INFO: `/v3/users/1e928873ee4f41c0a59c6b30ce6b0806` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:33.143271 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf323c73-9bb8-43f5-ae66-0fe126242121 None admin] RBAC: Authorizing `identity:get_user(user_id=1e928873ee4f41c0a59c6b30ce6b0806)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:33.144767 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf323c73-9bb8-43f5-ae66-0fe126242121 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:33.146701 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 76/158] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:44:32 2022] GET /identity/v3/users/1e928873ee4f41c0a59c6b30ce6b0806 => generated 247 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:44:33.158346 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf323c73-9bb8-43f5-ae66-0fe126242121 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:33.158550 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:33.232637 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432fc5ba-d8a8-4ff2-af46-ad9847d82fde None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:33.295545 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684fc6f3-55a1-4f53-b40b-5c73bf41edca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:33.296722 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684fc6f3-55a1-4f53-b40b-5c73bf41edca None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:33.297187 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684fc6f3-55a1-4f53-b40b-5c73bf41edca None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:33.297626 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684fc6f3-55a1-4f53-b40b-5c73bf41edca None admin] PATH_INFO: `/v3/users/b7fb68849e434f6e9714946fc10ec3ec` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:33.299176 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684fc6f3-55a1-4f53-b40b-5c73bf41edca None admin] RBAC: Authorizing `identity:get_user(user_id=b7fb68849e434f6e9714946fc10ec3ec)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:33.301134 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684fc6f3-55a1-4f53-b40b-5c73bf41edca None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:33.307876 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 83/159] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:44:33 2022] GET /identity/v3/users/b7fb68849e434f6e9714946fc10ec3ec => generated 289 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:44:33.318284 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684fc6f3-55a1-4f53-b40b-5c73bf41edca None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:33.460159 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf323c73-9bb8-43f5-ae66-0fe126242121 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:33.514405 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684fc6f3-55a1-4f53-b40b-5c73bf41edca None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:33.534857 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:33.562980 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1e714-e113-4652-b509-2718b7c05851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:33.563768 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1e714-e113-4652-b509-2718b7c05851 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:33.564064 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1e714-e113-4652-b509-2718b7c05851 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:33.564350 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1e714-e113-4652-b509-2718b7c05851 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:33.572786 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c932bbce-6001-4919-8132-16e9f4fa9922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:33.573746 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932bbce-6001-4919-8132-16e9f4fa9922 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:33.574050 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932bbce-6001-4919-8132-16e9f4fa9922 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:33.579505 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932bbce-6001-4919-8132-16e9f4fa9922 None admin] PATH_INFO: `/v3/projects/e8b08a08b5d3403b9697254998dfb18f` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:33.580919 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c932bbce-6001-4919-8132-16e9f4fa9922 None admin] RBAC: Authorizing `identity:get_project(project_id=e8b08a08b5d3403b9697254998dfb18f)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:33.582635 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c932bbce-6001-4919-8132-16e9f4fa9922 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:33.584883 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 84/160] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:44:33 2022] GET /identity/v3/projects/e8b08a08b5d3403b9697254998dfb18f => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:33.585389 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:33.594547 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c932bbce-6001-4919-8132-16e9f4fa9922 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:33.812177 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca1e714-e113-4652-b509-2718b7c05851 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:33.814232 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca1e714-e113-4652-b509-2718b7c05851 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:33.838660 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c932bbce-6001-4919-8132-16e9f4fa9922 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:33.922442 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b4c562-7cfe-46a2-b27a-d6b64a262154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:33.923443 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4c562-7cfe-46a2-b27a-d6b64a262154 None admin] REQUEST_METHOD: `PUT` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:33.923736 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4c562-7cfe-46a2-b27a-d6b64a262154 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:33.924021 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4c562-7cfe-46a2-b27a-d6b64a262154 None admin] PATH_INFO: `/v3/projects/e8b08a08b5d3403b9697254998dfb18f/users/b7fb68849e434f6e9714946fc10ec3ec/roles/b4cc928f3fd4418b988335683cdad5f3` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:33.926122 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b4c562-7cfe-46a2-b27a-d6b64a262154 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8b08a08b5d3403b9697254998dfb18f, user_id=b7fb68849e434f6e9714946fc10ec3ec, role_id=b4cc928f3fd4418b988335683cdad5f3)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:33.927630 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b4c562-7cfe-46a2-b27a-d6b64a262154 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:34.022199 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 77/161] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:44:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 864 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 21:44:34.024235 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec49d1a-4039-44c2-9beb-79603b841a67 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:34.024523 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec49d1a-4039-44c2-9beb-79603b841a67 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:34.024810 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec49d1a-4039-44c2-9beb-79603b841a67 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:34.026227 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 78/162] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:34.028189 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec49d1a-4039-44c2-9beb-79603b841a67 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:34.059894 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 85/163] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:44:33 2022] PUT /identity/v3/projects/e8b08a08b5d3403b9697254998dfb18f/users/b7fb68849e434f6e9714946fc10ec3ec/roles/b4cc928f3fd4418b988335683cdad5f3 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:44:34.061773 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d63f34-1a63-4180-b299-be607e2682a5 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:34.063306 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d63f34-1a63-4180-b299-be607e2682a5 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:34.064025 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d63f34-1a63-4180-b299-be607e2682a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:34.112075 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:34.115860 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-b7d63f34-1a63-4180-b299-be607e2682a5 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:34.119533 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-b7d63f34-1a63-4180-b299-be607e2682a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:34.271439 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:34.297618 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec49d1a-4039-44c2-9beb-79603b841a67 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:34.302469 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 86/164] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:44:34.309165 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f8277-6676-4d7e-93b5-885d84c1bbbc None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:34.309770 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f8277-6676-4d7e-93b5-885d84c1bbbc None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:34.310318 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f8277-6676-4d7e-93b5-885d84c1bbbc None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:34.311963 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 87/165] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:34.318330 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2489b6-8d9d-4741-8010-dca34b6cdc95 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:34.318910 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2489b6-8d9d-4741-8010-dca34b6cdc95 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:34.319424 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2489b6-8d9d-4741-8010-dca34b6cdc95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:34.338635 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-cd2489b6-8d9d-4741-8010-dca34b6cdc95 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:34.340564 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-cd2489b6-8d9d-4741-8010-dca34b6cdc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:34.386845 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb48f81-c506-4f54-afa9-a3201d735d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:34.387746 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb48f81-c506-4f54-afa9-a3201d735d89 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:34.388036 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb48f81-c506-4f54-afa9-a3201d735d89 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:34.388315 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb48f81-c506-4f54-afa9-a3201d735d89 None admin] PATH_INFO: `/v3/projects/e8b08a08b5d3403b9697254998dfb18f` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:34.389587 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb48f81-c506-4f54-afa9-a3201d735d89 None admin] RBAC: Authorizing `identity:get_project(project_id=e8b08a08b5d3403b9697254998dfb18f)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:34.391108 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb48f81-c506-4f54-afa9-a3201d735d89 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:34.397013 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 79/166] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:44:34 2022] GET /identity/v3/projects/e8b08a08b5d3403b9697254998dfb18f => generated 298 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:34.397013 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb48f81-c506-4f54-afa9-a3201d735d89 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:34.444062 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 88/167] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:44:34.444772 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2489b6-8d9d-4741-8010-dca34b6cdc95 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:34.526725 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:34.531655 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb48f81-c506-4f54-afa9-a3201d735d89 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:34.581873 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb70db53-95a8-4b96-b458-61427c93fb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:34.583069 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70db53-95a8-4b96-b458-61427c93fb42 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:34.583591 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70db53-95a8-4b96-b458-61427c93fb42 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:34.584085 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70db53-95a8-4b96-b458-61427c93fb42 None admin] PATH_INFO: `/v3/roles/member` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:34.596383 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb70db53-95a8-4b96-b458-61427c93fb42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:44:34.605697 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-eb70db53-95a8-4b96-b458-61427c93fb42 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:44:34.605697 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:44:34.605697 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:44:34.605697 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:44:34.605697 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:44:34.605697 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:44:34.605697 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:44:34.605697 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:44:34.605697 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:44:34.605697 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:44:34.605697 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:44:34.605697 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:44:34.605697 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:44:34.605697 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:44:34.605697 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:44:34.605697 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:44:34.606804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:44:34.606804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:44:34.606804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:44:34.606804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:44:34.606804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:44:34.606804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:44:34.606804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:44:34.606804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:44:34.606804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:44:34.606804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:44:34.606804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:44:34.606804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:44:34.606804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:44:34.606804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:44:34.606804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:44:34.606804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:44:34.607720 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:44:34.607720 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:44:34.607720 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:44:34.607720 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:44:34.607720 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:44:34.607720 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:44:34.607720 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:44:34.607720 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:44:34.607720 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:44:34.607720 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:44:34.607720 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:44:34.607720 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:44:34.610704 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 80/168] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:44:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:44:34.611750 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb70db53-95a8-4b96-b458-61427c93fb42 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:34.722240 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb70db53-95a8-4b96-b458-61427c93fb42 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:34.724410 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2489b6-8d9d-4741-8010-dca34b6cdc95 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:34.760330 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0d9345-224f-4622-86cd-98f7f8b38645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:34.761734 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d9345-224f-4622-86cd-98f7f8b38645 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:34.762287 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d9345-224f-4622-86cd-98f7f8b38645 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:34.762785 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d9345-224f-4622-86cd-98f7f8b38645 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:34.764719 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:34.776736 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0d9345-224f-4622-86cd-98f7f8b38645 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:44:34.785509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-5b0d9345-224f-4622-86cd-98f7f8b38645 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:44:34.785509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:44:34.785509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:44:34.785509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:44:34.785509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:44:34.785509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:44:34.785509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:44:34.785509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:44:34.785509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:44:34.785509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:44:34.785509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:44:34.785509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:44:34.785509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:44:34.785509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:44:34.785509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:44:34.785509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:44:34.786509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:44:34.786509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:44:34.786509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:44:34.786509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:44:34.786509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:44:34.786509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:44:34.786509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:44:34.786509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:44:34.786509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:44:34.786509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:44:34.786509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:44:34.786509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:44:34.786509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:44:34.786509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:44:34.786509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:44:34.786509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:44:34.787446 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:44:34.787446 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:44:34.787446 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:44:34.787446 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:44:34.787446 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:44:34.787446 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:44:34.787446 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:44:34.787446 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:44:34.787446 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:44:34.787446 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:44:34.787446 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:44:34.787446 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:44:34.789589 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 81/169] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:44:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:44:34.790809 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0d9345-224f-4622-86cd-98f7f8b38645 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:34.814320 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce91a15-5f81-4c55-9af5-a7dd12bb5ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:34.816670 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce91a15-5f81-4c55-9af5-a7dd12bb5ea5 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:34.817847 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce91a15-5f81-4c55-9af5-a7dd12bb5ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:34.818349 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce91a15-5f81-4c55-9af5-a7dd12bb5ea5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:34.819915 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce91a15-5f81-4c55-9af5-a7dd12bb5ea5 None admin] RBAC: Adding query filter params (role.id=e1c574c9973548ebb0e8d9e0656ccabd, scope.project.id=e8b08a08b5d3403b9697254998dfb18f, user.id=1e928873ee4f41c0a59c6b30ce6b0806) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:34.822012 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce91a15-5f81-4c55-9af5-a7dd12bb5ea5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:34.823788 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce91a15-5f81-4c55-9af5-a7dd12bb5ea5 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:34.830144 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:34.833286 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 89/170] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:44:34 2022] GET /identity/v3/role_assignments?user.id=1e928873ee4f41c0a59c6b30ce6b0806&scope.project.id=e8b08a08b5d3403b9697254998dfb18f&role.id=e1c574c9973548ebb0e8d9e0656ccabd => generated 608 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:34.834565 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce91a15-5f81-4c55-9af5-a7dd12bb5ea5 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:35.040130 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce91a15-5f81-4c55-9af5-a7dd12bb5ea5 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:35.089242 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0d9345-224f-4622-86cd-98f7f8b38645 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:35.105383 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467c7f0-2e13-4c74-9f99-a8f41d470358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:35.106507 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467c7f0-2e13-4c74-9f99-a8f41d470358 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:35.107017 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467c7f0-2e13-4c74-9f99-a8f41d470358 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:35.107539 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467c7f0-2e13-4c74-9f99-a8f41d470358 None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:35.108574 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c467c7f0-2e13-4c74-9f99-a8f41d470358 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:35.109241 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c467c7f0-2e13-4c74-9f99-a8f41d470358 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:35.113826 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c467c7f0-2e13-4c74-9f99-a8f41d470358 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:35.134415 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 90/171] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:44:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:35.136185 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e2fde-0e93-4189-bf46-15cee7e3ef29 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:35.140280 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e2fde-0e93-4189-bf46-15cee7e3ef29 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:35.140916 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e2fde-0e93-4189-bf46-15cee7e3ef29 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:35.142676 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 91/172] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:35.145751 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e2fde-0e93-4189-bf46-15cee7e3ef29 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:35.167402 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78d22c-1a6e-4e71-ac5c-100a94d93bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:35.168512 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78d22c-1a6e-4e71-ac5c-100a94d93bd4 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:35.169070 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78d22c-1a6e-4e71-ac5c-100a94d93bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:35.169575 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78d22c-1a6e-4e71-ac5c-100a94d93bd4 None admin] PATH_INFO: `/v3/roles` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:35.170651 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb78d22c-1a6e-4e71-ac5c-100a94d93bd4 None admin] RBAC: Adding query filter params (name=member) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:35.171200 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb78d22c-1a6e-4e71-ac5c-100a94d93bd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:35.172836 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb78d22c-1a6e-4e71-ac5c-100a94d93bd4 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:35.184620 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 82/173] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:44:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:35.186343 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff6db5-e646-4603-8354-0961f7390bbd None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:35.186926 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff6db5-e646-4603-8354-0961f7390bbd None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:35.187433 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff6db5-e646-4603-8354-0961f7390bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:35.206260 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-8cff6db5-e646-4603-8354-0961f7390bbd None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:35.207893 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-8cff6db5-e646-4603-8354-0961f7390bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:35.213655 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:35.279939 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e2fde-0e93-4189-bf46-15cee7e3ef29 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:35.298267 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 83/174] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:44:35.299544 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff6db5-e646-4603-8354-0961f7390bbd None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:35.312961 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:35.348552 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c32454-14f5-4175-a425-576baeedebbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:35.349150 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c32454-14f5-4175-a425-576baeedebbc None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:35.349436 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c32454-14f5-4175-a425-576baeedebbc None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:35.349717 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c32454-14f5-4175-a425-576baeedebbc None admin] PATH_INFO: `/v3/users/c408cf8653cd44348de851d3fa6f8d63` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:35.354921 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c32454-14f5-4175-a425-576baeedebbc None admin] RBAC: Authorizing `identity:get_user(user_id=c408cf8653cd44348de851d3fa6f8d63)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:35.356404 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c32454-14f5-4175-a425-576baeedebbc None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:35.358536 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 92/175] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:44:35 2022] GET /identity/v3/users/c408cf8653cd44348de851d3fa6f8d63 => generated 275 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:35.359318 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c32454-14f5-4175-a425-576baeedebbc None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:35.416356 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff6db5-e646-4603-8354-0961f7390bbd None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:35.454864 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45119d6-e33a-4c70-80b5-635597c935cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:35.456195 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45119d6-e33a-4c70-80b5-635597c935cf None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:35.456738 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45119d6-e33a-4c70-80b5-635597c935cf None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:35.457234 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45119d6-e33a-4c70-80b5-635597c935cf None admin] PATH_INFO: `/v3/users/c408cf8653cd44348de851d3fa6f8d63` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:35.458738 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45119d6-e33a-4c70-80b5-635597c935cf None admin] RBAC: Authorizing `identity:get_user(user_id=c408cf8653cd44348de851d3fa6f8d63)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:35.461838 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45119d6-e33a-4c70-80b5-635597c935cf None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:35.464488 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 84/176] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:44:35 2022] GET /identity/v3/users/c408cf8653cd44348de851d3fa6f8d63 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:35.465914 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45119d6-e33a-4c70-80b5-635597c935cf None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:35.521637 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c32454-14f5-4175-a425-576baeedebbc None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:35.537552 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:35.574111 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580edcc5-3b7d-4292-8430-7e690f9a4f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:35.576520 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580edcc5-3b7d-4292-8430-7e690f9a4f66 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:35.577057 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580edcc5-3b7d-4292-8430-7e690f9a4f66 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:35.577559 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580edcc5-3b7d-4292-8430-7e690f9a4f66 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:35.587613 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:35.594520 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580edcc5-3b7d-4292-8430-7e690f9a4f66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:44:35.605892 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-580edcc5-3b7d-4292-8430-7e690f9a4f66 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:44:35.605892 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:44:35.605892 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:44:35.605892 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:44:35.605892 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:44:35.605892 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:44:35.605892 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:44:35.605892 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:44:35.605892 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:44:35.605892 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:44:35.605892 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:44:35.605892 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:44:35.605892 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:44:35.605892 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:44:35.605892 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:44:35.605892 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:44:35.606952 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:44:35.606952 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:44:35.606952 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:44:35.606952 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:44:35.606952 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:44:35.606952 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:44:35.606952 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:44:35.606952 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:44:35.606952 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:44:35.606952 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:44:35.606952 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:44:35.606952 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:44:35.606952 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:44:35.606952 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:44:35.606952 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:44:35.606952 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:44:35.607851 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:44:35.607851 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:44:35.607851 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:44:35.607851 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:44:35.607851 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:44:35.607851 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:44:35.607851 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:44:35.607851 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:44:35.607851 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:44:35.607851 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:44:35.607851 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:44:35.607851 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:44:35.611240 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 93/177] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:44:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:44:35.612336 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580edcc5-3b7d-4292-8430-7e690f9a4f66 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:35.622349 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45119d6-e33a-4c70-80b5-635597c935cf None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:35.662693 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e0a7b-420d-471c-8d42-62e728ae786e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:35.663423 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e0a7b-420d-471c-8d42-62e728ae786e None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:35.663792 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e0a7b-420d-471c-8d42-62e728ae786e None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:35.664071 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e0a7b-420d-471c-8d42-62e728ae786e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:35.727552 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580edcc5-3b7d-4292-8430-7e690f9a4f66 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:35.741682 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894e0a7b-420d-471c-8d42-62e728ae786e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:35.743509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894e0a7b-420d-471c-8d42-62e728ae786e None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:35.766593 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38970b32-6872-418d-9958-74a24f443df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:35.767709 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38970b32-6872-418d-9958-74a24f443df2 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:35.768258 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38970b32-6872-418d-9958-74a24f443df2 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:35.768780 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38970b32-6872-418d-9958-74a24f443df2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:35.815198 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:35.832627 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:35.845496 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38970b32-6872-418d-9958-74a24f443df2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:35.847114 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38970b32-6872-418d-9958-74a24f443df2 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:35.865608 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 85/178] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:44:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:44:35.867131 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e0a7b-420d-471c-8d42-62e728ae786e None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:35.964740 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 94/179] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:44:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:44:35.965800 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38970b32-6872-418d-9958-74a24f443df2 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:35.998102 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e0a7b-420d-471c-8d42-62e728ae786e None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:36.038500 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1fa9ca-d86a-4c5f-ae63-0a69d198dbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:36.040022 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fa9ca-d86a-4c5f-ae63-0a69d198dbfb None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:36.040703 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fa9ca-d86a-4c5f-ae63-0a69d198dbfb None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:36.041473 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fa9ca-d86a-4c5f-ae63-0a69d198dbfb None admin] PATH_INFO: `/v3/roles` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:36.042122 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:36.043707 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1fa9ca-d86a-4c5f-ae63-0a69d198dbfb None admin] RBAC: Adding query filter params (name=admin) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:36.044241 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1fa9ca-d86a-4c5f-ae63-0a69d198dbfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:36.045838 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1fa9ca-d86a-4c5f-ae63-0a69d198dbfb None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:36.057209 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 86/180] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:44:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:36.058977 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89869457-7c87-4830-b890-fa78384f85cb None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:36.059488 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89869457-7c87-4830-b890-fa78384f85cb None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:36.060070 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89869457-7c87-4830-b890-fa78384f85cb None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:36.061714 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 87/181] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:36.066669 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89869457-7c87-4830-b890-fa78384f85cb None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:36.075724 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38970b32-6872-418d-9958-74a24f443df2 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:36.112813 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc8002a-baf9-4d28-8609-099cf492abc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:36.113105 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8002a-baf9-4d28-8609-099cf492abc3 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:36.113372 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8002a-baf9-4d28-8609-099cf492abc3 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:36.113656 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8002a-baf9-4d28-8609-099cf492abc3 None admin] PATH_INFO: `/v3/projects/e8b08a08b5d3403b9697254998dfb18f` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:36.114897 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc8002a-baf9-4d28-8609-099cf492abc3 None admin] RBAC: Authorizing `identity:get_project(project_id=e8b08a08b5d3403b9697254998dfb18f)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:36.116443 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc8002a-baf9-4d28-8609-099cf492abc3 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:36.119160 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 95/182] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:44:35 2022] GET /identity/v3/projects/e8b08a08b5d3403b9697254998dfb18f => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:36.119814 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc8002a-baf9-4d28-8609-099cf492abc3 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:36.121921 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:36.186654 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89869457-7c87-4830-b890-fa78384f85cb None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:36.223210 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ab2b8-c0a0-4d45-95fc-15a2c342af44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:36.224170 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ab2b8-c0a0-4d45-95fc-15a2c342af44 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:36.224558 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ab2b8-c0a0-4d45-95fc-15a2c342af44 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:36.224909 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ab2b8-c0a0-4d45-95fc-15a2c342af44 None admin] PATH_INFO: `/v3/projects/b189e5e641e04cd98d98a238e646371a` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:36.226108 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ab2b8-c0a0-4d45-95fc-15a2c342af44 None admin] RBAC: Authorizing `identity:get_project(project_id=b189e5e641e04cd98d98a238e646371a)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:36.228204 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ab2b8-c0a0-4d45-95fc-15a2c342af44 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:36.228332 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc8002a-baf9-4d28-8609-099cf492abc3 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:36.229963 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 88/183] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:44:36 2022] GET /identity/v3/projects/b189e5e641e04cd98d98a238e646371a => generated 312 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:36.235852 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb7e69-2008-45b4-a558-e736d44a90ab None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:36.236140 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb7e69-2008-45b4-a558-e736d44a90ab None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:36.236430 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb7e69-2008-45b4-a558-e736d44a90ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:36.267699 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f083427-7796-41e2-9f18-5ba9d5834ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:36.269241 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f083427-7796-41e2-9f18-5ba9d5834ad4 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:36.269615 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f083427-7796-41e2-9f18-5ba9d5834ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:36.269900 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f083427-7796-41e2-9f18-5ba9d5834ad4 None admin] PATH_INFO: `/v3/users/b55731353b0b4ad194b78a350ceef5cd` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:36.290705 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:36.293803 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f083427-7796-41e2-9f18-5ba9d5834ad4 None admin] RBAC: Authorizing `identity:get_user(user_id=b55731353b0b4ad194b78a350ceef5cd)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:36.295043 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-fabb7e69-2008-45b4-a558-e736d44a90ab None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:36.295336 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f083427-7796-41e2-9f18-5ba9d5834ad4 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:36.296246 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-fabb7e69-2008-45b4-a558-e736d44a90ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:36.302040 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 96/184] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:44:36 2022] GET /identity/v3/users/b55731353b0b4ad194b78a350ceef5cd => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:36.302040 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044249b-fe43-48a7-99a1-de0cddec4895 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:36.302040 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044249b-fe43-48a7-99a1-de0cddec4895 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:36.302040 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044249b-fe43-48a7-99a1-de0cddec4895 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:36.302040 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 97/185] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:36.302040 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044249b-fe43-48a7-99a1-de0cddec4895 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:36.374926 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 89/186] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:44:36.375808 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb7e69-2008-45b4-a558-e736d44a90ab None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:36.424672 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:36.427578 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044249b-fe43-48a7-99a1-de0cddec4895 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:36.468110 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78be5d2-7c03-476e-b9e2-d40a3b3a861b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:36.469647 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78be5d2-7c03-476e-b9e2-d40a3b3a861b None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:36.469967 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78be5d2-7c03-476e-b9e2-d40a3b3a861b None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:36.470532 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78be5d2-7c03-476e-b9e2-d40a3b3a861b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:36.471628 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78be5d2-7c03-476e-b9e2-d40a3b3a861b None admin] RBAC: Adding query filter params (role.id=9bd598b07a9942b7a91c3a372f3cf094, scope.project.id=e8b08a08b5d3403b9697254998dfb18f, user.id=c408cf8653cd44348de851d3fa6f8d63) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:36.472175 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78be5d2-7c03-476e-b9e2-d40a3b3a861b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:36.474013 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78be5d2-7c03-476e-b9e2-d40a3b3a861b None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:36.490161 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 98/187] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:44:36 2022] GET /identity/v3/role_assignments?user.id=c408cf8653cd44348de851d3fa6f8d63&scope.project.id=e8b08a08b5d3403b9697254998dfb18f&role.id=9bd598b07a9942b7a91c3a372f3cf094 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:36.490161 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78be5d2-7c03-476e-b9e2-d40a3b3a861b None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:36.490482 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb7e69-2008-45b4-a558-e736d44a90ab None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:36.532538 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ba74c-ab6e-4588-a07b-4fe716e98b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:36.533715 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ba74c-ab6e-4588-a07b-4fe716e98b20 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:36.534373 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ba74c-ab6e-4588-a07b-4fe716e98b20 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:36.534783 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ba74c-ab6e-4588-a07b-4fe716e98b20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:36.535965 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ba74c-ab6e-4588-a07b-4fe716e98b20 None admin] RBAC: Adding query filter params (role.id=41a9e10d8ca34fa892f53bf450f29554, scope.project.id=b189e5e641e04cd98d98a238e646371a, user.id=c408cf8653cd44348de851d3fa6f8d63) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:36.536723 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ba74c-ab6e-4588-a07b-4fe716e98b20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:36.538847 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ba74c-ab6e-4588-a07b-4fe716e98b20 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:36.560406 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 90/188] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:44:36 2022] GET /identity/v3/role_assignments?user.id=c408cf8653cd44348de851d3fa6f8d63&scope.project.id=b189e5e641e04cd98d98a238e646371a&role.id=41a9e10d8ca34fa892f53bf450f29554 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:36.561852 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1e8a1-37f2-40b1-9713-466dbb7294d7 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:36.562249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1e8a1-37f2-40b1-9713-466dbb7294d7 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:36.562609 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1e8a1-37f2-40b1-9713-466dbb7294d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:36.586447 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:36.597931 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-14c1e8a1-37f2-40b1-9713-466dbb7294d7 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:36.599468 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-14c1e8a1-37f2-40b1-9713-466dbb7294d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:36.671301 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78be5d2-7c03-476e-b9e2-d40a3b3a861b None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:36.718779 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 91/189] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:44:36.719973 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c1e8a1-37f2-40b1-9713-466dbb7294d7 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:36.738331 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f93be-70aa-4e09-80d2-a2e2bd55303c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:36.739617 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f93be-70aa-4e09-80d2-a2e2bd55303c None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:36.740095 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f93be-70aa-4e09-80d2-a2e2bd55303c None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:36.740534 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f93be-70aa-4e09-80d2-a2e2bd55303c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:36.776036 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:36.840715 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f93be-70aa-4e09-80d2-a2e2bd55303c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:36.842953 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f93be-70aa-4e09-80d2-a2e2bd55303c None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:36.861466 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c1e8a1-37f2-40b1-9713-466dbb7294d7 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:36.906549 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5736d9d-30c0-4b47-b4cb-f23610c48fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:36.907379 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5736d9d-30c0-4b47-b4cb-f23610c48fba None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:36.907879 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5736d9d-30c0-4b47-b4cb-f23610c48fba None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:36.908161 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5736d9d-30c0-4b47-b4cb-f23610c48fba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:36.919557 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:36.921189 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5736d9d-30c0-4b47-b4cb-f23610c48fba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:44:36.932412 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-d5736d9d-30c0-4b47-b4cb-f23610c48fba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:44:36.932412 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:44:36.932412 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:44:36.932412 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:44:36.932412 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:44:36.932412 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:44:36.932412 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:44:36.932412 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:44:36.932412 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:44:36.932412 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:44:36.932412 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:44:36.932412 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:44:36.932412 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:44:36.932412 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:44:36.932412 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:44:36.932412 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:44:36.933489 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:44:36.933489 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:44:36.933489 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:44:36.933489 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:44:36.933489 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:44:36.933489 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:44:36.933489 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:44:36.933489 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:44:36.933489 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:44:36.933489 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:44:36.933489 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:44:36.933489 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:44:36.933489 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:44:36.933489 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:44:36.933489 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:44:36.933489 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:44:36.934559 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:44:36.934559 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:44:36.934559 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:44:36.934559 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:44:36.934559 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:44:36.934559 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:44:36.934559 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:44:36.934559 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:44:36.934559 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:44:36.934559 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:44:36.934559 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:44:36.934559 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:44:36.937267 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 92/190] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:44:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:44:36.937267 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5736d9d-30c0-4b47-b4cb-f23610c48fba None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:36.967138 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 99/191] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:44:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:44:36.967843 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f93be-70aa-4e09-80d2-a2e2bd55303c None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:37.043502 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:37.052089 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5736d9d-30c0-4b47-b4cb-f23610c48fba None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:37.069007 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f93be-70aa-4e09-80d2-a2e2bd55303c None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:37.087679 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e6ad9-8d26-4853-819c-1d79a01aa477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:37.088484 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e6ad9-8d26-4853-819c-1d79a01aa477 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:37.088776 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e6ad9-8d26-4853-819c-1d79a01aa477 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:37.089061 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e6ad9-8d26-4853-819c-1d79a01aa477 None admin] PATH_INFO: `/v3/domains/default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:37.090305 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e6ad9-8d26-4853-819c-1d79a01aa477 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:37.091884 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e6ad9-8d26-4853-819c-1d79a01aa477 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:37.093437 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 93/192] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:44:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:37.094230 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e6ad9-8d26-4853-819c-1d79a01aa477 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:37.103773 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b4f5b9-497a-4b93-a154-15a1542cda65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:37.104459 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4f5b9-497a-4b93-a154-15a1542cda65 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:37.104751 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4f5b9-497a-4b93-a154-15a1542cda65 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:37.105033 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4f5b9-497a-4b93-a154-15a1542cda65 None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:37.105807 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b4f5b9-497a-4b93-a154-15a1542cda65 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:37.106122 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b4f5b9-497a-4b93-a154-15a1542cda65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:37.107558 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b4f5b9-497a-4b93-a154-15a1542cda65 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:37.115921 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 100/193] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:44:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:37.117496 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554f495-0614-432e-b447-12874d1c5d52 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:37.117802 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554f495-0614-432e-b447-12874d1c5d52 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:37.118091 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554f495-0614-432e-b447-12874d1c5d52 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:37.119393 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 101/194] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:37.120085 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554f495-0614-432e-b447-12874d1c5d52 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:37.145539 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:37.197760 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e6ad9-8d26-4853-819c-1d79a01aa477 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:37.222244 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554f495-0614-432e-b447-12874d1c5d52 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:37.233153 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f67952-de46-4df8-b43d-bf50627e4b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:37.234027 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f67952-de46-4df8-b43d-bf50627e4b64 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:37.234398 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f67952-de46-4df8-b43d-bf50627e4b64 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:37.234683 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f67952-de46-4df8-b43d-bf50627e4b64 None admin] PATH_INFO: `/v3/projects/b74bb643188f42a68dced2cedca8fb95` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:37.235898 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f67952-de46-4df8-b43d-bf50627e4b64 None admin] RBAC: Authorizing `identity:get_project(project_id=b74bb643188f42a68dced2cedca8fb95)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:37.237350 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f67952-de46-4df8-b43d-bf50627e4b64 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:37.239113 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 94/195] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:44:37 2022] GET /identity/v3/projects/b74bb643188f42a68dced2cedca8fb95 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:37.244324 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f67952-de46-4df8-b43d-bf50627e4b64 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:37.256920 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4ffb5-eb3e-47e6-a2c8-050eb1a32659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:37.262241 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4ffb5-eb3e-47e6-a2c8-050eb1a32659 None admin] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:37.262241 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4ffb5-eb3e-47e6-a2c8-050eb1a32659 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:37.262241 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4ffb5-eb3e-47e6-a2c8-050eb1a32659 None admin] PATH_INFO: `/v3/users` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:37.262241 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e4ffb5-eb3e-47e6-a2c8-050eb1a32659 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:37.262241 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e4ffb5-eb3e-47e6-a2c8-050eb1a32659 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:37.305180 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:37.375413 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f67952-de46-4df8-b43d-bf50627e4b64 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:37.378291 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 102/196] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:44:37 2022] POST /identity/v3/users => generated 297 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:44:37.379587 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5abee6-0cc5-4c05-9a99-0406f7b43b01 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:37.379876 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5abee6-0cc5-4c05-9a99-0406f7b43b01 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:37.380439 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5abee6-0cc5-4c05-9a99-0406f7b43b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:37.400616 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-3e5abee6-0cc5-4c05-9a99-0406f7b43b01 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:37.402026 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-3e5abee6-0cc5-4c05-9a99-0406f7b43b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:37.422269 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858a55b-a1e2-4d73-aa6f-04d6c52d1907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:37.423976 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858a55b-a1e2-4d73-aa6f-04d6c52d1907 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:37.424271 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858a55b-a1e2-4d73-aa6f-04d6c52d1907 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:37.424554 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858a55b-a1e2-4d73-aa6f-04d6c52d1907 None admin] PATH_INFO: `/v3/users/b55731353b0b4ad194b78a350ceef5cd` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:37.425940 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858a55b-a1e2-4d73-aa6f-04d6c52d1907 None admin] RBAC: Authorizing `identity:get_user(user_id=b55731353b0b4ad194b78a350ceef5cd)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:37.428103 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858a55b-a1e2-4d73-aa6f-04d6c52d1907 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:37.430848 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 95/197] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:44:37 2022] GET /identity/v3/users/b55731353b0b4ad194b78a350ceef5cd => generated 283 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:37.431527 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858a55b-a1e2-4d73-aa6f-04d6c52d1907 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:37.486471 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 103/198] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:44:37.487341 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5abee6-0cc5-4c05-9a99-0406f7b43b01 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:37.504849 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:37.556961 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:37.564638 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858a55b-a1e2-4d73-aa6f-04d6c52d1907 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:37.606351 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca24500a-8f99-4948-b64f-47a74ed984f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:37.607031 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24500a-8f99-4948-b64f-47a74ed984f0 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:37.607324 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24500a-8f99-4948-b64f-47a74ed984f0 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:37.607607 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24500a-8f99-4948-b64f-47a74ed984f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:37.608160 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5abee6-0cc5-4c05-9a99-0406f7b43b01 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:37.608465 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca24500a-8f99-4948-b64f-47a74ed984f0 None admin] RBAC: Adding query filter params (role.id=e1c574c9973548ebb0e8d9e0656ccabd, scope.project.id=b74bb643188f42a68dced2cedca8fb95, user.id=b55731353b0b4ad194b78a350ceef5cd) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:37.608785 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca24500a-8f99-4948-b64f-47a74ed984f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:37.610497 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca24500a-8f99-4948-b64f-47a74ed984f0 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:37.619872 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 96/199] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:44:37 2022] GET /identity/v3/role_assignments?user.id=b55731353b0b4ad194b78a350ceef5cd&scope.project.id=b74bb643188f42a68dced2cedca8fb95&role.id=e1c574c9973548ebb0e8d9e0656ccabd => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:37.622286 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca24500a-8f99-4948-b64f-47a74ed984f0 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:37.653151 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7d901-7c33-4688-b314-26ed911e822a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:37.654195 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7d901-7c33-4688-b314-26ed911e822a None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:37.654718 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7d901-7c33-4688-b314-26ed911e822a None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:37.655906 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7d901-7c33-4688-b314-26ed911e822a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:37.745957 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d7d901-7c33-4688-b314-26ed911e822a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:37.747414 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d7d901-7c33-4688-b314-26ed911e822a None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:37.761558 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:37.772537 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca24500a-8f99-4948-b64f-47a74ed984f0 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:37.830245 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8de031-a030-484e-8e37-6452518fc449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:37.831066 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8de031-a030-484e-8e37-6452518fc449 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:37.831357 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8de031-a030-484e-8e37-6452518fc449 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:37.831755 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8de031-a030-484e-8e37-6452518fc449 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:37.846492 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8de031-a030-484e-8e37-6452518fc449 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:44:37.855608 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-5b8de031-a030-484e-8e37-6452518fc449 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:44:37.855608 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:44:37.855608 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:44:37.855608 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:44:37.855608 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:44:37.855608 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:44:37.855608 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:44:37.855608 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:44:37.855608 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:44:37.855608 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:44:37.855608 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:44:37.855608 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:44:37.855608 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:44:37.855608 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:44:37.855608 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:44:37.855608 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:44:37.856639 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:44:37.856639 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:44:37.856639 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:44:37.856639 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:44:37.856639 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:44:37.856639 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:44:37.856639 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:44:37.856639 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:44:37.856639 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:44:37.856639 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:44:37.856639 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:44:37.856639 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:44:37.856639 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:44:37.856639 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:44:37.856639 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:44:37.856639 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:44:37.857552 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:44:37.857552 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:44:37.857552 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:44:37.857552 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:44:37.857552 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:44:37.857552 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:44:37.857552 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:44:37.857552 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:44:37.857552 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:44:37.857552 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:44:37.857552 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:44:37.857552 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:44:37.857552 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 97/200] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:44:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:44:37.862993 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8de031-a030-484e-8e37-6452518fc449 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:37.883695 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 104/201] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:44:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:44:37.888814 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7d901-7c33-4688-b314-26ed911e822a None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:37.892768 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:37.976286 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8de031-a030-484e-8e37-6452518fc449 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:38.034256 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd3908-410f-4f65-844a-0d26d7af5454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:38.035282 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd3908-410f-4f65-844a-0d26d7af5454 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:38.035797 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd3908-410f-4f65-844a-0d26d7af5454 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:38.036296 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd3908-410f-4f65-844a-0d26d7af5454 None admin] PATH_INFO: `/v3/roles` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:38.037270 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fd3908-410f-4f65-844a-0d26d7af5454 None admin] RBAC: Adding query filter params (name=reader) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:38.037805 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fd3908-410f-4f65-844a-0d26d7af5454 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:38.040152 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fd3908-410f-4f65-844a-0d26d7af5454 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:38.049862 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 98/202] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:44:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:38.058258 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd3908-410f-4f65-844a-0d26d7af5454 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:38.094977 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7d901-7c33-4688-b314-26ed911e822a None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:38.124072 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:38.186961 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3af542-7f19-414d-bcfc-9910c39a4a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:38.188182 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3af542-7f19-414d-bcfc-9910c39a4a64 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:38.188620 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3af542-7f19-414d-bcfc-9910c39a4a64 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:38.189049 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3af542-7f19-414d-bcfc-9910c39a4a64 None admin] PATH_INFO: `/v3/projects/b74bb643188f42a68dced2cedca8fb95` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:38.191942 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3af542-7f19-414d-bcfc-9910c39a4a64 None admin] RBAC: Authorizing `identity:get_project(project_id=b74bb643188f42a68dced2cedca8fb95)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:38.193903 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3af542-7f19-414d-bcfc-9910c39a4a64 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:38.196519 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 105/203] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:44:37 2022] GET /identity/v3/projects/b74bb643188f42a68dced2cedca8fb95 => generated 302 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:44:38.202624 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3af542-7f19-414d-bcfc-9910c39a4a64 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:38.203401 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:38.256464 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd3908-410f-4f65-844a-0d26d7af5454 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:38.324599 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3af542-7f19-414d-bcfc-9910c39a4a64 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:38.366094 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1146edd5-fa14-4c4a-8132-fa6c571c61fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:38.367264 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146edd5-fa14-4c4a-8132-fa6c571c61fd None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:38.367798 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146edd5-fa14-4c4a-8132-fa6c571c61fd None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:38.368237 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146edd5-fa14-4c4a-8132-fa6c571c61fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:38.369254 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1146edd5-fa14-4c4a-8132-fa6c571c61fd None admin] RBAC: Adding query filter params (role.id=9bd598b07a9942b7a91c3a372f3cf094, scope.project.id=b74bb643188f42a68dced2cedca8fb95, user.id=b55731353b0b4ad194b78a350ceef5cd) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:38.369729 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1146edd5-fa14-4c4a-8132-fa6c571c61fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:38.371472 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1146edd5-fa14-4c4a-8132-fa6c571c61fd None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:38.378219 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 106/204] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:44:38 2022] GET /identity/v3/role_assignments?user.id=b55731353b0b4ad194b78a350ceef5cd&scope.project.id=b74bb643188f42a68dced2cedca8fb95&role.id=9bd598b07a9942b7a91c3a372f3cf094 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:38.383149 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c92eda6-6202-4a06-ad06-287efd67abca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:38.390313 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92eda6-6202-4a06-ad06-287efd67abca None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:38.390313 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92eda6-6202-4a06-ad06-287efd67abca None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:38.390313 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92eda6-6202-4a06-ad06-287efd67abca None admin] PATH_INFO: `/v3/users/b7fb68849e434f6e9714946fc10ec3ec` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:38.391663 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c92eda6-6202-4a06-ad06-287efd67abca None admin] RBAC: Authorizing `identity:get_user(user_id=b7fb68849e434f6e9714946fc10ec3ec)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:38.393354 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c92eda6-6202-4a06-ad06-287efd67abca None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:38.395663 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 99/205] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:44:38 2022] GET /identity/v3/users/b7fb68849e434f6e9714946fc10ec3ec => generated 289 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:44:38.402083 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1146edd5-fa14-4c4a-8132-fa6c571c61fd None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:38.482309 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:38.573849 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1146edd5-fa14-4c4a-8132-fa6c571c61fd None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:38.612458 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f700182f-fc8e-4479-a486-d75fc3e7104a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:38.613370 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700182f-fc8e-4479-a486-d75fc3e7104a None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:38.613838 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700182f-fc8e-4479-a486-d75fc3e7104a None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:38.614317 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700182f-fc8e-4479-a486-d75fc3e7104a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:38.709463 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f700182f-fc8e-4479-a486-d75fc3e7104a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:38.712036 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f700182f-fc8e-4479-a486-d75fc3e7104a None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:38.767048 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:38.843352 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 107/206] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:44:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:44:38.849007 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c92eda6-6202-4a06-ad06-287efd67abca None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:39.002806 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c92eda6-6202-4a06-ad06-287efd67abca None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:39.058946 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0480e-7906-4dfb-bf17-c9ed8b665f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:39.059860 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0480e-7906-4dfb-bf17-c9ed8b665f67 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:39.060151 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0480e-7906-4dfb-bf17-c9ed8b665f67 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:39.060437 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0480e-7906-4dfb-bf17-c9ed8b665f67 None admin] PATH_INFO: `/v3/projects/e8b08a08b5d3403b9697254998dfb18f` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:39.061719 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e0480e-7906-4dfb-bf17-c9ed8b665f67 None admin] RBAC: Authorizing `identity:get_project(project_id=e8b08a08b5d3403b9697254998dfb18f)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:39.063237 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e0480e-7906-4dfb-bf17-c9ed8b665f67 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:39.065292 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 100/207] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:44:38 2022] GET /identity/v3/projects/e8b08a08b5d3403b9697254998dfb18f => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:39.071371 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f700182f-fc8e-4479-a486-d75fc3e7104a None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:39.212482 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f700182f-fc8e-4479-a486-d75fc3e7104a None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:39.265335 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f0178-d91c-4dbe-a941-ab4d8297c577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:39.265933 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f0178-d91c-4dbe-a941-ab4d8297c577 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:39.266245 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f0178-d91c-4dbe-a941-ab4d8297c577 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:39.266529 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f0178-d91c-4dbe-a941-ab4d8297c577 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:39.267383 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6f0178-d91c-4dbe-a941-ab4d8297c577 None admin] RBAC: Adding query filter params (role.id=b4cc928f3fd4418b988335683cdad5f3, scope.project.id=e8b08a08b5d3403b9697254998dfb18f, user.id=b7fb68849e434f6e9714946fc10ec3ec) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:39.267699 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6f0178-d91c-4dbe-a941-ab4d8297c577 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:39.269165 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6f0178-d91c-4dbe-a941-ab4d8297c577 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:39.278971 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 108/208] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:44:39 2022] GET /identity/v3/role_assignments?user.id=b7fb68849e434f6e9714946fc10ec3ec&scope.project.id=e8b08a08b5d3403b9697254998dfb18f&role.id=b4cc928f3fd4418b988335683cdad5f3 => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:44:39.990586 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0543329-2cad-4d43-a76a-16f225b047a8 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:39.991124 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0543329-2cad-4d43-a76a-16f225b047a8 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:39.991124 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0543329-2cad-4d43-a76a-16f225b047a8 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:39.993073 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 101/209] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:39.998377 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9b235-cd0f-4de1-92ca-36ca43791d9b None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:39.998807 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9b235-cd0f-4de1-92ca-36ca43791d9b None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:39.998986 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9b235-cd0f-4de1-92ca-36ca43791d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:40.010354 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:40.016425 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-75a9b235-cd0f-4de1-92ca-36ca43791d9b None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:40.017672 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-75a9b235-cd0f-4de1-92ca-36ca43791d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:40.031036 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6760903-ebd2-4f76-9361-919f3eba8137 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:40.031628 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6760903-ebd2-4f76-9361-919f3eba8137 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:40.032114 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6760903-ebd2-4f76-9361-919f3eba8137 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:40.033900 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 102/210] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:40.038679 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54220d-63a4-4fda-8935-5e57195cdbd5 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:40.039695 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54220d-63a4-4fda-8935-5e57195cdbd5 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:40.040152 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54220d-63a4-4fda-8935-5e57195cdbd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:40.064020 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-3e54220d-63a4-4fda-8935-5e57195cdbd5 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:40.065851 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-3e54220d-63a4-4fda-8935-5e57195cdbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:40.086831 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:40.093174 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 109/211] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:44:40.118001 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a9b235-cd0f-4de1-92ca-36ca43791d9b None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:40.157893 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 103/212] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:44:40.182179 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54220d-63a4-4fda-8935-5e57195cdbd5 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:40.233134 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a9b235-cd0f-4de1-92ca-36ca43791d9b None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:40.270368 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef1201-7ad4-46c1-a384-effce6115ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:40.271175 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef1201-7ad4-46c1-a384-effce6115ee9 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:40.271461 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef1201-7ad4-46c1-a384-effce6115ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:40.271741 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef1201-7ad4-46c1-a384-effce6115ee9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:40.278214 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:40.292046 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ef1201-7ad4-46c1-a384-effce6115ee9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:44:40.306226 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-72ef1201-7ad4-46c1-a384-effce6115ee9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:44:40.306226 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:44:40.306226 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:44:40.306226 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:44:40.306226 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:44:40.306226 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:44:40.306226 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:44:40.306226 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:44:40.306226 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:44:40.306226 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:44:40.306226 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:44:40.306226 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:44:40.306226 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:44:40.306226 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:44:40.306226 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:44:40.306226 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:44:40.307231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:44:40.307231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:44:40.307231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:44:40.307231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:44:40.307231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:44:40.307231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:44:40.307231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:44:40.307231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:44:40.307231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:44:40.307231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:44:40.307231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:44:40.307231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:44:40.307231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:44:40.307231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:44:40.307231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:44:40.307231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:44:40.308128 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:44:40.308128 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:44:40.308128 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:44:40.308128 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:44:40.308128 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:44:40.308128 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:44:40.308128 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:44:40.308128 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:44:40.308128 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:44:40.308128 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:44:40.308128 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:44:40.308128 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:44:40.312882 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 110/213] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:44:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:44:40.313004 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54220d-63a4-4fda-8935-5e57195cdbd5 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:40.314244 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9efc77-009a-40eb-ae6d-8ad43479efe3 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:40.314553 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9efc77-009a-40eb-ae6d-8ad43479efe3 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:40.314819 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9efc77-009a-40eb-ae6d-8ad43479efe3 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:40.316292 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 111/214] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:40.321587 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9efc77-009a-40eb-ae6d-8ad43479efe3 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:40.351179 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930c39c-dc6e-450a-8f79-6d6de10e5104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:40.352206 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930c39c-dc6e-450a-8f79-6d6de10e5104 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:40.352751 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930c39c-dc6e-450a-8f79-6d6de10e5104 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:40.353028 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930c39c-dc6e-450a-8f79-6d6de10e5104 None admin] PATH_INFO: `/v3/domains/default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:40.354303 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2930c39c-dc6e-450a-8f79-6d6de10e5104 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:40.355986 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2930c39c-dc6e-450a-8f79-6d6de10e5104 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:40.357895 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 104/215] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:44:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:44:40.358867 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52b1b7-de93-4ac0-89ef-9cd199ab8b9e None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:40.359161 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52b1b7-de93-4ac0-89ef-9cd199ab8b9e None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:40.359438 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52b1b7-de93-4ac0-89ef-9cd199ab8b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:40.378606 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-0f52b1b7-de93-4ac0-89ef-9cd199ab8b9e None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:40.379788 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-0f52b1b7-de93-4ac0-89ef-9cd199ab8b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:40.391239 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:40.443347 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9efc77-009a-40eb-ae6d-8ad43479efe3 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:40.451792 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 105/216] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:44:40.453045 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f52b1b7-de93-4ac0-89ef-9cd199ab8b9e None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:40.480910 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f53018-5489-4737-8d9b-c73b158f8f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:40.481924 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f53018-5489-4737-8d9b-c73b158f8f32 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:40.482258 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f53018-5489-4737-8d9b-c73b158f8f32 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:40.482545 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f53018-5489-4737-8d9b-c73b158f8f32 None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:40.483316 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f53018-5489-4737-8d9b-c73b158f8f32 None admin] RBAC: Adding query filter params (name=member) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:40.483627 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f53018-5489-4737-8d9b-c73b158f8f32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:40.485035 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f53018-5489-4737-8d9b-c73b158f8f32 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:40.494797 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 112/217] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:44:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:40.495472 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f53018-5489-4737-8d9b-c73b158f8f32 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:40.561834 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:40.578900 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f52b1b7-de93-4ac0-89ef-9cd199ab8b9e None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:40.608170 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f53018-5489-4737-8d9b-c73b158f8f32 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:40.619368 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d139b5-c305-4a30-93cc-6e8557bc819d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:40.620054 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d139b5-c305-4a30-93cc-6e8557bc819d None admin] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:40.620341 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d139b5-c305-4a30-93cc-6e8557bc819d None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:40.620620 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d139b5-c305-4a30-93cc-6e8557bc819d None admin] PATH_INFO: `/v3/users` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:40.621351 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d139b5-c305-4a30-93cc-6e8557bc819d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:40.622846 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d139b5-c305-4a30-93cc-6e8557bc819d None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:40.645689 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31571e0-a07b-4d48-a69c-a41912c7d5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:40.648961 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31571e0-a07b-4d48-a69c-a41912c7d5f2 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:40.648961 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31571e0-a07b-4d48-a69c-a41912c7d5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:40.648961 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31571e0-a07b-4d48-a69c-a41912c7d5f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:40.657435 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31571e0-a07b-4d48-a69c-a41912c7d5f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:44:40.665203 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-f31571e0-a07b-4d48-a69c-a41912c7d5f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:44:40.665203 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:44:40.665203 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:44:40.665203 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:44:40.665203 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:44:40.665203 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:44:40.665203 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:44:40.665203 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:44:40.665203 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:44:40.665203 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:44:40.665203 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:44:40.665203 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:44:40.665203 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:44:40.665203 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:44:40.665203 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:44:40.665203 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:44:40.666340 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:44:40.666340 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:44:40.666340 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:44:40.666340 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:44:40.666340 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:44:40.666340 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:44:40.666340 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:44:40.666340 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:44:40.666340 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:44:40.666340 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:44:40.666340 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:44:40.666340 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:44:40.666340 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:44:40.666340 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:44:40.666340 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:44:40.666340 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:44:40.667231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:44:40.667231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:44:40.667231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:44:40.667231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:44:40.667231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:44:40.667231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:44:40.667231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:44:40.667231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:44:40.667231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:44:40.667231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:44:40.667231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:44:40.667231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:44:40.667231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 113/218] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:44:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:44:40.667231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31571e0-a07b-4d48-a69c-a41912c7d5f2 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:40.705385 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 106/219] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:44:40 2022] POST /identity/v3/users => generated 297 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:44:40.706255 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d139b5-c305-4a30-93cc-6e8557bc819d None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:40.709502 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:40.791500 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31571e0-a07b-4d48-a69c-a41912c7d5f2 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:40.811178 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:40.829238 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71122d95-1bce-46ad-8216-8f019b33f947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:40.830166 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71122d95-1bce-46ad-8216-8f019b33f947 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:40.830461 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71122d95-1bce-46ad-8216-8f019b33f947 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:40.830739 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71122d95-1bce-46ad-8216-8f019b33f947 None admin] PATH_INFO: `/v3/users/2cabc64aaedd44038857e90f895366b4` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:40.840318 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d139b5-c305-4a30-93cc-6e8557bc819d None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:40.846944 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71122d95-1bce-46ad-8216-8f019b33f947 None admin] RBAC: Authorizing `identity:get_user(user_id=2cabc64aaedd44038857e90f895366b4)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:40.848582 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71122d95-1bce-46ad-8216-8f019b33f947 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:40.855770 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 114/220] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:44:40 2022] GET /identity/v3/users/2cabc64aaedd44038857e90f895366b4 => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:40.857274 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8dde8f-651d-418b-9006-9edd9302d8f1 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:40.857577 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8dde8f-651d-418b-9006-9edd9302d8f1 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:40.857870 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8dde8f-651d-418b-9006-9edd9302d8f1 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:40.859290 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 115/221] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:40.860004 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8dde8f-651d-418b-9006-9edd9302d8f1 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:40.887497 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec16e2-196c-4619-8d80-8dceaf02e514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:40.888189 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec16e2-196c-4619-8d80-8dceaf02e514 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:40.888482 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec16e2-196c-4619-8d80-8dceaf02e514 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:40.888765 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec16e2-196c-4619-8d80-8dceaf02e514 None admin] PATH_INFO: `/v3/roles` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:40.889539 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ec16e2-196c-4619-8d80-8dceaf02e514 None admin] RBAC: Adding query filter params (name=admin) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:40.889858 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ec16e2-196c-4619-8d80-8dceaf02e514 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:40.891298 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ec16e2-196c-4619-8d80-8dceaf02e514 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:40.900242 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 107/222] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:44:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:40.901618 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c3ed9-3abb-413e-8d46-033acd7ae5e1 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:40.901927 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c3ed9-3abb-413e-8d46-033acd7ae5e1 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:40.902236 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c3ed9-3abb-413e-8d46-033acd7ae5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:40.920232 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-d45c3ed9-3abb-413e-8d46-033acd7ae5e1 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:40.921297 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-d45c3ed9-3abb-413e-8d46-033acd7ae5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:40.995946 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8dde8f-651d-418b-9006-9edd9302d8f1 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:40.997808 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:41.007409 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 108/223] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:44:41.009017 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c3ed9-3abb-413e-8d46-033acd7ae5e1 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:41.037661 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c85eab-ef39-4a82-a705-650f45c454ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:41.038377 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c85eab-ef39-4a82-a705-650f45c454ac None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:41.038668 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c85eab-ef39-4a82-a705-650f45c454ac None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:41.039001 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c85eab-ef39-4a82-a705-650f45c454ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:41.099593 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:41.124539 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c85eab-ef39-4a82-a705-650f45c454ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:41.127299 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c85eab-ef39-4a82-a705-650f45c454ac None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:41.140502 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c3ed9-3abb-413e-8d46-033acd7ae5e1 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:41.190291 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea00e1-f817-4238-9616-da030795c6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:41.191440 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea00e1-f817-4238-9616-da030795c6f5 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:41.191728 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea00e1-f817-4238-9616-da030795c6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:41.192259 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea00e1-f817-4238-9616-da030795c6f5 None admin] PATH_INFO: `/v3/users/b55731353b0b4ad194b78a350ceef5cd` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:41.194160 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea00e1-f817-4238-9616-da030795c6f5 None admin] RBAC: Authorizing `identity:get_user(user_id=b55731353b0b4ad194b78a350ceef5cd)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:41.196269 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea00e1-f817-4238-9616-da030795c6f5 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:41.198472 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 109/224] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:44:41 2022] GET /identity/v3/users/b55731353b0b4ad194b78a350ceef5cd => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:41.199299 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea00e1-f817-4238-9616-da030795c6f5 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:41.251784 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 116/225] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:44:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:44:41.252839 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c85eab-ef39-4a82-a705-650f45c454ac None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:41.286354 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:41.339579 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea00e1-f817-4238-9616-da030795c6f5 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:41.340495 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:41.369794 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c85eab-ef39-4a82-a705-650f45c454ac None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:41.382441 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f51b4ae-f601-46ca-baa6-02d2955ea021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:41.383495 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51b4ae-f601-46ca-baa6-02d2955ea021 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:41.383786 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51b4ae-f601-46ca-baa6-02d2955ea021 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:41.384066 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51b4ae-f601-46ca-baa6-02d2955ea021 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:41.395274 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f51b4ae-f601-46ca-baa6-02d2955ea021 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:44:41.404125 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-7f51b4ae-f601-46ca-baa6-02d2955ea021 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:44:41.404125 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:44:41.404125 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:44:41.404125 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:44:41.404125 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:44:41.404125 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:44:41.404125 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:44:41.404125 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:44:41.404125 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:44:41.404125 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:44:41.404125 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:44:41.404125 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:44:41.404125 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:44:41.404125 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:44:41.404125 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:44:41.404125 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:44:41.405224 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:44:41.405224 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:44:41.405224 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:44:41.405224 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:44:41.405224 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:44:41.405224 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:44:41.405224 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:44:41.405224 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:44:41.405224 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:44:41.405224 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:44:41.405224 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:44:41.405224 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:44:41.405224 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:44:41.405224 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:44:41.405224 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:44:41.405224 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:44:41.406115 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:44:41.406115 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:44:41.406115 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:44:41.406115 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:44:41.406115 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:44:41.406115 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:44:41.406115 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:44:41.406115 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:44:41.406115 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:44:41.406115 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:44:41.406115 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:44:41.406115 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:44:41.406115 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 110/226] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:44:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:44:41.406115 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f51b4ae-f601-46ca-baa6-02d2955ea021 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:41.412959 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db6b42-6c1a-4fa0-8340-ec63dcb06aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:41.414118 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db6b42-6c1a-4fa0-8340-ec63dcb06aa6 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:41.414495 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db6b42-6c1a-4fa0-8340-ec63dcb06aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:41.414907 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db6b42-6c1a-4fa0-8340-ec63dcb06aa6 None admin] PATH_INFO: `/v3/projects/b74bb643188f42a68dced2cedca8fb95` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:41.416856 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db6b42-6c1a-4fa0-8340-ec63dcb06aa6 None admin] RBAC: Authorizing `identity:get_project(project_id=b74bb643188f42a68dced2cedca8fb95)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:41.418887 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db6b42-6c1a-4fa0-8340-ec63dcb06aa6 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:41.421687 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 117/227] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:44:41 2022] GET /identity/v3/projects/b74bb643188f42a68dced2cedca8fb95 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:41.422604 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db6b42-6c1a-4fa0-8340-ec63dcb06aa6 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:41.527445 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f51b4ae-f601-46ca-baa6-02d2955ea021 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:41.555939 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:41.567508 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db6b42-6c1a-4fa0-8340-ec63dcb06aa6 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:41.568982 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39a7e1-a66c-4c32-8e9f-2adcc3549213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:41.570758 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39a7e1-a66c-4c32-8e9f-2adcc3549213 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:41.571386 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39a7e1-a66c-4c32-8e9f-2adcc3549213 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:41.571894 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39a7e1-a66c-4c32-8e9f-2adcc3549213 None admin] PATH_INFO: `/v3/projects/b74bb643188f42a68dced2cedca8fb95` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:41.573485 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a39a7e1-a66c-4c32-8e9f-2adcc3549213 None admin] RBAC: Authorizing `identity:get_project(project_id=b74bb643188f42a68dced2cedca8fb95)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:41.575194 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a39a7e1-a66c-4c32-8e9f-2adcc3549213 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:41.577226 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 111/228] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:44:41 2022] GET /identity/v3/projects/b74bb643188f42a68dced2cedca8fb95 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:41.578322 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39a7e1-a66c-4c32-8e9f-2adcc3549213 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:41.608911 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541320da-7475-4b7b-99dd-8901cf9a614f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:41.609646 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541320da-7475-4b7b-99dd-8901cf9a614f None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:41.609939 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541320da-7475-4b7b-99dd-8901cf9a614f None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:41.610254 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541320da-7475-4b7b-99dd-8901cf9a614f None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:41.611142 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541320da-7475-4b7b-99dd-8901cf9a614f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:41.611442 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541320da-7475-4b7b-99dd-8901cf9a614f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:41.612850 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541320da-7475-4b7b-99dd-8901cf9a614f None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:41.623529 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 118/229] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:44:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:41.624379 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541320da-7475-4b7b-99dd-8901cf9a614f None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:41.634680 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:41.692076 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39a7e1-a66c-4c32-8e9f-2adcc3549213 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:41.730612 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ecc9ae-de7a-48e8-ad48-0ffc7d730b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:41.731976 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecc9ae-de7a-48e8-ad48-0ffc7d730b9d None admin] REQUEST_METHOD: `PUT` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:41.732477 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecc9ae-de7a-48e8-ad48-0ffc7d730b9d None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:41.732973 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecc9ae-de7a-48e8-ad48-0ffc7d730b9d None admin] PATH_INFO: `/v3/projects/b74bb643188f42a68dced2cedca8fb95/users/b55731353b0b4ad194b78a350ceef5cd/roles/e1c574c9973548ebb0e8d9e0656ccabd` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:41.735374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ecc9ae-de7a-48e8-ad48-0ffc7d730b9d None admin] RBAC: Authorizing `identity:create_grant(project_id=b74bb643188f42a68dced2cedca8fb95, user_id=b55731353b0b4ad194b78a350ceef5cd, role_id=e1c574c9973548ebb0e8d9e0656ccabd)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:41.736892 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541320da-7475-4b7b-99dd-8901cf9a614f None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:41.737315 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ecc9ae-de7a-48e8-ad48-0ffc7d730b9d None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:41.772780 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23625f3-a4ff-4981-9f59-791e80543265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:41.773475 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23625f3-a4ff-4981-9f59-791e80543265 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:41.773765 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23625f3-a4ff-4981-9f59-791e80543265 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:41.774051 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23625f3-a4ff-4981-9f59-791e80543265 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:41.774946 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23625f3-a4ff-4981-9f59-791e80543265 None admin] RBAC: Adding query filter params (role.id=41a9e10d8ca34fa892f53bf450f29554, scope.project.id=b74bb643188f42a68dced2cedca8fb95, user.id=2cabc64aaedd44038857e90f895366b4) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:41.775266 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23625f3-a4ff-4981-9f59-791e80543265 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:41.776849 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23625f3-a4ff-4981-9f59-791e80543265 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:41.782893 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 119/230] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:44:41 2022] GET /identity/v3/role_assignments?user.id=2cabc64aaedd44038857e90f895366b4&scope.project.id=b74bb643188f42a68dced2cedca8fb95&role.id=41a9e10d8ca34fa892f53bf450f29554 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:41.783475 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23625f3-a4ff-4981-9f59-791e80543265 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:41.822647 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 112/231] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:44:41 2022] PUT /identity/v3/projects/b74bb643188f42a68dced2cedca8fb95/users/b55731353b0b4ad194b78a350ceef5cd/roles/e1c574c9973548ebb0e8d9e0656ccabd => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:44:41.874888 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:41.914671 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23625f3-a4ff-4981-9f59-791e80543265 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:41.956065 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f113b81-8c9d-40d4-8f19-b7eb20b5ed42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:41.956992 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f113b81-8c9d-40d4-8f19-b7eb20b5ed42 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:41.957287 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f113b81-8c9d-40d4-8f19-b7eb20b5ed42 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:41.957576 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f113b81-8c9d-40d4-8f19-b7eb20b5ed42 None admin] PATH_INFO: `/v3/users/b55731353b0b4ad194b78a350ceef5cd` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:41.958951 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f113b81-8c9d-40d4-8f19-b7eb20b5ed42 None admin] RBAC: Authorizing `identity:get_user(user_id=b55731353b0b4ad194b78a350ceef5cd)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:41.960537 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f113b81-8c9d-40d4-8f19-b7eb20b5ed42 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:41.963112 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 120/232] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:44:41 2022] GET /identity/v3/users/b55731353b0b4ad194b78a350ceef5cd => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:41.968767 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ecc9ae-de7a-48e8-ad48-0ffc7d730b9d None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:42.035492 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:42.115862 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ecc9ae-de7a-48e8-ad48-0ffc7d730b9d None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:42.157066 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4317f8-f1dd-4429-b447-9f5aa06c2323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:42.157871 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4317f8-f1dd-4429-b447-9f5aa06c2323 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:42.158196 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4317f8-f1dd-4429-b447-9f5aa06c2323 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:42.158486 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4317f8-f1dd-4429-b447-9f5aa06c2323 None admin] PATH_INFO: `/v3/projects/b74bb643188f42a68dced2cedca8fb95` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:42.161512 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4317f8-f1dd-4429-b447-9f5aa06c2323 None admin] RBAC: Authorizing `identity:get_project(project_id=b74bb643188f42a68dced2cedca8fb95)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:42.163036 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4317f8-f1dd-4429-b447-9f5aa06c2323 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:42.164883 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 113/233] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:44:41 2022] GET /identity/v3/projects/b74bb643188f42a68dced2cedca8fb95 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:42.170687 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f113b81-8c9d-40d4-8f19-b7eb20b5ed42 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:42.297371 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f113b81-8c9d-40d4-8f19-b7eb20b5ed42 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:42.344395 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbfb3a8-e5a9-4654-8c12-4636960b7f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:42.345309 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbfb3a8-e5a9-4654-8c12-4636960b7f0a None admin] REQUEST_METHOD: `PUT` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:42.345654 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbfb3a8-e5a9-4654-8c12-4636960b7f0a None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:42.345949 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbfb3a8-e5a9-4654-8c12-4636960b7f0a None admin] PATH_INFO: `/v3/projects/b74bb643188f42a68dced2cedca8fb95/users/b55731353b0b4ad194b78a350ceef5cd/roles/9bd598b07a9942b7a91c3a372f3cf094` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:42.352195 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbfb3a8-e5a9-4654-8c12-4636960b7f0a None admin] RBAC: Authorizing `identity:create_grant(project_id=b74bb643188f42a68dced2cedca8fb95, user_id=b55731353b0b4ad194b78a350ceef5cd, role_id=9bd598b07a9942b7a91c3a372f3cf094)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:42.353940 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbfb3a8-e5a9-4654-8c12-4636960b7f0a None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:42.450551 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:42.456042 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 121/234] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:44:42 2022] PUT /identity/v3/projects/b74bb643188f42a68dced2cedca8fb95/users/b55731353b0b4ad194b78a350ceef5cd/roles/9bd598b07a9942b7a91c3a372f3cf094 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:44:43.144769 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1093501-bf3f-4c0c-896b-a860ed4e960c None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:43.145325 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1093501-bf3f-4c0c-896b-a860ed4e960c None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:43.145325 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1093501-bf3f-4c0c-896b-a860ed4e960c None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:43.146746 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 114/235] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:43.152148 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d393ab9-e2fb-4454-91a2-59aee1e280f5 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:43.152449 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d393ab9-e2fb-4454-91a2-59aee1e280f5 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:43.152735 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d393ab9-e2fb-4454-91a2-59aee1e280f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:43.177076 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-0d393ab9-e2fb-4454-91a2-59aee1e280f5 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:43.178312 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-0d393ab9-e2fb-4454-91a2-59aee1e280f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:43.206366 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd980e31-6d99-4b6e-85d6-d379db6dce5b None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:43.206698 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd980e31-6d99-4b6e-85d6-d379db6dce5b None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:43.206953 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd980e31-6d99-4b6e-85d6-d379db6dce5b None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:43.208751 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 115/236] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:43.216080 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2d3e2-0784-46fc-ae2f-441f3dca34c7 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:43.216374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2d3e2-0784-46fc-ae2f-441f3dca34c7 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:43.217146 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2d3e2-0784-46fc-ae2f-441f3dca34c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:43.244832 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-bfe2d3e2-0784-46fc-ae2f-441f3dca34c7 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:43.246792 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-bfe2d3e2-0784-46fc-ae2f-441f3dca34c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:43.282194 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 122/237] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:44:43.310587 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d393ab9-e2fb-4454-91a2-59aee1e280f5 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:43.401818 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 116/238] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:44:43.427547 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2d3e2-0784-46fc-ae2f-441f3dca34c7 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:43.480960 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d393ab9-e2fb-4454-91a2-59aee1e280f5 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:43.486360 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:43.546677 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2d3e2-0784-46fc-ae2f-441f3dca34c7 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:43.558483 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:43.588904 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99647af-05cf-4fd0-9431-74e73dc8b408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:43.589867 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99647af-05cf-4fd0-9431-74e73dc8b408 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:43.590285 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99647af-05cf-4fd0-9431-74e73dc8b408 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:43.590821 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99647af-05cf-4fd0-9431-74e73dc8b408 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:43.595415 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c685d-fa44-42a6-a1ee-8f27bfe84e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:43.596246 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c685d-fa44-42a6-a1ee-8f27bfe84e7d None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:43.596544 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c685d-fa44-42a6-a1ee-8f27bfe84e7d None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:43.596901 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c685d-fa44-42a6-a1ee-8f27bfe84e7d None admin] PATH_INFO: `/v3/domains/default` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:43.598047 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c685d-fa44-42a6-a1ee-8f27bfe84e7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:43.599563 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c685d-fa44-42a6-a1ee-8f27bfe84e7d None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:43.601260 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 123/239] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:44:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:43.602981 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99647af-05cf-4fd0-9431-74e73dc8b408 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:44:43.610487 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c685d-fa44-42a6-a1ee-8f27bfe84e7d None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:43.615550 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-b99647af-05cf-4fd0-9431-74e73dc8b408 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:44:43.615550 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:44:43.615550 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:44:43.615550 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:44:43.615550 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:44:43.615550 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:44:43.615550 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:44:43.615550 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:44:43.615550 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:44:43.615550 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:44:43.615550 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:44:43.615550 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:44:43.615550 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:44:43.615550 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:44:43.615550 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:44:43.615550 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:44:43.616731 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:44:43.616731 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:44:43.616731 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:44:43.616731 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:44:43.616731 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:44:43.616731 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:44:43.616731 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:44:43.616731 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:44:43.616731 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:44:43.616731 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:44:43.616731 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:44:43.616731 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:44:43.616731 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:44:43.616731 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:44:43.616731 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:44:43.616731 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:44:43.617907 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:44:43.617907 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:44:43.617907 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:44:43.617907 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:44:43.617907 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:44:43.617907 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:44:43.617907 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:44:43.617907 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:44:43.617907 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:44:43.617907 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:44:43.617907 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:44:43.617907 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:44:43.619064 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 117/240] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:44:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:44:43.625172 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99647af-05cf-4fd0-9431-74e73dc8b408 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:43.736031 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99647af-05cf-4fd0-9431-74e73dc8b408 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:43.748389 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:43.774769 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9cad01-0940-4d3a-b5cb-fb7601726e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:43.775677 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9cad01-0940-4d3a-b5cb-fb7601726e7e None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:43.776202 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9cad01-0940-4d3a-b5cb-fb7601726e7e None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:43.776561 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9cad01-0940-4d3a-b5cb-fb7601726e7e None admin] PATH_INFO: `/v3/roles` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:43.777399 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9cad01-0940-4d3a-b5cb-fb7601726e7e None admin] RBAC: Adding query filter params (name=reader) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:43.777800 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9cad01-0940-4d3a-b5cb-fb7601726e7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:43.779793 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9cad01-0940-4d3a-b5cb-fb7601726e7e None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:43.789728 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 118/241] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:44:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:44:43.795350 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9cad01-0940-4d3a-b5cb-fb7601726e7e None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:43.906499 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9cad01-0940-4d3a-b5cb-fb7601726e7e None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:43.950766 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc64283-5059-4438-a083-ca1f9f5af3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:43.951656 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc64283-5059-4438-a083-ca1f9f5af3a1 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:43.951939 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc64283-5059-4438-a083-ca1f9f5af3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:43.952217 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc64283-5059-4438-a083-ca1f9f5af3a1 None admin] PATH_INFO: `/v3/users/d8db9261080c45b7a24af1ecbd8e34d8` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:43.971833 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c685d-fa44-42a6-a1ee-8f27bfe84e7d None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:43.989595 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc64283-5059-4438-a083-ca1f9f5af3a1 None admin] RBAC: Authorizing `identity:get_user(user_id=d8db9261080c45b7a24af1ecbd8e34d8)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:43.991031 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc64283-5059-4438-a083-ca1f9f5af3a1 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:43.993198 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 119/242] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:44:43 2022] GET /identity/v3/users/d8db9261080c45b7a24af1ecbd8e34d8 => generated 297 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:44.015297 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc64283-5059-4438-a083-ca1f9f5af3a1 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:44.056995 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8da775-a5b6-4ff7-b244-8f7018dc304a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:44.057686 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8da775-a5b6-4ff7-b244-8f7018dc304a None admin] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:44.058019 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8da775-a5b6-4ff7-b244-8f7018dc304a None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:44.058329 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8da775-a5b6-4ff7-b244-8f7018dc304a None admin] PATH_INFO: `/v3/users` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:44.059057 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8da775-a5b6-4ff7-b244-8f7018dc304a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:44.060518 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8da775-a5b6-4ff7-b244-8f7018dc304a None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:44.066494 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:44.154535 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc64283-5059-4438-a083-ca1f9f5af3a1 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:44.175327 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 124/243] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:44:43 2022] POST /identity/v3/users => generated 293 bytes in 565 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:44:44.214503 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e2459-2ee7-464f-a386-86681c115cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:44.215194 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e2459-2ee7-464f-a386-86681c115cf7 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:44.215487 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e2459-2ee7-464f-a386-86681c115cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:44.215824 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e2459-2ee7-464f-a386-86681c115cf7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:44.312873 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2e2459-2ee7-464f-a386-86681c115cf7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:44.314393 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2e2459-2ee7-464f-a386-86681c115cf7 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:44.343814 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b7cb2-a039-479f-bcef-4583c152ae0d None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:44.344727 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b7cb2-a039-479f-bcef-4583c152ae0d None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:44.345177 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b7cb2-a039-479f-bcef-4583c152ae0d None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:44.347336 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 125/244] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:44.353549 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f176d40-89d8-45b7-af5e-4d71efa5f5a2 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:44.354237 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f176d40-89d8-45b7-af5e-4d71efa5f5a2 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:44.354743 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f176d40-89d8-45b7-af5e-4d71efa5f5a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:44.358517 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:44.373114 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-7f176d40-89d8-45b7-af5e-4d71efa5f5a2 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:44.374692 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-7f176d40-89d8-45b7-af5e-4d71efa5f5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:44.438494 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:44.455750 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 120/245] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:44:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 21:44:44.461532 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e2459-2ee7-464f-a386-86681c115cf7 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:44.467678 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 126/246] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:44:44.500254 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f176d40-89d8-45b7-af5e-4d71efa5f5a2 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:44.608099 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e2459-2ee7-464f-a386-86681c115cf7 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:44.642096 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:44.653020 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f176d40-89d8-45b7-af5e-4d71efa5f5a2 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:44.654181 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163c867-6b54-4621-9f1e-f04d92496d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:44.655516 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163c867-6b54-4621-9f1e-f04d92496d8c None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:44.656021 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163c867-6b54-4621-9f1e-f04d92496d8c None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:44.657715 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163c867-6b54-4621-9f1e-f04d92496d8c None admin] PATH_INFO: `/v3/projects/b74bb643188f42a68dced2cedca8fb95` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:44.659303 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b163c867-6b54-4621-9f1e-f04d92496d8c None admin] RBAC: Authorizing `identity:get_project(project_id=b74bb643188f42a68dced2cedca8fb95)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:44.661011 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b163c867-6b54-4621-9f1e-f04d92496d8c None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:44.665348 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 121/247] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:44:44 2022] GET /identity/v3/projects/b74bb643188f42a68dced2cedca8fb95 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:44.665980 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64d9cd-7c47-4ea5-86ae-8740b00da4e5 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:44.666638 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64d9cd-7c47-4ea5-86ae-8740b00da4e5 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:44.666638 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64d9cd-7c47-4ea5-86ae-8740b00da4e5 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:44.668023 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 122/248] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:44.671859 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b64d9cd-7c47-4ea5-86ae-8740b00da4e5 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:44.705836 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3eccb-8035-4c7f-a115-0ff050e0ea06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:44.706714 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3eccb-8035-4c7f-a115-0ff050e0ea06 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:44.707006 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3eccb-8035-4c7f-a115-0ff050e0ea06 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:44.707286 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3eccb-8035-4c7f-a115-0ff050e0ea06 None admin] PATH_INFO: `/v3/roles/member` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:44.722000 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa3eccb-8035-4c7f-a115-0ff050e0ea06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:44:44.731069 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-6aa3eccb-8035-4c7f-a115-0ff050e0ea06 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:44:44.731069 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:44:44.731069 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:44:44.731069 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:44:44.731069 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:44:44.731069 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:44:44.731069 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:44:44.731069 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:44:44.731069 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:44:44.731069 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:44:44.731069 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:44:44.731069 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:44:44.731069 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:44:44.731069 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:44:44.731069 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:44:44.731069 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:44:44.732324 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:44:44.732324 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:44:44.732324 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:44:44.732324 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:44:44.732324 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:44:44.732324 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:44:44.732324 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:44:44.732324 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:44:44.732324 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:44:44.732324 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:44:44.732324 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:44:44.732324 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:44:44.732324 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:44:44.732324 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:44:44.732324 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:44:44.732324 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:44:44.733427 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:44:44.733427 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:44:44.733427 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:44:44.733427 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:44:44.733427 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:44:44.733427 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:44:44.733427 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:44:44.733427 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:44:44.733427 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:44:44.733427 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:44:44.733427 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:44:44.733427 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:44:44.733427 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 127/249] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:44:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:44:44.734359 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ff23b-ce54-4882-87c2-83442ef04fe0 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:44.734359 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ff23b-ce54-4882-87c2-83442ef04fe0 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:44.734359 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ff23b-ce54-4882-87c2-83442ef04fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:44.754305 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-600ff23b-ce54-4882-87c2-83442ef04fe0 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:44.755558 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-600ff23b-ce54-4882-87c2-83442ef04fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:44.796585 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:44.802625 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b64d9cd-7c47-4ea5-86ae-8740b00da4e5 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:44.844722 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 128/250] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:44:44.844722 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ff23b-ce54-4882-87c2-83442ef04fe0 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:44.858568 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbb778-0979-4fb9-ad82-a31c0e5f1c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:44.859230 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbb778-0979-4fb9-ad82-a31c0e5f1c6e None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:44.859933 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbb778-0979-4fb9-ad82-a31c0e5f1c6e None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:44.860228 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbb778-0979-4fb9-ad82-a31c0e5f1c6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:44.861321 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fbb778-0979-4fb9-ad82-a31c0e5f1c6e None admin] RBAC: Adding query filter params (role.id=b4cc928f3fd4418b988335683cdad5f3, scope.project.id=b74bb643188f42a68dced2cedca8fb95, user.id=d8db9261080c45b7a24af1ecbd8e34d8) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:44.861649 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fbb778-0979-4fb9-ad82-a31c0e5f1c6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:44.865599 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fbb778-0979-4fb9-ad82-a31c0e5f1c6e None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:44.874989 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 123/251] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:44:44 2022] GET /identity/v3/role_assignments?user.id=d8db9261080c45b7a24af1ecbd8e34d8&scope.project.id=b74bb643188f42a68dced2cedca8fb95&role.id=b4cc928f3fd4418b988335683cdad5f3 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:44.876385 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbb778-0979-4fb9-ad82-a31c0e5f1c6e None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:44.949990 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:44.983756 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ff23b-ce54-4882-87c2-83442ef04fe0 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:45.020082 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbb778-0979-4fb9-ad82-a31c0e5f1c6e None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:45.059511 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3892f2-30a5-4f05-b105-11a7b589416d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:45.060223 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3892f2-30a5-4f05-b105-11a7b589416d None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:45.060515 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3892f2-30a5-4f05-b105-11a7b589416d None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:45.060800 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3892f2-30a5-4f05-b105-11a7b589416d None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:45.061595 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3892f2-30a5-4f05-b105-11a7b589416d None admin] RBAC: Adding query filter params (name=member) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:45.062577 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3892f2-30a5-4f05-b105-11a7b589416d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:45.064923 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3892f2-30a5-4f05-b105-11a7b589416d None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:45.067526 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67151389-b338-40d5-a833-f5b1457d5cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:45.068352 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67151389-b338-40d5-a833-f5b1457d5cd8 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:45.068653 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67151389-b338-40d5-a833-f5b1457d5cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:45.068926 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67151389-b338-40d5-a833-f5b1457d5cd8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:45.091167 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 129/252] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:44:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:45.095691 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67151389-b338-40d5-a833-f5b1457d5cd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:44:45.099271 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3892f2-30a5-4f05-b105-11a7b589416d None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:45.116140 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-67151389-b338-40d5-a833-f5b1457d5cd8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:44:45.116140 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:44:45.116140 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:44:45.116140 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:44:45.116140 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:44:45.116140 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:44:45.116140 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:44:45.116140 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:44:45.116140 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:44:45.116140 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:44:45.116140 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:44:45.116140 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:44:45.116140 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:44:45.116140 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:44:45.116140 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:44:45.116140 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:44:45.117962 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:44:45.117962 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:44:45.117962 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:44:45.117962 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:44:45.117962 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:44:45.117962 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:44:45.117962 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:44:45.117962 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:44:45.117962 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:44:45.117962 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:44:45.117962 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:44:45.117962 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:44:45.117962 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:44:45.117962 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:44:45.117962 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:44:45.117962 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:44:45.120252 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:44:45.120252 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:44:45.120252 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:44:45.120252 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:44:45.120252 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:44:45.120252 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:44:45.120252 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:44:45.120252 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:44:45.120252 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:44:45.120252 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:44:45.120252 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:44:45.120252 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:44:45.120252 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 124/253] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:44:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:44:45.128214 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67151389-b338-40d5-a833-f5b1457d5cd8 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:45.179251 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:45.274665 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67151389-b338-40d5-a833-f5b1457d5cd8 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:45.299056 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:45.300357 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3892f2-30a5-4f05-b105-11a7b589416d None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:45.331035 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d7274-4000-438e-b082-d922cc876ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:45.331880 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d7274-4000-438e-b082-d922cc876ede None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:45.332173 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d7274-4000-438e-b082-d922cc876ede None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:45.332461 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d7274-4000-438e-b082-d922cc876ede None admin] PATH_INFO: `/v3/roles` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:45.333240 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356d7274-4000-438e-b082-d922cc876ede None admin] RBAC: Adding query filter params (name=admin) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:45.333559 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356d7274-4000-438e-b082-d922cc876ede None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:45.335014 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356d7274-4000-438e-b082-d922cc876ede None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:45.355260 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 125/254] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:44:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:44:45.356435 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf3bde-e579-4f24-a18d-de0d8f0c7fc3 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:45.356737 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf3bde-e579-4f24-a18d-de0d8f0c7fc3 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:45.357022 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf3bde-e579-4f24-a18d-de0d8f0c7fc3 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:45.358431 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 126/255] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:45.365417 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf3bde-e579-4f24-a18d-de0d8f0c7fc3 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:45.380499 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057dca3-ad17-4905-8fac-263470ad097b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:45.382122 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057dca3-ad17-4905-8fac-263470ad097b None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:45.382808 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057dca3-ad17-4905-8fac-263470ad097b None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:45.383300 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057dca3-ad17-4905-8fac-263470ad097b None admin] PATH_INFO: `/v3/users/2cabc64aaedd44038857e90f895366b4` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:45.385097 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c057dca3-ad17-4905-8fac-263470ad097b None admin] RBAC: Authorizing `identity:get_user(user_id=2cabc64aaedd44038857e90f895366b4)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:45.387059 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c057dca3-ad17-4905-8fac-263470ad097b None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:45.391359 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 130/256] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:44:45 2022] GET /identity/v3/users/2cabc64aaedd44038857e90f895366b4 => generated 297 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:45.393135 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a33abb-ea46-4af3-a4d5-c43bdb09fe72 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:45.398612 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a33abb-ea46-4af3-a4d5-c43bdb09fe72 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:45.399164 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a33abb-ea46-4af3-a4d5-c43bdb09fe72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:45.434415 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-06a33abb-ea46-4af3-a4d5-c43bdb09fe72 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:45.436936 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-06a33abb-ea46-4af3-a4d5-c43bdb09fe72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:45.574937 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf3bde-e579-4f24-a18d-de0d8f0c7fc3 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:45.587362 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 131/257] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:44:45.588396 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a33abb-ea46-4af3-a4d5-c43bdb09fe72 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:45.640022 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:45.670860 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a906ae-3b6d-48df-95a1-804f3f54853a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:45.671766 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a906ae-3b6d-48df-95a1-804f3f54853a None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:45.672057 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a906ae-3b6d-48df-95a1-804f3f54853a None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:45.672341 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a906ae-3b6d-48df-95a1-804f3f54853a None admin] PATH_INFO: `/v3/users/b55731353b0b4ad194b78a350ceef5cd` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:45.682213 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a906ae-3b6d-48df-95a1-804f3f54853a None admin] RBAC: Authorizing `identity:get_user(user_id=b55731353b0b4ad194b78a350ceef5cd)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:45.682213 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a906ae-3b6d-48df-95a1-804f3f54853a None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:45.682213 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 127/258] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:44:45 2022] GET /identity/v3/users/b55731353b0b4ad194b78a350ceef5cd => generated 283 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:45.682213 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a906ae-3b6d-48df-95a1-804f3f54853a None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:45.762891 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a33abb-ea46-4af3-a4d5-c43bdb09fe72 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:45.777872 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:45.851865 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56eb04c-ca30-460f-9bd9-83da35983bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:45.853020 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56eb04c-ca30-460f-9bd9-83da35983bcb None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:45.853310 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56eb04c-ca30-460f-9bd9-83da35983bcb None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:45.853595 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56eb04c-ca30-460f-9bd9-83da35983bcb None admin] PATH_INFO: `/v3/projects/b74bb643188f42a68dced2cedca8fb95` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:45.854861 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56eb04c-ca30-460f-9bd9-83da35983bcb None admin] RBAC: Authorizing `identity:get_project(project_id=b74bb643188f42a68dced2cedca8fb95)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:45.856333 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56eb04c-ca30-460f-9bd9-83da35983bcb None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:45.858267 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 132/259] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:44:45 2022] GET /identity/v3/projects/b74bb643188f42a68dced2cedca8fb95 => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:45.858883 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56eb04c-ca30-460f-9bd9-83da35983bcb None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:45.864129 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a906ae-3b6d-48df-95a1-804f3f54853a None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:45.905799 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f700c-a479-43a8-8d6a-3d541d4d4279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:45.906757 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f700c-a479-43a8-8d6a-3d541d4d4279 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:45.907048 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f700c-a479-43a8-8d6a-3d541d4d4279 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:45.907329 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f700c-a479-43a8-8d6a-3d541d4d4279 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:45.928824 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f700c-a479-43a8-8d6a-3d541d4d4279 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:44:45.940389 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-df3f700c-a479-43a8-8d6a-3d541d4d4279 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:44:45.940389 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:44:45.940389 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:44:45.940389 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:44:45.940389 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:44:45.940389 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:44:45.940389 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:44:45.940389 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:44:45.940389 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:44:45.940389 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:44:45.940389 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:44:45.940389 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:44:45.940389 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:44:45.940389 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:44:45.940389 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:44:45.940389 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:44:45.941385 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:44:45.941385 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:44:45.941385 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:44:45.941385 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:44:45.941385 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:44:45.941385 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:44:45.941385 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:44:45.941385 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:44:45.941385 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:44:45.941385 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:44:45.941385 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:44:45.941385 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:44:45.941385 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:44:45.941385 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:44:45.941385 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:44:45.941385 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:44:45.942287 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:44:45.942287 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:44:45.942287 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:44:45.942287 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:44:45.942287 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:44:45.942287 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:44:45.942287 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:44:45.942287 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:44:45.942287 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:44:45.942287 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:44:45.942287 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:44:45.942287 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:44:45.942287 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 128/260] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:44:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:44:45.943033 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f700c-a479-43a8-8d6a-3d541d4d4279 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:46.056801 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f700c-a479-43a8-8d6a-3d541d4d4279 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:46.068940 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:46.095179 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17961a96-ceed-4724-9da5-038f8d36e400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:46.096085 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17961a96-ceed-4724-9da5-038f8d36e400 None admin] REQUEST_METHOD: `PUT` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:46.096374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17961a96-ceed-4724-9da5-038f8d36e400 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:46.096657 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17961a96-ceed-4724-9da5-038f8d36e400 None admin] PATH_INFO: `/v3/projects/b74bb643188f42a68dced2cedca8fb95/users/2cabc64aaedd44038857e90f895366b4/roles/41a9e10d8ca34fa892f53bf450f29554` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:46.098855 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17961a96-ceed-4724-9da5-038f8d36e400 None admin] RBAC: Authorizing `identity:create_grant(project_id=b74bb643188f42a68dced2cedca8fb95, user_id=2cabc64aaedd44038857e90f895366b4, role_id=41a9e10d8ca34fa892f53bf450f29554)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:46.100608 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17961a96-ceed-4724-9da5-038f8d36e400 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:46.116550 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:46.120326 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56eb04c-ca30-460f-9bd9-83da35983bcb None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:46.156061 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0953b73-07b8-4b6c-9421-56143cab9181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:46.156656 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0953b73-07b8-4b6c-9421-56143cab9181 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:46.156945 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0953b73-07b8-4b6c-9421-56143cab9181 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:46.157228 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0953b73-07b8-4b6c-9421-56143cab9181 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:46.204770 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 129/261] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:44:45 2022] PUT /identity/v3/projects/b74bb643188f42a68dced2cedca8fb95/users/2cabc64aaedd44038857e90f895366b4/roles/41a9e10d8ca34fa892f53bf450f29554 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:44:46.206026 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17961a96-ceed-4724-9da5-038f8d36e400 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:46.234296 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0953b73-07b8-4b6c-9421-56143cab9181 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:46.236125 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0953b73-07b8-4b6c-9421-56143cab9181 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:46.344582 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:46.348651 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 133/262] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:44:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:44:46.369501 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0953b73-07b8-4b6c-9421-56143cab9181 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:46.386357 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17961a96-ceed-4724-9da5-038f8d36e400 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:46.447069 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a031ec6-cc58-49ac-a19d-afe0783dccb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:46.447812 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a031ec6-cc58-49ac-a19d-afe0783dccb5 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:46.448112 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a031ec6-cc58-49ac-a19d-afe0783dccb5 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:46.448522 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a031ec6-cc58-49ac-a19d-afe0783dccb5 None admin] PATH_INFO: `/v3/roles` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:46.449298 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a031ec6-cc58-49ac-a19d-afe0783dccb5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:46.449612 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a031ec6-cc58-49ac-a19d-afe0783dccb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:46.452909 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a031ec6-cc58-49ac-a19d-afe0783dccb5 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:46.477017 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 130/263] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:44:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:46.483362 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a031ec6-cc58-49ac-a19d-afe0783dccb5 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:46.553882 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:46.604305 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0953b73-07b8-4b6c-9421-56143cab9181 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:46.668872 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e2cbb-75ac-46fd-98ae-a829d4b9a2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:46.669743 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e2cbb-75ac-46fd-98ae-a829d4b9a2ca None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:46.670027 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e2cbb-75ac-46fd-98ae-a829d4b9a2ca None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:46.670336 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e2cbb-75ac-46fd-98ae-a829d4b9a2ca None admin] PATH_INFO: `/v3/projects/b74bb643188f42a68dced2cedca8fb95` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:46.672668 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e2cbb-75ac-46fd-98ae-a829d4b9a2ca None admin] RBAC: Authorizing `identity:get_project(project_id=b74bb643188f42a68dced2cedca8fb95)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:46.674161 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e2cbb-75ac-46fd-98ae-a829d4b9a2ca None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:46.677414 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 134/264] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:44:46 2022] GET /identity/v3/projects/b74bb643188f42a68dced2cedca8fb95 => generated 302 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:46.685468 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e2cbb-75ac-46fd-98ae-a829d4b9a2ca None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:46.688907 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a031ec6-cc58-49ac-a19d-afe0783dccb5 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:46.746713 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c7f2f6-75df-4d9e-8b4a-6166d1f1e8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:46.747523 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7f2f6-75df-4d9e-8b4a-6166d1f1e8ac None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:46.747825 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7f2f6-75df-4d9e-8b4a-6166d1f1e8ac None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:46.748101 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7f2f6-75df-4d9e-8b4a-6166d1f1e8ac None admin] PATH_INFO: `/v3/users/b55731353b0b4ad194b78a350ceef5cd` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:46.749360 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c7f2f6-75df-4d9e-8b4a-6166d1f1e8ac None admin] RBAC: Authorizing `identity:get_user(user_id=b55731353b0b4ad194b78a350ceef5cd)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:46.750868 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c7f2f6-75df-4d9e-8b4a-6166d1f1e8ac None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:46.752543 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 131/265] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:44:46 2022] GET /identity/v3/users/b55731353b0b4ad194b78a350ceef5cd => generated 283 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:44:46.763166 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c7f2f6-75df-4d9e-8b4a-6166d1f1e8ac None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:46.839909 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:46.928219 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e2cbb-75ac-46fd-98ae-a829d4b9a2ca None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:47.002934 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11340097-5bba-465d-be58-bea4b0d98eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:47.004010 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11340097-5bba-465d-be58-bea4b0d98eec None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:47.004518 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11340097-5bba-465d-be58-bea4b0d98eec None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:47.005015 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11340097-5bba-465d-be58-bea4b0d98eec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:47.005893 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c7f2f6-75df-4d9e-8b4a-6166d1f1e8ac None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:47.006335 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11340097-5bba-465d-be58-bea4b0d98eec None admin] RBAC: Adding query filter params (role.id=e1c574c9973548ebb0e8d9e0656ccabd, scope.project.id=b74bb643188f42a68dced2cedca8fb95, user.id=b55731353b0b4ad194b78a350ceef5cd) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:47.006887 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11340097-5bba-465d-be58-bea4b0d98eec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:47.009231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11340097-5bba-465d-be58-bea4b0d98eec None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:47.011516 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:47.016283 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 135/266] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:44:46 2022] GET /identity/v3/role_assignments?user.id=b55731353b0b4ad194b78a350ceef5cd&scope.project.id=b74bb643188f42a68dced2cedca8fb95&role.id=e1c574c9973548ebb0e8d9e0656ccabd => generated 608 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:47.091861 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9474824f-e5a7-4503-949f-c4b18ac5ed7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:47.092537 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474824f-e5a7-4503-949f-c4b18ac5ed7a None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:47.092832 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474824f-e5a7-4503-949f-c4b18ac5ed7a None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:47.093114 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474824f-e5a7-4503-949f-c4b18ac5ed7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:47.201932 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9474824f-e5a7-4503-949f-c4b18ac5ed7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:47.203477 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9474824f-e5a7-4503-949f-c4b18ac5ed7a None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:47.322528 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:47.330208 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 132/267] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:44:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:44:47.335131 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2dc0c-c262-485f-b99b-eca117b26a49 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:47.335427 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2dc0c-c262-485f-b99b-eca117b26a49 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:47.335833 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2dc0c-c262-485f-b99b-eca117b26a49 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:47.337700 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 136/268] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:47.344177 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c17d1-d024-4831-9b75-e66b0c1b097e None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:47.344316 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfbf6d7-0e63-40a0-968f-a63d2cf9b330 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:47.344506 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c17d1-d024-4831-9b75-e66b0c1b097e None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:47.344607 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfbf6d7-0e63-40a0-968f-a63d2cf9b330 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:47.344758 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c17d1-d024-4831-9b75-e66b0c1b097e None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:47.344867 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfbf6d7-0e63-40a0-968f-a63d2cf9b330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:47.346252 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 137/269] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:47.347101 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c17d1-d024-4831-9b75-e66b0c1b097e None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:47.366687 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-0bfbf6d7-0e63-40a0-968f-a63d2cf9b330 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:47.368550 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-0bfbf6d7-0e63-40a0-968f-a63d2cf9b330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:47.455481 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 133/270] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:44:47.456811 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0c6eb-39c4-40d2-94d2-17dcc84232ad None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:47.458543 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0c6eb-39c4-40d2-94d2-17dcc84232ad None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:47.458847 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0c6eb-39c4-40d2-94d2-17dcc84232ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:47.487169 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-fbb0c6eb-39c4-40d2-94d2-17dcc84232ad None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:47.488539 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-fbb0c6eb-39c4-40d2-94d2-17dcc84232ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:47.520842 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c17d1-d024-4831-9b75-e66b0c1b097e None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:47.556433 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:47.563138 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c7678-b60f-42ae-9b31-ea59433af6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:47.564014 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c7678-b60f-42ae-9b31-ea59433af6fc None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:47.566419 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c7678-b60f-42ae-9b31-ea59433af6fc None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:47.566419 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c7678-b60f-42ae-9b31-ea59433af6fc None admin] PATH_INFO: `/v3/projects/b74bb643188f42a68dced2cedca8fb95` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:47.566419 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481c7678-b60f-42ae-9b31-ea59433af6fc None admin] RBAC: Authorizing `identity:get_project(project_id=b74bb643188f42a68dced2cedca8fb95)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:47.567391 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481c7678-b60f-42ae-9b31-ea59433af6fc None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:47.569342 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 138/271] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:44:47 2022] GET /identity/v3/projects/b74bb643188f42a68dced2cedca8fb95 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:47.570538 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa713d-59fd-4349-beac-8f24b394605d None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:47.570826 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa713d-59fd-4349-beac-8f24b394605d None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:47.571111 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa713d-59fd-4349-beac-8f24b394605d None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:47.572592 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 139/272] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:47.573164 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa713d-59fd-4349-beac-8f24b394605d None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:47.579051 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 134/273] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:44:47.580608 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388e781-7223-440b-ab83-32dc8a59f453 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:47.581009 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388e781-7223-440b-ab83-32dc8a59f453 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:47.581275 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388e781-7223-440b-ab83-32dc8a59f453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:47.599697 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-c388e781-7223-440b-ab83-32dc8a59f453 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:47.600958 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-c388e781-7223-440b-ab83-32dc8a59f453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:47.664544 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:47.680824 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 135/274] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:44:47.680824 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388e781-7223-440b-ab83-32dc8a59f453 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:47.690303 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa713d-59fd-4349-beac-8f24b394605d None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:47.729108 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc653d-fd3a-4a6d-9f9c-85b6fe7c56e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:47.729943 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc653d-fd3a-4a6d-9f9c-85b6fe7c56e3 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:47.730267 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc653d-fd3a-4a6d-9f9c-85b6fe7c56e3 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:47.730547 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc653d-fd3a-4a6d-9f9c-85b6fe7c56e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:47.731736 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc653d-fd3a-4a6d-9f9c-85b6fe7c56e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:47.733189 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc653d-fd3a-4a6d-9f9c-85b6fe7c56e3 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:47.735045 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 140/275] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:44:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:47.735729 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc653d-fd3a-4a6d-9f9c-85b6fe7c56e3 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:47.798363 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388e781-7223-440b-ab83-32dc8a59f453 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:47.807203 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:47.837740 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2408e6-9ce0-4463-ab4b-9ee81f0f5f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:47.838345 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2408e6-9ce0-4463-ab4b-9ee81f0f5f42 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:47.838641 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2408e6-9ce0-4463-ab4b-9ee81f0f5f42 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:47.838921 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2408e6-9ce0-4463-ab4b-9ee81f0f5f42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:47.839763 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2408e6-9ce0-4463-ab4b-9ee81f0f5f42 None admin] RBAC: Adding query filter params (role.id=9bd598b07a9942b7a91c3a372f3cf094, scope.project.id=b74bb643188f42a68dced2cedca8fb95, user.id=b55731353b0b4ad194b78a350ceef5cd) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:47.840084 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2408e6-9ce0-4463-ab4b-9ee81f0f5f42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:47.841560 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2408e6-9ce0-4463-ab4b-9ee81f0f5f42 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:47.842476 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc653d-fd3a-4a6d-9f9c-85b6fe7c56e3 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:47.858169 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 136/276] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:44:47 2022] GET /identity/v3/role_assignments?user.id=b55731353b0b4ad194b78a350ceef5cd&scope.project.id=b74bb643188f42a68dced2cedca8fb95&role.id=9bd598b07a9942b7a91c3a372f3cf094 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:47.858169 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2408e6-9ce0-4463-ab4b-9ee81f0f5f42 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:47.892059 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e389f47a-0a7a-4a42-aa42-0fbf20274094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:47.893764 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389f47a-0a7a-4a42-aa42-0fbf20274094 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:47.894160 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389f47a-0a7a-4a42-aa42-0fbf20274094 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:47.894513 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389f47a-0a7a-4a42-aa42-0fbf20274094 None admin] PATH_INFO: `/v3/roles/member` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:47.909889 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e389f47a-0a7a-4a42-aa42-0fbf20274094 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:44:47.921462 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-e389f47a-0a7a-4a42-aa42-0fbf20274094 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:44:47.921462 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:44:47.921462 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:44:47.921462 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:44:47.921462 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:44:47.921462 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:44:47.921462 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:44:47.921462 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:44:47.921462 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:44:47.921462 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:44:47.921462 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:44:47.921462 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:44:47.921462 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:44:47.921462 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:44:47.921462 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:44:47.921462 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:44:47.922568 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:44:47.922568 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:44:47.922568 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:44:47.922568 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:44:47.922568 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:44:47.922568 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:44:47.922568 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:44:47.922568 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:44:47.922568 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:44:47.922568 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:44:47.922568 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:44:47.922568 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:44:47.922568 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:44:47.922568 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:44:47.922568 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:44:47.922568 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:44:47.923463 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:44:47.923463 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:44:47.923463 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:44:47.923463 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:44:47.923463 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:44:47.923463 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:44:47.923463 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:44:47.923463 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:44:47.923463 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:44:47.923463 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:44:47.923463 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:44:47.923463 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:44:47.924138 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:47.926315 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 141/277] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:44:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:44:47.932719 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e389f47a-0a7a-4a42-aa42-0fbf20274094 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:47.985611 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2408e6-9ce0-4463-ab4b-9ee81f0f5f42 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:48.029218 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef793de-edfe-4a90-a994-1fd3df3efec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:48.029966 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef793de-edfe-4a90-a994-1fd3df3efec2 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:48.030296 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef793de-edfe-4a90-a994-1fd3df3efec2 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:48.030577 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef793de-edfe-4a90-a994-1fd3df3efec2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:48.043457 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef793de-edfe-4a90-a994-1fd3df3efec2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:44:48.051536 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-4ef793de-edfe-4a90-a994-1fd3df3efec2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:44:48.051536 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:44:48.051536 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:44:48.051536 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:44:48.051536 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:44:48.051536 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:44:48.051536 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:44:48.051536 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:44:48.051536 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:44:48.051536 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:44:48.051536 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:44:48.051536 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:44:48.051536 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:44:48.051536 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:44:48.051536 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:44:48.051536 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:44:48.052557 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:44:48.052557 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:44:48.052557 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:44:48.052557 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:44:48.052557 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:44:48.052557 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:44:48.052557 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:44:48.052557 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:44:48.052557 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:44:48.052557 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:44:48.052557 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:44:48.052557 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:44:48.052557 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:44:48.052557 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:44:48.052557 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:44:48.052557 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:44:48.053516 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:44:48.053516 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:44:48.053516 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:44:48.053516 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:44:48.053516 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:44:48.053516 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:44:48.053516 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:44:48.053516 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:44:48.053516 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:44:48.053516 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:44:48.053516 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:44:48.053516 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:44:48.058472 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 137/278] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:44:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:44:48.059410 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef793de-edfe-4a90-a994-1fd3df3efec2 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:48.076716 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e389f47a-0a7a-4a42-aa42-0fbf20274094 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:48.110551 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:48.128919 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb66894-e2e7-4fdc-8949-1b3983773f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:48.129618 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb66894-e2e7-4fdc-8949-1b3983773f61 None admin] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:48.129905 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb66894-e2e7-4fdc-8949-1b3983773f61 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:48.141069 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb66894-e2e7-4fdc-8949-1b3983773f61 None admin] PATH_INFO: `/v3/users` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:48.141069 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb66894-e2e7-4fdc-8949-1b3983773f61 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:48.141069 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb66894-e2e7-4fdc-8949-1b3983773f61 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:48.187073 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef793de-edfe-4a90-a994-1fd3df3efec2 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:48.201934 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:48.222156 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff55a9-4f57-40c9-b652-1228563571e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:48.222856 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff55a9-4f57-40c9-b652-1228563571e7 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:48.223151 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff55a9-4f57-40c9-b652-1228563571e7 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:48.223434 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff55a9-4f57-40c9-b652-1228563571e7 None admin] PATH_INFO: `/v3/roles` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:48.224215 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ff55a9-4f57-40c9-b652-1228563571e7 None admin] RBAC: Adding query filter params (name=member) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:48.224511 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ff55a9-4f57-40c9-b652-1228563571e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:48.225949 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ff55a9-4f57-40c9-b652-1228563571e7 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:48.235192 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 138/279] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:44:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:48.235990 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff55a9-4f57-40c9-b652-1228563571e7 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:48.262164 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 142/280] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:44:47 2022] POST /identity/v3/users => generated 293 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:44:48.262164 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb66894-e2e7-4fdc-8949-1b3983773f61 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:48.376502 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff55a9-4f57-40c9-b652-1228563571e7 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:48.380866 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb66894-e2e7-4fdc-8949-1b3983773f61 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:48.416845 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2afe82-ed08-4b17-82d3-c55ad79d386b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:48.417692 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2afe82-ed08-4b17-82d3-c55ad79d386b None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:48.417994 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2afe82-ed08-4b17-82d3-c55ad79d386b None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:48.418340 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2afe82-ed08-4b17-82d3-c55ad79d386b None admin] PATH_INFO: `/v3/roles` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:48.419089 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2afe82-ed08-4b17-82d3-c55ad79d386b None admin] RBAC: Adding query filter params (name=reader) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:48.419461 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2afe82-ed08-4b17-82d3-c55ad79d386b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:48.420877 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2afe82-ed08-4b17-82d3-c55ad79d386b None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:48.424646 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c7f0a-4a41-4ab4-94bb-9f85a4895597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:48.425735 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c7f0a-4a41-4ab4-94bb-9f85a4895597 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:48.426260 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c7f0a-4a41-4ab4-94bb-9f85a4895597 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:48.426750 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c7f0a-4a41-4ab4-94bb-9f85a4895597 None admin] PATH_INFO: `/v3/users/de4a1d47e01f41db96cded97b19a056d` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:48.430552 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 139/281] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:44:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:48.436380 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2afe82-ed08-4b17-82d3-c55ad79d386b None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:48.447611 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c7f0a-4a41-4ab4-94bb-9f85a4895597 None admin] RBAC: Authorizing `identity:get_user(user_id=de4a1d47e01f41db96cded97b19a056d)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:48.448562 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c7f0a-4a41-4ab4-94bb-9f85a4895597 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:48.455556 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 143/282] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:44:48 2022] GET /identity/v3/users/de4a1d47e01f41db96cded97b19a056d => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:48.456751 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c7f0a-4a41-4ab4-94bb-9f85a4895597 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:48.492780 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:48.506619 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:48.579590 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2afe82-ed08-4b17-82d3-c55ad79d386b None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:48.587693 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c7f0a-4a41-4ab4-94bb-9f85a4895597 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:48.629789 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d6bc9c-4d03-449b-b6d9-22078715b50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:48.630627 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6bc9c-4d03-449b-b6d9-22078715b50b None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:48.630954 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6bc9c-4d03-449b-b6d9-22078715b50b None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:48.631199 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6bc9c-4d03-449b-b6d9-22078715b50b None admin] PATH_INFO: `/v3/users/d8db9261080c45b7a24af1ecbd8e34d8` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:48.634413 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d6bc9c-4d03-449b-b6d9-22078715b50b None admin] RBAC: Authorizing `identity:get_user(user_id=d8db9261080c45b7a24af1ecbd8e34d8)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:48.635893 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d6bc9c-4d03-449b-b6d9-22078715b50b None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:48.637926 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 140/283] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:44:48 2022] GET /identity/v3/users/d8db9261080c45b7a24af1ecbd8e34d8 => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:44:48.638231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4d66b-2765-45a0-917d-ab9afa318018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:48.639168 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4d66b-2765-45a0-917d-ab9afa318018 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:48.639605 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4d66b-2765-45a0-917d-ab9afa318018 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:48.640027 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4d66b-2765-45a0-917d-ab9afa318018 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:48.641036 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf4d66b-2765-45a0-917d-ab9afa318018 None admin] RBAC: Adding query filter params (role.id=41a9e10d8ca34fa892f53bf450f29554, user.id=de4a1d47e01f41db96cded97b19a056d, scope.system=all) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:48.641363 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf4d66b-2765-45a0-917d-ab9afa318018 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:48.643126 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf4d66b-2765-45a0-917d-ab9afa318018 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:48.643418 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d6bc9c-4d03-449b-b6d9-22078715b50b None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:48.649317 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 144/284] 10.222.0.30 () {56 vars in 1308 bytes} [Tue Jul 5 21:44:48 2022] GET /identity/v3/role_assignments?user.id=de4a1d47e01f41db96cded97b19a056d&scope.system=all&role.id=41a9e10d8ca34fa892f53bf450f29554 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:48.766230 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d6bc9c-4d03-449b-b6d9-22078715b50b None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:48.775764 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:48.811609 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b7ef0-ad66-44b6-a670-c65666afe8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:48.812777 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b7ef0-ad66-44b6-a670-c65666afe8ef None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:48.813226 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b7ef0-ad66-44b6-a670-c65666afe8ef None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:48.813664 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b7ef0-ad66-44b6-a670-c65666afe8ef None admin] PATH_INFO: `/v3/projects/b74bb643188f42a68dced2cedca8fb95` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:48.815164 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b7ef0-ad66-44b6-a670-c65666afe8ef None admin] RBAC: Authorizing `identity:get_project(project_id=b74bb643188f42a68dced2cedca8fb95)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:48.817078 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b7ef0-ad66-44b6-a670-c65666afe8ef None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:48.819540 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 141/285] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:44:48 2022] GET /identity/v3/projects/b74bb643188f42a68dced2cedca8fb95 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:44:48.825913 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4d66b-2765-45a0-917d-ab9afa318018 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:48.943438 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4d66b-2765-45a0-917d-ab9afa318018 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:48.951766 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:48.985062 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0e3d7-c9c4-4f19-b0f4-9ec7a23b2e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:48.985974 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0e3d7-c9c4-4f19-b0f4-9ec7a23b2e66 None admin] REQUEST_METHOD: `PUT` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:48.986291 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0e3d7-c9c4-4f19-b0f4-9ec7a23b2e66 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:48.986576 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0e3d7-c9c4-4f19-b0f4-9ec7a23b2e66 None admin] PATH_INFO: `/v3/projects/b74bb643188f42a68dced2cedca8fb95/users/d8db9261080c45b7a24af1ecbd8e34d8/roles/b4cc928f3fd4418b988335683cdad5f3` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:48.988641 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e0e3d7-c9c4-4f19-b0f4-9ec7a23b2e66 None admin] RBAC: Authorizing `identity:create_grant(project_id=b74bb643188f42a68dced2cedca8fb95, user_id=d8db9261080c45b7a24af1ecbd8e34d8, role_id=b4cc928f3fd4418b988335683cdad5f3)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:48.990090 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e0e3d7-c9c4-4f19-b0f4-9ec7a23b2e66 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:49.072621 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 145/286] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:44:48 2022] PUT /identity/v3/projects/b74bb643188f42a68dced2cedca8fb95/users/d8db9261080c45b7a24af1ecbd8e34d8/roles/b4cc928f3fd4418b988335683cdad5f3 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:44:49.093046 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b36194-c3f1-46f3-847d-c022a249c1f3 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:49.093429 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b36194-c3f1-46f3-847d-c022a249c1f3 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:49.093755 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b36194-c3f1-46f3-847d-c022a249c1f3 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:49.095487 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 142/287] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:49.101963 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25c297-e03b-4ed7-886b-03d6c5630993 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:49.102330 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25c297-e03b-4ed7-886b-03d6c5630993 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:49.102894 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25c297-e03b-4ed7-886b-03d6c5630993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:49.127385 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-4a25c297-e03b-4ed7-886b-03d6c5630993 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:49.128650 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-4a25c297-e03b-4ed7-886b-03d6c5630993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:49.233149 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 146/288] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:44:49.273998 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b36194-c3f1-46f3-847d-c022a249c1f3 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:49.499908 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b36194-c3f1-46f3-847d-c022a249c1f3 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:49.562928 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d63ce9-82fe-4d4a-a0b8-c2200cb8aabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:49.563766 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d63ce9-82fe-4d4a-a0b8-c2200cb8aabd None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:49.564057 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d63ce9-82fe-4d4a-a0b8-c2200cb8aabd None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:49.564341 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d63ce9-82fe-4d4a-a0b8-c2200cb8aabd None admin] PATH_INFO: `/v3/roles/member` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:49.577101 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d63ce9-82fe-4d4a-a0b8-c2200cb8aabd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:44:49.584951 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-a6d63ce9-82fe-4d4a-a0b8-c2200cb8aabd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:44:49.584951 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:44:49.584951 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:44:49.584951 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:44:49.584951 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:44:49.584951 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:44:49.584951 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:44:49.584951 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:44:49.584951 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:44:49.584951 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:44:49.584951 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:44:49.584951 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:44:49.584951 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:44:49.584951 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:44:49.584951 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:44:49.584951 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:44:49.586294 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:44:49.586294 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:44:49.586294 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:44:49.586294 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:44:49.586294 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:44:49.586294 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:44:49.586294 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:44:49.586294 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:44:49.586294 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:44:49.586294 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:44:49.586294 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:44:49.586294 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:44:49.586294 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:44:49.586294 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:44:49.586294 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:44:49.586294 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:44:49.587182 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:44:49.587182 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:44:49.587182 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:44:49.587182 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:44:49.587182 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:44:49.587182 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:44:49.587182 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:44:49.587182 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:44:49.587182 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:44:49.587182 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:44:49.587182 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:44:49.587182 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:44:49.587182 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 143/289] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:44:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:44:49.592285 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a25c297-e03b-4ed7-886b-03d6c5630993 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:49.743330 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a25c297-e03b-4ed7-886b-03d6c5630993 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:49.746445 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:49.789608 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01e274-46f3-4a2f-a774-46a7f78b0eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:49.790242 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01e274-46f3-4a2f-a774-46a7f78b0eb0 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:49.790535 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01e274-46f3-4a2f-a774-46a7f78b0eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:49.790822 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01e274-46f3-4a2f-a774-46a7f78b0eb0 None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:49.791592 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af01e274-46f3-4a2f-a774-46a7f78b0eb0 None admin] RBAC: Adding query filter params (name=member) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:49.791906 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af01e274-46f3-4a2f-a774-46a7f78b0eb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:49.793302 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af01e274-46f3-4a2f-a774-46a7f78b0eb0 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:49.806548 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 147/290] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:44:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:49.811240 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d63ce9-82fe-4d4a-a0b8-c2200cb8aabd None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:49.871238 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:49.944095 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d63ce9-82fe-4d4a-a0b8-c2200cb8aabd None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:49.989626 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96513be7-0de6-403e-9de7-def430431846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:49.990543 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96513be7-0de6-403e-9de7-def430431846 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:49.990838 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96513be7-0de6-403e-9de7-def430431846 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:49.991122 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96513be7-0de6-403e-9de7-def430431846 None admin] PATH_INFO: `/v3/users/2cabc64aaedd44038857e90f895366b4` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:49.992486 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96513be7-0de6-403e-9de7-def430431846 None admin] RBAC: Authorizing `identity:get_user(user_id=2cabc64aaedd44038857e90f895366b4)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:49.993955 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96513be7-0de6-403e-9de7-def430431846 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:49.995843 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 144/291] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:44:49 2022] GET /identity/v3/users/2cabc64aaedd44038857e90f895366b4 => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:50.001378 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01e274-46f3-4a2f-a774-46a7f78b0eb0 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:50.149835 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01e274-46f3-4a2f-a774-46a7f78b0eb0 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:50.185169 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb9a8e-25b9-4218-be69-dae9391fd0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:50.185832 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb9a8e-25b9-4218-be69-dae9391fd0b3 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:50.186193 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb9a8e-25b9-4218-be69-dae9391fd0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:50.186483 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb9a8e-25b9-4218-be69-dae9391fd0b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:50.225925 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:50.281587 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb9a8e-25b9-4218-be69-dae9391fd0b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:50.283098 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb9a8e-25b9-4218-be69-dae9391fd0b3 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:50.414075 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 148/292] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:44:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:44:50.419436 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96513be7-0de6-403e-9de7-def430431846 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:50.573011 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96513be7-0de6-403e-9de7-def430431846 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:50.574859 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:50.630864 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6259c3-3483-4566-a7c7-2f34112a571e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:50.631756 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6259c3-3483-4566-a7c7-2f34112a571e None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:50.632050 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6259c3-3483-4566-a7c7-2f34112a571e None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:50.632423 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6259c3-3483-4566-a7c7-2f34112a571e None admin] PATH_INFO: `/v3/projects/b74bb643188f42a68dced2cedca8fb95` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:50.633882 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6259c3-3483-4566-a7c7-2f34112a571e None admin] RBAC: Authorizing `identity:get_project(project_id=b74bb643188f42a68dced2cedca8fb95)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:50.635393 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6259c3-3483-4566-a7c7-2f34112a571e None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:50.637438 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 145/293] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:44:50 2022] GET /identity/v3/projects/b74bb643188f42a68dced2cedca8fb95 => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:50.643209 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb9a8e-25b9-4218-be69-dae9391fd0b3 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:50.744138 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:50.787841 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb9a8e-25b9-4218-be69-dae9391fd0b3 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:50.824451 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651377e7-efbb-4172-be9b-715899999f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:50.825445 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651377e7-efbb-4172-be9b-715899999f00 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:50.825964 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651377e7-efbb-4172-be9b-715899999f00 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:50.826428 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651377e7-efbb-4172-be9b-715899999f00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:50.827522 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651377e7-efbb-4172-be9b-715899999f00 None admin] RBAC: Adding query filter params (role.id=41a9e10d8ca34fa892f53bf450f29554, scope.project.id=b74bb643188f42a68dced2cedca8fb95, user.id=2cabc64aaedd44038857e90f895366b4) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:50.828009 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651377e7-efbb-4172-be9b-715899999f00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:50.829623 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651377e7-efbb-4172-be9b-715899999f00 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:50.836220 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 149/294] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:44:50 2022] GET /identity/v3/role_assignments?user.id=2cabc64aaedd44038857e90f895366b4&scope.project.id=b74bb643188f42a68dced2cedca8fb95&role.id=41a9e10d8ca34fa892f53bf450f29554 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:50.987649 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d28c79-73e0-43af-a570-ca858a6310c5 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:50.988222 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d28c79-73e0-43af-a570-ca858a6310c5 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:50.988667 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d28c79-73e0-43af-a570-ca858a6310c5 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:50.990221 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 146/295] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:50.998822 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f859e60-8df5-47b8-aa5f-b4742634c1a2 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:50.999036 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f859e60-8df5-47b8-aa5f-b4742634c1a2 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:50.999493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f859e60-8df5-47b8-aa5f-b4742634c1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:51.029087 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-7f859e60-8df5-47b8-aa5f-b4742634c1a2 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:51.031072 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-7f859e60-8df5-47b8-aa5f-b4742634c1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:51.111439 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 150/296] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:44:51.135285 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d28c79-73e0-43af-a570-ca858a6310c5 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:51.247927 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d28c79-73e0-43af-a570-ca858a6310c5 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:51.270884 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086a714-e1e4-4f27-95d8-1404e0bfea31 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:51.271507 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086a714-e1e4-4f27-95d8-1404e0bfea31 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:51.272015 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086a714-e1e4-4f27-95d8-1404e0bfea31 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:51.275173 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 151/297] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:51.281146 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b7df9-9211-4d5e-b677-1bb0a45ce63d None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:51.281749 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b7df9-9211-4d5e-b677-1bb0a45ce63d None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:51.282299 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b7df9-9211-4d5e-b677-1bb0a45ce63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:51.294842 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9503061-98fd-4bc1-9757-992a6027709b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:51.295627 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9503061-98fd-4bc1-9757-992a6027709b None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:51.303023 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9503061-98fd-4bc1-9757-992a6027709b None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:51.303023 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9503061-98fd-4bc1-9757-992a6027709b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:51.304675 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-dc1b7df9-9211-4d5e-b677-1bb0a45ce63d None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:51.306339 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-dc1b7df9-9211-4d5e-b677-1bb0a45ce63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:51.311078 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9503061-98fd-4bc1-9757-992a6027709b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:44:51.319203 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-f9503061-98fd-4bc1-9757-992a6027709b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:44:51.319203 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:44:51.319203 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:44:51.319203 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:44:51.319203 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:44:51.319203 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:44:51.319203 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:44:51.319203 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:44:51.319203 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:44:51.319203 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:44:51.319203 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:44:51.319203 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:44:51.319203 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:44:51.319203 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:44:51.319203 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:44:51.319203 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:44:51.320850 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:44:51.320850 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:44:51.320850 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:44:51.320850 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:44:51.320850 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:44:51.320850 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:44:51.320850 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:44:51.320850 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:44:51.320850 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:44:51.320850 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:44:51.320850 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:44:51.320850 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:44:51.320850 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:44:51.320850 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:44:51.320850 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:44:51.320850 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:44:51.321734 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:44:51.321734 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:44:51.321734 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:44:51.321734 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:44:51.321734 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:44:51.321734 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:44:51.321734 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:44:51.321734 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:44:51.321734 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:44:51.321734 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:44:51.321734 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:44:51.321734 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:44:51.321734 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 147/298] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:44:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:44:51.323443 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364da082-8f87-4b11-9255-806627498b16 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:51.323443 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364da082-8f87-4b11-9255-806627498b16 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:51.323443 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364da082-8f87-4b11-9255-806627498b16 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:51.325182 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 148/299] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:51.326742 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364da082-8f87-4b11-9255-806627498b16 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:51.364571 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:51.374429 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:51.400760 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 152/300] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:44:51.400760 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c57a05-89f5-4ed7-9ba1-70f924de2528 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:51.400760 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c57a05-89f5-4ed7-9ba1-70f924de2528 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:51.400760 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c57a05-89f5-4ed7-9ba1-70f924de2528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:51.413474 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-46c57a05-89f5-4ed7-9ba1-70f924de2528 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:51.415484 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-46c57a05-89f5-4ed7-9ba1-70f924de2528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:51.453256 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364da082-8f87-4b11-9255-806627498b16 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:51.498157 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 153/301] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:44:51.498157 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c57a05-89f5-4ed7-9ba1-70f924de2528 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:51.499395 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9adc0-f384-449d-b8dd-4ee290adc137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:51.500291 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9adc0-f384-449d-b8dd-4ee290adc137 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:51.500698 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9adc0-f384-449d-b8dd-4ee290adc137 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:51.501041 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9adc0-f384-449d-b8dd-4ee290adc137 None admin] PATH_INFO: `/v3/roles` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:51.501970 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd9adc0-f384-449d-b8dd-4ee290adc137 None admin] RBAC: Adding query filter params (name=reader) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:51.502374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd9adc0-f384-449d-b8dd-4ee290adc137 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:51.503905 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd9adc0-f384-449d-b8dd-4ee290adc137 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:51.514964 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 149/302] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:44:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:51.517664 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9adc0-f384-449d-b8dd-4ee290adc137 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:51.618066 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c57a05-89f5-4ed7-9ba1-70f924de2528 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:51.622912 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:51.632605 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:51.633271 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9adc0-f384-449d-b8dd-4ee290adc137 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:51.655574 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ca2557-1556-4ca2-a8a4-7bc2963f68b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:51.655914 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca2557-1556-4ca2-a8a4-7bc2963f68b6 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:51.656207 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca2557-1556-4ca2-a8a4-7bc2963f68b6 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:51.656487 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca2557-1556-4ca2-a8a4-7bc2963f68b6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:51.657691 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ca2557-1556-4ca2-a8a4-7bc2963f68b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:51.659218 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ca2557-1556-4ca2-a8a4-7bc2963f68b6 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:51.666459 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 154/303] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:44:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:51.666459 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ca2557-1556-4ca2-a8a4-7bc2963f68b6 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:51.675744 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ead426-7944-4594-a2a4-0ff57499c4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:51.676747 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ead426-7944-4594-a2a4-0ff57499c4bc None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:51.677039 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ead426-7944-4594-a2a4-0ff57499c4bc None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:51.677322 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ead426-7944-4594-a2a4-0ff57499c4bc None admin] PATH_INFO: `/v3/roles/member` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:51.688893 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ead426-7944-4594-a2a4-0ff57499c4bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:44:51.697457 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-30ead426-7944-4594-a2a4-0ff57499c4bc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:44:51.697457 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:44:51.697457 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:44:51.697457 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:44:51.697457 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:44:51.697457 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:44:51.697457 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:44:51.697457 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:44:51.697457 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:44:51.697457 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:44:51.697457 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:44:51.697457 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:44:51.697457 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:44:51.697457 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:44:51.697457 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:44:51.697457 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:44:51.698482 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:44:51.698482 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:44:51.698482 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:44:51.698482 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:44:51.698482 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:44:51.698482 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:44:51.698482 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:44:51.698482 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:44:51.698482 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:44:51.698482 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:44:51.698482 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:44:51.698482 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:44:51.698482 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:44:51.698482 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:44:51.698482 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:44:51.698482 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:44:51.699394 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:44:51.699394 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:44:51.699394 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:44:51.699394 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:44:51.699394 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:44:51.699394 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:44:51.699394 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:44:51.699394 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:44:51.699394 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:44:51.699394 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:44:51.699394 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:44:51.699394 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:44:51.699394 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 150/304] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:44:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:44:51.700135 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ead426-7944-4594-a2a4-0ff57499c4bc None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:51.773655 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ca2557-1556-4ca2-a8a4-7bc2963f68b6 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:51.801412 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ead426-7944-4594-a2a4-0ff57499c4bc None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:51.809606 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce686e-8093-4484-a9ad-5a53629f81e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:51.810518 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce686e-8093-4484-a9ad-5a53629f81e9 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:51.810806 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce686e-8093-4484-a9ad-5a53629f81e9 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:51.811091 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce686e-8093-4484-a9ad-5a53629f81e9 None admin] PATH_INFO: `/v3/users/499d500f1e0045019ee4c10f318af9ec` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:51.824218 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ce686e-8093-4484-a9ad-5a53629f81e9 None admin] RBAC: Authorizing `identity:get_user(user_id=499d500f1e0045019ee4c10f318af9ec)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:51.825676 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ce686e-8093-4484-a9ad-5a53629f81e9 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:51.827556 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 155/305] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:44:51 2022] GET /identity/v3/users/499d500f1e0045019ee4c10f318af9ec => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:51.828171 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce686e-8093-4484-a9ad-5a53629f81e9 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:51.839451 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb67bc6-fad4-4e6c-8312-01d60121f1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:51.840136 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb67bc6-fad4-4e6c-8312-01d60121f1ce None admin] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:51.840430 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb67bc6-fad4-4e6c-8312-01d60121f1ce None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:51.840720 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb67bc6-fad4-4e6c-8312-01d60121f1ce None admin] PATH_INFO: `/v3/groups` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:51.841432 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb67bc6-fad4-4e6c-8312-01d60121f1ce None admin] RBAC: Authorizing `identity:create_group()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:51.842935 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb67bc6-fad4-4e6c-8312-01d60121f1ce None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:51.867916 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:51.893809 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 151/306] 10.222.0.30 () {60 vars in 1134 bytes} [Tue Jul 5 21:44:51 2022] POST /identity/v3/groups => generated 229 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:44:51.895143 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c621b-7bf2-47b0-a167-f2678eb134b1 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:51.895445 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c621b-7bf2-47b0-a167-f2678eb134b1 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:51.895732 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c621b-7bf2-47b0-a167-f2678eb134b1 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:51.897020 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 152/307] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:51.897761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c621b-7bf2-47b0-a167-f2678eb134b1 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:51.928606 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:51.937588 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce686e-8093-4484-a9ad-5a53629f81e9 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:51.979986 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece2635e-61f2-4a80-a74b-af8c29f204be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:51.980976 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2635e-61f2-4a80-a74b-af8c29f204be None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:51.981449 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2635e-61f2-4a80-a74b-af8c29f204be None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:51.981736 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2635e-61f2-4a80-a74b-af8c29f204be None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:51.982598 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece2635e-61f2-4a80-a74b-af8c29f204be None admin] RBAC: Adding query filter params (name=member) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:51.982961 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece2635e-61f2-4a80-a74b-af8c29f204be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:51.984449 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece2635e-61f2-4a80-a74b-af8c29f204be None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:51.994606 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 156/308] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:44:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:51.995800 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d6bdd-b412-41ee-8693-4b13a5c5bfc9 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:51.996100 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d6bdd-b412-41ee-8693-4b13a5c5bfc9 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:51.996388 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d6bdd-b412-41ee-8693-4b13a5c5bfc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:52.013705 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-873d6bdd-b412-41ee-8693-4b13a5c5bfc9 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:52.015021 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-873d6bdd-b412-41ee-8693-4b13a5c5bfc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:52.036804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c621b-7bf2-47b0-a167-f2678eb134b1 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:52.079338 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5ede8-7183-4957-a049-32d8f3e9918c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:52.080247 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5ede8-7183-4957-a049-32d8f3e9918c None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:52.080696 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5ede8-7183-4957-a049-32d8f3e9918c None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:52.080979 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5ede8-7183-4957-a049-32d8f3e9918c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:52.081854 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f5ede8-7183-4957-a049-32d8f3e9918c None admin] RBAC: Adding query filter params (role.id=b4cc928f3fd4418b988335683cdad5f3, user.id=499d500f1e0045019ee4c10f318af9ec, scope.system=all) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:52.082196 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f5ede8-7183-4957-a049-32d8f3e9918c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:52.084515 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f5ede8-7183-4957-a049-32d8f3e9918c None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:52.090206 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 153/309] 10.222.0.30 () {56 vars in 1308 bytes} [Tue Jul 5 21:44:51 2022] GET /identity/v3/role_assignments?user.id=499d500f1e0045019ee4c10f318af9ec&scope.system=all&role.id=b4cc928f3fd4418b988335683cdad5f3 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:52.090368 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5ede8-7183-4957-a049-32d8f3e9918c None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:52.094343 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 157/310] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:44:52.120106 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d6bdd-b412-41ee-8693-4b13a5c5bfc9 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:52.167605 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:52.188414 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:52.215748 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5ede8-7183-4957-a049-32d8f3e9918c None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:52.256308 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160d9b9-4da4-4b89-bb74-37d829dec3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:52.256844 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d6bdd-b412-41ee-8693-4b13a5c5bfc9 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:52.258407 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160d9b9-4da4-4b89-bb74-37d829dec3cd None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:52.258889 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160d9b9-4da4-4b89-bb74-37d829dec3cd None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:52.259356 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160d9b9-4da4-4b89-bb74-37d829dec3cd None admin] PATH_INFO: `/v3/users/de4a1d47e01f41db96cded97b19a056d` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:52.260851 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4160d9b9-4da4-4b89-bb74-37d829dec3cd None admin] RBAC: Authorizing `identity:get_user(user_id=de4a1d47e01f41db96cded97b19a056d)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:52.262571 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4160d9b9-4da4-4b89-bb74-37d829dec3cd None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:52.264493 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 154/311] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:44:52 2022] GET /identity/v3/users/de4a1d47e01f41db96cded97b19a056d => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:52.271925 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160d9b9-4da4-4b89-bb74-37d829dec3cd None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:52.296291 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e0e13-cc61-42a0-ad57-5233388a6d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:52.297420 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e0e13-cc61-42a0-ad57-5233388a6d07 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:52.297891 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e0e13-cc61-42a0-ad57-5233388a6d07 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:52.298364 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e0e13-cc61-42a0-ad57-5233388a6d07 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:52.310738 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8e0e13-cc61-42a0-ad57-5233388a6d07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:44:52.318772 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-1b8e0e13-cc61-42a0-ad57-5233388a6d07 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:44:52.318772 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:44:52.318772 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:44:52.318772 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:44:52.318772 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:44:52.318772 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:44:52.318772 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:44:52.318772 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:44:52.318772 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:44:52.318772 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:44:52.318772 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:44:52.318772 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:44:52.318772 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:44:52.318772 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:44:52.318772 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:44:52.318772 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:44:52.320558 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:44:52.320558 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:44:52.320558 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:44:52.320558 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:44:52.320558 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:44:52.320558 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:44:52.320558 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:44:52.320558 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:44:52.320558 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:44:52.320558 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:44:52.320558 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:44:52.320558 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:44:52.320558 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:44:52.320558 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:44:52.320558 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:44:52.320558 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:44:52.321678 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:44:52.321678 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:44:52.321678 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:44:52.321678 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:44:52.321678 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:44:52.321678 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:44:52.321678 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:44:52.321678 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:44:52.321678 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:44:52.321678 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:44:52.321678 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:44:52.321678 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:44:52.329081 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 158/312] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:44:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:44:52.330194 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e0e13-cc61-42a0-ad57-5233388a6d07 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:52.385846 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160d9b9-4da4-4b89-bb74-37d829dec3cd None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:52.430537 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1b756-10c5-4b6e-a7a5-e9edcb88a7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:52.431688 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1b756-10c5-4b6e-a7a5-e9edcb88a7d3 None admin] REQUEST_METHOD: `PUT` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:52.432265 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1b756-10c5-4b6e-a7a5-e9edcb88a7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:52.433507 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1b756-10c5-4b6e-a7a5-e9edcb88a7d3 None admin] PATH_INFO: `/v3/system/users/de4a1d47e01f41db96cded97b19a056d/roles/41a9e10d8ca34fa892f53bf450f29554` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:52.435315 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca1b756-10c5-4b6e-a7a5-e9edcb88a7d3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=de4a1d47e01f41db96cded97b19a056d, role_id=41a9e10d8ca34fa892f53bf450f29554)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:52.437812 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca1b756-10c5-4b6e-a7a5-e9edcb88a7d3 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:52.451890 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:52.462214 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e0e13-cc61-42a0-ad57-5233388a6d07 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:52.498537 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb52bad-28e4-451a-98c9-1f1e41fea251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:52.499248 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb52bad-28e4-451a-98c9-1f1e41fea251 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:52.499542 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb52bad-28e4-451a-98c9-1f1e41fea251 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:52.499818 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb52bad-28e4-451a-98c9-1f1e41fea251 None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:52.500580 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb52bad-28e4-451a-98c9-1f1e41fea251 None admin] RBAC: Adding query filter params (name=reader) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:52.500893 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb52bad-28e4-451a-98c9-1f1e41fea251 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:52.502355 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb52bad-28e4-451a-98c9-1f1e41fea251 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:52.515614 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 159/313] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:44:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:52.520059 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb52bad-28e4-451a-98c9-1f1e41fea251 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:52.539862 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 155/314] 10.222.0.30 () {58 vars in 1334 bytes} [Tue Jul 5 21:44:52 2022] PUT /identity/v3/system/users/de4a1d47e01f41db96cded97b19a056d/roles/41a9e10d8ca34fa892f53bf450f29554 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:44:52.649617 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb52bad-28e4-451a-98c9-1f1e41fea251 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:52.689321 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c027c1-b77d-4060-9bff-96c68838db36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:52.690244 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c027c1-b77d-4060-9bff-96c68838db36 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:52.690538 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c027c1-b77d-4060-9bff-96c68838db36 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:52.690820 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c027c1-b77d-4060-9bff-96c68838db36 None admin] PATH_INFO: `/v3/users/d8db9261080c45b7a24af1ecbd8e34d8` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:52.692209 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c027c1-b77d-4060-9bff-96c68838db36 None admin] RBAC: Authorizing `identity:get_user(user_id=d8db9261080c45b7a24af1ecbd8e34d8)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:52.693793 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c027c1-b77d-4060-9bff-96c68838db36 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:52.697226 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 160/315] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:44:52 2022] GET /identity/v3/users/d8db9261080c45b7a24af1ecbd8e34d8 => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:52.702697 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1b756-10c5-4b6e-a7a5-e9edcb88a7d3 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:52.716776 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:52.816476 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1b756-10c5-4b6e-a7a5-e9edcb88a7d3 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:52.857109 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e258d85-b6c8-46ac-847a-95c8658395df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:52.857782 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e258d85-b6c8-46ac-847a-95c8658395df None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:52.858078 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e258d85-b6c8-46ac-847a-95c8658395df None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:52.858406 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e258d85-b6c8-46ac-847a-95c8658395df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:52.933320 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e258d85-b6c8-46ac-847a-95c8658395df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:52.934772 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e258d85-b6c8-46ac-847a-95c8658395df None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:52.944969 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:53.041507 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 156/316] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:44:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:44:53.047199 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c027c1-b77d-4060-9bff-96c68838db36 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:53.071779 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:53.172610 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c027c1-b77d-4060-9bff-96c68838db36 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:53.208323 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155372d-d49d-4df4-82ce-91cea468f249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:53.209647 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155372d-d49d-4df4-82ce-91cea468f249 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:53.210164 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155372d-d49d-4df4-82ce-91cea468f249 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:53.211695 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155372d-d49d-4df4-82ce-91cea468f249 None admin] PATH_INFO: `/v3/projects/b74bb643188f42a68dced2cedca8fb95` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:53.213285 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6155372d-d49d-4df4-82ce-91cea468f249 None admin] RBAC: Authorizing `identity:get_project(project_id=b74bb643188f42a68dced2cedca8fb95)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:53.214987 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6155372d-d49d-4df4-82ce-91cea468f249 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:53.217247 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 161/317] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:44:53 2022] GET /identity/v3/projects/b74bb643188f42a68dced2cedca8fb95 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:53.227659 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e258d85-b6c8-46ac-847a-95c8658395df None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:53.333201 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e258d85-b6c8-46ac-847a-95c8658395df None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:53.343604 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:53.369847 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9c122-0346-4362-8243-693dff2457ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:53.370569 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9c122-0346-4362-8243-693dff2457ef None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:53.370864 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9c122-0346-4362-8243-693dff2457ef None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:53.371150 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9c122-0346-4362-8243-693dff2457ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:53.372080 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f9c122-0346-4362-8243-693dff2457ef None admin] RBAC: Adding query filter params (role.id=b4cc928f3fd4418b988335683cdad5f3, scope.project.id=b74bb643188f42a68dced2cedca8fb95, user.id=d8db9261080c45b7a24af1ecbd8e34d8) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:53.372768 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f9c122-0346-4362-8243-693dff2457ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:53.374285 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f9c122-0346-4362-8243-693dff2457ef None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:53.380732 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 157/318] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:44:53 2022] GET /identity/v3/role_assignments?user.id=d8db9261080c45b7a24af1ecbd8e34d8&scope.project.id=b74bb643188f42a68dced2cedca8fb95&role.id=b4cc928f3fd4418b988335683cdad5f3 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:54.030898 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6a4b9-1a3d-4c7f-b41c-b1555b8ee2e9 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:54.031218 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6a4b9-1a3d-4c7f-b41c-b1555b8ee2e9 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:54.031498 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6a4b9-1a3d-4c7f-b41c-b1555b8ee2e9 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:54.032855 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 162/319] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:54.038340 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98459114-6091-4623-a6e9-ff1f4f6d3852 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:54.038911 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98459114-6091-4623-a6e9-ff1f4f6d3852 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:54.039030 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98459114-6091-4623-a6e9-ff1f4f6d3852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:54.056376 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-98459114-6091-4623-a6e9-ff1f4f6d3852 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:54.057585 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-98459114-6091-4623-a6e9-ff1f4f6d3852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:54.128611 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 158/320] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:44:54.152001 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6a4b9-1a3d-4c7f-b41c-b1555b8ee2e9 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:54.244425 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:54.258514 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6a4b9-1a3d-4c7f-b41c-b1555b8ee2e9 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:54.266975 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b606d-ce0b-4019-a049-a286ab5ba570 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:54.267280 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b606d-ce0b-4019-a049-a286ab5ba570 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:54.267575 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b606d-ce0b-4019-a049-a286ab5ba570 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:54.269003 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 159/321] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:54.274950 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4d026-bc9d-4629-a051-c2c02470d3a2 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:54.275244 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4d026-bc9d-4629-a051-c2c02470d3a2 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:54.275526 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4d026-bc9d-4629-a051-c2c02470d3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:54.293748 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-b8a4d026-bc9d-4629-a051-c2c02470d3a2 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:54.294934 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486bfa4-3a15-41fd-a18d-4ccd2b0b40f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:54.295257 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-b8a4d026-bc9d-4629-a051-c2c02470d3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:54.295743 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486bfa4-3a15-41fd-a18d-4ccd2b0b40f3 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:54.296030 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486bfa4-3a15-41fd-a18d-4ccd2b0b40f3 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:54.296309 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486bfa4-3a15-41fd-a18d-4ccd2b0b40f3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:54.297483 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486bfa4-3a15-41fd-a18d-4ccd2b0b40f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:54.299157 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486bfa4-3a15-41fd-a18d-4ccd2b0b40f3 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:54.300748 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 163/322] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:44:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:54.306256 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486bfa4-3a15-41fd-a18d-4ccd2b0b40f3 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:54.370168 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 160/323] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:44:54.392460 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4d026-bc9d-4629-a051-c2c02470d3a2 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:54.419055 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486bfa4-3a15-41fd-a18d-4ccd2b0b40f3 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:54.425038 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:54.456568 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6bce7c-a095-4fc7-aab3-48cf3b1be639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:54.457252 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bce7c-a095-4fc7-aab3-48cf3b1be639 None admin] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:54.457542 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bce7c-a095-4fc7-aab3-48cf3b1be639 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:54.457823 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bce7c-a095-4fc7-aab3-48cf3b1be639 None admin] PATH_INFO: `/v3/groups` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:54.458547 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6bce7c-a095-4fc7-aab3-48cf3b1be639 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:54.459990 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6bce7c-a095-4fc7-aab3-48cf3b1be639 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:54.497856 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4d026-bc9d-4629-a051-c2c02470d3a2 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:54.534295 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02575ee7-1615-413d-99c9-23bb1518bea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:54.535113 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02575ee7-1615-413d-99c9-23bb1518bea1 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:54.535407 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02575ee7-1615-413d-99c9-23bb1518bea1 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:54.535689 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02575ee7-1615-413d-99c9-23bb1518bea1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:54.541196 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 164/324] 10.222.0.30 () {60 vars in 1134 bytes} [Tue Jul 5 21:44:54 2022] POST /identity/v3/groups => generated 226 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:44:54.559947 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02575ee7-1615-413d-99c9-23bb1518bea1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:44:54.568471 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-02575ee7-1615-413d-99c9-23bb1518bea1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:44:54.568471 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:44:54.568471 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:44:54.568471 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:44:54.568471 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:44:54.568471 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:44:54.568471 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:44:54.568471 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:44:54.568471 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:44:54.568471 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:44:54.568471 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:44:54.568471 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:44:54.568471 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:44:54.568471 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:44:54.568471 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:44:54.568471 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:44:54.569717 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:44:54.569717 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:44:54.569717 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:44:54.569717 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:44:54.569717 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:44:54.569717 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:44:54.569717 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:44:54.569717 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:44:54.569717 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:44:54.569717 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:44:54.569717 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:44:54.569717 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:44:54.569717 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:44:54.569717 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:44:54.569717 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:44:54.569717 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:44:54.576829 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:44:54.576829 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:44:54.576829 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:44:54.576829 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:44:54.576829 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:44:54.576829 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:44:54.576829 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:44:54.576829 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:44:54.576829 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:44:54.576829 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:44:54.576829 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:44:54.576829 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:44:54.576829 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 161/325] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:44:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:44:54.581839 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6bce7c-a095-4fc7-aab3-48cf3b1be639 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:54.604596 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:54.664550 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec679c-3b95-4910-b80b-964a440ab109 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:54.664829 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec679c-3b95-4910-b80b-964a440ab109 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:54.665252 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec679c-3b95-4910-b80b-964a440ab109 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:54.666856 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 162/326] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:44:54.673024 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24019264-f638-48ec-87cc-ca454f9a38a3 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:54.673579 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24019264-f638-48ec-87cc-ca454f9a38a3 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:54.673883 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24019264-f638-48ec-87cc-ca454f9a38a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:54.692177 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-24019264-f638-48ec-87cc-ca454f9a38a3 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:54.693411 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-24019264-f638-48ec-87cc-ca454f9a38a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:54.703022 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6bce7c-a095-4fc7-aab3-48cf3b1be639 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:54.741407 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4319728-c499-4b11-80b6-5e138c740f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:54.742573 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4319728-c499-4b11-80b6-5e138c740f2f None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:54.745583 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4319728-c499-4b11-80b6-5e138c740f2f None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:54.745583 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4319728-c499-4b11-80b6-5e138c740f2f None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:54.745583 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4319728-c499-4b11-80b6-5e138c740f2f None admin] RBAC: Adding query filter params (name=reader) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:54.745583 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4319728-c499-4b11-80b6-5e138c740f2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:54.745583 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4319728-c499-4b11-80b6-5e138c740f2f None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:54.760299 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 165/327] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:44:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:54.761232 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4319728-c499-4b11-80b6-5e138c740f2f None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:54.791587 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 163/328] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:44:54.815627 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24019264-f638-48ec-87cc-ca454f9a38a3 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:54.846547 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:54.870611 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:54.894832 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4319728-c499-4b11-80b6-5e138c740f2f None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:54.940704 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24019264-f638-48ec-87cc-ca454f9a38a3 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:54.942009 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3650a6aa-2d2d-4355-9bad-687c19efba82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:54.944862 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650a6aa-2d2d-4355-9bad-687c19efba82 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:54.945665 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650a6aa-2d2d-4355-9bad-687c19efba82 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:54.945957 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650a6aa-2d2d-4355-9bad-687c19efba82 None admin] PATH_INFO: `/v3/users/499d500f1e0045019ee4c10f318af9ec` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:54.948224 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3650a6aa-2d2d-4355-9bad-687c19efba82 None admin] RBAC: Authorizing `identity:get_user(user_id=499d500f1e0045019ee4c10f318af9ec)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:54.949724 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3650a6aa-2d2d-4355-9bad-687c19efba82 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:54.951780 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 166/329] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:44:54 2022] GET /identity/v3/users/499d500f1e0045019ee4c10f318af9ec => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:54.957264 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3650a6aa-2d2d-4355-9bad-687c19efba82 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:54.993502 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0164645-532b-437a-982b-ee9f97fc9ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:54.994370 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0164645-532b-437a-982b-ee9f97fc9ec6 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:54.994666 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0164645-532b-437a-982b-ee9f97fc9ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:54.994953 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0164645-532b-437a-982b-ee9f97fc9ec6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:55.008569 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0164645-532b-437a-982b-ee9f97fc9ec6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:44:55.018263 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-e0164645-532b-437a-982b-ee9f97fc9ec6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:44:55.018263 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:44:55.018263 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:44:55.018263 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:44:55.018263 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:44:55.018263 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:44:55.018263 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:44:55.018263 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:44:55.018263 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:44:55.018263 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:44:55.018263 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:44:55.018263 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:44:55.018263 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:44:55.018263 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:44:55.018263 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:44:55.018263 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:44:55.019357 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:44:55.019357 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:44:55.019357 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:44:55.019357 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:44:55.019357 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:44:55.019357 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:44:55.019357 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:44:55.019357 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:44:55.019357 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:44:55.019357 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:44:55.019357 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:44:55.019357 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:44:55.019357 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:44:55.019357 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:44:55.019357 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:44:55.019357 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:44:55.020417 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:44:55.020417 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:44:55.020417 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:44:55.020417 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:44:55.020417 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:44:55.020417 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:44:55.020417 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:44:55.020417 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:44:55.020417 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:44:55.020417 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:44:55.020417 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:44:55.020417 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:44:55.020417 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 164/330] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:44:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:44:55.027839 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0164645-532b-437a-982b-ee9f97fc9ec6 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:55.089554 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3650a6aa-2d2d-4355-9bad-687c19efba82 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:55.139297 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a893486-c9b6-4193-a3cb-c179c72572ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:55.140354 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a893486-c9b6-4193-a3cb-c179c72572ca None admin] REQUEST_METHOD: `PUT` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:55.140650 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a893486-c9b6-4193-a3cb-c179c72572ca None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:55.140943 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a893486-c9b6-4193-a3cb-c179c72572ca None admin] PATH_INFO: `/v3/system/users/499d500f1e0045019ee4c10f318af9ec/roles/b4cc928f3fd4418b988335683cdad5f3` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:55.142532 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a893486-c9b6-4193-a3cb-c179c72572ca None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=499d500f1e0045019ee4c10f318af9ec, role_id=b4cc928f3fd4418b988335683cdad5f3)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:55.143936 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a893486-c9b6-4193-a3cb-c179c72572ca None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:55.149595 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:55.172668 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0164645-532b-437a-982b-ee9f97fc9ec6 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:55.209253 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640121d-d799-42b2-8dc8-84008378e104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:55.209940 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640121d-d799-42b2-8dc8-84008378e104 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:55.210264 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640121d-d799-42b2-8dc8-84008378e104 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:55.211128 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640121d-d799-42b2-8dc8-84008378e104 None admin] PATH_INFO: `/v3/roles` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:55.212082 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0640121d-d799-42b2-8dc8-84008378e104 None admin] RBAC: Adding query filter params (name=member) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:55.212400 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0640121d-d799-42b2-8dc8-84008378e104 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:55.215484 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 167/331] 10.222.0.30 () {58 vars in 1334 bytes} [Tue Jul 5 21:44:54 2022] PUT /identity/v3/system/users/499d500f1e0045019ee4c10f318af9ec/roles/b4cc928f3fd4418b988335683cdad5f3 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:44:55.215919 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0640121d-d799-42b2-8dc8-84008378e104 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:55.229071 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 165/332] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:44:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:55.235110 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a893486-c9b6-4193-a3cb-c179c72572ca None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:55.253238 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:55.366424 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a893486-c9b6-4193-a3cb-c179c72572ca None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:55.410727 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb294705-1d0a-4b76-abdf-3a4fae07f3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:55.411624 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb294705-1d0a-4b76-abdf-3a4fae07f3c4 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:55.411912 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb294705-1d0a-4b76-abdf-3a4fae07f3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:55.412192 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb294705-1d0a-4b76-abdf-3a4fae07f3c4 None admin] PATH_INFO: `/v3/users/de4a1d47e01f41db96cded97b19a056d` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:55.413475 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb294705-1d0a-4b76-abdf-3a4fae07f3c4 None admin] RBAC: Authorizing `identity:get_user(user_id=de4a1d47e01f41db96cded97b19a056d)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:55.415363 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb294705-1d0a-4b76-abdf-3a4fae07f3c4 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:55.417378 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 168/333] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:44:55 2022] GET /identity/v3/users/de4a1d47e01f41db96cded97b19a056d => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:55.423477 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640121d-d799-42b2-8dc8-84008378e104 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:55.549943 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640121d-d799-42b2-8dc8-84008378e104 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:55.594247 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ea6a4-1038-4824-8bab-31a6589f26ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:55.594926 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ea6a4-1038-4824-8bab-31a6589f26ed None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:55.595216 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ea6a4-1038-4824-8bab-31a6589f26ed None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:55.595502 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ea6a4-1038-4824-8bab-31a6589f26ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:55.596358 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ea6a4-1038-4824-8bab-31a6589f26ed None admin] RBAC: Adding query filter params (role.id=41a9e10d8ca34fa892f53bf450f29554, user.id=de4a1d47e01f41db96cded97b19a056d, scope.system=all) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:55.596679 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ea6a4-1038-4824-8bab-31a6589f26ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:55.598243 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ea6a4-1038-4824-8bab-31a6589f26ed None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:55.612494 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 166/334] 10.222.0.30 () {56 vars in 1308 bytes} [Tue Jul 5 21:44:55 2022] GET /identity/v3/role_assignments?user.id=de4a1d47e01f41db96cded97b19a056d&scope.system=all&role.id=41a9e10d8ca34fa892f53bf450f29554 => generated 510 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:57.013907 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197470f-6cc3-404e-9b55-cdd110f06c5d None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:57.014490 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197470f-6cc3-404e-9b55-cdd110f06c5d None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:57.014490 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197470f-6cc3-404e-9b55-cdd110f06c5d None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:57.016137 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 169/335] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:57.021565 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb8923-eb23-4cc4-b21d-60290224d28f None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:57.022001 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb8923-eb23-4cc4-b21d-60290224d28f None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:57.022229 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb8923-eb23-4cc4-b21d-60290224d28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:57.028329 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:57.042349 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-64bb8923-eb23-4cc4-b21d-60290224d28f None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:57.047686 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-64bb8923-eb23-4cc4-b21d-60290224d28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:57.132214 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 167/336] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:44:57.168836 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197470f-6cc3-404e-9b55-cdd110f06c5d None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:57.287707 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:57.318458 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197470f-6cc3-404e-9b55-cdd110f06c5d None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:57.369776 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0c2d7-06b6-4bdc-a8b1-209ece1b2bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:57.371018 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0c2d7-06b6-4bdc-a8b1-209ece1b2bac None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:57.371530 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0c2d7-06b6-4bdc-a8b1-209ece1b2bac None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:57.372025 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0c2d7-06b6-4bdc-a8b1-209ece1b2bac None admin] PATH_INFO: `/v3/roles/member` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:57.388415 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc0c2d7-06b6-4bdc-a8b1-209ece1b2bac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:44:57.396629 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-9fc0c2d7-06b6-4bdc-a8b1-209ece1b2bac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:44:57.396629 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:44:57.396629 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:44:57.396629 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:44:57.396629 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:44:57.396629 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:44:57.396629 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:44:57.396629 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:44:57.396629 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:44:57.396629 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:44:57.396629 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:44:57.396629 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:44:57.396629 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:44:57.396629 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:44:57.396629 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:44:57.396629 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:44:57.397633 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:44:57.397633 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:44:57.397633 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:44:57.397633 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:44:57.397633 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:44:57.397633 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:44:57.397633 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:44:57.397633 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:44:57.397633 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:44:57.397633 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:44:57.397633 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:44:57.397633 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:44:57.397633 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:44:57.397633 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:44:57.397633 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:44:57.397633 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:44:57.399421 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:44:57.399421 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:44:57.399421 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:44:57.399421 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:44:57.399421 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:44:57.399421 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:44:57.399421 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:44:57.399421 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:44:57.399421 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:44:57.399421 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:44:57.399421 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:44:57.399421 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:44:57.406354 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 170/337] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:44:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:44:57.407689 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb8923-eb23-4cc4-b21d-60290224d28f None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:57.578329 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb8923-eb23-4cc4-b21d-60290224d28f None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:57.611201 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:57.616688 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050812a0-4fcf-45d6-808e-88c5a058d323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:57.617387 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050812a0-4fcf-45d6-808e-88c5a058d323 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:57.617666 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050812a0-4fcf-45d6-808e-88c5a058d323 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:57.617987 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050812a0-4fcf-45d6-808e-88c5a058d323 None admin] PATH_INFO: `/v3/roles` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:57.618793 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050812a0-4fcf-45d6-808e-88c5a058d323 None admin] RBAC: Adding query filter params (name=member) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:57.625321 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050812a0-4fcf-45d6-808e-88c5a058d323 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:57.625321 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050812a0-4fcf-45d6-808e-88c5a058d323 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:57.632672 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 168/338] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:44:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:57.638271 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0c2d7-06b6-4bdc-a8b1-209ece1b2bac None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:57.768005 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0c2d7-06b6-4bdc-a8b1-209ece1b2bac None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:57.817752 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f55932b-ca90-4632-be82-c5928429947a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:57.818812 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55932b-ca90-4632-be82-c5928429947a None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:57.819325 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55932b-ca90-4632-be82-c5928429947a None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:57.820469 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55932b-ca90-4632-be82-c5928429947a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:57.835616 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:57.906403 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f55932b-ca90-4632-be82-c5928429947a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:57.907882 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f55932b-ca90-4632-be82-c5928429947a None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:57.965012 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40540a3e-678e-4485-9049-b7a448bc534a None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:57.965697 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40540a3e-678e-4485-9049-b7a448bc534a None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:57.966239 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40540a3e-678e-4485-9049-b7a448bc534a None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:57.967848 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 169/339] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:44:57.973061 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936dc061-337d-46cf-ac9e-12091e95e8a5 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:57.973726 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936dc061-337d-46cf-ac9e-12091e95e8a5 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:57.974260 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936dc061-337d-46cf-ac9e-12091e95e8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:58.008128 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-936dc061-337d-46cf-ac9e-12091e95e8a5 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:58.009816 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-936dc061-337d-46cf-ac9e-12091e95e8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:58.041977 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 171/340] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:44:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 21:44:58.045068 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec857054-9079-459e-94ae-b06be3cfef73 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:58.045360 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec857054-9079-459e-94ae-b06be3cfef73 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:58.045642 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec857054-9079-459e-94ae-b06be3cfef73 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:58.046960 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 172/341] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:58.050494 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec857054-9079-459e-94ae-b06be3cfef73 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:58.121766 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:58.155621 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 170/342] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:44:58.157080 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd6d01-87ff-4e92-94d0-68234779b33d None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:58.157378 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd6d01-87ff-4e92-94d0-68234779b33d None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:58.157665 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd6d01-87ff-4e92-94d0-68234779b33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:58.194309 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-b4dd6d01-87ff-4e92-94d0-68234779b33d None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:58.196072 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-b4dd6d01-87ff-4e92-94d0-68234779b33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:58.234831 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec857054-9079-459e-94ae-b06be3cfef73 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:58.275751 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110a58e-f400-4191-acd8-c866dcde1299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:58.276626 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110a58e-f400-4191-acd8-c866dcde1299 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:58.276911 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110a58e-f400-4191-acd8-c866dcde1299 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:58.277209 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110a58e-f400-4191-acd8-c866dcde1299 None admin] PATH_INFO: `/v3/projects/e8b08a08b5d3403b9697254998dfb18f` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:58.278617 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5110a58e-f400-4191-acd8-c866dcde1299 None admin] RBAC: Authorizing `identity:get_project(project_id=e8b08a08b5d3403b9697254998dfb18f)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:58.280069 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5110a58e-f400-4191-acd8-c866dcde1299 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:58.282794 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 173/343] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:44:58 2022] GET /identity/v3/projects/e8b08a08b5d3403b9697254998dfb18f => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:58.283588 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110a58e-f400-4191-acd8-c866dcde1299 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:58.293313 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 171/344] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:44:58.294789 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f7d60-003d-4c9a-b92b-83dfc098786f None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:58.295053 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f7d60-003d-4c9a-b92b-83dfc098786f None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:58.295339 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f7d60-003d-4c9a-b92b-83dfc098786f None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:58.296882 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 172/345] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:58.297602 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f7d60-003d-4c9a-b92b-83dfc098786f None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:58.364740 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:58.402277 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110a58e-f400-4191-acd8-c866dcde1299 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:58.418518 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:58.426175 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f7d60-003d-4c9a-b92b-83dfc098786f None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:58.446426 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0701ed1-3c94-4c59-9e70-deba5e810f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:58.447937 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0701ed1-3c94-4c59-9e70-deba5e810f40 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:58.448236 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0701ed1-3c94-4c59-9e70-deba5e810f40 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:58.448520 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0701ed1-3c94-4c59-9e70-deba5e810f40 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:58.465277 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0701ed1-3c94-4c59-9e70-deba5e810f40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:44:58.471874 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724dfbd7-3ee2-4bea-9bb4-aec421571cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:58.472771 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724dfbd7-3ee2-4bea-9bb4-aec421571cb0 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:58.473065 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724dfbd7-3ee2-4bea-9bb4-aec421571cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:58.473355 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724dfbd7-3ee2-4bea-9bb4-aec421571cb0 None admin] PATH_INFO: `/v3/groups/de080813b38b4e56981829a0177784ab` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:58.475332 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-b0701ed1-3c94-4c59-9e70-deba5e810f40 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:44:58.475332 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:44:58.475332 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:44:58.475332 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:44:58.475332 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:44:58.475332 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:44:58.475332 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:44:58.475332 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:44:58.475332 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:44:58.475332 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:44:58.475332 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:44:58.475332 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:44:58.475332 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:44:58.475332 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:44:58.475332 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:44:58.475332 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:44:58.476545 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:44:58.476545 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:44:58.476545 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:44:58.476545 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:44:58.476545 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:44:58.476545 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:44:58.476545 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:44:58.476545 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:44:58.476545 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:44:58.476545 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:44:58.476545 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:44:58.476545 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:44:58.476545 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:44:58.476545 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:44:58.476545 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:44:58.476545 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:44:58.477772 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:44:58.477772 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:44:58.477772 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:44:58.477772 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:44:58.477772 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:44:58.477772 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:44:58.477772 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:44:58.477772 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:44:58.477772 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:44:58.477772 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:44:58.477772 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:44:58.477772 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:44:58.478554 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 174/346] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:44:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:44:58.480764 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4b9dd-a2f2-475a-983a-9264cc4ed0bd None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:58.480764 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4b9dd-a2f2-475a-983a-9264cc4ed0bd None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:58.481093 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4b9dd-a2f2-475a-983a-9264cc4ed0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:58.488438 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724dfbd7-3ee2-4bea-9bb4-aec421571cb0 None admin] RBAC: Authorizing `identity:get_group(group_id=de080813b38b4e56981829a0177784ab)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:58.489974 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724dfbd7-3ee2-4bea-9bb4-aec421571cb0 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:58.495699 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 173/347] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Jul 5 21:44:58 2022] GET /identity/v3/groups/de080813b38b4e56981829a0177784ab => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:58.496648 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724dfbd7-3ee2-4bea-9bb4-aec421571cb0 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:58.500031 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-6ee4b9dd-a2f2-475a-983a-9264cc4ed0bd None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:58.502343 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-6ee4b9dd-a2f2-475a-983a-9264cc4ed0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:58.595343 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 175/348] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:44:58.596337 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4b9dd-a2f2-475a-983a-9264cc4ed0bd None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:58.653581 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724dfbd7-3ee2-4bea-9bb4-aec421571cb0 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:58.680197 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:58.699902 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331ed22-343f-46df-8c84-fa964b4411af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:58.700786 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331ed22-343f-46df-8c84-fa964b4411af None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:58.701084 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331ed22-343f-46df-8c84-fa964b4411af None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:58.701372 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331ed22-343f-46df-8c84-fa964b4411af None admin] PATH_INFO: `/v3/roles/member` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:58.715534 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331ed22-343f-46df-8c84-fa964b4411af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:44:58.724318 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-0331ed22-343f-46df-8c84-fa964b4411af None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:44:58.724318 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:44:58.724318 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:44:58.724318 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:44:58.724318 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:44:58.724318 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:44:58.724318 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:44:58.724318 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:44:58.724318 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:44:58.724318 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:44:58.724318 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:44:58.724318 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:44:58.724318 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:44:58.724318 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:44:58.724318 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:44:58.724318 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:44:58.725452 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:44:58.725452 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:44:58.725452 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:44:58.725452 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:44:58.725452 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:44:58.725452 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:44:58.725452 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:44:58.725452 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:44:58.725452 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:44:58.725452 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:44:58.725452 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:44:58.725452 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:44:58.725452 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:44:58.725452 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:44:58.725452 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:44:58.725452 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:44:58.726795 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:44:58.726795 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:44:58.726795 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:44:58.726795 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:44:58.726795 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:44:58.726795 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:44:58.726795 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:44:58.726795 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:44:58.726795 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:44:58.726795 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:44:58.726795 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:44:58.726795 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:44:58.726795 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 174/349] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:44:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:44:58.726795 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331ed22-343f-46df-8c84-fa964b4411af None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:58.729939 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4b9dd-a2f2-475a-983a-9264cc4ed0bd None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:58.742555 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:58.779822 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83935fbb-3e4b-434f-a2c8-79b04b767978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:58.780550 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83935fbb-3e4b-434f-a2c8-79b04b767978 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:58.780847 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83935fbb-3e4b-434f-a2c8-79b04b767978 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:58.781135 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83935fbb-3e4b-434f-a2c8-79b04b767978 None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:58.781913 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83935fbb-3e4b-434f-a2c8-79b04b767978 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:58.782259 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83935fbb-3e4b-434f-a2c8-79b04b767978 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:58.783663 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83935fbb-3e4b-434f-a2c8-79b04b767978 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:58.796277 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 176/350] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:44:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:58.797099 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83935fbb-3e4b-434f-a2c8-79b04b767978 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:58.864850 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331ed22-343f-46df-8c84-fa964b4411af None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:58.910595 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236bcc9b-bee3-47e3-8506-c8bf9774f380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:58.911222 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bcc9b-bee3-47e3-8506-c8bf9774f380 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:58.911819 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bcc9b-bee3-47e3-8506-c8bf9774f380 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:58.912113 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bcc9b-bee3-47e3-8506-c8bf9774f380 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:58.912981 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236bcc9b-bee3-47e3-8506-c8bf9774f380 None admin] RBAC: Adding query filter params (group.id=de080813b38b4e56981829a0177784ab, role.id=41a9e10d8ca34fa892f53bf450f29554, scope.project.id=e8b08a08b5d3403b9697254998dfb18f) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:58.913301 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236bcc9b-bee3-47e3-8506-c8bf9774f380 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:58.914922 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236bcc9b-bee3-47e3-8506-c8bf9774f380 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:58.923275 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 175/351] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Jul 5 21:44:58 2022] GET /identity/v3/role_assignments?group.id=de080813b38b4e56981829a0177784ab&scope.project.id=e8b08a08b5d3403b9697254998dfb18f&role.id=41a9e10d8ca34fa892f53bf450f29554 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:58.924469 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236bcc9b-bee3-47e3-8506-c8bf9774f380 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:58.929614 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83935fbb-3e4b-434f-a2c8-79b04b767978 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:58.982230 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1fe48c-1f26-49ed-89c1-3381f5ecc425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:58.983281 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1fe48c-1f26-49ed-89c1-3381f5ecc425 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:58.983678 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1fe48c-1f26-49ed-89c1-3381f5ecc425 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:58.984066 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1fe48c-1f26-49ed-89c1-3381f5ecc425 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:58.987308 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:59.002556 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1fe48c-1f26-49ed-89c1-3381f5ecc425 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:44:59.011749 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-6a1fe48c-1f26-49ed-89c1-3381f5ecc425 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:44:59.011749 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:44:59.011749 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:44:59.011749 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:44:59.011749 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:44:59.011749 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:44:59.011749 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:44:59.011749 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:44:59.011749 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:44:59.011749 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:44:59.011749 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:44:59.011749 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:44:59.011749 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:44:59.011749 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:44:59.011749 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:44:59.011749 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:44:59.012798 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:44:59.012798 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:44:59.012798 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:44:59.012798 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:44:59.012798 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:44:59.012798 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:44:59.012798 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:44:59.012798 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:44:59.012798 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:44:59.012798 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:44:59.012798 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:44:59.012798 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:44:59.012798 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:44:59.012798 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:44:59.012798 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:44:59.012798 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:44:59.013827 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:44:59.013827 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:44:59.013827 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:44:59.013827 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:44:59.013827 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:44:59.013827 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:44:59.013827 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:44:59.013827 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:44:59.013827 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:44:59.013827 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:44:59.013827 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 21:44:59.013827 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:44:59.014634 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 177/352] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:44:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:44:59.015459 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1fe48c-1f26-49ed-89c1-3381f5ecc425 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:59.051481 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:59.066424 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236bcc9b-bee3-47e3-8506-c8bf9774f380 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:59.115546 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86affd3c-edce-4caa-a71f-3488db1db214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:59.116241 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86affd3c-edce-4caa-a71f-3488db1db214 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:59.116535 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86affd3c-edce-4caa-a71f-3488db1db214 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:59.116826 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86affd3c-edce-4caa-a71f-3488db1db214 None admin] PATH_INFO: `/v3/roles` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:59.119450 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86affd3c-edce-4caa-a71f-3488db1db214 None admin] RBAC: Adding query filter params (name=member) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:59.119780 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86affd3c-edce-4caa-a71f-3488db1db214 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:59.121382 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86affd3c-edce-4caa-a71f-3488db1db214 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:59.133058 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 176/353] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:44:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:59.134841 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433d9da-385c-4533-b490-cbb74776e5ac None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:59.135315 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433d9da-385c-4533-b490-cbb74776e5ac None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:59.135774 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433d9da-385c-4533-b490-cbb74776e5ac None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:59.137561 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 177/354] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:59.138616 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e433d9da-385c-4533-b490-cbb74776e5ac None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:59.170862 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1fe48c-1f26-49ed-89c1-3381f5ecc425 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:59.231187 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98954f-0853-4505-b99b-44c3919b8250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:59.239213 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98954f-0853-4505-b99b-44c3919b8250 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:59.239213 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98954f-0853-4505-b99b-44c3919b8250 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:59.239213 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98954f-0853-4505-b99b-44c3919b8250 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:59.291526 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e433d9da-385c-4533-b490-cbb74776e5ac None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:59.295016 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:59.323067 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be98954f-0853-4505-b99b-44c3919b8250 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:59.324740 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be98954f-0853-4505-b99b-44c3919b8250 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:59.338946 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce8ae6-6d81-49f6-b7e5-72a3ada3ab14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:59.340074 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce8ae6-6d81-49f6-b7e5-72a3ada3ab14 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:59.340603 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce8ae6-6d81-49f6-b7e5-72a3ada3ab14 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:59.341108 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce8ae6-6d81-49f6-b7e5-72a3ada3ab14 None admin] PATH_INFO: `/v3/roles` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:59.342100 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ce8ae6-6d81-49f6-b7e5-72a3ada3ab14 None admin] RBAC: Adding query filter params (name=reader) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:44:59.342755 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ce8ae6-6d81-49f6-b7e5-72a3ada3ab14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:59.344541 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ce8ae6-6d81-49f6-b7e5-72a3ada3ab14 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:59.347042 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:59.356530 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 178/355] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:44:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:59.357893 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce8ae6-6d81-49f6-b7e5-72a3ada3ab14 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:59.459717 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 178/356] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:44:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:44:59.460696 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fc4e0-14b0-4377-929c-516fb26e64c8 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:59.460998 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fc4e0-14b0-4377-929c-516fb26e64c8 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:59.461617 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fc4e0-14b0-4377-929c-516fb26e64c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:59.483782 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-048fc4e0-14b0-4377-929c-516fb26e64c8 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:44:59.484728 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce8ae6-6d81-49f6-b7e5-72a3ada3ab14 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:59.485025 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-048fc4e0-14b0-4377-929c-516fb26e64c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:44:59.525346 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ae6cf-aaa1-4ef7-9092-9572d95254f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:59.526551 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ae6cf-aaa1-4ef7-9092-9572d95254f0 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:59.527119 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ae6cf-aaa1-4ef7-9092-9572d95254f0 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:59.527615 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ae6cf-aaa1-4ef7-9092-9572d95254f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:59.576527 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 179/357] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:44:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:44:59.576856 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:59.577298 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048fc4e0-14b0-4377-929c-516fb26e64c8 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:59.626520 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ae6cf-aaa1-4ef7-9092-9572d95254f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:59.628382 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ae6cf-aaa1-4ef7-9092-9572d95254f0 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:59.653755 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:59.718973 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048fc4e0-14b0-4377-929c-516fb26e64c8 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:59.751794 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 179/358] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:44:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:44:59.752675 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ae6cf-aaa1-4ef7-9092-9572d95254f0 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:59.764058 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31a3a3-71e9-4eb5-8d41-ff3e1bc491da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:59.764966 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31a3a3-71e9-4eb5-8d41-ff3e1bc491da None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:59.765390 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31a3a3-71e9-4eb5-8d41-ff3e1bc491da None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:59.765678 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31a3a3-71e9-4eb5-8d41-ff3e1bc491da None admin] PATH_INFO: `/v3/users/499d500f1e0045019ee4c10f318af9ec` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:59.766966 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31a3a3-71e9-4eb5-8d41-ff3e1bc491da None admin] RBAC: Authorizing `identity:get_user(user_id=499d500f1e0045019ee4c10f318af9ec)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:59.768567 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31a3a3-71e9-4eb5-8d41-ff3e1bc491da None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:59.770673 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 180/359] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:44:59 2022] GET /identity/v3/users/499d500f1e0045019ee4c10f318af9ec => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:59.771913 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca2a23-4718-4f49-a521-feb17c11e187 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:59.772199 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca2a23-4718-4f49-a521-feb17c11e187 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:59.772478 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca2a23-4718-4f49-a521-feb17c11e187 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:59.774290 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 181/360] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:44:59.775153 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca2a23-4718-4f49-a521-feb17c11e187 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:59.836481 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:59.884542 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ae6cf-aaa1-4ef7-9092-9572d95254f0 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:59.914184 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca2a23-4718-4f49-a521-feb17c11e187 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:44:59.933654 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:44:59.933975 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0430a30-13a6-45cb-92a0-46069fbb0c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:59.934896 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0430a30-13a6-45cb-92a0-46069fbb0c66 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:59.935252 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0430a30-13a6-45cb-92a0-46069fbb0c66 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:59.935537 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0430a30-13a6-45cb-92a0-46069fbb0c66 None admin] PATH_INFO: `/v3/projects/e8b08a08b5d3403b9697254998dfb18f` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:59.938164 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0430a30-13a6-45cb-92a0-46069fbb0c66 None admin] RBAC: Authorizing `identity:get_project(project_id=e8b08a08b5d3403b9697254998dfb18f)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:44:59.938448 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0430a30-13a6-45cb-92a0-46069fbb0c66 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:44:59.940492 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 180/361] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:44:59 2022] GET /identity/v3/projects/e8b08a08b5d3403b9697254998dfb18f => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:44:59.941290 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0430a30-13a6-45cb-92a0-46069fbb0c66 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:44:59.955685 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2f4c8-b2e8-4fd0-8e5b-ac185f8ac238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:44:59.956583 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2f4c8-b2e8-4fd0-8e5b-ac185f8ac238 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:44:59.956878 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2f4c8-b2e8-4fd0-8e5b-ac185f8ac238 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:44:59.957162 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2f4c8-b2e8-4fd0-8e5b-ac185f8ac238 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:44:59.969591 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb2f4c8-b2e8-4fd0-8e5b-ac185f8ac238 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:44:59.980871 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-cbb2f4c8-b2e8-4fd0-8e5b-ac185f8ac238 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:44:59.980871 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:44:59.980871 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:44:59.980871 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:44:59.980871 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:44:59.980871 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:44:59.980871 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:44:59.980871 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:44:59.980871 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:44:59.980871 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:44:59.980871 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:44:59.980871 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:44:59.980871 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:44:59.980871 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:44:59.980871 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:44:59.980871 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:44:59.981889 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:44:59.981889 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:44:59.981889 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:44:59.981889 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:44:59.981889 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:44:59.981889 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:44:59.981889 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:44:59.981889 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:44:59.981889 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:44:59.981889 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:44:59.981889 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:44:59.981889 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:44:59.981889 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:44:59.981889 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:44:59.981889 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:44:59.981889 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:44:59.982841 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:44:59.982841 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:44:59.982841 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:44:59.982841 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:44:59.982841 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:44:59.982841 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:44:59.982841 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:44:59.982841 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:44:59.982841 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:44:59.982841 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:44:59.982841 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:44:59.982841 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:44:59.982841 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 182/362] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:44:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:44:59.982841 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2f4c8-b2e8-4fd0-8e5b-ac185f8ac238 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:00.068829 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0430a30-13a6-45cb-92a0-46069fbb0c66 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:00.115127 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2f4c8-b2e8-4fd0-8e5b-ac185f8ac238 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:00.115805 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32b6c7-6f0a-4198-982e-f3429d0db5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:00.117461 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32b6c7-6f0a-4198-982e-f3429d0db5a2 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:00.117892 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32b6c7-6f0a-4198-982e-f3429d0db5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:00.119069 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32b6c7-6f0a-4198-982e-f3429d0db5a2 None admin] PATH_INFO: `/v3/projects/b74bb643188f42a68dced2cedca8fb95` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:00.120361 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd32b6c7-6f0a-4198-982e-f3429d0db5a2 None admin] RBAC: Authorizing `identity:get_project(project_id=b74bb643188f42a68dced2cedca8fb95)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:00.121816 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd32b6c7-6f0a-4198-982e-f3429d0db5a2 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:00.124215 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 181/363] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:44:59 2022] GET /identity/v3/projects/b74bb643188f42a68dced2cedca8fb95 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:00.125778 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b44e5-7d56-443a-88c3-c4ede09ed2d3 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:00.126075 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b44e5-7d56-443a-88c3-c4ede09ed2d3 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:00.126412 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b44e5-7d56-443a-88c3-c4ede09ed2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:00.133005 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:00.146466 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-0d6b44e5-7d56-443a-88c3-c4ede09ed2d3 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:00.148276 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-0d6b44e5-7d56-443a-88c3-c4ede09ed2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:00.153091 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e72e58-a264-49d9-a09c-761b96b1f079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:00.153770 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e72e58-a264-49d9-a09c-761b96b1f079 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:00.154062 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e72e58-a264-49d9-a09c-761b96b1f079 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:00.154376 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e72e58-a264-49d9-a09c-761b96b1f079 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:00.155227 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e72e58-a264-49d9-a09c-761b96b1f079 None admin] RBAC: Adding query filter params (role.id=b4cc928f3fd4418b988335683cdad5f3, user.id=499d500f1e0045019ee4c10f318af9ec, scope.system=all) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:00.155546 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e72e58-a264-49d9-a09c-761b96b1f079 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:00.157013 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e72e58-a264-49d9-a09c-761b96b1f079 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:00.170892 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 183/364] 10.222.0.30 () {56 vars in 1308 bytes} [Tue Jul 5 21:44:59 2022] GET /identity/v3/role_assignments?user.id=499d500f1e0045019ee4c10f318af9ec&scope.system=all&role.id=b4cc928f3fd4418b988335683cdad5f3 => generated 510 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:00.171591 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e72e58-a264-49d9-a09c-761b96b1f079 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:00.218670 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:00.258749 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 182/365] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:45:00.260504 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b44e5-7d56-443a-88c3-c4ede09ed2d3 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:00.337437 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e72e58-a264-49d9-a09c-761b96b1f079 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:00.384479 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739dcb9d-63a8-4d05-b63a-ecf98b264b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:00.385466 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739dcb9d-63a8-4d05-b63a-ecf98b264b4b None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:00.385830 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739dcb9d-63a8-4d05-b63a-ecf98b264b4b None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:00.386292 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739dcb9d-63a8-4d05-b63a-ecf98b264b4b None admin] PATH_INFO: `/v3/groups/de080813b38b4e56981829a0177784ab` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:00.387567 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739dcb9d-63a8-4d05-b63a-ecf98b264b4b None admin] RBAC: Authorizing `identity:get_group(group_id=de080813b38b4e56981829a0177784ab)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:00.389231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739dcb9d-63a8-4d05-b63a-ecf98b264b4b None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:00.391737 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 184/366] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Jul 5 21:45:00 2022] GET /identity/v3/groups/de080813b38b4e56981829a0177784ab => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:00.391737 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739dcb9d-63a8-4d05-b63a-ecf98b264b4b None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:00.428491 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b44e5-7d56-443a-88c3-c4ede09ed2d3 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:00.467697 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:00.473717 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c37cb3-fbb9-493a-99a7-9d3812b51923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:00.474544 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c37cb3-fbb9-493a-99a7-9d3812b51923 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:00.475015 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c37cb3-fbb9-493a-99a7-9d3812b51923 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:00.475391 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c37cb3-fbb9-493a-99a7-9d3812b51923 None admin] PATH_INFO: `/v3/roles` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:00.476800 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c37cb3-fbb9-493a-99a7-9d3812b51923 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:00.477171 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c37cb3-fbb9-493a-99a7-9d3812b51923 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:00.480995 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c37cb3-fbb9-493a-99a7-9d3812b51923 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:00.494308 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 183/367] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:45:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:00.495241 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c37cb3-fbb9-493a-99a7-9d3812b51923 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:00.530424 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739dcb9d-63a8-4d05-b63a-ecf98b264b4b None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:00.531970 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:00.582688 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b08111-d947-42c3-b7e5-0a51b62f8a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:00.583947 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b08111-d947-42c3-b7e5-0a51b62f8a5e None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:00.584418 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b08111-d947-42c3-b7e5-0a51b62f8a5e None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:00.584886 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b08111-d947-42c3-b7e5-0a51b62f8a5e None admin] PATH_INFO: `/v3/groups/de080813b38b4e56981829a0177784ab` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:00.586337 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b08111-d947-42c3-b7e5-0a51b62f8a5e None admin] RBAC: Authorizing `identity:get_group(group_id=de080813b38b4e56981829a0177784ab)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:00.587915 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b08111-d947-42c3-b7e5-0a51b62f8a5e None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:00.589983 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 185/368] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Jul 5 21:45:00 2022] GET /identity/v3/groups/de080813b38b4e56981829a0177784ab => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:00.590795 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b08111-d947-42c3-b7e5-0a51b62f8a5e None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:00.634419 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c37cb3-fbb9-493a-99a7-9d3812b51923 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:00.684524 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dafa0c-fc52-4d69-807c-c265eacecf7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:00.685339 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dafa0c-fc52-4d69-807c-c265eacecf7c None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:00.685633 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dafa0c-fc52-4d69-807c-c265eacecf7c None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:00.685919 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dafa0c-fc52-4d69-807c-c265eacecf7c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:00.697689 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dafa0c-fc52-4d69-807c-c265eacecf7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:45:00.707084 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-64dafa0c-fc52-4d69-807c-c265eacecf7c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:45:00.707084 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:00.707084 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:00.707084 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:00.707084 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:00.707084 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:00.707084 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:00.707084 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:00.707084 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:00.707084 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:00.707084 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:00.707084 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:00.707084 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:45:00.707084 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:45:00.707084 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:45:00.707084 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:45:00.708080 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:45:00.708080 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:45:00.708080 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:45:00.708080 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:45:00.708080 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:00.708080 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:00.708080 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:00.708080 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:00.708080 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:00.708080 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:00.708080 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:00.708080 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:00.708080 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:00.708080 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:00.708080 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:00.708080 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:00.708987 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:00.708987 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:00.708987 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:00.708987 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:00.708987 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:45:00.708987 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:45:00.708987 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:45:00.708987 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:45:00.708987 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:45:00.708987 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:45:00.708987 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:45:00.708987 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:00.708987 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 184/369] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:45:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:00.709745 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dafa0c-fc52-4d69-807c-c265eacecf7c None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:00.723271 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b08111-d947-42c3-b7e5-0a51b62f8a5e None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:00.771594 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47987296-a1e8-4ff5-a18c-83166da90aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:00.772700 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47987296-a1e8-4ff5-a18c-83166da90aa3 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:00.773387 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47987296-a1e8-4ff5-a18c-83166da90aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:00.773948 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47987296-a1e8-4ff5-a18c-83166da90aa3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:00.775125 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47987296-a1e8-4ff5-a18c-83166da90aa3 None admin] RBAC: Adding query filter params (group.id=de080813b38b4e56981829a0177784ab, role.id=9bd598b07a9942b7a91c3a372f3cf094, scope.project.id=e8b08a08b5d3403b9697254998dfb18f) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:00.775660 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47987296-a1e8-4ff5-a18c-83166da90aa3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:00.777347 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47987296-a1e8-4ff5-a18c-83166da90aa3 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:00.781294 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:00.784201 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 186/370] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Jul 5 21:45:00 2022] GET /identity/v3/role_assignments?group.id=de080813b38b4e56981829a0177784ab&scope.project.id=e8b08a08b5d3403b9697254998dfb18f&role.id=9bd598b07a9942b7a91c3a372f3cf094 => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:00.785219 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47987296-a1e8-4ff5-a18c-83166da90aa3 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:00.826062 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:00.837807 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dafa0c-fc52-4d69-807c-c265eacecf7c None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:00.882750 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b7499-3de4-4fff-b360-1492681e95ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:00.883614 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b7499-3de4-4fff-b360-1492681e95ef None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:00.884011 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b7499-3de4-4fff-b360-1492681e95ef None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:00.884404 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b7499-3de4-4fff-b360-1492681e95ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:00.909567 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47987296-a1e8-4ff5-a18c-83166da90aa3 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:00.953647 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e58dcf-13f6-49c9-a9b1-35ee339a1d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:00.954661 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e58dcf-13f6-49c9-a9b1-35ee339a1d0e None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:00.955146 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e58dcf-13f6-49c9-a9b1-35ee339a1d0e None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:00.955589 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e58dcf-13f6-49c9-a9b1-35ee339a1d0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:00.957322 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e58dcf-13f6-49c9-a9b1-35ee339a1d0e None admin] RBAC: Adding query filter params (group.id=de080813b38b4e56981829a0177784ab, role.id=41a9e10d8ca34fa892f53bf450f29554, scope.project.id=b74bb643188f42a68dced2cedca8fb95) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:00.957842 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e58dcf-13f6-49c9-a9b1-35ee339a1d0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:00.959531 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e58dcf-13f6-49c9-a9b1-35ee339a1d0e None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:00.967044 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 187/371] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Jul 5 21:45:00 2022] GET /identity/v3/role_assignments?group.id=de080813b38b4e56981829a0177784ab&scope.project.id=b74bb643188f42a68dced2cedca8fb95&role.id=41a9e10d8ca34fa892f53bf450f29554 => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:00.974156 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e58dcf-13f6-49c9-a9b1-35ee339a1d0e None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:00.974377 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997b7499-3de4-4fff-b360-1492681e95ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:00.974377 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997b7499-3de4-4fff-b360-1492681e95ef None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:01.043697 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:01.108372 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 185/372] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:45:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:45:01.112753 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b7499-3de4-4fff-b360-1492681e95ef None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:01.190440 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:01.195748 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e58dcf-13f6-49c9-a9b1-35ee339a1d0e None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:01.251904 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b7499-3de4-4fff-b360-1492681e95ef None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:01.259470 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a28776-37b3-4393-9f60-7cae71386242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:01.260176 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a28776-37b3-4393-9f60-7cae71386242 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:01.260464 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a28776-37b3-4393-9f60-7cae71386242 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:01.260743 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a28776-37b3-4393-9f60-7cae71386242 None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:01.261516 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a28776-37b3-4393-9f60-7cae71386242 None admin] RBAC: Adding query filter params (name=admin) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:01.261825 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a28776-37b3-4393-9f60-7cae71386242 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:01.263253 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a28776-37b3-4393-9f60-7cae71386242 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:01.277793 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 188/373] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:45:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:01.285315 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a28776-37b3-4393-9f60-7cae71386242 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:01.298713 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6cd64c-bc26-4149-a05f-9a713e4cc6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:01.300006 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cd64c-bc26-4149-a05f-9a713e4cc6ec None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:01.300530 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cd64c-bc26-4149-a05f-9a713e4cc6ec None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:01.301022 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cd64c-bc26-4149-a05f-9a713e4cc6ec None admin] PATH_INFO: `/v3/projects/b74bb643188f42a68dced2cedca8fb95` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:01.302528 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6cd64c-bc26-4149-a05f-9a713e4cc6ec None admin] RBAC: Authorizing `identity:get_project(project_id=b74bb643188f42a68dced2cedca8fb95)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:01.304771 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6cd64c-bc26-4149-a05f-9a713e4cc6ec None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:01.307170 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 186/374] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:45:01 2022] GET /identity/v3/projects/b74bb643188f42a68dced2cedca8fb95 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:01.314502 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6cd64c-bc26-4149-a05f-9a713e4cc6ec None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:01.358976 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:01.435082 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a28776-37b3-4393-9f60-7cae71386242 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:01.459217 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6cd64c-bc26-4149-a05f-9a713e4cc6ec None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:01.474898 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5083e4-9faa-4871-93af-7e4a5e32eb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:01.475570 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5083e4-9faa-4871-93af-7e4a5e32eb53 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:01.475908 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5083e4-9faa-4871-93af-7e4a5e32eb53 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:01.476258 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5083e4-9faa-4871-93af-7e4a5e32eb53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:01.513739 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86bd72-7289-445e-ab02-08b306f343ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:01.515044 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86bd72-7289-445e-ab02-08b306f343ad None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:01.515584 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86bd72-7289-445e-ab02-08b306f343ad None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:01.516073 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86bd72-7289-445e-ab02-08b306f343ad None admin] PATH_INFO: `/v3/groups/de080813b38b4e56981829a0177784ab` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:01.518101 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:01.519042 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e86bd72-7289-445e-ab02-08b306f343ad None admin] RBAC: Authorizing `identity:get_group(group_id=de080813b38b4e56981829a0177784ab)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:01.520739 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e86bd72-7289-445e-ab02-08b306f343ad None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:01.523554 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 187/375] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Jul 5 21:45:01 2022] GET /identity/v3/groups/de080813b38b4e56981829a0177784ab => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:01.525140 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25296461-ac9a-4e72-a86f-83d1fc2f62d2 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:01.525662 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25296461-ac9a-4e72-a86f-83d1fc2f62d2 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:01.526174 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25296461-ac9a-4e72-a86f-83d1fc2f62d2 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:01.527731 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 188/376] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:45:01.528974 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25296461-ac9a-4e72-a86f-83d1fc2f62d2 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:01.579264 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5083e4-9faa-4871-93af-7e4a5e32eb53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:01.581420 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5083e4-9faa-4871-93af-7e4a5e32eb53 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:01.655606 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:01.667328 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25296461-ac9a-4e72-a86f-83d1fc2f62d2 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:01.722300 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45654015-9e0d-4a7d-91db-45d9a1028d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:01.723260 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45654015-9e0d-4a7d-91db-45d9a1028d33 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:01.723700 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45654015-9e0d-4a7d-91db-45d9a1028d33 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:01.724141 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45654015-9e0d-4a7d-91db-45d9a1028d33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:01.725194 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45654015-9e0d-4a7d-91db-45d9a1028d33 None admin] RBAC: Adding query filter params (group.id=de080813b38b4e56981829a0177784ab, role.id=9bd598b07a9942b7a91c3a372f3cf094, scope.project.id=b74bb643188f42a68dced2cedca8fb95) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:01.725725 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45654015-9e0d-4a7d-91db-45d9a1028d33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:01.728266 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45654015-9e0d-4a7d-91db-45d9a1028d33 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:01.728533 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 189/377] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:45:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:45:01.729923 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2cf74-f6ad-4a4f-82ee-16a5f69d746f None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:01.734446 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2cf74-f6ad-4a4f-82ee-16a5f69d746f None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:01.734822 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2cf74-f6ad-4a4f-82ee-16a5f69d746f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:01.735972 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 189/378] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Jul 5 21:45:01 2022] GET /identity/v3/role_assignments?group.id=de080813b38b4e56981829a0177784ab&scope.project.id=b74bb643188f42a68dced2cedca8fb95&role.id=9bd598b07a9942b7a91c3a372f3cf094 => generated 260 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:45:01.741338 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45654015-9e0d-4a7d-91db-45d9a1028d33 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:01.758184 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-1bb2cf74-f6ad-4a4f-82ee-16a5f69d746f None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:01.758184 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-1bb2cf74-f6ad-4a4f-82ee-16a5f69d746f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:01.883907 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:01.908082 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 190/379] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:45:01.931552 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45654015-9e0d-4a7d-91db-45d9a1028d33 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:01.949969 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb2cf74-f6ad-4a4f-82ee-16a5f69d746f None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:01.984750 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7588665-4917-4c89-b62e-c8f2774b3149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:01.987656 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7588665-4917-4c89-b62e-c8f2774b3149 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:01.989287 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7588665-4917-4c89-b62e-c8f2774b3149 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:01.989287 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7588665-4917-4c89-b62e-c8f2774b3149 None admin] PATH_INFO: `/v3/projects/557b6303201840cf82d0fdc7c227e5e6` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:01.989815 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7588665-4917-4c89-b62e-c8f2774b3149 None admin] RBAC: Authorizing `identity:get_project(project_id=557b6303201840cf82d0fdc7c227e5e6)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:01.991977 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7588665-4917-4c89-b62e-c8f2774b3149 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:01.994426 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 190/380] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:45:01 2022] GET /identity/v3/projects/557b6303201840cf82d0fdc7c227e5e6 => generated 344 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:02.000684 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7588665-4917-4c89-b62e-c8f2774b3149 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:02.051262 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:02.168231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb2cf74-f6ad-4a4f-82ee-16a5f69d746f None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:02.191551 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7588665-4917-4c89-b62e-c8f2774b3149 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:02.236572 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a8561-9628-48d9-a4a3-a5321864ef6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:02.238116 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a8561-9628-48d9-a4a3-a5321864ef6d None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:02.238648 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a8561-9628-48d9-a4a3-a5321864ef6d None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:02.240255 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a8561-9628-48d9-a4a3-a5321864ef6d None admin] PATH_INFO: `/v3/roles/member` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:02.256273 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff30517-9a0a-487c-bd63-125748862457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:02.260026 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff30517-9a0a-487c-bd63-125748862457 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:02.260545 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff30517-9a0a-487c-bd63-125748862457 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:02.261034 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff30517-9a0a-487c-bd63-125748862457 None admin] PATH_INFO: `/v3/groups/2e1a376b13ee42d7832b5011273b41e7` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:02.262771 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a8561-9628-48d9-a4a3-a5321864ef6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:45:02.274601 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff30517-9a0a-487c-bd63-125748862457 None admin] RBAC: Authorizing `identity:get_group(group_id=2e1a376b13ee42d7832b5011273b41e7)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:02.276355 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff30517-9a0a-487c-bd63-125748862457 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:02.278652 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 191/381] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Jul 5 21:45:01 2022] GET /identity/v3/groups/2e1a376b13ee42d7832b5011273b41e7 => generated 229 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:45:02.279698 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-196a8561-9628-48d9-a4a3-a5321864ef6d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:45:02.279698 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:02.279698 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:02.279698 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:02.279698 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:02.279698 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:02.279698 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:02.279698 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:02.279698 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:02.279698 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:02.279698 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:02.279698 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:02.279698 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:45:02.279698 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:45:02.279698 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:45:02.279698 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:45:02.280686 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:45:02.280686 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:45:02.280686 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:45:02.280686 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:45:02.280686 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:02.280686 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:02.280686 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:02.280686 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:02.280686 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:02.280686 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:02.280686 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:02.280686 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:02.280686 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:02.280686 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:02.280686 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:02.280686 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:02.281567 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:02.281567 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:02.281567 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:02.281567 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:02.281567 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:45:02.281567 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:45:02.281567 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:45:02.281567 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:45:02.281567 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:45:02.281567 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:45:02.281567 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:45:02.281567 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:02.283981 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff30517-9a0a-487c-bd63-125748862457 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:02.285763 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 191/382] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:45:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:45:02.291913 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a8561-9628-48d9-a4a3-a5321864ef6d None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:02.395398 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:02.398607 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:02.404869 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff30517-9a0a-487c-bd63-125748862457 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:02.442993 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a03562-6ed9-4936-822e-543f0f5dbd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:02.443991 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a03562-6ed9-4936-822e-543f0f5dbd7c None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:02.444381 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a03562-6ed9-4936-822e-543f0f5dbd7c None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:02.444883 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a03562-6ed9-4936-822e-543f0f5dbd7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:02.445842 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a03562-6ed9-4936-822e-543f0f5dbd7c None admin] RBAC: Adding query filter params (group.id=2e1a376b13ee42d7832b5011273b41e7, role.id=e1c574c9973548ebb0e8d9e0656ccabd, scope.project.id=557b6303201840cf82d0fdc7c227e5e6) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:02.446284 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a03562-6ed9-4936-822e-543f0f5dbd7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:02.448158 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a03562-6ed9-4936-822e-543f0f5dbd7c None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:02.456076 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 192/383] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Jul 5 21:45:02 2022] GET /identity/v3/role_assignments?group.id=2e1a376b13ee42d7832b5011273b41e7&scope.project.id=557b6303201840cf82d0fdc7c227e5e6&role.id=e1c574c9973548ebb0e8d9e0656ccabd => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:02.508707 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a8561-9628-48d9-a4a3-a5321864ef6d None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:02.570976 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89044399-453a-4062-81d0-cc6865331be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:02.571685 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89044399-453a-4062-81d0-cc6865331be4 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:02.571978 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89044399-453a-4062-81d0-cc6865331be4 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:02.572256 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89044399-453a-4062-81d0-cc6865331be4 None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:02.573121 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89044399-453a-4062-81d0-cc6865331be4 None admin] RBAC: Adding query filter params (name=member) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:02.573430 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89044399-453a-4062-81d0-cc6865331be4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:02.574885 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89044399-453a-4062-81d0-cc6865331be4 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:02.585090 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 192/384] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:45:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:02.591145 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a03562-6ed9-4936-822e-543f0f5dbd7c None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:02.740847 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a03562-6ed9-4936-822e-543f0f5dbd7c None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:02.794566 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ae7df-a00e-4556-b74b-1e564309d9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:02.795450 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ae7df-a00e-4556-b74b-1e564309d9da None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:02.795747 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ae7df-a00e-4556-b74b-1e564309d9da None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:02.796036 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ae7df-a00e-4556-b74b-1e564309d9da None admin] PATH_INFO: `/v3/groups/de080813b38b4e56981829a0177784ab` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:02.798606 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ae7df-a00e-4556-b74b-1e564309d9da None admin] RBAC: Authorizing `identity:get_group(group_id=de080813b38b4e56981829a0177784ab)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:02.800499 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ae7df-a00e-4556-b74b-1e564309d9da None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:02.802614 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 193/385] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Jul 5 21:45:02 2022] GET /identity/v3/groups/de080813b38b4e56981829a0177784ab => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:02.808467 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89044399-453a-4062-81d0-cc6865331be4 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:02.942984 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89044399-453a-4062-81d0-cc6865331be4 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:02.959044 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:02.989161 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd79c357-423e-4e4b-8e20-6bc70bdab152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:02.990046 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79c357-423e-4e4b-8e20-6bc70bdab152 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:02.990407 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79c357-423e-4e4b-8e20-6bc70bdab152 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:02.990693 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79c357-423e-4e4b-8e20-6bc70bdab152 None admin] PATH_INFO: `/v3/projects/e8b08a08b5d3403b9697254998dfb18f` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:02.995056 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd79c357-423e-4e4b-8e20-6bc70bdab152 None admin] RBAC: Authorizing `identity:get_project(project_id=e8b08a08b5d3403b9697254998dfb18f)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:02.996638 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd79c357-423e-4e4b-8e20-6bc70bdab152 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:02.998831 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 193/386] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:45:02 2022] GET /identity/v3/projects/e8b08a08b5d3403b9697254998dfb18f => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:03.004627 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ae7df-a00e-4556-b74b-1e564309d9da None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:03.028389 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:03.136832 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ae7df-a00e-4556-b74b-1e564309d9da None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:03.186926 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5e625-d83f-45ea-acc5-8bb5b9dd6b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:03.187825 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5e625-d83f-45ea-acc5-8bb5b9dd6b30 None admin] REQUEST_METHOD: `PUT` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:03.188115 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5e625-d83f-45ea-acc5-8bb5b9dd6b30 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:03.188402 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5e625-d83f-45ea-acc5-8bb5b9dd6b30 None admin] PATH_INFO: `/v3/projects/e8b08a08b5d3403b9697254998dfb18f/groups/de080813b38b4e56981829a0177784ab/roles/41a9e10d8ca34fa892f53bf450f29554` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:03.195591 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c5e625-d83f-45ea-acc5-8bb5b9dd6b30 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8b08a08b5d3403b9697254998dfb18f, group_id=de080813b38b4e56981829a0177784ab, role_id=41a9e10d8ca34fa892f53bf450f29554)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:03.197069 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c5e625-d83f-45ea-acc5-8bb5b9dd6b30 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:03.284139 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 194/387] 10.222.0.30 () {58 vars in 1442 bytes} [Tue Jul 5 21:45:03 2022] PUT /identity/v3/projects/e8b08a08b5d3403b9697254998dfb18f/groups/de080813b38b4e56981829a0177784ab/roles/41a9e10d8ca34fa892f53bf450f29554 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:45:03.397851 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715d5d1-0034-4667-a28d-b1527bd59f19 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:03.398624 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715d5d1-0034-4667-a28d-b1527bd59f19 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:03.398624 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715d5d1-0034-4667-a28d-b1527bd59f19 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:03.400163 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 194/388] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:45:03.405496 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16418726-1d91-4104-995c-ec08343b7da6 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:03.405857 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16418726-1d91-4104-995c-ec08343b7da6 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:03.406065 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16418726-1d91-4104-995c-ec08343b7da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:03.427357 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-16418726-1d91-4104-995c-ec08343b7da6 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:03.428688 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-16418726-1d91-4104-995c-ec08343b7da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:03.529187 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 195/389] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:45:03.551453 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715d5d1-0034-4667-a28d-b1527bd59f19 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:03.644858 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c3c54d-3a76-4251-836e-988f0f5b0098 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:03.645410 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c3c54d-3a76-4251-836e-988f0f5b0098 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:03.645410 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c3c54d-3a76-4251-836e-988f0f5b0098 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:03.647045 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 196/390] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:45:03.652934 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4573613-e74f-4d76-98c8-75eadda1ed63 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:03.653231 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4573613-e74f-4d76-98c8-75eadda1ed63 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:03.653516 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4573613-e74f-4d76-98c8-75eadda1ed63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:03.692224 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-b4573613-e74f-4d76-98c8-75eadda1ed63 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:03.693434 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-b4573613-e74f-4d76-98c8-75eadda1ed63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:03.696365 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:03.697173 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715d5d1-0034-4667-a28d-b1527bd59f19 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:03.737297 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d923969-8568-4005-aee7-39f4a3c80026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:03.738119 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d923969-8568-4005-aee7-39f4a3c80026 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:03.738429 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d923969-8568-4005-aee7-39f4a3c80026 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:03.738710 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d923969-8568-4005-aee7-39f4a3c80026 None admin] PATH_INFO: `/v3/roles/member` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:03.751519 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d923969-8568-4005-aee7-39f4a3c80026 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:45:03.759834 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-3d923969-8568-4005-aee7-39f4a3c80026 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:45:03.759834 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:03.759834 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:03.759834 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:03.759834 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:03.759834 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:03.759834 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:03.759834 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:03.759834 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:03.759834 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:03.759834 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:03.759834 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:03.759834 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:45:03.759834 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:45:03.759834 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:45:03.759834 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:45:03.761504 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:45:03.761504 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:45:03.761504 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:45:03.761504 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:45:03.761504 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:03.761504 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:03.761504 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:03.761504 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:03.761504 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:03.761504 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:03.761504 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:03.761504 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:03.761504 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:03.761504 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:03.761504 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:03.761504 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:03.762657 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:03.762657 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:03.762657 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:03.762657 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:03.762657 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:45:03.762657 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:45:03.762657 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:45:03.762657 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:45:03.762657 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:45:03.762657 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:45:03.762657 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:45:03.762657 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:03.762657 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 195/391] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:45:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:03.767779 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d923969-8568-4005-aee7-39f4a3c80026 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:03.780292 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 197/392] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:45:03.824222 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4573613-e74f-4d76-98c8-75eadda1ed63 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:03.839636 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:03.930804 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d923969-8568-4005-aee7-39f4a3c80026 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:03.989468 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4573613-e74f-4d76-98c8-75eadda1ed63 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:04.021732 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c0cc6-32bd-44d9-ae54-34dc58e2e966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:04.022498 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c0cc6-32bd-44d9-ae54-34dc58e2e966 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:04.023375 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c0cc6-32bd-44d9-ae54-34dc58e2e966 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:04.023734 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c0cc6-32bd-44d9-ae54-34dc58e2e966 None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:04.024450 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c0cc6-32bd-44d9-ae54-34dc58e2e966 None admin] RBAC: Adding query filter params (name=member) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:04.024765 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c0cc6-32bd-44d9-ae54-34dc58e2e966 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:04.026288 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c0cc6-32bd-44d9-ae54-34dc58e2e966 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:04.035972 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 196/393] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:45:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:04.036721 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8b063-6e25-4a5e-ad2b-5eb765924880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:04.037563 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8b063-6e25-4a5e-ad2b-5eb765924880 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:04.037855 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8b063-6e25-4a5e-ad2b-5eb765924880 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:04.038176 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8b063-6e25-4a5e-ad2b-5eb765924880 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:04.041653 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c0cc6-32bd-44d9-ae54-34dc58e2e966 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:04.057034 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:04.071201 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d8b063-6e25-4a5e-ad2b-5eb765924880 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:45:04.093395 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-58d8b063-6e25-4a5e-ad2b-5eb765924880 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:45:04.093395 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:04.093395 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:04.093395 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:04.093395 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:04.093395 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:04.093395 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:04.093395 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:04.093395 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:04.093395 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:04.093395 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:04.093395 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:04.093395 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:45:04.093395 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:45:04.093395 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:45:04.093395 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:45:04.094714 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:45:04.094714 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:45:04.094714 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:45:04.094714 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:45:04.094714 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:04.094714 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:04.094714 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:04.094714 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:04.094714 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:04.094714 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:04.094714 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:04.094714 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:04.094714 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:04.094714 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:04.094714 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:04.094714 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:04.095829 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:04.095829 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:04.095829 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:04.095829 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:04.095829 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:45:04.095829 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:45:04.095829 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:45:04.095829 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:45:04.095829 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:45:04.095829 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:45:04.095829 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:45:04.095829 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:04.095829 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 198/394] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:45:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:45:04.099294 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8b063-6e25-4a5e-ad2b-5eb765924880 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:04.166448 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c0cc6-32bd-44d9-ae54-34dc58e2e966 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:04.169049 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:04.207368 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1d281-1921-44a7-a9c5-cec65f7c52a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:04.208250 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1d281-1921-44a7-a9c5-cec65f7c52a3 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:04.208539 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1d281-1921-44a7-a9c5-cec65f7c52a3 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:04.208822 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1d281-1921-44a7-a9c5-cec65f7c52a3 None admin] PATH_INFO: `/v3/groups/de080813b38b4e56981829a0177784ab` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:04.210805 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1d281-1921-44a7-a9c5-cec65f7c52a3 None admin] RBAC: Authorizing `identity:get_group(group_id=de080813b38b4e56981829a0177784ab)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:04.212271 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1d281-1921-44a7-a9c5-cec65f7c52a3 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:04.214152 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 197/395] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Jul 5 21:45:04 2022] GET /identity/v3/groups/de080813b38b4e56981829a0177784ab => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:04.224535 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1d281-1921-44a7-a9c5-cec65f7c52a3 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:04.300319 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8b063-6e25-4a5e-ad2b-5eb765924880 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:04.338845 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec715da-8cc6-4937-a1ca-8dd8fa67b883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:04.339922 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec715da-8cc6-4937-a1ca-8dd8fa67b883 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:04.340544 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec715da-8cc6-4937-a1ca-8dd8fa67b883 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:04.341079 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec715da-8cc6-4937-a1ca-8dd8fa67b883 None admin] PATH_INFO: `/v3/roles` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:04.342120 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec715da-8cc6-4937-a1ca-8dd8fa67b883 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:04.342679 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec715da-8cc6-4937-a1ca-8dd8fa67b883 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:04.344366 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec715da-8cc6-4937-a1ca-8dd8fa67b883 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:04.355055 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 199/396] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:45:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:45:04.360919 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec715da-8cc6-4937-a1ca-8dd8fa67b883 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:04.427916 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:04.435545 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1d281-1921-44a7-a9c5-cec65f7c52a3 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:04.479458 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec715da-8cc6-4937-a1ca-8dd8fa67b883 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:04.485650 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1927d08c-268f-4b46-81ab-78b2170b5c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:04.486574 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927d08c-268f-4b46-81ab-78b2170b5c4d None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:04.486860 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927d08c-268f-4b46-81ab-78b2170b5c4d None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:04.487143 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927d08c-268f-4b46-81ab-78b2170b5c4d None admin] PATH_INFO: `/v3/projects/b74bb643188f42a68dced2cedca8fb95` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:04.488364 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1927d08c-268f-4b46-81ab-78b2170b5c4d None admin] RBAC: Authorizing `identity:get_project(project_id=b74bb643188f42a68dced2cedca8fb95)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:04.490407 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1927d08c-268f-4b46-81ab-78b2170b5c4d None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:04.494282 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 198/397] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:45:04 2022] GET /identity/v3/projects/b74bb643188f42a68dced2cedca8fb95 => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:04.495860 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb0739-4260-40f0-bf20-5e32973b4b78 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:04.496373 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb0739-4260-40f0-bf20-5e32973b4b78 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:04.496877 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb0739-4260-40f0-bf20-5e32973b4b78 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:04.498639 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 199/398] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:45:04.499546 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb0739-4260-40f0-bf20-5e32973b4b78 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:04.535101 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec1290-2f8a-4d6f-8576-67544b067a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:04.536246 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec1290-2f8a-4d6f-8576-67544b067a53 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:04.536538 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec1290-2f8a-4d6f-8576-67544b067a53 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:04.536820 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec1290-2f8a-4d6f-8576-67544b067a53 None admin] PATH_INFO: `/v3/groups/de080813b38b4e56981829a0177784ab` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:04.538040 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ec1290-2f8a-4d6f-8576-67544b067a53 None admin] RBAC: Authorizing `identity:get_group(group_id=de080813b38b4e56981829a0177784ab)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:04.539819 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ec1290-2f8a-4d6f-8576-67544b067a53 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:04.550391 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 200/399] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Jul 5 21:45:04 2022] GET /identity/v3/groups/de080813b38b4e56981829a0177784ab => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:04.552352 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b79f8-952f-4a60-af64-4389dde67b6f None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:04.552824 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b79f8-952f-4a60-af64-4389dde67b6f None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:04.553262 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b79f8-952f-4a60-af64-4389dde67b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:04.558062 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:04.575663 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-0a6b79f8-952f-4a60-af64-4389dde67b6f None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:04.577055 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-0a6b79f8-952f-4a60-af64-4389dde67b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:04.642011 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb0739-4260-40f0-bf20-5e32973b4b78 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:04.662151 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 201/400] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:45:04.662151 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b79f8-952f-4a60-af64-4389dde67b6f None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:04.703500 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582cd8d-024f-4b02-b206-549de6b6a180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:04.704776 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582cd8d-024f-4b02-b206-549de6b6a180 None admin] REQUEST_METHOD: `PUT` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:04.705285 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582cd8d-024f-4b02-b206-549de6b6a180 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:04.705793 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582cd8d-024f-4b02-b206-549de6b6a180 None admin] PATH_INFO: `/v3/projects/b74bb643188f42a68dced2cedca8fb95/groups/de080813b38b4e56981829a0177784ab/roles/41a9e10d8ca34fa892f53bf450f29554` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:04.708116 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8582cd8d-024f-4b02-b206-549de6b6a180 None admin] RBAC: Authorizing `identity:create_grant(project_id=b74bb643188f42a68dced2cedca8fb95, group_id=de080813b38b4e56981829a0177784ab, role_id=41a9e10d8ca34fa892f53bf450f29554)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:04.709777 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8582cd8d-024f-4b02-b206-549de6b6a180 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:04.723443 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:04.766108 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 200/401] 10.222.0.30 () {58 vars in 1442 bytes} [Tue Jul 5 21:45:04 2022] PUT /identity/v3/projects/b74bb643188f42a68dced2cedca8fb95/groups/de080813b38b4e56981829a0177784ab/roles/41a9e10d8ca34fa892f53bf450f29554 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:45:04.767174 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b79f8-952f-4a60-af64-4389dde67b6f None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:04.767732 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582cd8d-024f-4b02-b206-549de6b6a180 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:04.837278 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a96a0-0c0b-4a47-b970-ece30d8a36e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:04.838213 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a96a0-0c0b-4a47-b970-ece30d8a36e6 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:04.838508 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a96a0-0c0b-4a47-b970-ece30d8a36e6 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:04.838801 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a96a0-0c0b-4a47-b970-ece30d8a36e6 None admin] PATH_INFO: `/v3/projects/e8b08a08b5d3403b9697254998dfb18f` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:04.840140 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a96a0-0c0b-4a47-b970-ece30d8a36e6 None admin] RBAC: Authorizing `identity:get_project(project_id=e8b08a08b5d3403b9697254998dfb18f)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:04.843746 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a96a0-0c0b-4a47-b970-ece30d8a36e6 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:04.844089 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 202/402] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:45:04 2022] GET /identity/v3/projects/e8b08a08b5d3403b9697254998dfb18f => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:04.849185 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a96a0-0c0b-4a47-b970-ece30d8a36e6 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:04.971554 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:04.977778 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582cd8d-024f-4b02-b206-549de6b6a180 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:05.013573 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3ca4c-b2e9-4dec-86e3-7da54b55b8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:05.014440 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3ca4c-b2e9-4dec-86e3-7da54b55b8f5 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:05.014723 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3ca4c-b2e9-4dec-86e3-7da54b55b8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:05.015007 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3ca4c-b2e9-4dec-86e3-7da54b55b8f5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:05.021278 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a96a0-0c0b-4a47-b970-ece30d8a36e6 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:05.026268 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3ca4c-b2e9-4dec-86e3-7da54b55b8f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:45:05.034386 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-49b3ca4c-b2e9-4dec-86e3-7da54b55b8f5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:45:05.034386 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:05.034386 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:05.034386 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:05.034386 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:05.034386 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:05.034386 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:05.034386 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:05.034386 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:05.034386 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:05.034386 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:05.034386 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:05.034386 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:45:05.034386 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:45:05.034386 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:45:05.034386 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:45:05.035595 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:45:05.035595 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:45:05.035595 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:45:05.035595 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:45:05.035595 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:05.035595 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:05.035595 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:05.035595 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:05.035595 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:05.035595 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:05.035595 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:05.035595 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:05.035595 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:05.035595 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:05.035595 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:05.035595 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:05.036692 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:05.036692 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:05.036692 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:05.036692 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:05.036692 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:45:05.036692 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:45:05.036692 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:45:05.036692 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:45:05.036692 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:45:05.036692 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:45:05.036692 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:45:05.036692 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:05.036692 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 201/403] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:45:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:05.038733 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07363ef9-3e64-4b3f-8b31-87a2687759e2 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:05.039602 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07363ef9-3e64-4b3f-8b31-87a2687759e2 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:05.039602 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07363ef9-3e64-4b3f-8b31-87a2687759e2 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:05.041137 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 202/404] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:45:05.045776 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07363ef9-3e64-4b3f-8b31-87a2687759e2 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:05.062069 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:05.073932 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a64030-1cb9-4625-aa18-568f613dabec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:05.075459 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a64030-1cb9-4625-aa18-568f613dabec None admin] REQUEST_METHOD: `PUT` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:05.076098 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a64030-1cb9-4625-aa18-568f613dabec None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:05.076444 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a64030-1cb9-4625-aa18-568f613dabec None admin] PATH_INFO: `/v3/projects/e8b08a08b5d3403b9697254998dfb18f/groups/de080813b38b4e56981829a0177784ab/roles/9bd598b07a9942b7a91c3a372f3cf094` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:05.079325 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a64030-1cb9-4625-aa18-568f613dabec None admin] RBAC: Authorizing `identity:create_grant(project_id=e8b08a08b5d3403b9697254998dfb18f, group_id=de080813b38b4e56981829a0177784ab, role_id=9bd598b07a9942b7a91c3a372f3cf094)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:05.081368 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a64030-1cb9-4625-aa18-568f613dabec None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:05.155646 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 203/405] 10.222.0.30 () {58 vars in 1442 bytes} [Tue Jul 5 21:45:04 2022] PUT /identity/v3/projects/e8b08a08b5d3403b9697254998dfb18f/groups/de080813b38b4e56981829a0177784ab/roles/9bd598b07a9942b7a91c3a372f3cf094 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:45:05.157646 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5079cf-a8f8-439e-bda5-9bebce38e23f None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:05.158038 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5079cf-a8f8-439e-bda5-9bebce38e23f None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:05.158948 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5079cf-a8f8-439e-bda5-9bebce38e23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:05.162691 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07363ef9-3e64-4b3f-8b31-87a2687759e2 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:05.184318 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-6f5079cf-a8f8-439e-bda5-9bebce38e23f None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:05.186160 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-6f5079cf-a8f8-439e-bda5-9bebce38e23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:05.206309 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7993e-60c4-4e73-bf50-dc12bcfb23f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:05.207294 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7993e-60c4-4e73-bf50-dc12bcfb23f5 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:05.207746 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7993e-60c4-4e73-bf50-dc12bcfb23f5 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:05.208176 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7993e-60c4-4e73-bf50-dc12bcfb23f5 None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:05.209087 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa7993e-60c4-4e73-bf50-dc12bcfb23f5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:05.209560 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa7993e-60c4-4e73-bf50-dc12bcfb23f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:05.211752 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa7993e-60c4-4e73-bf50-dc12bcfb23f5 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:05.221432 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 203/406] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:45:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:05.231516 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7993e-60c4-4e73-bf50-dc12bcfb23f5 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:05.263042 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:05.274887 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 204/407] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:45:05.297828 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5079cf-a8f8-439e-bda5-9bebce38e23f None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:05.375928 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7993e-60c4-4e73-bf50-dc12bcfb23f5 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:05.410346 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5079cf-a8f8-439e-bda5-9bebce38e23f None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:05.429630 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8821066c-2547-4b43-9f6c-aaf3fe9fafc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:05.430818 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:05.432763 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821066c-2547-4b43-9f6c-aaf3fe9fafc5 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:05.433160 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821066c-2547-4b43-9f6c-aaf3fe9fafc5 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:05.433558 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821066c-2547-4b43-9f6c-aaf3fe9fafc5 None admin] PATH_INFO: `/v3/groups/de080813b38b4e56981829a0177784ab` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:05.435050 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8821066c-2547-4b43-9f6c-aaf3fe9fafc5 None admin] RBAC: Authorizing `identity:get_group(group_id=de080813b38b4e56981829a0177784ab)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:05.437258 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8821066c-2547-4b43-9f6c-aaf3fe9fafc5 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:05.443958 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 204/408] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Jul 5 21:45:05 2022] GET /identity/v3/groups/de080813b38b4e56981829a0177784ab => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:45:05.446283 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8821066c-2547-4b43-9f6c-aaf3fe9fafc5 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:05.457278 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169a736-7831-464f-81e5-a8d8e2412a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:05.458441 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169a736-7831-464f-81e5-a8d8e2412a45 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:05.458904 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169a736-7831-464f-81e5-a8d8e2412a45 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:05.459187 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169a736-7831-464f-81e5-a8d8e2412a45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:05.472458 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6169a736-7831-464f-81e5-a8d8e2412a45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:45:05.481675 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-6169a736-7831-464f-81e5-a8d8e2412a45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:45:05.481675 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:05.481675 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:05.481675 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:05.481675 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:05.481675 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:05.481675 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:05.481675 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:05.481675 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:05.481675 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:05.481675 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:05.481675 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:05.481675 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:45:05.481675 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:45:05.481675 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:45:05.481675 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:45:05.482882 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:45:05.482882 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:45:05.482882 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:45:05.482882 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:45:05.482882 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:05.482882 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:05.482882 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:05.482882 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:05.482882 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:05.482882 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:05.482882 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:05.482882 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:05.482882 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:05.482882 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:05.482882 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:05.482882 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:05.483985 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:05.483985 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:05.483985 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:05.483985 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:05.483985 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:45:05.483985 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:45:05.483985 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:45:05.483985 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:45:05.483985 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:45:05.483985 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:45:05.483985 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:45:05.483985 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:05.488548 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 205/409] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:45:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:05.489427 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169a736-7831-464f-81e5-a8d8e2412a45 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:05.573087 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:05.589916 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8821066c-2547-4b43-9f6c-aaf3fe9fafc5 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:05.622879 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169a736-7831-464f-81e5-a8d8e2412a45 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:05.641765 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d267ee-5229-4377-888b-28cf2bb84ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:05.642751 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d267ee-5229-4377-888b-28cf2bb84ede None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:05.643314 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d267ee-5229-4377-888b-28cf2bb84ede None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:05.643527 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d267ee-5229-4377-888b-28cf2bb84ede None admin] PATH_INFO: `/v3/projects/b74bb643188f42a68dced2cedca8fb95` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:05.644961 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d267ee-5229-4377-888b-28cf2bb84ede None admin] RBAC: Authorizing `identity:get_project(project_id=b74bb643188f42a68dced2cedca8fb95)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:05.646620 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d267ee-5229-4377-888b-28cf2bb84ede None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:05.649411 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 205/410] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:45:05 2022] GET /identity/v3/projects/b74bb643188f42a68dced2cedca8fb95 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:05.657767 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d267ee-5229-4377-888b-28cf2bb84ede None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:05.674544 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e27e3-4429-43d0-99ff-2f84a045d2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:05.675832 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e27e3-4429-43d0-99ff-2f84a045d2eb None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:05.676274 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e27e3-4429-43d0-99ff-2f84a045d2eb None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:05.676723 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e27e3-4429-43d0-99ff-2f84a045d2eb None admin] PATH_INFO: `/v3/roles` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:05.677790 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94e27e3-4429-43d0-99ff-2f84a045d2eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:05.678369 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94e27e3-4429-43d0-99ff-2f84a045d2eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:05.680034 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94e27e3-4429-43d0-99ff-2f84a045d2eb None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:05.690153 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 206/411] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:45:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:05.696390 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e27e3-4429-43d0-99ff-2f84a045d2eb None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:05.742779 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:05.768714 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d267ee-5229-4377-888b-28cf2bb84ede None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:05.805197 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5db15f-855e-4f9d-95f8-786b82d0c289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:05.806297 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5db15f-855e-4f9d-95f8-786b82d0c289 None admin] REQUEST_METHOD: `PUT` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:05.806851 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5db15f-855e-4f9d-95f8-786b82d0c289 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:05.807243 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5db15f-855e-4f9d-95f8-786b82d0c289 None admin] PATH_INFO: `/v3/projects/b74bb643188f42a68dced2cedca8fb95/groups/de080813b38b4e56981829a0177784ab/roles/9bd598b07a9942b7a91c3a372f3cf094` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:05.809745 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5db15f-855e-4f9d-95f8-786b82d0c289 None admin] RBAC: Authorizing `identity:create_grant(project_id=b74bb643188f42a68dced2cedca8fb95, group_id=de080813b38b4e56981829a0177784ab, role_id=9bd598b07a9942b7a91c3a372f3cf094)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:05.811537 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5db15f-855e-4f9d-95f8-786b82d0c289 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:05.814234 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e27e3-4429-43d0-99ff-2f84a045d2eb None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:05.850321 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef0547-284c-47c6-b364-1dd2cbfc72b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:05.852016 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef0547-284c-47c6-b364-1dd2cbfc72b2 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:05.852456 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef0547-284c-47c6-b364-1dd2cbfc72b2 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:05.853164 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef0547-284c-47c6-b364-1dd2cbfc72b2 None admin] PATH_INFO: `/v3/groups/2e1a376b13ee42d7832b5011273b41e7` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:05.854585 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ef0547-284c-47c6-b364-1dd2cbfc72b2 None admin] RBAC: Authorizing `identity:get_group(group_id=2e1a376b13ee42d7832b5011273b41e7)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:05.858143 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ef0547-284c-47c6-b364-1dd2cbfc72b2 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:05.858316 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 207/412] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Jul 5 21:45:05 2022] GET /identity/v3/groups/2e1a376b13ee42d7832b5011273b41e7 => generated 229 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:05.863756 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef0547-284c-47c6-b364-1dd2cbfc72b2 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:05.888171 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 206/413] 10.222.0.30 () {58 vars in 1442 bytes} [Tue Jul 5 21:45:05 2022] PUT /identity/v3/projects/b74bb643188f42a68dced2cedca8fb95/groups/de080813b38b4e56981829a0177784ab/roles/9bd598b07a9942b7a91c3a372f3cf094 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:45:05.925673 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e01689-4da1-404b-9d00-1d97cddf171f None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:05.925972 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e01689-4da1-404b-9d00-1d97cddf171f None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:05.926304 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e01689-4da1-404b-9d00-1d97cddf171f None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:05.928027 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 207/414] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:45:05.933862 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d9dfc-84d4-44d3-976c-6cde8a832d81 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:05.934201 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d9dfc-84d4-44d3-976c-6cde8a832d81 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:05.934508 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d9dfc-84d4-44d3-976c-6cde8a832d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:05.952869 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-a36d9dfc-84d4-44d3-976c-6cde8a832d81 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:05.954175 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-a36d9dfc-84d4-44d3-976c-6cde8a832d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:05.967398 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:05.999208 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef0547-284c-47c6-b364-1dd2cbfc72b2 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:06.008415 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:06.039263 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a43f8-5e22-498c-9be1-cf5e2943f845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:06.040204 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a43f8-5e22-498c-9be1-cf5e2943f845 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:06.040565 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a43f8-5e22-498c-9be1-cf5e2943f845 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:06.040914 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a43f8-5e22-498c-9be1-cf5e2943f845 None admin] PATH_INFO: `/v3/projects/557b6303201840cf82d0fdc7c227e5e6` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:06.045983 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0a43f8-5e22-498c-9be1-cf5e2943f845 None admin] RBAC: Authorizing `identity:get_project(project_id=557b6303201840cf82d0fdc7c227e5e6)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:06.045983 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0a43f8-5e22-498c-9be1-cf5e2943f845 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:06.045983 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 208/416] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:45:05 2022] GET /identity/v3/projects/557b6303201840cf82d0fdc7c227e5e6 => generated 344 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:45:06.046559 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 208/416] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:45:06.051964 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a43f8-5e22-498c-9be1-cf5e2943f845 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:06.073037 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d9dfc-84d4-44d3-976c-6cde8a832d81 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:06.174245 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a43f8-5e22-498c-9be1-cf5e2943f845 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:06.212788 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92fab87-d7f1-441f-a72f-bdffd95b3a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:06.214710 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fab87-d7f1-441f-a72f-bdffd95b3a7e None admin] REQUEST_METHOD: `PUT` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:06.215551 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fab87-d7f1-441f-a72f-bdffd95b3a7e None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:06.216121 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fab87-d7f1-441f-a72f-bdffd95b3a7e None admin] PATH_INFO: `/v3/projects/557b6303201840cf82d0fdc7c227e5e6/groups/2e1a376b13ee42d7832b5011273b41e7/roles/e1c574c9973548ebb0e8d9e0656ccabd` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:06.217387 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d9dfc-84d4-44d3-976c-6cde8a832d81 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:06.218660 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92fab87-d7f1-441f-a72f-bdffd95b3a7e None admin] RBAC: Authorizing `identity:create_grant(project_id=557b6303201840cf82d0fdc7c227e5e6, group_id=2e1a376b13ee42d7832b5011273b41e7, role_id=e1c574c9973548ebb0e8d9e0656ccabd)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:06.221324 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92fab87-d7f1-441f-a72f-bdffd95b3a7e None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:06.261617 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007490b5-4a8f-4b33-9928-d5ec3dd6640b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:06.262417 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007490b5-4a8f-4b33-9928-d5ec3dd6640b None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:06.262708 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007490b5-4a8f-4b33-9928-d5ec3dd6640b None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:06.262988 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007490b5-4a8f-4b33-9928-d5ec3dd6640b None admin] PATH_INFO: `/v3/roles/member` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:06.274515 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007490b5-4a8f-4b33-9928-d5ec3dd6640b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:45:06.282871 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-007490b5-4a8f-4b33-9928-d5ec3dd6640b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:45:06.282871 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:06.282871 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:06.282871 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:06.282871 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:06.282871 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:06.282871 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:06.282871 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:06.282871 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:06.282871 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:06.282871 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:06.282871 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:06.282871 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:45:06.282871 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:45:06.282871 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:45:06.282871 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:45:06.283885 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:45:06.283885 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:45:06.283885 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:45:06.283885 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:45:06.283885 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:06.283885 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:06.283885 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:06.283885 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:06.283885 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:06.283885 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:06.283885 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:06.283885 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:06.283885 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:06.283885 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:06.283885 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:06.283885 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:06.285008 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:06.285008 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:06.285008 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:06.285008 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:06.285008 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:45:06.285008 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:45:06.285008 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:45:06.285008 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:45:06.285008 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:45:06.285008 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:45:06.285008 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:45:06.285008 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:06.285008 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 209/417] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:45:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:06.292395 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007490b5-4a8f-4b33-9928-d5ec3dd6640b None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:06.307925 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:06.335043 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 209/418] 10.222.0.30 () {58 vars in 1442 bytes} [Tue Jul 5 21:45:06 2022] PUT /identity/v3/projects/557b6303201840cf82d0fdc7c227e5e6/groups/2e1a376b13ee42d7832b5011273b41e7/roles/e1c574c9973548ebb0e8d9e0656ccabd => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:45:06.460811 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007490b5-4a8f-4b33-9928-d5ec3dd6640b None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:06.519242 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac2641-4fa5-4215-99e7-2846b6922ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:06.520002 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac2641-4fa5-4215-99e7-2846b6922ddd None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:06.520392 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac2641-4fa5-4215-99e7-2846b6922ddd None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:06.520773 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac2641-4fa5-4215-99e7-2846b6922ddd None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:06.521552 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcac2641-4fa5-4215-99e7-2846b6922ddd None admin] RBAC: Adding query filter params (name=member) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:06.521860 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcac2641-4fa5-4215-99e7-2846b6922ddd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:06.523646 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcac2641-4fa5-4215-99e7-2846b6922ddd None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:06.537087 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 210/419] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:45:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:45:06.543192 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92fab87-d7f1-441f-a72f-bdffd95b3a7e None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:06.590399 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:06.682602 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92fab87-d7f1-441f-a72f-bdffd95b3a7e None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:06.723031 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446237e4-9288-418d-8a43-c4e15ccb0918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:06.723650 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446237e4-9288-418d-8a43-c4e15ccb0918 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:06.723944 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446237e4-9288-418d-8a43-c4e15ccb0918 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:06.724226 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446237e4-9288-418d-8a43-c4e15ccb0918 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:06.805756 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446237e4-9288-418d-8a43-c4e15ccb0918 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:06.807198 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446237e4-9288-418d-8a43-c4e15ccb0918 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:06.847634 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:06.941300 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 210/420] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:45:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:45:06.946882 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac2641-4fa5-4215-99e7-2846b6922ddd None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:07.040188 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:07.074192 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac2641-4fa5-4215-99e7-2846b6922ddd None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:07.110326 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16025f2-c6a7-4e26-9540-e8ecfce78c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:07.111202 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16025f2-c6a7-4e26-9540-e8ecfce78c99 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:07.111492 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16025f2-c6a7-4e26-9540-e8ecfce78c99 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:07.111774 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16025f2-c6a7-4e26-9540-e8ecfce78c99 None admin] PATH_INFO: `/v3/projects/e8b08a08b5d3403b9697254998dfb18f` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:07.112975 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16025f2-c6a7-4e26-9540-e8ecfce78c99 None admin] RBAC: Authorizing `identity:get_project(project_id=e8b08a08b5d3403b9697254998dfb18f)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:07.114464 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16025f2-c6a7-4e26-9540-e8ecfce78c99 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:07.116505 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 211/421] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:45:06 2022] GET /identity/v3/projects/e8b08a08b5d3403b9697254998dfb18f => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:07.123489 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446237e4-9288-418d-8a43-c4e15ccb0918 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:07.321272 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446237e4-9288-418d-8a43-c4e15ccb0918 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:07.369426 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136aefa9-5117-4e3a-8ba4-a2a86972aa18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:07.370246 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136aefa9-5117-4e3a-8ba4-a2a86972aa18 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:07.370541 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136aefa9-5117-4e3a-8ba4-a2a86972aa18 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:07.370827 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136aefa9-5117-4e3a-8ba4-a2a86972aa18 None admin] PATH_INFO: `/v3/groups/de080813b38b4e56981829a0177784ab` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:07.372051 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136aefa9-5117-4e3a-8ba4-a2a86972aa18 None admin] RBAC: Authorizing `identity:get_group(group_id=de080813b38b4e56981829a0177784ab)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:07.373510 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136aefa9-5117-4e3a-8ba4-a2a86972aa18 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:07.375507 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 211/422] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Jul 5 21:45:07 2022] GET /identity/v3/groups/de080813b38b4e56981829a0177784ab => generated 226 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:07.381091 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16025f2-c6a7-4e26-9540-e8ecfce78c99 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:07.528957 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16025f2-c6a7-4e26-9540-e8ecfce78c99 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:07.591402 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72f77b-749b-49c7-b7d0-4b80ebb59d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:07.592078 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72f77b-749b-49c7-b7d0-4b80ebb59d6e None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:07.592369 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72f77b-749b-49c7-b7d0-4b80ebb59d6e None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:07.592649 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72f77b-749b-49c7-b7d0-4b80ebb59d6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:07.593505 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e72f77b-749b-49c7-b7d0-4b80ebb59d6e None admin] RBAC: Adding query filter params (group.id=de080813b38b4e56981829a0177784ab, role.id=41a9e10d8ca34fa892f53bf450f29554, scope.project.id=e8b08a08b5d3403b9697254998dfb18f) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:07.593819 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e72f77b-749b-49c7-b7d0-4b80ebb59d6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:07.595293 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e72f77b-749b-49c7-b7d0-4b80ebb59d6e None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:07.603633 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:07.607839 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 212/423] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Jul 5 21:45:07 2022] GET /identity/v3/role_assignments?group.id=de080813b38b4e56981829a0177784ab&scope.project.id=e8b08a08b5d3403b9697254998dfb18f&role.id=41a9e10d8ca34fa892f53bf450f29554 => generated 611 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:07.682534 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf8ade-dee9-48ae-bb70-4ec2aea80c5d None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:07.682849 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf8ade-dee9-48ae-bb70-4ec2aea80c5d None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:07.683399 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf8ade-dee9-48ae-bb70-4ec2aea80c5d None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:07.684725 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 212/424] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:45:07.689784 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163f289-b70b-4774-9559-ba1737a8a045 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:07.690081 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163f289-b70b-4774-9559-ba1737a8a045 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:07.690388 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163f289-b70b-4774-9559-ba1737a8a045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:07.714454 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-8163f289-b70b-4774-9559-ba1737a8a045 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:07.716085 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-8163f289-b70b-4774-9559-ba1737a8a045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:07.811064 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 213/425] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:45:07.836962 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf8ade-dee9-48ae-bb70-4ec2aea80c5d None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:07.840051 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:07.970277 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf8ade-dee9-48ae-bb70-4ec2aea80c5d None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:08.009297 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ecd14-b0ad-4fe7-86c8-d53e06285631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:08.010107 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ecd14-b0ad-4fe7-86c8-d53e06285631 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:08.010435 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ecd14-b0ad-4fe7-86c8-d53e06285631 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:08.010716 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ecd14-b0ad-4fe7-86c8-d53e06285631 None admin] PATH_INFO: `/v3/roles/member` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:08.023679 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21ecd14-b0ad-4fe7-86c8-d53e06285631 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:45:08.032551 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b341da-40f4-4936-8ee7-c85a21dd546d None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:08.032911 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b341da-40f4-4936-8ee7-c85a21dd546d None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:08.033200 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b341da-40f4-4936-8ee7-c85a21dd546d None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:08.033919 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-b21ecd14-b0ad-4fe7-86c8-d53e06285631 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:45:08.033919 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:08.033919 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:08.033919 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:08.033919 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:08.033919 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:08.033919 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:08.033919 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:08.033919 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:08.033919 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:08.033919 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:08.033919 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:08.033919 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:45:08.033919 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:45:08.033919 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:45:08.033919 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:45:08.035203 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:45:08.035203 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:45:08.035203 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:45:08.035203 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:45:08.035203 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:08.035203 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:08.035203 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:08.035203 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:08.035203 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:08.035203 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:08.035203 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:08.035203 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:08.035203 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:08.035203 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:08.035203 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:08.035203 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:08.036283 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:08.036283 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:08.036283 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:08.036283 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:08.036283 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:45:08.036283 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:45:08.036283 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:45:08.036283 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:45:08.036283 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:45:08.036283 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:45:08.036283 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 21:45:08.036283 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:08.037256 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 214/426] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:45:08.037340 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 213/427] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:45:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:08.041749 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b341da-40f4-4936-8ee7-c85a21dd546d None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:08.044356 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263f9b6-fc6c-45d4-9ea4-53d933d63848 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:08.044648 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263f9b6-fc6c-45d4-9ea4-53d933d63848 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:08.044929 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263f9b6-fc6c-45d4-9ea4-53d933d63848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:08.068730 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-0263f9b6-fc6c-45d4-9ea4-53d933d63848 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:08.070628 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-0263f9b6-fc6c-45d4-9ea4-53d933d63848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:08.154868 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:08.170797 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 214/428] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:45:08.192482 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b341da-40f4-4936-8ee7-c85a21dd546d None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:08.208932 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0263f9b6-fc6c-45d4-9ea4-53d933d63848 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:08.240475 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:08.247069 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c89cd-213f-4887-8418-43ae0751782d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:08.248768 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c89cd-213f-4887-8418-43ae0751782d None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:08.249282 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c89cd-213f-4887-8418-43ae0751782d None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:08.249971 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c89cd-213f-4887-8418-43ae0751782d None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:08.251249 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97c89cd-213f-4887-8418-43ae0751782d None admin] RBAC: Adding query filter params (name=member) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:08.251743 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97c89cd-213f-4887-8418-43ae0751782d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:08.253921 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97c89cd-213f-4887-8418-43ae0751782d None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:08.266302 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 215/429] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:45:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:08.271492 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c89cd-213f-4887-8418-43ae0751782d None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:08.347288 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0263f9b6-fc6c-45d4-9ea4-53d933d63848 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:08.397524 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d57795-7a47-47f9-bde8-2fc71cf6fb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:08.399346 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d57795-7a47-47f9-bde8-2fc71cf6fb3a None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:08.399788 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d57795-7a47-47f9-bde8-2fc71cf6fb3a None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:08.400075 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d57795-7a47-47f9-bde8-2fc71cf6fb3a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:08.401559 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c89cd-213f-4887-8418-43ae0751782d None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:08.413993 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d57795-7a47-47f9-bde8-2fc71cf6fb3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:45:08.423266 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-51d57795-7a47-47f9-bde8-2fc71cf6fb3a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:45:08.423266 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:08.423266 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:08.423266 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:08.423266 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:08.423266 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:08.423266 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:08.423266 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:08.423266 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:08.423266 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:08.423266 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:08.423266 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:08.423266 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:45:08.423266 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:45:08.423266 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:45:08.423266 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:45:08.424355 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:45:08.424355 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:45:08.424355 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:45:08.424355 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:45:08.424355 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:08.424355 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:08.424355 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:08.424355 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:08.424355 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:08.424355 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:08.424355 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:08.424355 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:08.424355 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:08.424355 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:08.424355 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:08.424355 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:08.425244 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:08.425244 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:08.425244 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:08.425244 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:08.425244 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:45:08.425244 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:45:08.425244 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:45:08.425244 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:45:08.425244 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:45:08.425244 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:45:08.425244 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:45:08.425244 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:08.425244 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 215/430] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:45:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:08.426987 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e30c58-840c-4b60-b324-214b438941cd None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:08.426987 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e30c58-840c-4b60-b324-214b438941cd None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:08.426987 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e30c58-840c-4b60-b324-214b438941cd None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:08.428112 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 216/431] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:45:08.433827 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e30c58-840c-4b60-b324-214b438941cd None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:08.445903 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c689f-7e96-42fa-aef9-bbe75b30e9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:08.446688 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c689f-7e96-42fa-aef9-bbe75b30e9f9 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:08.446914 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c689f-7e96-42fa-aef9-bbe75b30e9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:08.447199 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c689f-7e96-42fa-aef9-bbe75b30e9f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:08.496959 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:08.512653 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:08.523934 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524c689f-7e96-42fa-aef9-bbe75b30e9f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:08.525331 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524c689f-7e96-42fa-aef9-bbe75b30e9f9 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:08.550021 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e30c58-840c-4b60-b324-214b438941cd None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:08.588901 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd2443-df2f-4b40-9d29-ded73d63576b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:08.589576 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd2443-df2f-4b40-9d29-ded73d63576b None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:08.589868 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd2443-df2f-4b40-9d29-ded73d63576b None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:08.590166 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd2443-df2f-4b40-9d29-ded73d63576b None admin] PATH_INFO: `/v3/roles` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:08.590931 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cd2443-df2f-4b40-9d29-ded73d63576b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:08.591239 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cd2443-df2f-4b40-9d29-ded73d63576b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:08.592646 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cd2443-df2f-4b40-9d29-ded73d63576b None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:08.605992 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 217/432] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:45:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:45:08.605992 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73a322-509a-4e38-a7c6-783f645b7628 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:08.605992 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73a322-509a-4e38-a7c6-783f645b7628 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:08.605992 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73a322-509a-4e38-a7c6-783f645b7628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:08.620948 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-be73a322-509a-4e38-a7c6-783f645b7628 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:08.622168 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-be73a322-509a-4e38-a7c6-783f645b7628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:08.646987 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 216/433] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:45:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 21:45:08.648258 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c689f-7e96-42fa-aef9-bbe75b30e9f9 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:08.696501 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 218/434] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:45:08.697360 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73a322-509a-4e38-a7c6-783f645b7628 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:08.746142 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:08.764852 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:08.774424 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c689f-7e96-42fa-aef9-bbe75b30e9f9 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:08.801964 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73a322-509a-4e38-a7c6-783f645b7628 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:08.809378 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be5815-4d15-4014-ada6-62e765e68a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:08.810046 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be5815-4d15-4014-ada6-62e765e68a62 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:08.810363 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be5815-4d15-4014-ada6-62e765e68a62 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:08.810649 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be5815-4d15-4014-ada6-62e765e68a62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:08.837729 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f454c-7b06-4c1b-a149-c06d00195028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:08.838683 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f454c-7b06-4c1b-a149-c06d00195028 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:08.838969 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f454c-7b06-4c1b-a149-c06d00195028 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:08.839291 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f454c-7b06-4c1b-a149-c06d00195028 None admin] PATH_INFO: `/v3/projects/b74bb643188f42a68dced2cedca8fb95` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:08.840503 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f454c-7b06-4c1b-a149-c06d00195028 None admin] RBAC: Authorizing `identity:get_project(project_id=b74bb643188f42a68dced2cedca8fb95)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:08.841943 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f454c-7b06-4c1b-a149-c06d00195028 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:08.847970 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 219/435] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:45:08 2022] GET /identity/v3/projects/b74bb643188f42a68dced2cedca8fb95 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:08.847970 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f454c-7b06-4c1b-a149-c06d00195028 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:08.887764 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be5815-4d15-4014-ada6-62e765e68a62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:08.889346 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be5815-4d15-4014-ada6-62e765e68a62 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:08.950789 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f454c-7b06-4c1b-a149-c06d00195028 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:08.965000 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:08.987464 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4512b929-f911-402b-bcce-2c81e69937bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:08.988550 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512b929-f911-402b-bcce-2c81e69937bc None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:08.988928 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512b929-f911-402b-bcce-2c81e69937bc None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:08.989361 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512b929-f911-402b-bcce-2c81e69937bc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:08.990512 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:09.000321 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 217/436] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:45:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:45:09.001416 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be5815-4d15-4014-ada6-62e765e68a62 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:09.013116 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4512b929-f911-402b-bcce-2c81e69937bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:45:09.016735 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-4512b929-f911-402b-bcce-2c81e69937bc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:45:09.016735 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:09.016735 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:09.016735 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:09.016735 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:09.016735 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:09.016735 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:09.016735 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:09.016735 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:09.016735 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:09.016735 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:09.016735 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:09.016735 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:45:09.016735 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:45:09.016735 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:45:09.016735 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:45:09.017746 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:45:09.017746 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:45:09.017746 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:45:09.017746 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:45:09.017746 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:09.017746 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:09.017746 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:09.017746 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:09.017746 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:09.017746 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:09.017746 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:09.017746 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:09.017746 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:09.017746 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:09.017746 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:09.017746 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:09.018681 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:09.018681 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:09.018681 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:09.018681 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:09.018681 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:45:09.018681 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:45:09.018681 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:45:09.018681 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:45:09.018681 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:45:09.018681 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:45:09.018681 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:45:09.018681 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:09.018681 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 220/437] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:45:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:09.020055 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4512b929-f911-402b-bcce-2c81e69937bc None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:09.109870 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be5815-4d15-4014-ada6-62e765e68a62 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:09.125813 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4512b929-f911-402b-bcce-2c81e69937bc None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:09.144053 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7118868-20cf-4eef-925f-73e228f335f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:09.144943 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7118868-20cf-4eef-925f-73e228f335f7 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:09.145237 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7118868-20cf-4eef-925f-73e228f335f7 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:09.145522 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7118868-20cf-4eef-925f-73e228f335f7 None admin] PATH_INFO: `/v3/groups/de080813b38b4e56981829a0177784ab` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:09.146743 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7118868-20cf-4eef-925f-73e228f335f7 None admin] RBAC: Authorizing `identity:get_group(group_id=de080813b38b4e56981829a0177784ab)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:09.148316 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7118868-20cf-4eef-925f-73e228f335f7 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:09.154274 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 218/438] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Jul 5 21:45:09 2022] GET /identity/v3/groups/de080813b38b4e56981829a0177784ab => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:09.154274 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7118868-20cf-4eef-925f-73e228f335f7 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:09.163880 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2776aeff-874d-41bf-9172-968ae90036b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:09.164740 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776aeff-874d-41bf-9172-968ae90036b9 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:09.165026 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776aeff-874d-41bf-9172-968ae90036b9 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:09.165305 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776aeff-874d-41bf-9172-968ae90036b9 None admin] PATH_INFO: `/v3/projects/e8b08a08b5d3403b9697254998dfb18f` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:09.166543 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2776aeff-874d-41bf-9172-968ae90036b9 None admin] RBAC: Authorizing `identity:get_project(project_id=e8b08a08b5d3403b9697254998dfb18f)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:09.168000 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2776aeff-874d-41bf-9172-968ae90036b9 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:09.169690 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 221/439] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:45:09 2022] GET /identity/v3/projects/e8b08a08b5d3403b9697254998dfb18f => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:09.170958 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58edb82d-b196-4453-92fe-5e66f60f4594 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:09.171233 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58edb82d-b196-4453-92fe-5e66f60f4594 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:09.171512 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58edb82d-b196-4453-92fe-5e66f60f4594 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:09.172733 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 222/440] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:45:09.173427 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58edb82d-b196-4453-92fe-5e66f60f4594 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:09.217148 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:09.218720 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:09.259170 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7118868-20cf-4eef-925f-73e228f335f7 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:09.276178 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58edb82d-b196-4453-92fe-5e66f60f4594 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:09.292875 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252d627-0f27-437e-bb81-95cae9e99a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:09.293549 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252d627-0f27-437e-bb81-95cae9e99a20 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:09.293836 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252d627-0f27-437e-bb81-95cae9e99a20 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:09.294113 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252d627-0f27-437e-bb81-95cae9e99a20 None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:09.294888 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b252d627-0f27-437e-bb81-95cae9e99a20 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:09.295196 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b252d627-0f27-437e-bb81-95cae9e99a20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:09.296563 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b252d627-0f27-437e-bb81-95cae9e99a20 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:09.305133 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 219/441] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:45:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:09.306118 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252d627-0f27-437e-bb81-95cae9e99a20 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:09.311241 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff87ce5e-6f61-4c8c-a425-59beafc41fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:09.311905 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87ce5e-6f61-4c8c-a425-59beafc41fae None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:09.312196 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87ce5e-6f61-4c8c-a425-59beafc41fae None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:09.312483 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87ce5e-6f61-4c8c-a425-59beafc41fae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:09.313338 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff87ce5e-6f61-4c8c-a425-59beafc41fae None admin] RBAC: Adding query filter params (group.id=de080813b38b4e56981829a0177784ab, role.id=41a9e10d8ca34fa892f53bf450f29554, scope.project.id=b74bb643188f42a68dced2cedca8fb95) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:09.313657 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff87ce5e-6f61-4c8c-a425-59beafc41fae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:09.315125 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff87ce5e-6f61-4c8c-a425-59beafc41fae None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:09.321216 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 223/442] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Jul 5 21:45:09 2022] GET /identity/v3/role_assignments?group.id=de080813b38b4e56981829a0177784ab&scope.project.id=b74bb643188f42a68dced2cedca8fb95&role.id=41a9e10d8ca34fa892f53bf450f29554 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:09.322762 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f7ae0-369d-4320-bd29-101d0d50f9e1 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:09.323055 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f7ae0-369d-4320-bd29-101d0d50f9e1 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:09.323354 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f7ae0-369d-4320-bd29-101d0d50f9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:09.341807 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-eb7f7ae0-369d-4320-bd29-101d0d50f9e1 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:09.343073 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-eb7f7ae0-369d-4320-bd29-101d0d50f9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:09.426348 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 224/443] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:45:09.426348 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f7ae0-369d-4320-bd29-101d0d50f9e1 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:09.430985 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252d627-0f27-437e-bb81-95cae9e99a20 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:09.457407 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:09.466464 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:09.470283 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0cb8fa-a456-4974-bf27-f850cd70d567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:09.471202 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cb8fa-a456-4974-bf27-f850cd70d567 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:09.471485 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cb8fa-a456-4974-bf27-f850cd70d567 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:09.471761 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cb8fa-a456-4974-bf27-f850cd70d567 None admin] PATH_INFO: `/v3/groups/de080813b38b4e56981829a0177784ab` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:09.473037 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0cb8fa-a456-4974-bf27-f850cd70d567 None admin] RBAC: Authorizing `identity:get_group(group_id=de080813b38b4e56981829a0177784ab)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:09.474547 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0cb8fa-a456-4974-bf27-f850cd70d567 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:09.478676 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 220/444] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Jul 5 21:45:09 2022] GET /identity/v3/groups/de080813b38b4e56981829a0177784ab => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:09.480044 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0cb8fa-a456-4974-bf27-f850cd70d567 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:09.551370 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f7ae0-369d-4320-bd29-101d0d50f9e1 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:09.587264 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d38fc72-d315-4fca-9c3b-339985c21c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:09.588022 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38fc72-d315-4fca-9c3b-339985c21c48 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:09.588367 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38fc72-d315-4fca-9c3b-339985c21c48 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:09.588716 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38fc72-d315-4fca-9c3b-339985c21c48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:09.598242 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0cb8fa-a456-4974-bf27-f850cd70d567 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:09.631655 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c75cf0-4e14-4024-b03b-10d4112f218b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:09.632986 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c75cf0-4e14-4024-b03b-10d4112f218b None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:09.633274 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c75cf0-4e14-4024-b03b-10d4112f218b None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:09.633560 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c75cf0-4e14-4024-b03b-10d4112f218b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:09.644219 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c75cf0-4e14-4024-b03b-10d4112f218b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:45:09.652646 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-20c75cf0-4e14-4024-b03b-10d4112f218b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:45:09.652646 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:09.652646 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:09.652646 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:09.652646 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:09.652646 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:09.652646 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:09.652646 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:09.652646 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:09.652646 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:09.652646 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:09.652646 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:09.652646 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:45:09.652646 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:45:09.652646 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:45:09.652646 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:45:09.654354 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:45:09.654354 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:45:09.654354 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:45:09.654354 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:45:09.654354 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:09.654354 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:09.654354 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:09.654354 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:09.654354 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:09.654354 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:09.654354 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:09.654354 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:09.654354 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:09.654354 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:09.654354 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:09.654354 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:09.655493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:09.655493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:09.655493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:09.655493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:09.655493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:45:09.655493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:45:09.655493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:45:09.655493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:45:09.655493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:45:09.655493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:45:09.655493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:45:09.655493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:09.655493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 221/445] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:45:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:09.655493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c75cf0-4e14-4024-b03b-10d4112f218b None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:09.661093 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d38fc72-d315-4fca-9c3b-339985c21c48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:09.662629 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d38fc72-d315-4fca-9c3b-339985c21c48 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:09.696577 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:09.706630 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:09.759230 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c75cf0-4e14-4024-b03b-10d4112f218b None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:09.763595 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 225/446] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:45:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:45:09.764430 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d38fc72-d315-4fca-9c3b-339985c21c48 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:09.793856 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b15024-30c7-411f-a3e5-bfe66877efc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:09.794558 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b15024-30c7-411f-a3e5-bfe66877efc2 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:09.794849 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b15024-30c7-411f-a3e5-bfe66877efc2 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:09.795134 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b15024-30c7-411f-a3e5-bfe66877efc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:09.795969 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b15024-30c7-411f-a3e5-bfe66877efc2 None admin] RBAC: Adding query filter params (group.id=de080813b38b4e56981829a0177784ab, role.id=9bd598b07a9942b7a91c3a372f3cf094, scope.project.id=e8b08a08b5d3403b9697254998dfb18f) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:09.796281 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b15024-30c7-411f-a3e5-bfe66877efc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:09.797787 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b15024-30c7-411f-a3e5-bfe66877efc2 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:09.803560 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 222/447] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Jul 5 21:45:09 2022] GET /identity/v3/role_assignments?group.id=de080813b38b4e56981829a0177784ab&scope.project.id=e8b08a08b5d3403b9697254998dfb18f&role.id=9bd598b07a9942b7a91c3a372f3cf094 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:09.804421 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b15024-30c7-411f-a3e5-bfe66877efc2 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:09.876529 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d38fc72-d315-4fca-9c3b-339985c21c48 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:09.914756 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cef8ce-2e41-4657-b6ba-3b0c967b9679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:09.915447 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cef8ce-2e41-4657-b6ba-3b0c967b9679 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:09.915737 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cef8ce-2e41-4657-b6ba-3b0c967b9679 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:09.916019 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cef8ce-2e41-4657-b6ba-3b0c967b9679 None admin] PATH_INFO: `/v3/roles` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:09.916789 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cef8ce-2e41-4657-b6ba-3b0c967b9679 None admin] RBAC: Adding query filter params (name=admin) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:09.917093 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cef8ce-2e41-4657-b6ba-3b0c967b9679 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:09.918569 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cef8ce-2e41-4657-b6ba-3b0c967b9679 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:09.920302 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:09.926221 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b15024-30c7-411f-a3e5-bfe66877efc2 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:09.928951 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 226/448] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:45:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:09.934996 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cef8ce-2e41-4657-b6ba-3b0c967b9679 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:09.944551 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:09.971364 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c89a00-61ab-43c3-bcca-8697bdd0ed14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:09.971957 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c89a00-61ab-43c3-bcca-8697bdd0ed14 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:09.972248 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c89a00-61ab-43c3-bcca-8697bdd0ed14 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:09.972530 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c89a00-61ab-43c3-bcca-8697bdd0ed14 None admin] PATH_INFO: `/v3/projects/b74bb643188f42a68dced2cedca8fb95` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:09.973917 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c89a00-61ab-43c3-bcca-8697bdd0ed14 None admin] RBAC: Authorizing `identity:get_project(project_id=b74bb643188f42a68dced2cedca8fb95)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:09.975610 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c89a00-61ab-43c3-bcca-8697bdd0ed14 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:09.982348 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 223/449] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:45:09 2022] GET /identity/v3/projects/b74bb643188f42a68dced2cedca8fb95 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:09.984206 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c89a00-61ab-43c3-bcca-8697bdd0ed14 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:10.058015 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cef8ce-2e41-4657-b6ba-3b0c967b9679 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:10.102305 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63772ab-4175-423b-b9fe-b7beffe74a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:10.103237 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63772ab-4175-423b-b9fe-b7beffe74a38 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:10.103523 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63772ab-4175-423b-b9fe-b7beffe74a38 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:10.103817 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63772ab-4175-423b-b9fe-b7beffe74a38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:10.114471 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c89a00-61ab-43c3-bcca-8697bdd0ed14 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:10.157236 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259eff46-9d3e-438e-b325-0475a02b3b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:10.158112 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259eff46-9d3e-438e-b325-0475a02b3b54 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:10.158430 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259eff46-9d3e-438e-b325-0475a02b3b54 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:10.158711 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259eff46-9d3e-438e-b325-0475a02b3b54 None admin] PATH_INFO: `/v3/groups/de080813b38b4e56981829a0177784ab` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:10.159914 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259eff46-9d3e-438e-b325-0475a02b3b54 None admin] RBAC: Authorizing `identity:get_group(group_id=de080813b38b4e56981829a0177784ab)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:10.161357 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259eff46-9d3e-438e-b325-0475a02b3b54 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:10.163103 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 224/450] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Jul 5 21:45:09 2022] GET /identity/v3/groups/de080813b38b4e56981829a0177784ab => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:45:10.169892 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259eff46-9d3e-438e-b325-0475a02b3b54 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:10.174451 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:10.184850 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63772ab-4175-423b-b9fe-b7beffe74a38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:10.186364 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63772ab-4175-423b-b9fe-b7beffe74a38 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:10.234073 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:10.296317 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259eff46-9d3e-438e-b325-0475a02b3b54 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:10.311595 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 227/451] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:45:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 21:45:10.317143 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63772ab-4175-423b-b9fe-b7beffe74a38 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:10.334370 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7371eee-841f-465f-87e0-fb4882604565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:10.335303 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7371eee-841f-465f-87e0-fb4882604565 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:10.335775 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7371eee-841f-465f-87e0-fb4882604565 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:10.336119 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7371eee-841f-465f-87e0-fb4882604565 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:10.337544 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7371eee-841f-465f-87e0-fb4882604565 None admin] RBAC: Adding query filter params (group.id=de080813b38b4e56981829a0177784ab, role.id=9bd598b07a9942b7a91c3a372f3cf094, scope.project.id=b74bb643188f42a68dced2cedca8fb95) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:10.337544 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7371eee-841f-465f-87e0-fb4882604565 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:10.338798 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7371eee-841f-465f-87e0-fb4882604565 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:10.346853 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 225/452] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Jul 5 21:45:10 2022] GET /identity/v3/role_assignments?group.id=de080813b38b4e56981829a0177784ab&scope.project.id=b74bb643188f42a68dced2cedca8fb95&role.id=9bd598b07a9942b7a91c3a372f3cf094 => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:10.426055 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:10.433404 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63772ab-4175-423b-b9fe-b7beffe74a38 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:10.469671 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a679c-7e20-4a66-8294-08d1dd3393ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:10.470584 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a679c-7e20-4a66-8294-08d1dd3393ca None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:10.470876 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a679c-7e20-4a66-8294-08d1dd3393ca None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:10.471160 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a679c-7e20-4a66-8294-08d1dd3393ca None admin] PATH_INFO: `/v3/projects/557b6303201840cf82d0fdc7c227e5e6` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:10.472415 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705a679c-7e20-4a66-8294-08d1dd3393ca None admin] RBAC: Authorizing `identity:get_project(project_id=557b6303201840cf82d0fdc7c227e5e6)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:10.473893 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705a679c-7e20-4a66-8294-08d1dd3393ca None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:10.476247 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 228/453] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:45:10 2022] GET /identity/v3/projects/557b6303201840cf82d0fdc7c227e5e6 => generated 344 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:45:10.482276 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7371eee-841f-465f-87e0-fb4882604565 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:10.590972 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7371eee-841f-465f-87e0-fb4882604565 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:10.605561 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:10.625590 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f75dc-0d16-4dba-b9a6-c4992f7b326c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:10.626496 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f75dc-0d16-4dba-b9a6-c4992f7b326c None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:10.626786 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f75dc-0d16-4dba-b9a6-c4992f7b326c None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:10.627071 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f75dc-0d16-4dba-b9a6-c4992f7b326c None admin] PATH_INFO: `/v3/groups/2e1a376b13ee42d7832b5011273b41e7` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:10.628263 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87f75dc-0d16-4dba-b9a6-c4992f7b326c None admin] RBAC: Authorizing `identity:get_group(group_id=2e1a376b13ee42d7832b5011273b41e7)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:10.629791 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87f75dc-0d16-4dba-b9a6-c4992f7b326c None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:10.631455 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 226/454] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Jul 5 21:45:10 2022] GET /identity/v3/groups/2e1a376b13ee42d7832b5011273b41e7 => generated 229 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:10.637540 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a679c-7e20-4a66-8294-08d1dd3393ca None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:10.742484 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a679c-7e20-4a66-8294-08d1dd3393ca None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:10.775915 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be65f11-deeb-4637-8da7-196068af6fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:10.776593 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be65f11-deeb-4637-8da7-196068af6fa5 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:10.776900 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be65f11-deeb-4637-8da7-196068af6fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:10.777168 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be65f11-deeb-4637-8da7-196068af6fa5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:10.778006 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be65f11-deeb-4637-8da7-196068af6fa5 None admin] RBAC: Adding query filter params (group.id=2e1a376b13ee42d7832b5011273b41e7, role.id=e1c574c9973548ebb0e8d9e0656ccabd, scope.project.id=557b6303201840cf82d0fdc7c227e5e6) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:10.778348 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be65f11-deeb-4637-8da7-196068af6fa5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:10.779790 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be65f11-deeb-4637-8da7-196068af6fa5 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:10.785554 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 229/455] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Jul 5 21:45:10 2022] GET /identity/v3/role_assignments?group.id=2e1a376b13ee42d7832b5011273b41e7&scope.project.id=557b6303201840cf82d0fdc7c227e5e6&role.id=e1c574c9973548ebb0e8d9e0656ccabd => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:13.200960 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b535ec2-20f5-43f7-b524-16feb9c212f9 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:13.201493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b535ec2-20f5-43f7-b524-16feb9c212f9 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:13.201493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b535ec2-20f5-43f7-b524-16feb9c212f9 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:13.203226 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 227/456] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:45:13.208340 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9239cb-f818-4c67-a794-35cda00cc09b None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:13.209172 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9239cb-f818-4c67-a794-35cda00cc09b None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:13.209672 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9239cb-f818-4c67-a794-35cda00cc09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:13.235571 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-ff9239cb-f818-4c67-a794-35cda00cc09b None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:13.239125 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-ff9239cb-f818-4c67-a794-35cda00cc09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:13.268650 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:13.331847 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 230/457] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:45:13.368731 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b535ec2-20f5-43f7-b524-16feb9c212f9 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:13.477362 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd77b59-bffd-493b-9ab4-f1e8b77c1833 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:13.477564 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd77b59-bffd-493b-9ab4-f1e8b77c1833 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:13.478119 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd77b59-bffd-493b-9ab4-f1e8b77c1833 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:13.479860 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 231/458] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:45:13.484913 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1251ab83-4d43-4448-b3e0-3b1be3bf972d None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:13.485206 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1251ab83-4d43-4448-b3e0-3b1be3bf972d None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:13.485508 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1251ab83-4d43-4448-b3e0-3b1be3bf972d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:13.516326 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b535ec2-20f5-43f7-b524-16feb9c212f9 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:13.519483 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-1251ab83-4d43-4448-b3e0-3b1be3bf972d None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:13.520680 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-1251ab83-4d43-4448-b3e0-3b1be3bf972d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:13.566162 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5fd6f9-abae-4226-9393-2d1b3019a0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:13.566162 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fd6f9-abae-4226-9393-2d1b3019a0e5 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:13.566162 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fd6f9-abae-4226-9393-2d1b3019a0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:13.566162 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fd6f9-abae-4226-9393-2d1b3019a0e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:13.584411 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5fd6f9-abae-4226-9393-2d1b3019a0e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:13.586843 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5fd6f9-abae-4226-9393-2d1b3019a0e5 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:13.615534 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-1e5fd6f9-abae-4226-9393-2d1b3019a0e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:13.615534 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:13.615534 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:13.615534 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:13.615534 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:13.615534 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:13.615534 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:13.615534 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:13.615534 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:13.615534 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:13.615534 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:13.615534 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:13.615534 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:13.615534 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:13.615534 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:13.617215 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:13.617215 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:13.617215 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:13.617215 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:13.617215 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:13.617215 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:13.617215 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:13.617215 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:13.617215 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:13.617215 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:13.617215 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:13.617215 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:13.617215 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:13.617215 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:13.617215 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:13.617215 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:13.617215 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:13.618212 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:13.618212 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:13.618212 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:13.618212 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:13.618212 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 228/459] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:13.627230 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5fd6f9-abae-4226-9393-2d1b3019a0e5 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:13.642890 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 232/460] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:45:13.690993 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:13.700965 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1251ab83-4d43-4448-b3e0-3b1be3bf972d None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:13.779325 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5fd6f9-abae-4226-9393-2d1b3019a0e5 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:13.803660 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:13.814971 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee214d7-850b-4004-a832-17e7b6a5b1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:13.815646 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee214d7-850b-4004-a832-17e7b6a5b1ed None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:13.816314 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee214d7-850b-4004-a832-17e7b6a5b1ed None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:13.816314 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee214d7-850b-4004-a832-17e7b6a5b1ed None admin] PATH_INFO: `/v3/domains` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:13.816939 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee214d7-850b-4004-a832-17e7b6a5b1ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:13.817255 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee214d7-850b-4004-a832-17e7b6a5b1ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:13.818276 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1251ab83-4d43-4448-b3e0-3b1be3bf972d None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:13.818677 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee214d7-850b-4004-a832-17e7b6a5b1ed None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:13.831842 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 229/461] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:13.833222 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985da49f-41dd-472c-b040-28d136379ed9 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:13.833524 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985da49f-41dd-472c-b040-28d136379ed9 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:13.833811 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985da49f-41dd-472c-b040-28d136379ed9 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:13.835616 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 230/462] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:45:13.840526 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985da49f-41dd-472c-b040-28d136379ed9 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:13.857502 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b545ea1-f99e-4bfe-bca8-41bf844e665f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:13.858347 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b545ea1-f99e-4bfe-bca8-41bf844e665f None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:13.858637 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b545ea1-f99e-4bfe-bca8-41bf844e665f None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:13.859018 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b545ea1-f99e-4bfe-bca8-41bf844e665f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:13.870869 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b545ea1-f99e-4bfe-bca8-41bf844e665f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:13.872441 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b545ea1-f99e-4bfe-bca8-41bf844e665f None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:13.892059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-6b545ea1-f99e-4bfe-bca8-41bf844e665f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:13.892059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:13.892059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:13.892059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:13.892059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:13.892059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:13.892059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:13.892059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:13.892059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:13.892059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:13.892059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:13.892059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:13.892059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:13.892059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:13.892059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:13.894157 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:13.894157 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:13.894157 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:13.894157 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:13.894157 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:13.894157 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:13.894157 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:13.894157 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:13.894157 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:13.894157 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:13.894157 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:13.894157 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:13.894157 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:13.894157 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:13.894157 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:13.894157 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:13.894157 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:13.896370 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:13.896370 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:13.896370 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:13.896370 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:13.896370 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 233/463] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:45:13.902159 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96b5a8-3a0a-4677-be0e-65ab4b7f23ca None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:13.902159 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96b5a8-3a0a-4677-be0e-65ab4b7f23ca None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:13.902159 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96b5a8-3a0a-4677-be0e-65ab4b7f23ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:13.918472 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-cc96b5a8-3a0a-4677-be0e-65ab4b7f23ca None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:13.919768 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-cc96b5a8-3a0a-4677-be0e-65ab4b7f23ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:13.940115 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:13.948602 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985da49f-41dd-472c-b040-28d136379ed9 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:13.985886 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2149f1c3-fea7-4f8c-a950-6128d7242785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:13.986613 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149f1c3-fea7-4f8c-a950-6128d7242785 None admin] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:13.986903 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149f1c3-fea7-4f8c-a950-6128d7242785 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:13.987189 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149f1c3-fea7-4f8c-a950-6128d7242785 None admin] PATH_INFO: `/v3/users` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:13.987905 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2149f1c3-fea7-4f8c-a950-6128d7242785 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:13.989343 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2149f1c3-fea7-4f8c-a950-6128d7242785 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:13.994827 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 234/464] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:45:13.995693 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96b5a8-3a0a-4677-be0e-65ab4b7f23ca None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:14.070225 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:14.101929 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96b5a8-3a0a-4677-be0e-65ab4b7f23ca None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:14.114085 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 231/465] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:45:13 2022] POST /identity/v3/users => generated 246 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:45:14.115179 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2149f1c3-fea7-4f8c-a950-6128d7242785 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:14.154958 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849461ea-99f8-4946-9fb4-a254b4532475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:14.155948 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849461ea-99f8-4946-9fb4-a254b4532475 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:14.156409 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849461ea-99f8-4946-9fb4-a254b4532475 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:14.156840 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849461ea-99f8-4946-9fb4-a254b4532475 None admin] PATH_INFO: `/v3/domains` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:14.157858 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849461ea-99f8-4946-9fb4-a254b4532475 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:14.158359 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849461ea-99f8-4946-9fb4-a254b4532475 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:14.160047 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849461ea-99f8-4946-9fb4-a254b4532475 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:14.185472 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 235/466] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:14.187525 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489ae57-4831-42a4-97ba-abf05f82b672 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:14.187952 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489ae57-4831-42a4-97ba-abf05f82b672 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:14.188346 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489ae57-4831-42a4-97ba-abf05f82b672 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:14.189918 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 236/467] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:45:14.194875 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489ae57-4831-42a4-97ba-abf05f82b672 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:14.265101 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2149f1c3-fea7-4f8c-a950-6128d7242785 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:14.306364 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee62d5e-9fef-4855-bc2a-df7bc5af5f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:14.307333 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee62d5e-9fef-4855-bc2a-df7bc5af5f46 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:14.307889 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee62d5e-9fef-4855-bc2a-df7bc5af5f46 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:14.308448 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee62d5e-9fef-4855-bc2a-df7bc5af5f46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:14.322081 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489ae57-4831-42a4-97ba-abf05f82b672 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:14.322607 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee62d5e-9fef-4855-bc2a-df7bc5af5f46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:14.323774 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee62d5e-9fef-4855-bc2a-df7bc5af5f46 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:14.346165 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-1ee62d5e-9fef-4855-bc2a-df7bc5af5f46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:14.346165 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:14.346165 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:14.346165 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:14.346165 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:14.346165 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:14.346165 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:14.346165 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:14.346165 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:14.346165 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:14.346165 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:14.346165 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:14.346165 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:14.346165 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:14.346165 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:14.347181 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:14.347181 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:14.347181 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:14.347181 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:14.347181 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:14.347181 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:14.347181 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:14.347181 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:14.347181 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:14.347181 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:14.347181 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:14.347181 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:14.347181 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:14.347181 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:14.347181 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:14.347181 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:14.347181 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:14.348142 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:14.348142 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:14.348142 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:14.348142 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:14.354385 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 232/468] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:14.354385 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d722dbd-c5c9-471b-a958-497f52774296 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:14.354385 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d722dbd-c5c9-471b-a958-497f52774296 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:14.354385 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d722dbd-c5c9-471b-a958-497f52774296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:14.357876 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:14.358878 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:14.365183 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32976ac7-7e70-41bd-a31f-56d4df4b0469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:14.365867 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32976ac7-7e70-41bd-a31f-56d4df4b0469 None admin] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:14.366760 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32976ac7-7e70-41bd-a31f-56d4df4b0469 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:14.367041 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32976ac7-7e70-41bd-a31f-56d4df4b0469 None admin] PATH_INFO: `/v3/users` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:14.368068 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32976ac7-7e70-41bd-a31f-56d4df4b0469 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:14.380228 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32976ac7-7e70-41bd-a31f-56d4df4b0469 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:14.380366 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-9d722dbd-c5c9-471b-a958-497f52774296 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:14.380366 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-9d722dbd-c5c9-471b-a958-497f52774296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:14.444160 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 233/469] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:45:14.445147 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d722dbd-c5c9-471b-a958-497f52774296 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:14.463433 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 237/470] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:45:14 2022] POST /identity/v3/users => generated 248 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:45:14.469225 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32976ac7-7e70-41bd-a31f-56d4df4b0469 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:14.582840 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d722dbd-c5c9-471b-a958-497f52774296 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:14.644951 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:14.651689 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c0fbb-42a1-402a-84de-dbbc25df3441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:14.652973 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c0fbb-42a1-402a-84de-dbbc25df3441 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:14.653608 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c0fbb-42a1-402a-84de-dbbc25df3441 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:14.654174 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c0fbb-42a1-402a-84de-dbbc25df3441 None admin] PATH_INFO: `/v3/domains` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:14.660377 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c0fbb-42a1-402a-84de-dbbc25df3441 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:14.660377 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c0fbb-42a1-402a-84de-dbbc25df3441 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:14.660377 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c0fbb-42a1-402a-84de-dbbc25df3441 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:14.669699 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32976ac7-7e70-41bd-a31f-56d4df4b0469 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:14.683532 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 234/471] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:14.690047 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c0fbb-42a1-402a-84de-dbbc25df3441 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:14.716820 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a964c8-64e4-4268-b0ab-a4fc6e3653d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:14.717992 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a964c8-64e4-4268-b0ab-a4fc6e3653d3 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:14.718552 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a964c8-64e4-4268-b0ab-a4fc6e3653d3 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:14.719150 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a964c8-64e4-4268-b0ab-a4fc6e3653d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:14.732683 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a964c8-64e4-4268-b0ab-a4fc6e3653d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:14.734486 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a964c8-64e4-4268-b0ab-a4fc6e3653d3 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:14.755423 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-17a964c8-64e4-4268-b0ab-a4fc6e3653d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:14.755423 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:14.755423 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:14.755423 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:14.755423 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:14.755423 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:14.755423 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:14.755423 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:14.755423 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:14.755423 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:14.755423 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:14.755423 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:14.755423 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:14.755423 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:14.755423 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:14.756510 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:14.756510 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:14.756510 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:14.756510 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:14.756510 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:14.756510 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:14.756510 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:14.756510 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:14.756510 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:14.756510 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:14.756510 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:14.756510 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:14.756510 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:14.756510 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:14.756510 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:14.756510 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:14.756510 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:14.757530 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:14.757530 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:14.757530 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:14.757530 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:14.759837 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 238/472] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:45:14.765652 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a964c8-64e4-4268-b0ab-a4fc6e3653d3 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:14.821368 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:14.855874 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c0fbb-42a1-402a-84de-dbbc25df3441 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:14.900499 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382be1d0-10b6-4311-aa37-980ead941e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:14.901249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a964c8-64e4-4268-b0ab-a4fc6e3653d3 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:14.901645 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382be1d0-10b6-4311-aa37-980ead941e5d None admin] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:14.902082 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382be1d0-10b6-4311-aa37-980ead941e5d None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:14.902779 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382be1d0-10b6-4311-aa37-980ead941e5d None admin] PATH_INFO: `/v3/users` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:14.904466 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382be1d0-10b6-4311-aa37-980ead941e5d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:14.906151 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382be1d0-10b6-4311-aa37-980ead941e5d None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:14.939087 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150ecbe-39ec-4573-993f-63c73be841f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:14.939762 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150ecbe-39ec-4573-993f-63c73be841f1 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:14.941176 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150ecbe-39ec-4573-993f-63c73be841f1 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:14.941176 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150ecbe-39ec-4573-993f-63c73be841f1 None admin] PATH_INFO: `/v3/domains` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:14.941176 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a150ecbe-39ec-4573-993f-63c73be841f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:14.941392 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a150ecbe-39ec-4573-993f-63c73be841f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:14.942816 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a150ecbe-39ec-4573-993f-63c73be841f1 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:14.955642 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 239/473] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:14.960367 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee8f50-98d8-46b6-850c-e79fb4027d8f None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:14.960367 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee8f50-98d8-46b6-850c-e79fb4027d8f None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:14.960367 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee8f50-98d8-46b6-850c-e79fb4027d8f None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:14.960367 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 240/474] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:45:14.961535 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee8f50-98d8-46b6-850c-e79fb4027d8f None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:15.034496 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 235/475] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:45:14 2022] POST /identity/v3/users => generated 248 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:45:15.037036 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febe0be-e941-49a1-96f9-9dccddfc8f76 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:15.037527 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febe0be-e941-49a1-96f9-9dccddfc8f76 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:15.037884 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febe0be-e941-49a1-96f9-9dccddfc8f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:15.080183 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-9febe0be-e941-49a1-96f9-9dccddfc8f76 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:15.082611 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-9febe0be-e941-49a1-96f9-9dccddfc8f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:15.114759 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:15.123495 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee8f50-98d8-46b6-850c-e79fb4027d8f None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:15.169911 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:15.197946 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 236/476] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:45:15.199695 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e6fa0-1b2b-4dbf-8deb-6a5437d76d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:15.200408 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e6fa0-1b2b-4dbf-8deb-6a5437d76d37 None admin] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:15.200695 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e6fa0-1b2b-4dbf-8deb-6a5437d76d37 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:15.200975 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e6fa0-1b2b-4dbf-8deb-6a5437d76d37 None admin] PATH_INFO: `/v3/users` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:15.201909 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e6fa0-1b2b-4dbf-8deb-6a5437d76d37 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:15.203448 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e6fa0-1b2b-4dbf-8deb-6a5437d76d37 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:15.224103 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febe0be-e941-49a1-96f9-9dccddfc8f76 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:15.336058 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febe0be-e941-49a1-96f9-9dccddfc8f76 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:15.375141 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e571d4f-9e69-4950-a838-061aebc35cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:15.375795 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e571d4f-9e69-4950-a838-061aebc35cfd None admin] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:15.376144 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e571d4f-9e69-4950-a838-061aebc35cfd None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:15.376482 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e571d4f-9e69-4950-a838-061aebc35cfd None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:15.377301 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e571d4f-9e69-4950-a838-061aebc35cfd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:15.378850 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e571d4f-9e69-4950-a838-061aebc35cfd None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:15.401854 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 241/477] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:45:14 2022] POST /identity/v3/users => generated 249 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:45:15.415148 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.sql.core [None req-3e571d4f-9e69-4950-a838-061aebc35cfd None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 05 21:45:15.415148 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 05 21:45:15.415148 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [parameters: {'id': '89582153c2e8470499734d22800c7b7a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 05 21:45:15.415148 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=244269) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 05 21:45:15.437889 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-3e571d4f-9e69-4950-a838-061aebc35cfd None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 05 21:45:15.437889 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:15.437889 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 21:45:15.437889 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 21:45:15.437889 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 21:45:15.437889 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 21:45:15.437889 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 21:45:15.437889 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 21:45:15.437889 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 21:45:15.437889 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application conn.query(q) Jul 05 21:45:15.437889 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 21:45:15.437889 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 21:45:15.437889 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 21:45:15.437889 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application result.read() Jul 05 21:45:15.437889 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 21:45:15.438962 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 21:45:15.438962 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 21:45:15.438962 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 21:45:15.438962 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 21:45:15.438962 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 21:45:15.438962 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 21:45:15.438962 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 21:45:15.438962 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 05 21:45:15.438962 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:15.438962 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 05 21:45:15.438962 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:15.438962 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:15.438962 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 05 21:45:15.438962 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 05 21:45:15.438962 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 05 21:45:15.438962 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return ref.to_dict() Jul 05 21:45:15.438962 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 21:45:15.438962 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application next(self.gen) Jul 05 21:45:15.440022 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 05 21:45:15.440022 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application yield resource Jul 05 21:45:15.440022 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 21:45:15.440022 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application next(self.gen) Jul 05 21:45:15.440022 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 05 21:45:15.440022 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application self.session.rollback() Jul 05 21:45:15.440022 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 05 21:45:15.440022 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application self.force_reraise() Jul 05 21:45:15.440022 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 05 21:45:15.440022 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise self.value Jul 05 21:45:15.440022 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 05 21:45:15.440022 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 05 21:45:15.440022 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 05 21:45:15.440022 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application session.commit() Jul 05 21:45:15.440022 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 05 21:45:15.440022 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 05 21:45:15.440022 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 05 21:45:15.442228 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application self._prepare_impl() Jul 05 21:45:15.442228 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 05 21:45:15.442228 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application self.session.flush() Jul 05 21:45:15.442228 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 05 21:45:15.442228 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application self._flush(objects) Jul 05 21:45:15.442228 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 05 21:45:15.442228 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 05 21:45:15.442228 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 05 21:45:15.442228 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application compat.raise_( Jul 05 21:45:15.442228 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 21:45:15.442228 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception Jul 05 21:45:15.442228 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 05 21:45:15.442228 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application flush_context.execute() Jul 05 21:45:15.442228 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 05 21:45:15.442228 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rec.execute(self) Jul 05 21:45:15.442228 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 05 21:45:15.442228 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 05 21:45:15.445047 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 05 21:45:15.445047 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 05 21:45:15.445047 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 05 21:45:15.445047 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 05 21:45:15.445047 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 05 21:45:15.445047 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 05 21:45:15.445047 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 05 21:45:15.445047 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 05 21:45:15.445047 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 05 21:45:15.445047 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 05 21:45:15.445047 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 05 21:45:15.445047 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 05 21:45:15.445047 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 05 21:45:15.445047 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 05 21:45:15.445047 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 21:45:15.445047 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception Jul 05 21:45:15.447257 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 21:45:15.447257 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 21:45:15.447257 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 21:45:15.447257 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 21:45:15.447257 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 21:45:15.447257 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 21:45:15.447257 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 21:45:15.447257 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application conn.query(q) Jul 05 21:45:15.447257 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 21:45:15.447257 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 21:45:15.447257 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 21:45:15.447257 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application result.read() Jul 05 21:45:15.447257 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 21:45:15.447257 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 21:45:15.447257 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 21:45:15.447257 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 21:45:15.449332 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 21:45:15.449332 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 21:45:15.449332 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 21:45:15.449332 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 21:45:15.449332 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 05 21:45:15.449332 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 05 21:45:15.449332 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [parameters: {'id': '89582153c2e8470499734d22800c7b7a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 05 21:45:15.449332 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 05 21:45:15.449332 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:15.449332 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:45:15.449332 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:15.449332 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:15.449332 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:15.449332 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:15.449332 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:15.449332 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:15.451575 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:15.451575 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:15.451575 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:15.451575 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:15.451575 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:15.451575 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:15.451575 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 05 21:45:15.451575 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 05 21:45:15.451575 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:15.451575 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:15.451575 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 05 21:45:15.451575 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 05 21:45:15.451575 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 05 21:45:15.451575 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 05 21:45:15.451575 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 05 21:45:15.451575 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:15.466663 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 237/478] 10.222.0.30 () {60 vars in 1131 bytes} [Tue Jul 5 21:45:15 2022] POST /identity/v3/roles => generated 144 bytes in 216 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:45:15.466813 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e6fa0-1b2b-4dbf-8deb-6a5437d76d37 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:15.594526 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e6fa0-1b2b-4dbf-8deb-6a5437d76d37 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:15.644902 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc9c1fb-ee48-4992-96b4-6aab822d2e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:15.645657 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9c1fb-ee48-4992-96b4-6aab822d2e89 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:15.645950 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9c1fb-ee48-4992-96b4-6aab822d2e89 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:15.646256 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9c1fb-ee48-4992-96b4-6aab822d2e89 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:15.666083 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc9c1fb-ee48-4992-96b4-6aab822d2e89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:45:15.674467 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-4cc9c1fb-ee48-4992-96b4-6aab822d2e89 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:45:15.674467 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:15.674467 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:15.674467 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:15.674467 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:15.674467 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:15.674467 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:15.674467 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:15.674467 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:15.674467 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:15.674467 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:15.674467 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:15.674467 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:45:15.674467 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:45:15.674467 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:45:15.674467 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:45:15.676648 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:45:15.676648 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:45:15.676648 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:45:15.676648 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:45:15.676648 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:15.676648 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:15.676648 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:15.676648 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:15.676648 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:15.676648 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:15.676648 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:15.676648 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:15.676648 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:15.676648 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:15.676648 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:15.676648 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:15.679431 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:15.679431 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:15.679431 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:15.679431 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:15.679431 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:45:15.679431 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:45:15.679431 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:45:15.679431 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:45:15.679431 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:45:15.679431 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:45:15.679431 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 21:45:15.679431 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:15.679431 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 242/479] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:45:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:15.684871 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e571d4f-9e69-4950-a838-061aebc35cfd None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:15.735969 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:15.798875 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e571d4f-9e69-4950-a838-061aebc35cfd None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:15.836360 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10419d5b-604c-4838-9532-bbf3dc1c3c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:15.837044 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10419d5b-604c-4838-9532-bbf3dc1c3c86 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:15.837333 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10419d5b-604c-4838-9532-bbf3dc1c3c86 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:15.837611 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10419d5b-604c-4838-9532-bbf3dc1c3c86 None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:15.838400 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10419d5b-604c-4838-9532-bbf3dc1c3c86 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:15.838695 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10419d5b-604c-4838-9532-bbf3dc1c3c86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:15.840078 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10419d5b-604c-4838-9532-bbf3dc1c3c86 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:15.849228 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 238/480] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:45:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:16.599350 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619078ae-4cc4-4d81-b64e-cbf02b223512 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:16.599886 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619078ae-4cc4-4d81-b64e-cbf02b223512 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:16.599886 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619078ae-4cc4-4d81-b64e-cbf02b223512 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:16.601573 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 243/481] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:45:16.615949 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20947f0b-8a70-485b-87d1-065a8c49d690 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:16.617001 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20947f0b-8a70-485b-87d1-065a8c49d690 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:16.617131 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20947f0b-8a70-485b-87d1-065a8c49d690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:16.639482 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-20947f0b-8a70-485b-87d1-065a8c49d690 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:16.640690 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-20947f0b-8a70-485b-87d1-065a8c49d690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:16.735671 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 239/482] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:45:16.771447 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619078ae-4cc4-4d81-b64e-cbf02b223512 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:16.793886 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:16.866955 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86520dd8-f539-4f91-8c7b-d3301dcbdc7d None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:16.867168 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86520dd8-f539-4f91-8c7b-d3301dcbdc7d None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:16.867421 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86520dd8-f539-4f91-8c7b-d3301dcbdc7d None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:16.869069 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 240/483] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:45:16.892017 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da158726-46b7-48a8-b8ae-0b37a98ff58b None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:16.892311 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da158726-46b7-48a8-b8ae-0b37a98ff58b None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:16.892604 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da158726-46b7-48a8-b8ae-0b37a98ff58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:16.909317 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619078ae-4cc4-4d81-b64e-cbf02b223512 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:16.931197 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-da158726-46b7-48a8-b8ae-0b37a98ff58b None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:16.932434 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-da158726-46b7-48a8-b8ae-0b37a98ff58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:16.949476 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211cf583-d784-4cd4-b7b9-2e445f83908d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:16.950978 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211cf583-d784-4cd4-b7b9-2e445f83908d None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:16.951498 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211cf583-d784-4cd4-b7b9-2e445f83908d None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:16.951941 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211cf583-d784-4cd4-b7b9-2e445f83908d None admin] PATH_INFO: `/v3/roles/service` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:16.964706 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211cf583-d784-4cd4-b7b9-2e445f83908d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:45:16.973378 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-211cf583-d784-4cd4-b7b9-2e445f83908d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:45:16.973378 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:16.973378 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:16.973378 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:16.973378 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:16.973378 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:16.973378 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:16.973378 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:16.973378 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:16.973378 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:16.973378 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:16.973378 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:16.973378 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:45:16.973378 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:45:16.973378 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:45:16.973378 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:45:16.974595 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:45:16.974595 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:45:16.974595 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:45:16.974595 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:45:16.974595 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:16.974595 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:16.974595 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:16.974595 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:16.974595 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:16.974595 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:16.974595 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:16.974595 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:16.974595 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:16.974595 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:16.974595 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:16.974595 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:16.977449 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:16.977449 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:16.977449 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:16.977449 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:16.977449 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:45:16.977449 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:45:16.977449 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:45:16.977449 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:45:16.977449 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:45:16.977449 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:45:16.977449 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:45:16.977449 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:16.977449 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 244/484] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:45:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:16.980970 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211cf583-d784-4cd4-b7b9-2e445f83908d None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:16.986256 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:17.067877 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 241/485] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:45:17.081393 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:17.091658 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da158726-46b7-48a8-b8ae-0b37a98ff58b None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:17.141677 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211cf583-d784-4cd4-b7b9-2e445f83908d None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:17.205628 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf5103-02f5-4c98-9a1f-84f71310247f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:17.206340 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf5103-02f5-4c98-9a1f-84f71310247f None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:17.206679 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf5103-02f5-4c98-9a1f-84f71310247f None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:17.206961 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf5103-02f5-4c98-9a1f-84f71310247f None admin] PATH_INFO: `/v3/roles` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:17.207723 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf5103-02f5-4c98-9a1f-84f71310247f None admin] RBAC: Adding query filter params (name=service) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:17.208030 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf5103-02f5-4c98-9a1f-84f71310247f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:17.209441 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf5103-02f5-4c98-9a1f-84f71310247f None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:17.218719 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 245/486] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:45:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:45:17.224319 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf5103-02f5-4c98-9a1f-84f71310247f None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:17.233096 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da158726-46b7-48a8-b8ae-0b37a98ff58b None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:17.275855 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063017e-3bb2-43b3-8771-5ebb6dd36e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:17.276666 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063017e-3bb2-43b3-8771-5ebb6dd36e15 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:17.276958 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063017e-3bb2-43b3-8771-5ebb6dd36e15 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:17.277465 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063017e-3bb2-43b3-8771-5ebb6dd36e15 None admin] PATH_INFO: `/v3/roles/service` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:17.299385 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a063017e-3bb2-43b3-8771-5ebb6dd36e15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:45:17.316120 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-a063017e-3bb2-43b3-8771-5ebb6dd36e15 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:45:17.316120 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:17.316120 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:17.316120 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:17.316120 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:17.316120 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:17.316120 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:17.316120 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:17.316120 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:17.316120 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:17.316120 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:17.316120 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:17.316120 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:45:17.316120 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:45:17.316120 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:45:17.316120 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:45:17.317195 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:45:17.317195 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:45:17.317195 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:45:17.317195 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:45:17.317195 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:17.317195 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:17.317195 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:17.317195 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:17.317195 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:17.317195 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:17.317195 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:17.317195 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:17.317195 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:17.317195 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:17.317195 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:17.317195 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:17.318518 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:17.318518 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:17.318518 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:17.318518 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:17.318518 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:45:17.318518 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:45:17.318518 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:45:17.318518 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:45:17.318518 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:45:17.318518 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:45:17.318518 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:45:17.318518 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:17.318518 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 242/487] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:45:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:45:17.329868 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063017e-3bb2-43b3-8771-5ebb6dd36e15 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:17.382153 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:17.436770 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf5103-02f5-4c98-9a1f-84f71310247f None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:17.492808 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063017e-3bb2-43b3-8771-5ebb6dd36e15 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:17.508336 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c76464-9b61-40fc-8967-bf6eae3cee9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:17.508677 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c76464-9b61-40fc-8967-bf6eae3cee9d None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:17.508943 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c76464-9b61-40fc-8967-bf6eae3cee9d None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:17.509231 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c76464-9b61-40fc-8967-bf6eae3cee9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:17.520532 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:17.529639 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f8227b-5e77-47eb-9843-f72e193a9eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:17.530552 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8227b-5e77-47eb-9843-f72e193a9eed None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:17.533458 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8227b-5e77-47eb-9843-f72e193a9eed None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:17.533458 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8227b-5e77-47eb-9843-f72e193a9eed None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:17.533458 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f8227b-5e77-47eb-9843-f72e193a9eed None admin] RBAC: Adding query filter params (name=service) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:17.533458 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f8227b-5e77-47eb-9843-f72e193a9eed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:17.534333 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f8227b-5e77-47eb-9843-f72e193a9eed None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:17.545330 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c76464-9b61-40fc-8967-bf6eae3cee9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:17.545330 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c76464-9b61-40fc-8967-bf6eae3cee9d None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:17.549856 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 243/488] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:45:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:17.567663 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f8227b-5e77-47eb-9843-f72e193a9eed None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:17.586414 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-57c76464-9b61-40fc-8967-bf6eae3cee9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:17.586414 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:17.586414 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:17.586414 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:17.586414 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:17.586414 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:17.586414 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:17.586414 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:17.586414 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:17.586414 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:17.586414 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:17.586414 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:17.586414 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:17.586414 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:17.586414 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:17.587623 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:17.587623 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:17.587623 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:17.587623 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:17.587623 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:17.587623 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:17.587623 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:17.587623 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:17.587623 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:17.587623 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:17.587623 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:17.587623 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:17.587623 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:17.587623 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:17.587623 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:17.587623 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:17.587623 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:17.588606 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:17.588606 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:17.588606 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:17.588606 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:17.588606 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 246/489] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:17.595175 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c76464-9b61-40fc-8967-bf6eae3cee9d None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:17.678568 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:17.699741 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f8227b-5e77-47eb-9843-f72e193a9eed None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:17.737345 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b121dc4-7d1f-494b-af0d-868f6c98b250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:17.738000 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b121dc4-7d1f-494b-af0d-868f6c98b250 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:17.738431 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b121dc4-7d1f-494b-af0d-868f6c98b250 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:17.738871 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b121dc4-7d1f-494b-af0d-868f6c98b250 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:17.750565 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b121dc4-7d1f-494b-af0d-868f6c98b250 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:17.752446 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b121dc4-7d1f-494b-af0d-868f6c98b250 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:17.763517 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c76464-9b61-40fc-8967-bf6eae3cee9d None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:17.772602 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-1b121dc4-7d1f-494b-af0d-868f6c98b250 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:17.772602 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:17.772602 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:17.772602 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:17.772602 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:17.772602 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:17.772602 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:17.772602 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:17.772602 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:17.772602 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:17.772602 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:17.772602 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:17.772602 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:17.772602 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:17.772602 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:17.773658 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:17.773658 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:17.773658 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:17.773658 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:17.773658 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:17.773658 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:17.773658 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:17.773658 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:17.773658 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:17.773658 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:17.773658 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:17.773658 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:17.773658 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:17.773658 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:17.773658 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:17.773658 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:17.773658 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:17.774863 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:17.774863 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:17.774863 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:17.774863 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:17.776547 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 244/490] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:17.777983 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839571d-a1ef-4f84-8ff9-c6d9b859b023 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:17.778505 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839571d-a1ef-4f84-8ff9-c6d9b859b023 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:17.778896 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839571d-a1ef-4f84-8ff9-c6d9b859b023 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:17.784258 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 245/491] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:45:17.784258 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6839571d-a1ef-4f84-8ff9-c6d9b859b023 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:17.818587 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8524e6f4-ccfa-4eb7-8722-2e8f069ec440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:17.820067 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524e6f4-ccfa-4eb7-8722-2e8f069ec440 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:17.820676 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524e6f4-ccfa-4eb7-8722-2e8f069ec440 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:17.821400 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524e6f4-ccfa-4eb7-8722-2e8f069ec440 None admin] PATH_INFO: `/v3/domains` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:17.823242 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8524e6f4-ccfa-4eb7-8722-2e8f069ec440 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:17.823761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8524e6f4-ccfa-4eb7-8722-2e8f069ec440 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:17.825327 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8524e6f4-ccfa-4eb7-8722-2e8f069ec440 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:17.847192 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 247/492] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:17.847760 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd5e48-6b35-438f-81e4-446d0491db27 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:17.848053 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd5e48-6b35-438f-81e4-446d0491db27 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:17.848332 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd5e48-6b35-438f-81e4-446d0491db27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:17.869365 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-f1dd5e48-6b35-438f-81e4-446d0491db27 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:17.870211 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-f1dd5e48-6b35-438f-81e4-446d0491db27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:17.916364 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:17.918804 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6839571d-a1ef-4f84-8ff9-c6d9b859b023 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:17.946217 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 248/493] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:45:17.946217 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd5e48-6b35-438f-81e4-446d0491db27 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:17.980771 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6847c8c-9d42-4a51-92f2-79001a225d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:17.981824 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6847c8c-9d42-4a51-92f2-79001a225d6c None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:17.982299 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6847c8c-9d42-4a51-92f2-79001a225d6c None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:17.982696 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6847c8c-9d42-4a51-92f2-79001a225d6c None admin] PATH_INFO: `/v3/domains` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:17.984245 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6847c8c-9d42-4a51-92f2-79001a225d6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:17.984715 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6847c8c-9d42-4a51-92f2-79001a225d6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:17.986941 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6847c8c-9d42-4a51-92f2-79001a225d6c None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:17.997469 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:18.004554 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 246/494] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:45:18.006192 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6847c8c-9d42-4a51-92f2-79001a225d6c None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:18.079511 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd5e48-6b35-438f-81e4-446d0491db27 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:18.116044 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49baaa5-a689-40bd-9d26-233d662db830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:18.117381 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49baaa5-a689-40bd-9d26-233d662db830 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:18.117669 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49baaa5-a689-40bd-9d26-233d662db830 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:18.117954 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49baaa5-a689-40bd-9d26-233d662db830 None admin] PATH_INFO: `/v3/users/nova` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:18.122210 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6847c8c-9d42-4a51-92f2-79001a225d6c None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:18.125610 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49baaa5-a689-40bd-9d26-233d662db830 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:18.127432 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49baaa5-a689-40bd-9d26-233d662db830 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:18.145509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-c49baaa5-a689-40bd-9d26-233d662db830 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:45:18.145509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:18.145509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:18.145509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:18.145509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:18.145509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:18.145509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:18.145509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:18.145509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:18.145509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:18.145509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:18.145509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:18.145509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:45:18.145509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:45:18.145509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:45:18.145509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:45:18.146821 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:18.146821 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:18.146821 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:45:18.146821 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:45:18.146821 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:45:18.146821 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:45:18.146821 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:18.146821 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:18.146821 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:18.146821 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:18.146821 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:18.146821 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:18.146821 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:18.146821 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:18.146821 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:18.146821 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:18.146821 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:18.146821 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:18.148144 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:18.148144 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:18.148144 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:45:18.148144 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:45:18.148144 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:45:18.148144 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:45:18.148144 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:45:18.148144 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:45:18.148144 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:45:18.148144 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:18.148837 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 249/495] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Jul 5 21:45:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:18.149370 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49baaa5-a689-40bd-9d26-233d662db830 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:18.166679 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a4599-c81f-46aa-bee7-39a27b667fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:18.167524 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a4599-c81f-46aa-bee7-39a27b667fbb None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:18.167818 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a4599-c81f-46aa-bee7-39a27b667fbb None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:18.168104 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a4599-c81f-46aa-bee7-39a27b667fbb None admin] PATH_INFO: `/v3/roles/service` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:18.181737 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a4599-c81f-46aa-bee7-39a27b667fbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:45:18.191284 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:18.191634 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-f47a4599-c81f-46aa-bee7-39a27b667fbb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:45:18.191634 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:18.191634 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:18.191634 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:18.191634 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:18.191634 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:18.191634 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:18.191634 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:18.191634 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:18.191634 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:18.191634 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:18.191634 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:18.191634 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:45:18.191634 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:45:18.191634 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:45:18.191634 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:45:18.192802 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:45:18.192802 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:45:18.192802 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:45:18.192802 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:45:18.192802 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:18.192802 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:18.192802 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:18.192802 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:18.192802 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:18.192802 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:18.192802 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:18.192802 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:18.192802 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:18.192802 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:18.192802 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:18.192802 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:18.193728 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:18.193728 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:18.193728 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:18.193728 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:18.193728 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:45:18.193728 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:45:18.193728 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:45:18.193728 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:45:18.193728 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:45:18.193728 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:45:18.193728 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:45:18.193728 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:18.193728 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 247/496] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:45:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:18.195459 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4d849-8975-45d4-b22e-48e653284683 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:18.195459 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4d849-8975-45d4-b22e-48e653284683 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:18.195592 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4d849-8975-45d4-b22e-48e653284683 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:18.197138 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 248/497] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:45:18.197618 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4d849-8975-45d4-b22e-48e653284683 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:18.270052 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:18.271113 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49baaa5-a689-40bd-9d26-233d662db830 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:18.309429 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cfe5b3-b2af-4d53-bb34-b081faa1d50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:18.310263 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cfe5b3-b2af-4d53-bb34-b081faa1d50c None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:18.310554 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cfe5b3-b2af-4d53-bb34-b081faa1d50c None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:18.311008 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cfe5b3-b2af-4d53-bb34-b081faa1d50c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:18.318079 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4d849-8975-45d4-b22e-48e653284683 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:18.319058 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cfe5b3-b2af-4d53-bb34-b081faa1d50c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:18.321208 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cfe5b3-b2af-4d53-bb34-b081faa1d50c None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:18.337183 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-83cfe5b3-b2af-4d53-bb34-b081faa1d50c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 21:45:18.337183 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:18.337183 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:18.337183 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:18.337183 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:18.337183 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:18.337183 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:18.337183 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:18.337183 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:18.337183 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:18.337183 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:18.337183 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:18.337183 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:45:18.337183 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:45:18.337183 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:45:18.337183 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:45:18.338434 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:18.338434 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:18.338434 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:45:18.338434 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:45:18.338434 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:45:18.338434 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:45:18.338434 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:18.338434 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:18.338434 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:18.338434 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:18.338434 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:18.338434 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:18.338434 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:18.338434 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:18.338434 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:18.338434 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:18.338434 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:18.338434 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:18.339479 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:18.339479 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:18.339479 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:45:18.339479 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:45:18.339479 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:45:18.339479 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:45:18.339479 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:45:18.339479 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:45:18.339479 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 21:45:18.339479 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:18.339479 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 250/498] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:45:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:18.339479 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cfe5b3-b2af-4d53-bb34-b081faa1d50c None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:18.361234 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a774bc-9852-4109-a40b-a0913d88f82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:18.361922 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a774bc-9852-4109-a40b-a0913d88f82c None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:18.362242 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a774bc-9852-4109-a40b-a0913d88f82c None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:18.362530 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a774bc-9852-4109-a40b-a0913d88f82c None admin] PATH_INFO: `/v3/users` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:18.363389 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a774bc-9852-4109-a40b-a0913d88f82c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:18.363705 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a774bc-9852-4109-a40b-a0913d88f82c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:18.365180 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a774bc-9852-4109-a40b-a0913d88f82c None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:18.405154 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 249/499] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Jul 5 21:45:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:18.406872 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffbfe88-e884-486c-87c1-e6a899f20633 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:18.407405 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffbfe88-e884-486c-87c1-e6a899f20633 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:18.407903 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffbfe88-e884-486c-87c1-e6a899f20633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:18.425696 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-8ffbfe88-e884-486c-87c1-e6a899f20633 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:18.427232 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-8ffbfe88-e884-486c-87c1-e6a899f20633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:18.452615 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:18.456446 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cfe5b3-b2af-4d53-bb34-b081faa1d50c None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:18.494662 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62fc544-5a27-4fe7-85b7-ee6a0d4832cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:18.495625 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62fc544-5a27-4fe7-85b7-ee6a0d4832cc None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:18.495919 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62fc544-5a27-4fe7-85b7-ee6a0d4832cc None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:18.496206 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62fc544-5a27-4fe7-85b7-ee6a0d4832cc None admin] PATH_INFO: `/v3/roles` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:18.496970 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62fc544-5a27-4fe7-85b7-ee6a0d4832cc None admin] RBAC: Adding query filter params (name=service) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:18.497282 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62fc544-5a27-4fe7-85b7-ee6a0d4832cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:18.498700 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62fc544-5a27-4fe7-85b7-ee6a0d4832cc None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:18.501794 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 250/500] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:45:18.502883 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffbfe88-e884-486c-87c1-e6a899f20633 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:18.514048 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 251/501] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:45:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:18.514048 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62fc544-5a27-4fe7-85b7-ee6a0d4832cc None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:18.571766 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:18.621748 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62fc544-5a27-4fe7-85b7-ee6a0d4832cc None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:18.633722 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffbfe88-e884-486c-87c1-e6a899f20633 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:18.656670 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa4f94-56b0-48e7-b08f-0c2794212000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:18.657333 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa4f94-56b0-48e7-b08f-0c2794212000 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:18.657624 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa4f94-56b0-48e7-b08f-0c2794212000 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:18.657906 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa4f94-56b0-48e7-b08f-0c2794212000 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:18.671019 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e803f0d-2feb-4410-80e7-d2bccba289dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:18.671697 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e803f0d-2feb-4410-80e7-d2bccba289dd None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:18.671990 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e803f0d-2feb-4410-80e7-d2bccba289dd None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:18.672272 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e803f0d-2feb-4410-80e7-d2bccba289dd None admin] PATH_INFO: `/v3/users` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:18.673135 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e803f0d-2feb-4410-80e7-d2bccba289dd None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:18.673570 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e803f0d-2feb-4410-80e7-d2bccba289dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:18.675164 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e803f0d-2feb-4410-80e7-d2bccba289dd None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:18.688329 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:18.700704 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 251/502] 10.222.0.30 () {56 vars in 1137 bytes} [Tue Jul 5 21:45:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:18.700704 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e803f0d-2feb-4410-80e7-d2bccba289dd None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:18.731486 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa4f94-56b0-48e7-b08f-0c2794212000 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:18.732960 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa4f94-56b0-48e7-b08f-0c2794212000 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:18.800084 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e803f0d-2feb-4410-80e7-d2bccba289dd None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:18.802523 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:18.832850 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 252/503] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:45:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:45:18.833638 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa4f94-56b0-48e7-b08f-0c2794212000 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:18.834083 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd5bd7-553b-440e-a1f0-40dd69c83d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:18.835505 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd5bd7-553b-440e-a1f0-40dd69c83d35 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:18.835868 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd5bd7-553b-440e-a1f0-40dd69c83d35 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:18.836264 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd5bd7-553b-440e-a1f0-40dd69c83d35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:18.846593 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd5bd7-553b-440e-a1f0-40dd69c83d35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:18.848051 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd5bd7-553b-440e-a1f0-40dd69c83d35 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:18.866505 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-1edd5bd7-553b-440e-a1f0-40dd69c83d35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:18.866505 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:18.866505 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:18.866505 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:18.866505 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:18.866505 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:18.866505 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:18.866505 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:18.866505 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:18.866505 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:18.866505 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:18.866505 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:18.866505 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:18.866505 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:18.866505 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:18.867548 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:18.867548 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:18.867548 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:18.867548 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:18.867548 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:18.867548 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:18.867548 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:18.867548 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:18.867548 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:18.867548 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:18.867548 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:18.867548 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:18.867548 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:18.867548 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:18.867548 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:18.867548 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:18.867548 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:18.868959 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:18.868959 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:18.868959 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:18.868959 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:18.868959 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 252/504] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:18.869342 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9eafa-3b17-4697-a15f-32f9cc6719fc None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:18.869595 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9eafa-3b17-4697-a15f-32f9cc6719fc None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:18.869837 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9eafa-3b17-4697-a15f-32f9cc6719fc None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:18.871288 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 253/505] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:45:18.871830 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b9eafa-3b17-4697-a15f-32f9cc6719fc None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:18.902509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:18.947444 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa4f94-56b0-48e7-b08f-0c2794212000 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:18.975343 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b9eafa-3b17-4697-a15f-32f9cc6719fc None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:18.981045 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebecdea-00cf-442f-bbdd-4ced1a0a226b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:18.981839 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebecdea-00cf-442f-bbdd-4ced1a0a226b None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:18.982151 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebecdea-00cf-442f-bbdd-4ced1a0a226b None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:18.982439 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebecdea-00cf-442f-bbdd-4ced1a0a226b None admin] PATH_INFO: `/v3/roles/service` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:18.993345 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebecdea-00cf-442f-bbdd-4ced1a0a226b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:45:19.001185 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-eebecdea-00cf-442f-bbdd-4ced1a0a226b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:45:19.001185 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:19.001185 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:19.001185 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:19.001185 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:19.001185 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:19.001185 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:19.001185 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:19.001185 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:19.001185 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:19.001185 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:19.001185 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:19.001185 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:45:19.001185 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:45:19.001185 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:45:19.001185 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:45:19.002396 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:45:19.002396 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:45:19.002396 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:45:19.002396 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:45:19.002396 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:19.002396 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:19.002396 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:19.002396 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:19.002396 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:19.002396 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:19.002396 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:19.002396 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:19.002396 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:19.002396 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:19.002396 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:19.002396 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:19.003571 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:19.003571 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:19.003571 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:19.003571 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:19.003571 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:45:19.003571 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:45:19.003571 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:45:19.003571 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:45:19.003571 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:45:19.003571 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:45:19.003571 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:45:19.003571 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:19.003571 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 253/506] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:45:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:19.003571 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebecdea-00cf-442f-bbdd-4ced1a0a226b None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:19.013854 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe64ee4-8bf5-49de-8ad5-64bac7608c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:19.014547 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe64ee4-8bf5-49de-8ad5-64bac7608c31 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:19.014836 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe64ee4-8bf5-49de-8ad5-64bac7608c31 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:19.015110 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe64ee4-8bf5-49de-8ad5-64bac7608c31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:19.039852 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:19.083593 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe64ee4-8bf5-49de-8ad5-64bac7608c31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:19.085071 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe64ee4-8bf5-49de-8ad5-64bac7608c31 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:19.105219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebecdea-00cf-442f-bbdd-4ced1a0a226b None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:19.125293 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:19.139854 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b269c-b320-4c95-a752-652ce7ff6d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:19.140658 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b269c-b320-4c95-a752-652ce7ff6d6b None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:19.140945 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b269c-b320-4c95-a752-652ce7ff6d6b None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:19.141226 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b269c-b320-4c95-a752-652ce7ff6d6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:19.152313 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b269c-b320-4c95-a752-652ce7ff6d6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:19.153830 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b269c-b320-4c95-a752-652ce7ff6d6b None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:19.171383 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-636b269c-b320-4c95-a752-652ce7ff6d6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:19.171383 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:19.171383 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:19.171383 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:19.171383 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:19.171383 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:19.171383 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:19.171383 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:19.171383 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:19.171383 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:19.171383 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:19.171383 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:19.171383 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:19.171383 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:19.171383 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:19.172489 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:19.172489 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:19.172489 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:19.172489 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:19.172489 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:19.172489 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:19.172489 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:19.172489 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:19.172489 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:19.172489 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:19.172489 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:19.172489 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:19.172489 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:19.172489 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:19.172489 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:19.172489 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:19.172489 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:19.178159 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:19.178159 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:19.178159 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:19.178159 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:19.178159 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 254/507] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:19.178159 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b269c-b320-4c95-a752-652ce7ff6d6b None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:19.187127 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 254/508] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:45:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:45:19.188447 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10255e4-ae2b-4501-b881-8d56a537bf81 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:19.188746 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10255e4-ae2b-4501-b881-8d56a537bf81 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:19.189034 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10255e4-ae2b-4501-b881-8d56a537bf81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:19.204981 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-c10255e4-ae2b-4501-b881-8d56a537bf81 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:19.206225 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-c10255e4-ae2b-4501-b881-8d56a537bf81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:19.257427 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:19.273656 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 255/509] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:45:19.274492 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10255e4-ae2b-4501-b881-8d56a537bf81 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:19.284909 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b269c-b320-4c95-a752-652ce7ff6d6b None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:19.321226 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e203a9d-0753-44b9-b6d8-5a863b0be834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:19.321899 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e203a9d-0753-44b9-b6d8-5a863b0be834 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:19.322223 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e203a9d-0753-44b9-b6d8-5a863b0be834 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:19.322513 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e203a9d-0753-44b9-b6d8-5a863b0be834 None admin] PATH_INFO: `/v3/domains` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:19.323258 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e203a9d-0753-44b9-b6d8-5a863b0be834 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:19.323575 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e203a9d-0753-44b9-b6d8-5a863b0be834 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:19.324976 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e203a9d-0753-44b9-b6d8-5a863b0be834 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:19.337229 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 255/510] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:19.337968 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e203a9d-0753-44b9-b6d8-5a863b0be834 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:19.369861 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:19.374103 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10255e4-ae2b-4501-b881-8d56a537bf81 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:19.408518 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237e51f1-e383-4537-a81e-2a4fa344b079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:19.409198 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e51f1-e383-4537-a81e-2a4fa344b079 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:19.409484 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e51f1-e383-4537-a81e-2a4fa344b079 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:19.409765 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e51f1-e383-4537-a81e-2a4fa344b079 None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:19.410560 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237e51f1-e383-4537-a81e-2a4fa344b079 None admin] RBAC: Adding query filter params (name=service) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:19.410867 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237e51f1-e383-4537-a81e-2a4fa344b079 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:19.412255 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237e51f1-e383-4537-a81e-2a4fa344b079 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:19.420690 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 256/511] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:45:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:19.421481 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237e51f1-e383-4537-a81e-2a4fa344b079 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:19.438894 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e203a9d-0753-44b9-b6d8-5a863b0be834 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:19.470059 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:19.472972 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8304b55d-056c-49aa-b3a5-7602c69a578d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:19.473635 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8304b55d-056c-49aa-b3a5-7602c69a578d None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:19.473924 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8304b55d-056c-49aa-b3a5-7602c69a578d None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:19.474236 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8304b55d-056c-49aa-b3a5-7602c69a578d None admin] PATH_INFO: `/v3/domains` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:19.474978 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8304b55d-056c-49aa-b3a5-7602c69a578d None admin] RBAC: Adding query filter params (name=Default) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:19.475285 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8304b55d-056c-49aa-b3a5-7602c69a578d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:19.477201 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8304b55d-056c-49aa-b3a5-7602c69a578d None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:19.489113 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 256/512] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:19.489915 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8304b55d-056c-49aa-b3a5-7602c69a578d None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:19.527393 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237e51f1-e383-4537-a81e-2a4fa344b079 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:19.564475 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef345eae-ba42-46ce-b73e-f7a9961c2a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:19.565286 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef345eae-ba42-46ce-b73e-f7a9961c2a54 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:19.565576 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef345eae-ba42-46ce-b73e-f7a9961c2a54 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:19.565854 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef345eae-ba42-46ce-b73e-f7a9961c2a54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:19.576593 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef345eae-ba42-46ce-b73e-f7a9961c2a54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:19.578045 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef345eae-ba42-46ce-b73e-f7a9961c2a54 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:19.583082 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:19.594531 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8304b55d-056c-49aa-b3a5-7602c69a578d None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:19.595752 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-ef345eae-ba42-46ce-b73e-f7a9961c2a54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:19.595752 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:19.595752 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:19.595752 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:19.595752 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:19.595752 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:19.595752 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:19.595752 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:19.595752 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:19.595752 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:19.595752 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:19.595752 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:19.595752 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:19.595752 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:19.595752 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:19.596847 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:19.596847 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:19.596847 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:19.596847 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:19.596847 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:19.596847 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:19.596847 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:19.596847 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:19.596847 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:19.596847 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:19.596847 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:19.596847 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:19.596847 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:19.596847 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:19.596847 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:19.596847 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:19.596847 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:19.597820 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:19.597820 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:19.597820 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:19.597820 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:19.597820 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 257/513] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:19.597820 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef345eae-ba42-46ce-b73e-f7a9961c2a54 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:19.626203 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c4c8a-aa32-4cd1-8db0-08629f28f3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:19.627011 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c4c8a-aa32-4cd1-8db0-08629f28f3e7 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:19.627302 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c4c8a-aa32-4cd1-8db0-08629f28f3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:19.627586 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c4c8a-aa32-4cd1-8db0-08629f28f3e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:19.638982 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c4c8a-aa32-4cd1-8db0-08629f28f3e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:19.640641 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c4c8a-aa32-4cd1-8db0-08629f28f3e7 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:19.660768 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-3a6c4c8a-aa32-4cd1-8db0-08629f28f3e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:19.660768 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:19.660768 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:19.660768 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:19.660768 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:19.660768 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:19.660768 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:19.660768 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:19.660768 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:19.660768 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:19.660768 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:19.660768 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:19.660768 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:19.660768 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:19.660768 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:19.661942 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:19.661942 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:19.661942 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:19.661942 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:19.661942 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:19.661942 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:19.661942 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:19.661942 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:19.661942 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:19.661942 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:19.661942 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:19.661942 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:19.661942 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:19.661942 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:19.661942 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:19.661942 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:19.661942 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:19.663804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:19.663804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:19.663804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:19.663804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:19.663804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 257/514] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:19.663804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c4c8a-aa32-4cd1-8db0-08629f28f3e7 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:19.700265 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:19.703495 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef345eae-ba42-46ce-b73e-f7a9961c2a54 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:19.738778 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d6be83-424c-469e-8a8e-0310c862a33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:19.739981 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6be83-424c-469e-8a8e-0310c862a33e None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:19.740281 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6be83-424c-469e-8a8e-0310c862a33e None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:19.740567 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6be83-424c-469e-8a8e-0310c862a33e None admin] PATH_INFO: `/v3/users/glance` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:19.748849 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d6be83-424c-469e-8a8e-0310c862a33e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:19.750331 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d6be83-424c-469e-8a8e-0310c862a33e None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:19.764062 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c4c8a-aa32-4cd1-8db0-08629f28f3e7 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:19.765898 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-93d6be83-424c-469e-8a8e-0310c862a33e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 05 21:45:19.765898 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:19.765898 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:19.765898 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:19.765898 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:19.765898 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:19.765898 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:19.765898 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:19.765898 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:19.765898 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:19.765898 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:19.765898 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:19.765898 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:45:19.765898 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:45:19.765898 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:45:19.765898 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:45:19.766921 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:19.766921 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:19.766921 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:45:19.766921 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:45:19.766921 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:45:19.766921 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:45:19.766921 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:19.766921 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:19.766921 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:19.766921 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:19.766921 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:19.766921 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:19.766921 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:19.766921 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:19.766921 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:19.766921 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:19.766921 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:19.766921 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:19.767964 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:19.767964 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:19.767964 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:45:19.767964 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:45:19.767964 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:45:19.767964 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:45:19.767964 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:45:19.767964 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:45:19.767964 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 05 21:45:19.767964 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:19.767964 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 258/515] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:45:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:19.767964 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d6be83-424c-469e-8a8e-0310c862a33e None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:19.798507 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feda41e-4408-49dc-a459-139c34b07592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:19.799303 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feda41e-4408-49dc-a459-139c34b07592 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:19.799594 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feda41e-4408-49dc-a459-139c34b07592 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:19.799873 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feda41e-4408-49dc-a459-139c34b07592 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:19.811014 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feda41e-4408-49dc-a459-139c34b07592 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:19.812468 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feda41e-4408-49dc-a459-139c34b07592 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:19.814982 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:19.829876 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-7feda41e-4408-49dc-a459-139c34b07592 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:19.829876 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:19.829876 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:19.829876 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:19.829876 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:19.829876 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:19.829876 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:19.829876 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:19.829876 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:19.829876 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:19.829876 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:19.829876 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:19.829876 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:19.829876 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:19.829876 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:19.831047 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:19.831047 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:19.831047 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:19.831047 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:19.831047 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:19.831047 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:19.831047 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:19.831047 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:19.831047 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:19.831047 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:19.831047 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:19.831047 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:19.831047 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:19.831047 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:19.831047 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:19.831047 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:19.831047 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:19.832219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:19.832219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:19.832219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:19.832219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:19.832219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 258/516] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:19.832219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feda41e-4408-49dc-a459-139c34b07592 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:19.875316 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d6be83-424c-469e-8a8e-0310c862a33e None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:19.908606 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae538b37-a068-4954-a21b-b8d3544f3e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:19.909405 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae538b37-a068-4954-a21b-b8d3544f3e43 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:19.909694 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae538b37-a068-4954-a21b-b8d3544f3e43 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:19.909977 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae538b37-a068-4954-a21b-b8d3544f3e43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:19.917465 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae538b37-a068-4954-a21b-b8d3544f3e43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:19.918966 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae538b37-a068-4954-a21b-b8d3544f3e43 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:19.932550 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feda41e-4408-49dc-a459-139c34b07592 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:19.934568 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-ae538b37-a068-4954-a21b-b8d3544f3e43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:45:19.934568 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:19.934568 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:19.934568 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:19.934568 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:19.934568 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:19.934568 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:19.934568 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:19.934568 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:19.934568 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:19.934568 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:19.934568 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:19.934568 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:45:19.934568 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:45:19.934568 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:45:19.935493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:45:19.935493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:19.935493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:19.935493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:19.935493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:19.935493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:19.935493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:19.935493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:19.935493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:19.935493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:19.935493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:19.935493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:19.935493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:19.935493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:19.935493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:19.935493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:19.935493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:19.936483 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:45:19.936483 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:45:19.936483 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:45:19.936483 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:45:19.936483 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:45:19.936483 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:45:19.936483 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:45:19.936483 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:19.936483 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 259/517] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:45:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:19.937029 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae538b37-a068-4954-a21b-b8d3544f3e43 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:19.957865 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:19.965922 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f953d998-7826-4fc0-bc18-b311c7786ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:19.966621 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953d998-7826-4fc0-bc18-b311c7786ad7 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:19.972093 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953d998-7826-4fc0-bc18-b311c7786ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:19.972093 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953d998-7826-4fc0-bc18-b311c7786ad7 None admin] PATH_INFO: `/v3/domains` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:19.972093 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f953d998-7826-4fc0-bc18-b311c7786ad7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:19.972093 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f953d998-7826-4fc0-bc18-b311c7786ad7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:19.972093 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f953d998-7826-4fc0-bc18-b311c7786ad7 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:19.982730 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 259/518] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:19.983587 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f953d998-7826-4fc0-bc18-b311c7786ad7 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:20.037554 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae538b37-a068-4954-a21b-b8d3544f3e43 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:20.041271 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:20.072277 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3deeeb-3ac4-48a8-80f5-7409c8cd0503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:20.072966 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3deeeb-3ac4-48a8-80f5-7409c8cd0503 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:20.073254 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3deeeb-3ac4-48a8-80f5-7409c8cd0503 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:20.073529 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3deeeb-3ac4-48a8-80f5-7409c8cd0503 None admin] PATH_INFO: `/v3/domains` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:20.074298 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3deeeb-3ac4-48a8-80f5-7409c8cd0503 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:20.074607 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3deeeb-3ac4-48a8-80f5-7409c8cd0503 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:20.076006 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3deeeb-3ac4-48a8-80f5-7409c8cd0503 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:20.087735 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 260/519] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:20.088562 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3deeeb-3ac4-48a8-80f5-7409c8cd0503 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:20.090022 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f953d998-7826-4fc0-bc18-b311c7786ad7 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:20.124266 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccfd768-08e3-498f-8a78-415bfa705b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:20.124937 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfd768-08e3-498f-8a78-415bfa705b74 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:20.125227 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfd768-08e3-498f-8a78-415bfa705b74 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:20.125565 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfd768-08e3-498f-8a78-415bfa705b74 None admin] PATH_INFO: `/v3/users` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:20.126387 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccfd768-08e3-498f-8a78-415bfa705b74 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:20.126702 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccfd768-08e3-498f-8a78-415bfa705b74 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:20.128131 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccfd768-08e3-498f-8a78-415bfa705b74 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:20.165322 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 260/520] 10.222.0.30 () {56 vars in 1137 bytes} [Tue Jul 5 21:45:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:20.166163 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccfd768-08e3-498f-8a78-415bfa705b74 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:20.174286 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:20.193003 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3deeeb-3ac4-48a8-80f5-7409c8cd0503 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:20.229108 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d238e-db78-446f-9a47-a69541664254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:20.229788 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d238e-db78-446f-9a47-a69541664254 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:20.230078 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d238e-db78-446f-9a47-a69541664254 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:20.230387 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d238e-db78-446f-9a47-a69541664254 None admin] PATH_INFO: `/v3/domains` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:20.231121 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42d238e-db78-446f-9a47-a69541664254 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:20.231429 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42d238e-db78-446f-9a47-a69541664254 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:20.232823 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42d238e-db78-446f-9a47-a69541664254 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:20.244857 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 261/521] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:20.245436 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d238e-db78-446f-9a47-a69541664254 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:20.270946 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccfd768-08e3-498f-8a78-415bfa705b74 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:20.286016 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:20.306328 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d8238e-5b12-4995-8c8d-ca9c2a29df3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:20.306997 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8238e-5b12-4995-8c8d-ca9c2a29df3f None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:20.307282 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8238e-5b12-4995-8c8d-ca9c2a29df3f None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:20.307565 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8238e-5b12-4995-8c8d-ca9c2a29df3f None admin] PATH_INFO: `/v3/projects` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:20.308356 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d8238e-5b12-4995-8c8d-ca9c2a29df3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:20.308739 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d8238e-5b12-4995-8c8d-ca9c2a29df3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:20.310210 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d8238e-5b12-4995-8c8d-ca9c2a29df3f None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:20.328027 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 261/522] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:45:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:20.328819 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d8238e-5b12-4995-8c8d-ca9c2a29df3f None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:20.348184 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d238e-db78-446f-9a47-a69541664254 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:20.382694 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1fa579-3e7e-4d81-ba6d-cba7e351d272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:20.383423 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1fa579-3e7e-4d81-ba6d-cba7e351d272 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:20.383708 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1fa579-3e7e-4d81-ba6d-cba7e351d272 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:20.383985 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1fa579-3e7e-4d81-ba6d-cba7e351d272 None admin] PATH_INFO: `/v3/projects/service` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:20.390633 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1fa579-3e7e-4d81-ba6d-cba7e351d272 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:20.392065 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1fa579-3e7e-4d81-ba6d-cba7e351d272 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:20.394552 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:20.406283 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-ed1fa579-3e7e-4d81-ba6d-cba7e351d272 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:45:20.406283 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:20.406283 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:20.406283 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:20.406283 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:20.406283 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:20.406283 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:20.406283 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:20.406283 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:20.406283 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:20.406283 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:20.406283 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:20.406283 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:45:20.406283 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:45:20.406283 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:45:20.407638 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:45:20.407638 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:20.407638 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:20.407638 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:20.407638 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:20.407638 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:20.407638 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:20.407638 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:20.407638 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:20.407638 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:20.407638 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:20.407638 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:20.407638 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:20.407638 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:20.407638 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:20.407638 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:20.407638 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:20.408637 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:45:20.408637 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:45:20.408637 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:45:20.408637 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:45:20.408637 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:45:20.408637 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:45:20.408637 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:45:20.408637 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:20.408637 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 262/523] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:45:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:20.408637 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1fa579-3e7e-4d81-ba6d-cba7e351d272 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:20.435797 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d8238e-5b12-4995-8c8d-ca9c2a29df3f None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:20.473540 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef16d23-7161-4574-859f-e77025536009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:20.474219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef16d23-7161-4574-859f-e77025536009 None admin] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:20.474513 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef16d23-7161-4574-859f-e77025536009 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:20.474793 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef16d23-7161-4574-859f-e77025536009 None admin] PATH_INFO: `/v3/users` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:20.475544 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef16d23-7161-4574-859f-e77025536009 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:20.477093 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef16d23-7161-4574-859f-e77025536009 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:20.519878 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1fa579-3e7e-4d81-ba6d-cba7e351d272 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:20.552109 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 262/524] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:45:20 2022] POST /identity/v3/users => generated 247 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:45:20.553160 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef16d23-7161-4574-859f-e77025536009 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:20.557144 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5ac5e-d045-4eeb-bcb8-4c195d6ac4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:20.557838 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5ac5e-d045-4eeb-bcb8-4c195d6ac4f4 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:20.558113 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5ac5e-d045-4eeb-bcb8-4c195d6ac4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:20.558422 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5ac5e-d045-4eeb-bcb8-4c195d6ac4f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:20.603776 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:20.651398 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:20.652778 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab5ac5e-d045-4eeb-bcb8-4c195d6ac4f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:20.654796 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab5ac5e-d045-4eeb-bcb8-4c195d6ac4f4 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:20.691018 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef16d23-7161-4574-859f-e77025536009 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:20.739200 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdebed75-bbd6-41a8-aeae-0bc5fbe46d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:20.740023 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebed75-bbd6-41a8-aeae-0bc5fbe46d4a None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:20.740312 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebed75-bbd6-41a8-aeae-0bc5fbe46d4a None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:20.741477 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebed75-bbd6-41a8-aeae-0bc5fbe46d4a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:20.753359 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdebed75-bbd6-41a8-aeae-0bc5fbe46d4a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:20.754921 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdebed75-bbd6-41a8-aeae-0bc5fbe46d4a None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:20.779017 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-fdebed75-bbd6-41a8-aeae-0bc5fbe46d4a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 21:45:20.779017 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:20.779017 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:20.779017 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:20.779017 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:20.779017 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:20.779017 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:20.779017 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:20.779017 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:20.779017 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:20.779017 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:20.779017 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:20.779017 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:45:20.779017 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:45:20.779017 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:45:20.779017 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:45:20.780066 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:20.780066 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:20.780066 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:45:20.780066 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:45:20.780066 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:45:20.780066 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:45:20.780066 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:20.780066 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:20.780066 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:20.780066 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:20.780066 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:20.780066 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:20.780066 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:20.780066 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:20.780066 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:20.780066 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:20.780066 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:20.780066 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:20.781088 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:20.781088 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:20.781088 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:45:20.781088 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:45:20.781088 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:45:20.781088 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:45:20.781088 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:45:20.781088 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:45:20.781088 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 21:45:20.781088 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:20.781088 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 263/525] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:45:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:20.781754 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdebed75-bbd6-41a8-aeae-0bc5fbe46d4a None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:20.803148 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 263/526] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:45:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:45:20.804190 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5ac5e-d045-4eeb-bcb8-4c195d6ac4f4 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:20.887187 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:20.897590 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdebed75-bbd6-41a8-aeae-0bc5fbe46d4a None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:20.912059 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:20.916361 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5ac5e-d045-4eeb-bcb8-4c195d6ac4f4 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:20.935670 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672a23a-36c9-45c9-a890-47a6c4efe858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:20.936337 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672a23a-36c9-45c9-a890-47a6c4efe858 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:20.936626 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672a23a-36c9-45c9-a890-47a6c4efe858 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:20.936956 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672a23a-36c9-45c9-a890-47a6c4efe858 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:20.937792 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9672a23a-36c9-45c9-a890-47a6c4efe858 None admin] RBAC: Adding query filter params (role.id=1884e658df064cc2a232687c678d8618, scope.project.id=93f20f89d0fc4bbf9cf557dd1e14d98d, user.id=f5d82e71aafe4b6ebcf60c23c050aafb) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:20.938107 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9672a23a-36c9-45c9-a890-47a6c4efe858 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:20.939590 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9672a23a-36c9-45c9-a890-47a6c4efe858 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:20.946513 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 264/527] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:45:20 2022] GET /identity/v3/role_assignments?user.id=f5d82e71aafe4b6ebcf60c23c050aafb&scope.project.id=93f20f89d0fc4bbf9cf557dd1e14d98d&role.id=1884e658df064cc2a232687c678d8618 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:20.947505 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672a23a-36c9-45c9-a890-47a6c4efe858 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:20.953057 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2db9ce-fe1a-4d33-9b71-35fb77959502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:20.954178 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2db9ce-fe1a-4d33-9b71-35fb77959502 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:20.954588 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2db9ce-fe1a-4d33-9b71-35fb77959502 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:20.954974 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2db9ce-fe1a-4d33-9b71-35fb77959502 None admin] PATH_INFO: `/v3/projects` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:20.955992 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2db9ce-fe1a-4d33-9b71-35fb77959502 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:20.956418 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2db9ce-fe1a-4d33-9b71-35fb77959502 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:20.958305 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2db9ce-fe1a-4d33-9b71-35fb77959502 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:20.982668 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 264/528] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:45:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:20.983670 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2db9ce-fe1a-4d33-9b71-35fb77959502 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:21.079716 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672a23a-36c9-45c9-a890-47a6c4efe858 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:21.123598 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0cf7f9-d7b9-41e9-9748-e186827e38e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:21.124291 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cf7f9-d7b9-41e9-9748-e186827e38e8 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:21.124585 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cf7f9-d7b9-41e9-9748-e186827e38e8 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:21.124876 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cf7f9-d7b9-41e9-9748-e186827e38e8 None admin] PATH_INFO: `/v3/users` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:21.125740 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0cf7f9-d7b9-41e9-9748-e186827e38e8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:21.126060 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0cf7f9-d7b9-41e9-9748-e186827e38e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:21.128450 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0cf7f9-d7b9-41e9-9748-e186827e38e8 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:21.129837 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2db9ce-fe1a-4d33-9b71-35fb77959502 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:21.156321 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 265/529] 10.222.0.30 () {56 vars in 1139 bytes} [Tue Jul 5 21:45:20 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:21.156321 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0cf7f9-d7b9-41e9-9748-e186827e38e8 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:21.168879 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:21.182163 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f9743-9c5b-40a2-ae9a-5967fc8a6edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:21.182163 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f9743-9c5b-40a2-ae9a-5967fc8a6edd None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:21.182163 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f9743-9c5b-40a2-ae9a-5967fc8a6edd None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:21.182163 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f9743-9c5b-40a2-ae9a-5967fc8a6edd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:21.193013 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226f9743-9c5b-40a2-ae9a-5967fc8a6edd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:21.194710 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226f9743-9c5b-40a2-ae9a-5967fc8a6edd None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:21.218527 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-226f9743-9c5b-40a2-ae9a-5967fc8a6edd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:21.218527 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:21.218527 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:21.218527 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:21.218527 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:21.218527 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:21.218527 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:21.218527 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:21.218527 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:21.218527 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:21.218527 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:21.218527 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:21.218527 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:21.218527 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:21.218527 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:21.219583 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:21.219583 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:21.219583 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:21.219583 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:21.219583 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:21.219583 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:21.219583 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:21.219583 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:21.219583 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:21.219583 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:21.219583 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:21.219583 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:21.219583 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:21.219583 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:21.219583 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:21.219583 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:21.219583 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:21.220550 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:21.220550 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:21.220550 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:21.220550 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:21.224906 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 265/530] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:21.226618 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f9743-9c5b-40a2-ae9a-5967fc8a6edd None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:21.242371 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:21.280664 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0cf7f9-d7b9-41e9-9748-e186827e38e8 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:21.329214 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc0d1d-28d5-4808-b9e7-c64a6d02698b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:21.330253 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc0d1d-28d5-4808-b9e7-c64a6d02698b None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:21.330555 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc0d1d-28d5-4808-b9e7-c64a6d02698b None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:21.330845 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc0d1d-28d5-4808-b9e7-c64a6d02698b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:21.332373 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc0d1d-28d5-4808-b9e7-c64a6d02698b None admin] RBAC: Adding query filter params (role.id=1884e658df064cc2a232687c678d8618, scope.project.id=93f20f89d0fc4bbf9cf557dd1e14d98d, user.id=b7f6902012fd4a9283c73b9e2394e0b0) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:21.332708 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc0d1d-28d5-4808-b9e7-c64a6d02698b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:21.334505 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc0d1d-28d5-4808-b9e7-c64a6d02698b None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:21.335815 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f9743-9c5b-40a2-ae9a-5967fc8a6edd None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:21.342869 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 266/531] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:45:21 2022] GET /identity/v3/role_assignments?user.id=b7f6902012fd4a9283c73b9e2394e0b0&scope.project.id=93f20f89d0fc4bbf9cf557dd1e14d98d&role.id=1884e658df064cc2a232687c678d8618 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:21.343716 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc0d1d-28d5-4808-b9e7-c64a6d02698b None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:21.409545 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fdbbbf-ca88-4b23-baa0-3a1bf0e01c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:21.410246 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fdbbbf-ca88-4b23-baa0-3a1bf0e01c67 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:21.410581 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fdbbbf-ca88-4b23-baa0-3a1bf0e01c67 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:21.410868 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fdbbbf-ca88-4b23-baa0-3a1bf0e01c67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:21.438270 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:21.467481 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc0d1d-28d5-4808-b9e7-c64a6d02698b None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:21.515836 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c644dd-e09b-4032-9c9c-16e015fd6d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:21.516520 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c644dd-e09b-4032-9c9c-16e015fd6d41 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:21.516815 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c644dd-e09b-4032-9c9c-16e015fd6d41 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:21.517101 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c644dd-e09b-4032-9c9c-16e015fd6d41 None admin] PATH_INFO: `/v3/domains` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:21.517855 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c644dd-e09b-4032-9c9c-16e015fd6d41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:21.518198 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c644dd-e09b-4032-9c9c-16e015fd6d41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:21.520722 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c644dd-e09b-4032-9c9c-16e015fd6d41 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:21.534720 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 267/532] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:21.541077 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c644dd-e09b-4032-9c9c-16e015fd6d41 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:21.580224 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fdbbbf-ca88-4b23-baa0-3a1bf0e01c67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:21.581772 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fdbbbf-ca88-4b23-baa0-3a1bf0e01c67 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:21.613381 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:21.662607 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c644dd-e09b-4032-9c9c-16e015fd6d41 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:21.701549 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3d7c3-ec7a-4a72-a55c-4964a1ed15b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:21.702394 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3d7c3-ec7a-4a72-a55c-4964a1ed15b5 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:21.702688 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3d7c3-ec7a-4a72-a55c-4964a1ed15b5 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:21.703436 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3d7c3-ec7a-4a72-a55c-4964a1ed15b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:21.707255 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:21.714259 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed3d7c3-ec7a-4a72-a55c-4964a1ed15b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:21.716543 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed3d7c3-ec7a-4a72-a55c-4964a1ed15b5 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:21.721211 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 266/533] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:45:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:45:21.728625 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fdbbbf-ca88-4b23-baa0-3a1bf0e01c67 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:21.733390 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-6ed3d7c3-ec7a-4a72-a55c-4964a1ed15b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:45:21.733390 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:21.733390 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:21.733390 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:21.733390 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:21.733390 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:21.733390 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:21.733390 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:21.733390 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:21.733390 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:21.733390 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:21.733390 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:21.733390 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:45:21.733390 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:45:21.733390 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:45:21.734572 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:45:21.734572 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:21.734572 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:21.734572 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:21.734572 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:21.734572 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:21.734572 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:21.734572 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:21.734572 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:21.734572 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:21.734572 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:21.734572 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:21.734572 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:21.734572 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:21.734572 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:21.734572 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:21.734572 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:21.735959 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:45:21.735959 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:45:21.735959 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:45:21.735959 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:45:21.735959 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:45:21.735959 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:45:21.735959 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:45:21.735959 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:21.737385 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 268/534] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:45:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:45:21.743221 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3d7c3-ec7a-4a72-a55c-4964a1ed15b5 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:21.868010 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3d7c3-ec7a-4a72-a55c-4964a1ed15b5 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:21.907908 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c9506-6c0f-456b-bb7b-f7e0b9c699aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:21.908594 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c9506-6c0f-456b-bb7b-f7e0b9c699aa None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:21.908889 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c9506-6c0f-456b-bb7b-f7e0b9c699aa None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:21.909180 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c9506-6c0f-456b-bb7b-f7e0b9c699aa None admin] PATH_INFO: `/v3/projects` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:21.909993 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c9506-6c0f-456b-bb7b-f7e0b9c699aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:21.910341 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c9506-6c0f-456b-bb7b-f7e0b9c699aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:21.911811 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c9506-6c0f-456b-bb7b-f7e0b9c699aa None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:21.925700 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 269/535] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:45:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:45:21.932646 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c9506-6c0f-456b-bb7b-f7e0b9c699aa None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:21.938123 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fdbbbf-ca88-4b23-baa0-3a1bf0e01c67 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:21.966580 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:21.999290 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:22.014866 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8553a-4b91-4ce9-a306-40202905d89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:22.015690 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8553a-4b91-4ce9-a306-40202905d89e None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:22.015982 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8553a-4b91-4ce9-a306-40202905d89e None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:22.016266 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8553a-4b91-4ce9-a306-40202905d89e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:22.036066 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c8553a-4b91-4ce9-a306-40202905d89e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:22.037559 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c8553a-4b91-4ce9-a306-40202905d89e None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:22.067528 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-02c8553a-4b91-4ce9-a306-40202905d89e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:22.067528 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:22.067528 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:22.067528 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:22.067528 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:22.067528 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:22.067528 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:22.067528 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:22.067528 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:22.067528 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:22.067528 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:22.067528 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:22.067528 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:22.067528 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:22.067528 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:22.069876 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:22.069876 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:22.069876 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:22.069876 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:22.069876 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:22.069876 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:22.069876 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:22.069876 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:22.069876 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:22.069876 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:22.069876 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:22.069876 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:22.069876 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:22.069876 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:22.069876 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:22.069876 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:22.069876 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:22.072403 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:22.072403 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:22.072403 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:22.072403 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:22.072403 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 267/536] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:22.078157 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8553a-4b91-4ce9-a306-40202905d89e None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:22.088673 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c9506-6c0f-456b-bb7b-f7e0b9c699aa None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:22.162806 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e80b5ff-8907-46fd-aa0f-d7aba89e38ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:22.164588 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80b5ff-8907-46fd-aa0f-d7aba89e38ae None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:22.165108 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80b5ff-8907-46fd-aa0f-d7aba89e38ae None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:22.165600 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80b5ff-8907-46fd-aa0f-d7aba89e38ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:22.166692 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e80b5ff-8907-46fd-aa0f-d7aba89e38ae None admin] RBAC: Adding query filter params (role.id=1884e658df064cc2a232687c678d8618, scope.project.id=93f20f89d0fc4bbf9cf557dd1e14d98d, user.id=8688d3d1cf62416da18c3ffb0b79ec54) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:22.167240 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e80b5ff-8907-46fd-aa0f-d7aba89e38ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:22.169009 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e80b5ff-8907-46fd-aa0f-d7aba89e38ae None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:22.180192 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 270/537] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:45:21 2022] GET /identity/v3/role_assignments?user.id=8688d3d1cf62416da18c3ffb0b79ec54&scope.project.id=93f20f89d0fc4bbf9cf557dd1e14d98d&role.id=1884e658df064cc2a232687c678d8618 => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:45:22.181691 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8553a-4b91-4ce9-a306-40202905d89e None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:22.260493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f7c77a-34b4-47fd-96a0-81dd42191295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:22.261097 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f7c77a-34b4-47fd-96a0-81dd42191295 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:22.261392 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f7c77a-34b4-47fd-96a0-81dd42191295 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:22.261680 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f7c77a-34b4-47fd-96a0-81dd42191295 None admin] PATH_INFO: `/v3/domains` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:22.262483 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f7c77a-34b4-47fd-96a0-81dd42191295 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:22.262805 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f7c77a-34b4-47fd-96a0-81dd42191295 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:22.264240 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f7c77a-34b4-47fd-96a0-81dd42191295 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:22.277584 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 268/538] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:22.283195 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e80b5ff-8907-46fd-aa0f-d7aba89e38ae None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:22.451977 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e80b5ff-8907-46fd-aa0f-d7aba89e38ae None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:22.473147 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:22.494117 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa31a3-a960-4293-8e2b-e545515af9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:22.494951 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa31a3-a960-4293-8e2b-e545515af9ae None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:22.495239 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa31a3-a960-4293-8e2b-e545515af9ae None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:22.495517 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa31a3-a960-4293-8e2b-e545515af9ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:22.507722 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa31a3-a960-4293-8e2b-e545515af9ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:22.509177 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa31a3-a960-4293-8e2b-e545515af9ae None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:22.527252 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-bffa31a3-a960-4293-8e2b-e545515af9ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:45:22.527252 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:22.527252 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:22.527252 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:22.527252 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:22.527252 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:22.527252 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:22.527252 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:22.527252 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:22.527252 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:22.527252 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:22.527252 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:22.527252 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:45:22.527252 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:45:22.527252 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:45:22.528222 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:45:22.528222 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:22.528222 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:22.528222 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:22.528222 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:22.528222 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:22.528222 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:22.528222 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:22.528222 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:22.528222 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:22.528222 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:22.528222 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:22.528222 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:22.528222 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:22.528222 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:22.528222 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:22.528222 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:22.529200 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:45:22.529200 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:45:22.529200 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:45:22.529200 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:45:22.529200 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:45:22.529200 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:45:22.529200 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:45:22.529200 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:22.529200 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 271/539] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:45:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:22.534181 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f7c77a-34b4-47fd-96a0-81dd42191295 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:22.602573 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:22.659195 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f7c77a-34b4-47fd-96a0-81dd42191295 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:22.695693 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed4c9c0-948a-47e0-a1d4-9c6b29faca32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:22.696378 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4c9c0-948a-47e0-a1d4-9c6b29faca32 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:22.696674 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4c9c0-948a-47e0-a1d4-9c6b29faca32 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:22.696958 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4c9c0-948a-47e0-a1d4-9c6b29faca32 None admin] PATH_INFO: `/v3/projects` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:22.697772 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed4c9c0-948a-47e0-a1d4-9c6b29faca32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:22.698089 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed4c9c0-948a-47e0-a1d4-9c6b29faca32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:22.699588 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed4c9c0-948a-47e0-a1d4-9c6b29faca32 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:22.713191 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 269/540] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:45:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:22.719052 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa31a3-a960-4293-8e2b-e545515af9ae None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:22.858358 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa31a3-a960-4293-8e2b-e545515af9ae None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:22.903103 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b0bf5-2b75-441b-90ed-3677bdc0fd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:22.903766 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b0bf5-2b75-441b-90ed-3677bdc0fd18 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:22.904052 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b0bf5-2b75-441b-90ed-3677bdc0fd18 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:22.904332 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b0bf5-2b75-441b-90ed-3677bdc0fd18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:22.905177 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b0bf5-2b75-441b-90ed-3677bdc0fd18 None admin] RBAC: Adding query filter params (role.id=1884e658df064cc2a232687c678d8618, scope.project.id=93f20f89d0fc4bbf9cf557dd1e14d98d, user.id=b59ded30d64d4eeca95c949259faf5ae) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:22.905490 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b0bf5-2b75-441b-90ed-3677bdc0fd18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:22.906978 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b0bf5-2b75-441b-90ed-3677bdc0fd18 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:22.909992 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a2bb2-2e32-4d93-b33b-bde56fe71127 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:22.910316 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a2bb2-2e32-4d93-b33b-bde56fe71127 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:22.910603 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a2bb2-2e32-4d93-b33b-bde56fe71127 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:22.912246 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 270/541] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:45:22.918557 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7670b4-5911-44dd-a8ee-456400b02f51 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:22.918854 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7670b4-5911-44dd-a8ee-456400b02f51 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:22.918972 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 272/542] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:45:22 2022] GET /identity/v3/role_assignments?user.id=b59ded30d64d4eeca95c949259faf5ae&scope.project.id=93f20f89d0fc4bbf9cf557dd1e14d98d&role.id=1884e658df064cc2a232687c678d8618 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:22.919137 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7670b4-5911-44dd-a8ee-456400b02f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:22.966700 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-be7670b4-5911-44dd-a8ee-456400b02f51 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:22.967938 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-be7670b4-5911-44dd-a8ee-456400b02f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:23.052450 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 271/543] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:45:23.077098 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b0bf5-2b75-441b-90ed-3677bdc0fd18 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:23.130173 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:23.192767 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b0bf5-2b75-441b-90ed-3677bdc0fd18 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:23.231730 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5ec5b-e899-4f8d-94bb-f1209292d554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:23.232554 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5ec5b-e899-4f8d-94bb-f1209292d554 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:23.232849 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5ec5b-e899-4f8d-94bb-f1209292d554 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:23.233137 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5ec5b-e899-4f8d-94bb-f1209292d554 None admin] PATH_INFO: `/v3/roles/service` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:23.245071 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db5ec5b-e899-4f8d-94bb-f1209292d554 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:45:23.253312 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-1db5ec5b-e899-4f8d-94bb-f1209292d554 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:45:23.253312 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:23.253312 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:23.253312 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:23.253312 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:23.253312 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:23.253312 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:23.253312 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:23.253312 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:23.253312 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:23.253312 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:23.253312 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:23.253312 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:45:23.253312 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:45:23.253312 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:45:23.253312 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:45:23.254401 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:45:23.254401 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:45:23.254401 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:45:23.254401 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:45:23.254401 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:23.254401 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:23.254401 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:23.254401 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:23.254401 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:23.254401 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:23.254401 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:23.254401 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:23.254401 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:23.254401 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:23.254401 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:23.254401 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:23.255715 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:23.255715 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:23.255715 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:23.255715 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:23.255715 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:45:23.255715 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:45:23.255715 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:45:23.255715 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:45:23.255715 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:45:23.255715 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:45:23.255715 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:45:23.255715 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:23.255715 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 273/544] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:45:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:23.261497 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7670b4-5911-44dd-a8ee-456400b02f51 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:23.280004 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:23.382934 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7670b4-5911-44dd-a8ee-456400b02f51 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:23.418046 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bbb9a-d915-4a3c-9d0b-4d2a1bc5217f None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:23.418382 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bbb9a-d915-4a3c-9d0b-4d2a1bc5217f None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:23.418649 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bbb9a-d915-4a3c-9d0b-4d2a1bc5217f None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:23.420282 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 274/545] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:45:23.425255 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd151d0-7564-435d-819b-e2280711819c None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:23.425554 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd151d0-7564-435d-819b-e2280711819c None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:23.425849 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd151d0-7564-435d-819b-e2280711819c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:23.434886 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82285a8-d370-4786-8670-1dbef804367b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:23.435589 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82285a8-d370-4786-8670-1dbef804367b None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:23.435940 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82285a8-d370-4786-8670-1dbef804367b None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:23.436236 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82285a8-d370-4786-8670-1dbef804367b None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:23.437067 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82285a8-d370-4786-8670-1dbef804367b None admin] RBAC: Adding query filter params (name=service) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:23.437387 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82285a8-d370-4786-8670-1dbef804367b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:23.438859 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82285a8-d370-4786-8670-1dbef804367b None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:23.448581 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 272/546] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:45:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:23.454012 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82285a8-d370-4786-8670-1dbef804367b None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:23.460351 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-cfd151d0-7564-435d-819b-e2280711819c None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:23.461588 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-cfd151d0-7564-435d-819b-e2280711819c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:23.558605 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:23.562661 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 275/547] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:45:23.578463 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82285a8-d370-4786-8670-1dbef804367b None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:23.597837 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd151d0-7564-435d-819b-e2280711819c None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:23.614061 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b06b13-5cea-4be8-9af9-d2939453db33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:23.614897 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b06b13-5cea-4be8-9af9-d2939453db33 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:23.615183 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b06b13-5cea-4be8-9af9-d2939453db33 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:23.615468 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b06b13-5cea-4be8-9af9-d2939453db33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:23.628228 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b06b13-5cea-4be8-9af9-d2939453db33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:23.629930 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b06b13-5cea-4be8-9af9-d2939453db33 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:23.651925 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-86b06b13-5cea-4be8-9af9-d2939453db33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:23.651925 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:23.651925 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:23.651925 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:23.651925 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:23.651925 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:23.651925 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:23.651925 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:23.651925 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:23.651925 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:23.651925 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:23.651925 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:23.651925 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:23.651925 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:23.651925 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:23.654257 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:23.654257 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:23.654257 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:23.654257 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:23.654257 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:23.654257 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:23.654257 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:23.654257 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:23.654257 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:23.654257 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:23.654257 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:23.654257 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:23.654257 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:23.654257 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:23.654257 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:23.654257 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:23.654257 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:23.656414 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:23.656414 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:23.656414 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:23.656414 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:23.656414 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 273/548] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:23.661518 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b06b13-5cea-4be8-9af9-d2939453db33 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:23.670275 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:23.783189 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd151d0-7564-435d-819b-e2280711819c None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:23.841808 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b06b13-5cea-4be8-9af9-d2939453db33 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:23.853146 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c39561-f175-475d-b1fe-99a24dd0b379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:23.853972 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c39561-f175-475d-b1fe-99a24dd0b379 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:23.854288 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c39561-f175-475d-b1fe-99a24dd0b379 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:23.854575 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c39561-f175-475d-b1fe-99a24dd0b379 None admin] PATH_INFO: `/v3/roles/service` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:23.874445 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c39561-f175-475d-b1fe-99a24dd0b379 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:45:23.887714 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-c8c39561-f175-475d-b1fe-99a24dd0b379 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:45:23.887714 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:23.887714 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:23.887714 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:23.887714 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:23.887714 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:23.887714 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:23.887714 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:23.887714 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:23.887714 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:23.887714 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:23.887714 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:23.887714 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:45:23.887714 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:45:23.887714 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:45:23.887714 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:45:23.888737 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:45:23.888737 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:45:23.888737 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:45:23.888737 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:45:23.888737 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:23.888737 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:23.888737 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:23.888737 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:23.888737 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:23.888737 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:23.888737 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:23.888737 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:23.888737 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:23.888737 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:23.888737 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:23.888737 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:23.889702 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:23.889702 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:23.889702 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:23.889702 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:23.889702 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:45:23.889702 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:45:23.889702 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:45:23.889702 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:45:23.889702 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:45:23.889702 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:45:23.889702 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:45:23.889702 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:23.889702 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 276/549] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:45:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:45:23.897052 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c39561-f175-475d-b1fe-99a24dd0b379 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:23.908933 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d5a65b-70c2-4bd9-8a44-a842a94f3f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:23.909669 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5a65b-70c2-4bd9-8a44-a842a94f3f82 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:23.910108 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:23.910607 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5a65b-70c2-4bd9-8a44-a842a94f3f82 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:23.911053 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5a65b-70c2-4bd9-8a44-a842a94f3f82 None admin] PATH_INFO: `/v3/domains` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:23.911950 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d5a65b-70c2-4bd9-8a44-a842a94f3f82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:23.912445 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d5a65b-70c2-4bd9-8a44-a842a94f3f82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:23.914829 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d5a65b-70c2-4bd9-8a44-a842a94f3f82 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:23.928648 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 274/550] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:23.930260 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4fc5a1-2623-4c04-b8da-ab76364b4502 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:23.930711 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4fc5a1-2623-4c04-b8da-ab76364b4502 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:23.931173 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4fc5a1-2623-4c04-b8da-ab76364b4502 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:23.933001 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 275/551] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:45:23.933870 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4fc5a1-2623-4c04-b8da-ab76364b4502 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:24.033284 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:24.042255 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c39561-f175-475d-b1fe-99a24dd0b379 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:24.061184 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4fc5a1-2623-4c04-b8da-ab76364b4502 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:24.088479 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f01fb-2a90-4e35-9f1b-59e1f4447453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:24.090463 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f01fb-2a90-4e35-9f1b-59e1f4447453 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:24.091006 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f01fb-2a90-4e35-9f1b-59e1f4447453 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:24.091783 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f01fb-2a90-4e35-9f1b-59e1f4447453 None admin] PATH_INFO: `/v3/roles` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:24.093190 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993f01fb-2a90-4e35-9f1b-59e1f4447453 None admin] RBAC: Adding query filter params (name=service) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:24.093942 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993f01fb-2a90-4e35-9f1b-59e1f4447453 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:24.096252 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993f01fb-2a90-4e35-9f1b-59e1f4447453 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:24.100822 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d134347-c1a4-409c-99de-7f46a6a55d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:24.101791 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d134347-c1a4-409c-99de-7f46a6a55d8b None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:24.102171 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d134347-c1a4-409c-99de-7f46a6a55d8b None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:24.102539 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d134347-c1a4-409c-99de-7f46a6a55d8b None admin] PATH_INFO: `/v3/users/swift` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:24.108332 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 277/552] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:45:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:24.109818 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5ee4f-b2e6-4b02-8a56-8e52e019b30a None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:24.110315 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5ee4f-b2e6-4b02-8a56-8e52e019b30a None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:24.110828 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5ee4f-b2e6-4b02-8a56-8e52e019b30a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:24.115517 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d134347-c1a4-409c-99de-7f46a6a55d8b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:24.118683 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d134347-c1a4-409c-99de-7f46a6a55d8b None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:24.130234 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-64d5ee4f-b2e6-4b02-8a56-8e52e019b30a None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:24.131657 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-64d5ee4f-b2e6-4b02-8a56-8e52e019b30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:24.135638 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-6d134347-c1a4-409c-99de-7f46a6a55d8b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 21:45:24.135638 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:24.135638 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:24.135638 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:24.135638 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:24.135638 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:24.135638 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:24.135638 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:24.135638 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:24.135638 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:24.135638 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:24.135638 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:24.135638 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:45:24.135638 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:45:24.135638 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:45:24.135638 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:45:24.136774 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:24.136774 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:24.136774 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:45:24.136774 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:45:24.136774 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:45:24.136774 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:45:24.136774 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:24.136774 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:24.136774 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:24.136774 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:24.136774 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:24.136774 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:24.136774 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:24.136774 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:24.136774 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:24.136774 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:24.136774 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:24.136774 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:24.137816 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:24.137816 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:24.137816 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:45:24.137816 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:45:24.137816 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:45:24.137816 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:45:24.137816 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:45:24.137816 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:45:24.137816 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 21:45:24.137816 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:24.142018 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 276/553] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:45:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:24.142952 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d134347-c1a4-409c-99de-7f46a6a55d8b None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:24.197530 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:24.222372 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 278/554] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:45:24.223533 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d5ee4f-b2e6-4b02-8a56-8e52e019b30a None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:24.254164 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d134347-c1a4-409c-99de-7f46a6a55d8b None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:24.292134 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dec1a0-3ff7-4e85-aa68-09f478f4722a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:24.293132 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dec1a0-3ff7-4e85-aa68-09f478f4722a None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:24.293498 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dec1a0-3ff7-4e85-aa68-09f478f4722a None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:24.293857 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dec1a0-3ff7-4e85-aa68-09f478f4722a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:24.305089 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dec1a0-3ff7-4e85-aa68-09f478f4722a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:24.306726 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dec1a0-3ff7-4e85-aa68-09f478f4722a None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:24.325526 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-28dec1a0-3ff7-4e85-aa68-09f478f4722a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:24.325526 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:24.325526 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:24.325526 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:24.325526 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:24.325526 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:24.325526 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:24.325526 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:24.325526 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:24.325526 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:24.325526 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:24.325526 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:24.325526 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:24.325526 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:24.325526 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:24.326681 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:24.326681 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:24.326681 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:24.326681 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:24.326681 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:24.326681 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:24.326681 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:24.326681 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:24.326681 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:24.326681 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:24.326681 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:24.326681 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:24.326681 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:24.326681 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:24.326681 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:24.326681 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:24.326681 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:24.327657 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:24.327657 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:24.327657 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:24.327657 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:24.327657 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 277/555] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:24.332137 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dec1a0-3ff7-4e85-aa68-09f478f4722a None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:24.339736 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:24.356840 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d5ee4f-b2e6-4b02-8a56-8e52e019b30a None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:24.396045 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de8a46-80b7-40de-91c9-e69cdf6e84d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:24.397965 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de8a46-80b7-40de-91c9-e69cdf6e84d1 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:24.398786 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de8a46-80b7-40de-91c9-e69cdf6e84d1 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:24.399263 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de8a46-80b7-40de-91c9-e69cdf6e84d1 None admin] PATH_INFO: `/v3/users` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:24.400491 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de8a46-80b7-40de-91c9-e69cdf6e84d1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:24.401278 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de8a46-80b7-40de-91c9-e69cdf6e84d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:24.403264 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de8a46-80b7-40de-91c9-e69cdf6e84d1 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:24.426960 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 279/556] 10.222.0.30 () {56 vars in 1135 bytes} [Tue Jul 5 21:45:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:24.428844 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de8a46-80b7-40de-91c9-e69cdf6e84d1 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:24.447187 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dec1a0-3ff7-4e85-aa68-09f478f4722a None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:24.450533 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:24.485588 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c18ca6-3214-4950-bfca-90a7d7d3364e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:24.487085 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c18ca6-3214-4950-bfca-90a7d7d3364e None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:24.487628 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c18ca6-3214-4950-bfca-90a7d7d3364e None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:24.488126 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c18ca6-3214-4950-bfca-90a7d7d3364e None admin] PATH_INFO: `/v3/roles/service` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:24.500125 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c18ca6-3214-4950-bfca-90a7d7d3364e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:45:24.509572 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-37c18ca6-3214-4950-bfca-90a7d7d3364e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:45:24.509572 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:24.509572 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:24.509572 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:24.509572 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:24.509572 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:24.509572 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:24.509572 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:24.509572 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:24.509572 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:24.509572 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:24.509572 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:24.509572 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:45:24.509572 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:45:24.509572 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:45:24.509572 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:45:24.510660 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:45:24.510660 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:45:24.510660 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:45:24.510660 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:45:24.510660 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:24.510660 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:24.510660 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:24.510660 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:24.510660 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:24.510660 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:24.510660 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:24.510660 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:24.510660 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:24.510660 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:24.510660 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:24.510660 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:24.511718 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:24.511718 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:24.511718 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:24.511718 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:24.511718 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:45:24.511718 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:45:24.511718 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:45:24.511718 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:45:24.511718 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:45:24.511718 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:45:24.511718 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:45:24.511718 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:24.514716 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 278/557] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:45:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:24.516006 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c18ca6-3214-4950-bfca-90a7d7d3364e None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:24.577803 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de8a46-80b7-40de-91c9-e69cdf6e84d1 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:24.629833 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f416cd-bfc5-4bf1-9809-a9583d1bc6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:24.631069 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f416cd-bfc5-4bf1-9809-a9583d1bc6e4 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:24.631627 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f416cd-bfc5-4bf1-9809-a9583d1bc6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:24.632134 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f416cd-bfc5-4bf1-9809-a9583d1bc6e4 None admin] PATH_INFO: `/v3/domains` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:24.633273 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f416cd-bfc5-4bf1-9809-a9583d1bc6e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:24.633918 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f416cd-bfc5-4bf1-9809-a9583d1bc6e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:24.635660 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f416cd-bfc5-4bf1-9809-a9583d1bc6e4 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:24.644140 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c18ca6-3214-4950-bfca-90a7d7d3364e None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:24.654104 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 280/558] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:24.655321 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f416cd-bfc5-4bf1-9809-a9583d1bc6e4 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:24.659602 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:24.686562 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446849b1-ff6c-4c42-82d2-1f502f8d177b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:24.687549 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446849b1-ff6c-4c42-82d2-1f502f8d177b None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:24.687846 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446849b1-ff6c-4c42-82d2-1f502f8d177b None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:24.688128 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446849b1-ff6c-4c42-82d2-1f502f8d177b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:24.724897 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:24.764823 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f416cd-bfc5-4bf1-9809-a9583d1bc6e4 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:24.776500 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446849b1-ff6c-4c42-82d2-1f502f8d177b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:24.778594 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446849b1-ff6c-4c42-82d2-1f502f8d177b None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:24.804072 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb161c0-2671-49f4-8c11-17da7bacc9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:24.805468 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb161c0-2671-49f4-8c11-17da7bacc9bc None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:24.806046 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb161c0-2671-49f4-8c11-17da7bacc9bc None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:24.806611 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb161c0-2671-49f4-8c11-17da7bacc9bc None admin] PATH_INFO: `/v3/roles` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:24.807607 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb161c0-2671-49f4-8c11-17da7bacc9bc None admin] RBAC: Adding query filter params (name=service) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:24.808140 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb161c0-2671-49f4-8c11-17da7bacc9bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:24.809919 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb161c0-2671-49f4-8c11-17da7bacc9bc None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:24.819786 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 281/559] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:45:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:24.820990 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb161c0-2671-49f4-8c11-17da7bacc9bc None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:24.894198 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:24.908294 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 279/560] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:45:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:45:24.908294 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446849b1-ff6c-4c42-82d2-1f502f8d177b None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:24.935876 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb161c0-2671-49f4-8c11-17da7bacc9bc None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:24.973192 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:24.973524 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33357b76-e659-423e-b704-81b5f02915e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:24.974722 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33357b76-e659-423e-b704-81b5f02915e3 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:24.975079 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33357b76-e659-423e-b704-81b5f02915e3 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:24.975335 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33357b76-e659-423e-b704-81b5f02915e3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:24.983990 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33357b76-e659-423e-b704-81b5f02915e3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:24.985491 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33357b76-e659-423e-b704-81b5f02915e3 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:25.001031 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-33357b76-e659-423e-b704-81b5f02915e3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:45:25.001031 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:25.001031 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:25.001031 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:25.001031 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:25.001031 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:25.001031 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:25.001031 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:25.001031 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:25.001031 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:25.001031 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:25.001031 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:25.001031 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:45:25.001031 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:45:25.001031 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:45:25.001031 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:45:25.002435 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:25.002435 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:25.002435 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:45:25.002435 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:45:25.002435 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:45:25.002435 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:45:25.002435 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:25.002435 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:25.002435 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:25.002435 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:25.002435 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:25.002435 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:25.002435 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:25.002435 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:25.002435 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:25.002435 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:25.002435 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:25.002435 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:25.003737 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:25.003737 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:25.003737 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:45:25.003737 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:45:25.003737 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:45:25.003737 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:45:25.003737 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:45:25.003737 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:45:25.003737 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:45:25.003737 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:25.007083 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 282/561] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Jul 5 21:45:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:25.008433 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa6437-d1fb-4812-826c-8eaeebd1b011 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:25.008727 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa6437-d1fb-4812-826c-8eaeebd1b011 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:25.009014 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa6437-d1fb-4812-826c-8eaeebd1b011 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:25.010354 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 283/562] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:45:25.011058 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa6437-d1fb-4812-826c-8eaeebd1b011 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:25.030515 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446849b1-ff6c-4c42-82d2-1f502f8d177b None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:25.066738 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e76719-1eb6-4547-93a3-911b42570a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:25.067548 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e76719-1eb6-4547-93a3-911b42570a64 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:25.067839 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e76719-1eb6-4547-93a3-911b42570a64 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:25.068121 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e76719-1eb6-4547-93a3-911b42570a64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:25.079501 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e76719-1eb6-4547-93a3-911b42570a64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:25.080970 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e76719-1eb6-4547-93a3-911b42570a64 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:25.099559 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-f6e76719-1eb6-4547-93a3-911b42570a64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:25.099559 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:25.099559 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:25.099559 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:25.099559 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:25.099559 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:25.099559 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:25.099559 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:25.099559 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:25.099559 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:25.099559 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:25.099559 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:25.099559 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:25.099559 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:25.099559 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:25.101121 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:25.101121 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:25.101121 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:25.101121 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:25.101121 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:25.101121 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:25.101121 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:25.101121 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:25.101121 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:25.101121 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:25.101121 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:25.101121 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:25.101121 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:25.101121 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:25.101121 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:25.101121 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:25.101121 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:25.102335 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:25.102335 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:25.102335 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:25.102335 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:25.105730 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 280/563] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:25.106604 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e76719-1eb6-4547-93a3-911b42570a64 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:25.131174 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa6437-d1fb-4812-826c-8eaeebd1b011 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:25.159279 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:25.169321 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a089d88-decb-4aa2-9b4e-ed25a862accd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:25.174849 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a089d88-decb-4aa2-9b4e-ed25a862accd None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:25.174849 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a089d88-decb-4aa2-9b4e-ed25a862accd None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:25.174849 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a089d88-decb-4aa2-9b4e-ed25a862accd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:25.183051 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a089d88-decb-4aa2-9b4e-ed25a862accd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:25.184578 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a089d88-decb-4aa2-9b4e-ed25a862accd None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:25.203474 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-0a089d88-decb-4aa2-9b4e-ed25a862accd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:25.203474 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:25.203474 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:25.203474 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:25.203474 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:25.203474 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:25.203474 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:25.203474 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:25.203474 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:25.203474 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:25.203474 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:25.203474 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:25.203474 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:25.203474 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:25.203474 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:25.204614 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:25.204614 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:25.204614 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:25.204614 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:25.204614 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:25.204614 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:25.204614 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:25.204614 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:25.204614 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:25.204614 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:25.204614 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:25.204614 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:25.204614 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:25.204614 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:25.204614 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:25.204614 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:25.204614 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:25.205713 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:25.205713 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:25.205713 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:25.205713 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:25.205713 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 284/564] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:25.207410 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc76fc3-7486-4acf-9513-c163343be0fb None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:25.208423 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc76fc3-7486-4acf-9513-c163343be0fb None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:25.208935 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc76fc3-7486-4acf-9513-c163343be0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:25.213903 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e76719-1eb6-4547-93a3-911b42570a64 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:25.228315 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-ccc76fc3-7486-4acf-9513-c163343be0fb None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:25.229325 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:25.230349 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-ccc76fc3-7486-4acf-9513-c163343be0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:25.254037 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b24344-5b8a-46b3-9336-672058a8e7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:25.254848 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b24344-5b8a-46b3-9336-672058a8e7d2 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:25.255218 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b24344-5b8a-46b3-9336-672058a8e7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:25.255577 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b24344-5b8a-46b3-9336-672058a8e7d2 None admin] PATH_INFO: `/v3/users` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:25.256504 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b24344-5b8a-46b3-9336-672058a8e7d2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:25.257402 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b24344-5b8a-46b3-9336-672058a8e7d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:25.259218 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b24344-5b8a-46b3-9336-672058a8e7d2 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:25.317154 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 281/565] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Jul 5 21:45:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:25.317154 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b24344-5b8a-46b3-9336-672058a8e7d2 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:25.345338 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 285/566] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:45:25.346234 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc76fc3-7486-4acf-9513-c163343be0fb None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:25.429165 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b24344-5b8a-46b3-9336-672058a8e7d2 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:25.465842 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0bb8a1-e85c-4114-86c3-03866d384508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:25.466551 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0bb8a1-e85c-4114-86c3-03866d384508 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:25.466847 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0bb8a1-e85c-4114-86c3-03866d384508 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:25.467134 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0bb8a1-e85c-4114-86c3-03866d384508 None admin] PATH_INFO: `/v3/domains` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:25.467253 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc76fc3-7486-4acf-9513-c163343be0fb None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:25.467876 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0bb8a1-e85c-4114-86c3-03866d384508 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:25.468192 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0bb8a1-e85c-4114-86c3-03866d384508 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:25.469596 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0bb8a1-e85c-4114-86c3-03866d384508 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:25.476570 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:25.486370 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 282/567] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:25.486370 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0bb8a1-e85c-4114-86c3-03866d384508 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:25.505994 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823aaffb-b3ee-47ff-96f9-b8262ceb2d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:25.507217 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823aaffb-b3ee-47ff-96f9-b8262ceb2d62 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:25.507533 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823aaffb-b3ee-47ff-96f9-b8262ceb2d62 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:25.507790 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823aaffb-b3ee-47ff-96f9-b8262ceb2d62 None admin] PATH_INFO: `/v3/domains` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:25.508528 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823aaffb-b3ee-47ff-96f9-b8262ceb2d62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:25.508839 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823aaffb-b3ee-47ff-96f9-b8262ceb2d62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:25.510257 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823aaffb-b3ee-47ff-96f9-b8262ceb2d62 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:25.513616 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:25.521759 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 286/568] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:25.527044 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823aaffb-b3ee-47ff-96f9-b8262ceb2d62 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:25.585907 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0bb8a1-e85c-4114-86c3-03866d384508 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:25.619397 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d167e8d-bc25-47be-836f-0f150d2ceef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:25.620189 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d167e8d-bc25-47be-836f-0f150d2ceef9 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:25.620471 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d167e8d-bc25-47be-836f-0f150d2ceef9 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:25.620745 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d167e8d-bc25-47be-836f-0f150d2ceef9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:25.627254 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823aaffb-b3ee-47ff-96f9-b8262ceb2d62 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:25.631182 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d167e8d-bc25-47be-836f-0f150d2ceef9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:25.632676 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d167e8d-bc25-47be-836f-0f150d2ceef9 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:25.649868 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-7d167e8d-bc25-47be-836f-0f150d2ceef9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:25.649868 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:25.649868 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:25.649868 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:25.649868 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:25.649868 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:25.649868 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:25.649868 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:25.649868 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:25.649868 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:25.649868 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:25.649868 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:25.649868 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:25.649868 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:25.649868 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:25.651065 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:25.651065 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:25.651065 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:25.651065 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:25.651065 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:25.651065 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:25.651065 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:25.651065 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:25.651065 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:25.651065 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:25.651065 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:25.651065 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:25.651065 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:25.651065 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:25.651065 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:25.651065 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:25.651065 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:25.652237 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:25.652237 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:25.652237 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:25.652237 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:25.652237 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 283/569] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:25.652714 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece41726-c77f-408b-a721-94478bdff3e4 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:25.653009 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece41726-c77f-408b-a721-94478bdff3e4 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:25.653292 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece41726-c77f-408b-a721-94478bdff3e4 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:25.654705 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 284/570] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:45:25.659214 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece41726-c77f-408b-a721-94478bdff3e4 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:25.664428 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514f272-9b94-4ca4-b0de-840bd3f96679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:25.665238 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514f272-9b94-4ca4-b0de-840bd3f96679 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:25.665532 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514f272-9b94-4ca4-b0de-840bd3f96679 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:25.665811 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514f272-9b94-4ca4-b0de-840bd3f96679 None admin] PATH_INFO: `/v3/roles/service` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:25.676344 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4514f272-9b94-4ca4-b0de-840bd3f96679 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:45:25.684829 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-4514f272-9b94-4ca4-b0de-840bd3f96679 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:45:25.684829 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:25.684829 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:25.684829 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:25.684829 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:25.684829 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:25.684829 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:25.684829 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:25.684829 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:25.684829 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:25.684829 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:25.684829 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:25.684829 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:45:25.684829 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:45:25.684829 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:45:25.684829 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:45:25.686039 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:45:25.686039 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:45:25.686039 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:45:25.686039 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:45:25.686039 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:25.686039 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:25.686039 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:25.686039 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:25.686039 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:25.686039 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:25.686039 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:25.686039 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:25.686039 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:25.686039 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:25.686039 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:25.686039 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:25.687580 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:25.687580 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:25.687580 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:25.687580 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:25.687580 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:45:25.687580 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:45:25.687580 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:45:25.687580 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:45:25.687580 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:45:25.687580 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:45:25.687580 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:45:25.687580 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:25.687580 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 287/571] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:45:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:25.687580 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514f272-9b94-4ca4-b0de-840bd3f96679 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:25.716265 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:25.758291 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:25.779626 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece41726-c77f-408b-a721-94478bdff3e4 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:25.788786 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514f272-9b94-4ca4-b0de-840bd3f96679 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:25.814372 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d0c59-c6dc-44c1-91e5-900775ec9876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:25.815175 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d0c59-c6dc-44c1-91e5-900775ec9876 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:25.815465 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d0c59-c6dc-44c1-91e5-900775ec9876 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:25.815745 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d0c59-c6dc-44c1-91e5-900775ec9876 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:25.822316 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a88cd7-a26e-4c61-b18d-522cb6129f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:25.823115 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a88cd7-a26e-4c61-b18d-522cb6129f00 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:25.823403 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a88cd7-a26e-4c61-b18d-522cb6129f00 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:25.823655 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d0c59-c6dc-44c1-91e5-900775ec9876 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:25.823761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a88cd7-a26e-4c61-b18d-522cb6129f00 None admin] PATH_INFO: `/v3/projects/service` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:25.825101 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d0c59-c6dc-44c1-91e5-900775ec9876 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:25.830281 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a88cd7-a26e-4c61-b18d-522cb6129f00 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:25.831702 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a88cd7-a26e-4c61-b18d-522cb6129f00 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:25.839751 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-903d0c59-c6dc-44c1-91e5-900775ec9876 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 21:45:25.839751 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:25.839751 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:25.839751 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:25.839751 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:25.839751 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:25.839751 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:25.839751 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:25.839751 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:25.839751 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:25.839751 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:25.839751 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:25.839751 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:45:25.839751 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:45:25.839751 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:45:25.839751 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:45:25.840945 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:25.840945 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:25.840945 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:45:25.840945 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:45:25.840945 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:45:25.840945 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:45:25.840945 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:25.840945 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:25.840945 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:25.840945 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:25.840945 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:25.840945 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:25.840945 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:25.840945 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:25.840945 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:25.840945 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:25.840945 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:25.840945 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:25.841986 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:25.841986 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:25.841986 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:45:25.841986 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:45:25.841986 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:45:25.841986 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:45:25.841986 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:45:25.841986 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:45:25.841986 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 21:45:25.841986 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:25.841986 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 285/572] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:45:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:25.842677 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d0c59-c6dc-44c1-91e5-900775ec9876 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:25.846062 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-f5a88cd7-a26e-4c61-b18d-522cb6129f00 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:45:25.846062 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:25.846062 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:25.846062 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:25.846062 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:25.846062 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:25.846062 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:25.846062 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:25.846062 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:25.846062 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:25.846062 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:25.846062 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:25.846062 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:45:25.846062 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:45:25.846062 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:45:25.847321 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:45:25.847321 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:25.847321 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:25.847321 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:25.847321 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:25.847321 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:25.847321 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:25.847321 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:25.847321 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:25.847321 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:25.847321 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:25.847321 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:25.847321 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:25.847321 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:25.847321 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:25.847321 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:25.847321 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:25.848860 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:45:25.848860 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:45:25.848860 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:45:25.848860 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:45:25.848860 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:45:25.848860 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:45:25.848860 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:45:25.848860 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:25.853687 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 288/573] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:45:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:25.853687 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434bc94-e2cb-4d40-afc7-8dfaed94fd7f None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:25.853687 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434bc94-e2cb-4d40-afc7-8dfaed94fd7f None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:25.853687 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434bc94-e2cb-4d40-afc7-8dfaed94fd7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:25.869267 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-f434bc94-e2cb-4d40-afc7-8dfaed94fd7f None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:25.870498 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-f434bc94-e2cb-4d40-afc7-8dfaed94fd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:25.936023 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 289/574] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:45:25.936929 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f434bc94-e2cb-4d40-afc7-8dfaed94fd7f None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:25.945183 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d0c59-c6dc-44c1-91e5-900775ec9876 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:25.958333 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:25.980009 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067dc7f6-1822-4b7d-9a20-32392564a8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:25.980688 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067dc7f6-1822-4b7d-9a20-32392564a8e2 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:25.980978 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067dc7f6-1822-4b7d-9a20-32392564a8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:25.981261 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067dc7f6-1822-4b7d-9a20-32392564a8e2 None admin] PATH_INFO: `/v3/domains` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:25.981993 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067dc7f6-1822-4b7d-9a20-32392564a8e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:25.982337 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067dc7f6-1822-4b7d-9a20-32392564a8e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:25.983725 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067dc7f6-1822-4b7d-9a20-32392564a8e2 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:25.999692 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 286/575] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:25.999692 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067dc7f6-1822-4b7d-9a20-32392564a8e2 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:25.999692 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:26.046537 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f434bc94-e2cb-4d40-afc7-8dfaed94fd7f None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:26.080516 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277f7f7-e47a-450a-a7a1-5c39843341a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:26.081187 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277f7f7-e47a-450a-a7a1-5c39843341a4 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:26.081475 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277f7f7-e47a-450a-a7a1-5c39843341a4 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:26.081808 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277f7f7-e47a-450a-a7a1-5c39843341a4 None admin] PATH_INFO: `/v3/roles` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:26.082588 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277f7f7-e47a-450a-a7a1-5c39843341a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:26.082899 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277f7f7-e47a-450a-a7a1-5c39843341a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:26.084285 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277f7f7-e47a-450a-a7a1-5c39843341a4 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:26.093149 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 290/576] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:45:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:26.093952 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277f7f7-e47a-450a-a7a1-5c39843341a4 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:26.096868 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067dc7f6-1822-4b7d-9a20-32392564a8e2 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:26.131308 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b9be4-8e36-42ac-86f6-08544a354535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:26.132472 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b9be4-8e36-42ac-86f6-08544a354535 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:26.132764 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b9be4-8e36-42ac-86f6-08544a354535 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:26.133046 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b9be4-8e36-42ac-86f6-08544a354535 None admin] PATH_INFO: `/v3/users` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:26.133898 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b9be4-8e36-42ac-86f6-08544a354535 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:26.134244 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b9be4-8e36-42ac-86f6-08544a354535 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:26.135695 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b9be4-8e36-42ac-86f6-08544a354535 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:26.157134 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 287/577] 10.222.0.30 () {56 vars in 1137 bytes} [Tue Jul 5 21:45:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:26.157134 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b9be4-8e36-42ac-86f6-08544a354535 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:26.173854 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:26.193572 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277f7f7-e47a-450a-a7a1-5c39843341a4 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:26.217279 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:26.230320 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865494c-cc36-40f3-b95e-9bd61daa0631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:26.233134 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865494c-cc36-40f3-b95e-9bd61daa0631 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:26.233134 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865494c-cc36-40f3-b95e-9bd61daa0631 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:26.233134 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865494c-cc36-40f3-b95e-9bd61daa0631 None admin] PATH_INFO: `/v3/projects` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:26.233134 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e865494c-cc36-40f3-b95e-9bd61daa0631 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:26.233134 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e865494c-cc36-40f3-b95e-9bd61daa0631 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:26.234094 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e865494c-cc36-40f3-b95e-9bd61daa0631 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:26.245652 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 291/578] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:45:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:26.246480 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865494c-cc36-40f3-b95e-9bd61daa0631 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:26.258401 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b9be4-8e36-42ac-86f6-08544a354535 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:26.297539 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae36dc6-b1ad-4315-a602-14cf150cac23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:26.298296 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae36dc6-b1ad-4315-a602-14cf150cac23 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:26.298587 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae36dc6-b1ad-4315-a602-14cf150cac23 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:26.298866 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae36dc6-b1ad-4315-a602-14cf150cac23 None admin] PATH_INFO: `/v3/roles/service` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:26.309730 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae36dc6-b1ad-4315-a602-14cf150cac23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:45:26.317442 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-8ae36dc6-b1ad-4315-a602-14cf150cac23 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:45:26.317442 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:26.317442 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:26.317442 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:26.317442 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:26.317442 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:26.317442 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:26.317442 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:26.317442 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:26.317442 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:26.317442 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:26.317442 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:26.317442 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:45:26.317442 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:45:26.317442 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:45:26.317442 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:45:26.318493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:45:26.318493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:45:26.318493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:45:26.318493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:45:26.318493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:26.318493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:26.318493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:26.318493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:26.318493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:26.318493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:26.318493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:26.318493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:26.318493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:26.318493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:26.318493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:26.318493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:26.319965 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:26.319965 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:26.319965 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:26.319965 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:26.319965 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:45:26.319965 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:45:26.319965 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:45:26.319965 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:45:26.319965 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:45:26.319965 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:45:26.319965 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:45:26.319965 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:26.322286 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 288/579] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:45:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:26.323319 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae36dc6-b1ad-4315-a602-14cf150cac23 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:26.349475 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865494c-cc36-40f3-b95e-9bd61daa0631 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:26.384354 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2f035-829e-4680-a888-d6c159b7dce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:26.385153 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2f035-829e-4680-a888-d6c159b7dce6 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:26.385439 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2f035-829e-4680-a888-d6c159b7dce6 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:26.385720 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2f035-829e-4680-a888-d6c159b7dce6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:26.392489 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a2f035-829e-4680-a888-d6c159b7dce6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:26.393938 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a2f035-829e-4680-a888-d6c159b7dce6 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:26.396454 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:26.409749 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-82a2f035-829e-4680-a888-d6c159b7dce6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:45:26.409749 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:26.409749 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:26.409749 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:26.409749 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:26.409749 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:26.409749 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:26.409749 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:26.409749 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:26.409749 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:26.409749 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:26.409749 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:26.409749 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:45:26.409749 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:45:26.409749 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:45:26.411459 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:45:26.411459 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:26.411459 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:26.411459 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:26.411459 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:26.411459 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:26.411459 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:26.411459 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:26.411459 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:26.411459 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:26.411459 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:26.411459 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:26.411459 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:26.411459 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:26.411459 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:26.411459 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:26.411459 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:26.412437 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:45:26.412437 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:45:26.412437 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:45:26.412437 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:45:26.412437 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:45:26.412437 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:45:26.412437 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:45:26.412437 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:26.412437 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 292/580] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:45:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:26.412437 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2f035-829e-4680-a888-d6c159b7dce6 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:26.425908 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae36dc6-b1ad-4315-a602-14cf150cac23 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:26.445785 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:26.460258 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52863812-388f-4f78-992d-2ee2d90c6187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:26.462168 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52863812-388f-4f78-992d-2ee2d90c6187 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:26.462168 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52863812-388f-4f78-992d-2ee2d90c6187 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:26.462168 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52863812-388f-4f78-992d-2ee2d90c6187 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:26.472323 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52863812-388f-4f78-992d-2ee2d90c6187 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:26.473857 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52863812-388f-4f78-992d-2ee2d90c6187 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:26.492267 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-52863812-388f-4f78-992d-2ee2d90c6187 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:26.492267 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:26.492267 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:26.492267 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:26.492267 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:26.492267 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:26.492267 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:26.492267 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:26.492267 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:26.492267 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:26.492267 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:26.492267 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:26.492267 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:26.492267 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:26.492267 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:26.493392 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:26.493392 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:26.493392 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:26.493392 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:26.493392 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:26.493392 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:26.493392 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:26.493392 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:26.493392 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:26.493392 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:26.493392 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:26.493392 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:26.493392 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:26.493392 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:26.493392 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:26.493392 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:26.493392 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:26.494454 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:26.494454 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:26.494454 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:26.494454 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:26.494454 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 289/581] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:26.494454 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52863812-388f-4f78-992d-2ee2d90c6187 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:26.516634 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2f035-829e-4680-a888-d6c159b7dce6 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:26.551394 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c14ae-cbf2-4b49-ae45-87af199a297c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:26.552137 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c14ae-cbf2-4b49-ae45-87af199a297c None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:26.552424 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c14ae-cbf2-4b49-ae45-87af199a297c None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:26.552703 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c14ae-cbf2-4b49-ae45-87af199a297c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:26.564600 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c14ae-cbf2-4b49-ae45-87af199a297c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:26.566083 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c14ae-cbf2-4b49-ae45-87af199a297c None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:26.584402 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-194c14ae-cbf2-4b49-ae45-87af199a297c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:26.584402 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:26.584402 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:26.584402 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:26.584402 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:26.584402 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:26.584402 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:26.584402 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:26.584402 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:26.584402 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:26.584402 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:26.584402 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:26.584402 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:26.584402 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:26.584402 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:26.586048 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:26.586048 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:26.586048 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:26.586048 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:26.586048 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:26.586048 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:26.586048 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:26.586048 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:26.586048 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:26.586048 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:26.586048 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:26.586048 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:26.586048 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:26.586048 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:26.586048 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:26.586048 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:26.586048 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:26.587044 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:26.587044 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:26.587044 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:26.587044 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:26.587044 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 293/582] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:26.587044 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c14ae-cbf2-4b49-ae45-87af199a297c None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:26.602174 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52863812-388f-4f78-992d-2ee2d90c6187 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:26.636748 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05615d35-c2ef-4b87-aec3-996217cf6d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:26.637404 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05615d35-c2ef-4b87-aec3-996217cf6d7c None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:26.637693 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05615d35-c2ef-4b87-aec3-996217cf6d7c None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:26.637975 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05615d35-c2ef-4b87-aec3-996217cf6d7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:26.638841 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05615d35-c2ef-4b87-aec3-996217cf6d7c None admin] RBAC: Adding query filter params (role.id=1884e658df064cc2a232687c678d8618, scope.project.id=93f20f89d0fc4bbf9cf557dd1e14d98d, user.id=ba028a9695364d54a73b01c986300344) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:26.639154 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05615d35-c2ef-4b87-aec3-996217cf6d7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:26.639720 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:26.640950 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05615d35-c2ef-4b87-aec3-996217cf6d7c None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:26.647077 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 290/583] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:45:26 2022] GET /identity/v3/role_assignments?user.id=ba028a9695364d54a73b01c986300344&scope.project.id=93f20f89d0fc4bbf9cf557dd1e14d98d&role.id=1884e658df064cc2a232687c678d8618 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:26.647989 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05615d35-c2ef-4b87-aec3-996217cf6d7c None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:26.689013 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:26.695889 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c14ae-cbf2-4b49-ae45-87af199a297c None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:26.735589 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcbf786-e7de-42ee-927a-3f907325d2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:26.736283 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbf786-e7de-42ee-927a-3f907325d2c8 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:26.736570 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbf786-e7de-42ee-927a-3f907325d2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:26.736851 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbf786-e7de-42ee-927a-3f907325d2c8 None admin] PATH_INFO: `/v3/roles` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:26.737619 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcbf786-e7de-42ee-927a-3f907325d2c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:26.737929 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcbf786-e7de-42ee-927a-3f907325d2c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:26.739365 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcbf786-e7de-42ee-927a-3f907325d2c8 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:26.749258 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 294/584] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:45:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:26.750026 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcbf786-e7de-42ee-927a-3f907325d2c8 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:26.773603 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05615d35-c2ef-4b87-aec3-996217cf6d7c None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:26.814240 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525cd5db-8a73-4828-a7b7-1fef04301d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:26.815014 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525cd5db-8a73-4828-a7b7-1fef04301d97 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:26.815323 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525cd5db-8a73-4828-a7b7-1fef04301d97 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:26.815917 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525cd5db-8a73-4828-a7b7-1fef04301d97 None admin] PATH_INFO: `/v3/projects` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:26.816736 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525cd5db-8a73-4828-a7b7-1fef04301d97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:26.817058 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525cd5db-8a73-4828-a7b7-1fef04301d97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:26.818706 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525cd5db-8a73-4828-a7b7-1fef04301d97 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:26.836917 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 291/585] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:45:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:26.836917 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525cd5db-8a73-4828-a7b7-1fef04301d97 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:26.864398 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcbf786-e7de-42ee-927a-3f907325d2c8 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:26.879225 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:26.905176 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3faaa9-02c0-4041-b4eb-4f9d3e36c731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:26.905950 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3faaa9-02c0-4041-b4eb-4f9d3e36c731 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:26.906468 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3faaa9-02c0-4041-b4eb-4f9d3e36c731 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:26.906836 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3faaa9-02c0-4041-b4eb-4f9d3e36c731 None admin] PATH_INFO: `/v3/domains` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:26.908130 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3faaa9-02c0-4041-b4eb-4f9d3e36c731 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:26.908527 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3faaa9-02c0-4041-b4eb-4f9d3e36c731 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:26.910145 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3faaa9-02c0-4041-b4eb-4f9d3e36c731 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:26.931225 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 295/586] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:26.931225 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3faaa9-02c0-4041-b4eb-4f9d3e36c731 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:26.942748 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:26.949958 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525cd5db-8a73-4828-a7b7-1fef04301d97 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:26.987188 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16708182-9648-46eb-93d1-f2c013d24fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:26.987958 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16708182-9648-46eb-93d1-f2c013d24fcd None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:26.988313 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16708182-9648-46eb-93d1-f2c013d24fcd None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:26.988685 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16708182-9648-46eb-93d1-f2c013d24fcd None admin] PATH_INFO: `/v3/domains` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:26.989565 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16708182-9648-46eb-93d1-f2c013d24fcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:26.989957 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16708182-9648-46eb-93d1-f2c013d24fcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:26.991460 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16708182-9648-46eb-93d1-f2c013d24fcd None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:27.008359 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 292/587] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:27.008359 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16708182-9648-46eb-93d1-f2c013d24fcd None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:27.034089 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3faaa9-02c0-4041-b4eb-4f9d3e36c731 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:27.073094 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bfa70e-0b4e-4bb8-979d-146f68e2004f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:27.073820 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bfa70e-0b4e-4bb8-979d-146f68e2004f None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:27.074115 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bfa70e-0b4e-4bb8-979d-146f68e2004f None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:27.074411 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bfa70e-0b4e-4bb8-979d-146f68e2004f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:27.085756 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bfa70e-0b4e-4bb8-979d-146f68e2004f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:27.087258 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bfa70e-0b4e-4bb8-979d-146f68e2004f None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:27.105510 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-c7bfa70e-0b4e-4bb8-979d-146f68e2004f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:27.105510 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:27.105510 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:27.105510 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:27.105510 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:27.105510 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:27.105510 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:27.105510 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:27.105510 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:27.105510 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:27.105510 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:27.105510 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:27.105510 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:27.105510 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:27.105510 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:27.106725 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:27.106725 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:27.106725 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:27.106725 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:27.106725 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:27.106725 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:27.106725 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:27.106725 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:27.106725 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:27.106725 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:27.106725 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:27.106725 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:27.106725 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:27.106725 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:27.106725 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:27.106725 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:27.106725 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:27.107871 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:27.107871 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:27.107871 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:27.107871 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:27.107871 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 296/588] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:27.107871 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bfa70e-0b4e-4bb8-979d-146f68e2004f None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:27.128053 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16708182-9648-46eb-93d1-f2c013d24fcd None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:27.139260 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:27.165199 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c82a770-c0e1-4b09-9d6d-e1e4f2960855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:27.166231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82a770-c0e1-4b09-9d6d-e1e4f2960855 None admin] REQUEST_METHOD: `PUT` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:27.166581 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82a770-c0e1-4b09-9d6d-e1e4f2960855 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:27.166933 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82a770-c0e1-4b09-9d6d-e1e4f2960855 None admin] PATH_INFO: `/v3/projects/93f20f89d0fc4bbf9cf557dd1e14d98d/users/f5d82e71aafe4b6ebcf60c23c050aafb/roles/1884e658df064cc2a232687c678d8618` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:27.182100 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c82a770-c0e1-4b09-9d6d-e1e4f2960855 None admin] RBAC: Authorizing `identity:create_grant(project_id=93f20f89d0fc4bbf9cf557dd1e14d98d, user_id=f5d82e71aafe4b6ebcf60c23c050aafb, role_id=1884e658df064cc2a232687c678d8618)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:27.183657 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c82a770-c0e1-4b09-9d6d-e1e4f2960855 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:27.223420 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bfa70e-0b4e-4bb8-979d-146f68e2004f None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:27.248312 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 293/589] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:45:27 2022] PUT /identity/v3/projects/93f20f89d0fc4bbf9cf557dd1e14d98d/users/f5d82e71aafe4b6ebcf60c23c050aafb/roles/1884e658df064cc2a232687c678d8618 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:45:27.249696 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c82a770-c0e1-4b09-9d6d-e1e4f2960855 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:27.266056 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:27.271347 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c104501-09e8-4b7a-90cc-4c6079c03280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:27.273367 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c104501-09e8-4b7a-90cc-4c6079c03280 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:27.273367 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c104501-09e8-4b7a-90cc-4c6079c03280 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:27.273574 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c104501-09e8-4b7a-90cc-4c6079c03280 None admin] PATH_INFO: `/v3/users/glance` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:27.282368 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c104501-09e8-4b7a-90cc-4c6079c03280 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:27.283970 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c104501-09e8-4b7a-90cc-4c6079c03280 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:27.300823 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-2c104501-09e8-4b7a-90cc-4c6079c03280 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 05 21:45:27.300823 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:27.300823 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:27.300823 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:27.300823 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:27.300823 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:27.300823 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:27.300823 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:27.300823 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:27.300823 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:27.300823 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:27.300823 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:27.300823 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:45:27.300823 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:45:27.300823 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:45:27.300823 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:45:27.307534 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:27.307534 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:27.307534 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:45:27.307534 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:45:27.307534 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:45:27.307534 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:45:27.307534 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:27.307534 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:27.307534 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:27.307534 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:27.307534 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:27.307534 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:27.307534 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:27.307534 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:27.307534 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:27.307534 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:27.307534 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:27.307534 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:27.308618 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:27.308618 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:27.308618 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:45:27.308618 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:45:27.308618 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:45:27.308618 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:45:27.308618 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:45:27.308618 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:45:27.308618 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 05 21:45:27.308618 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:27.308618 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 297/590] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:45:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:27.308618 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c104501-09e8-4b7a-90cc-4c6079c03280 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:27.382620 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c82a770-c0e1-4b09-9d6d-e1e4f2960855 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:27.421195 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a9dc2-769e-41e6-881f-cd2983a77c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:27.422014 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a9dc2-769e-41e6-881f-cd2983a77c78 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:27.422331 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a9dc2-769e-41e6-881f-cd2983a77c78 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:27.422611 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a9dc2-769e-41e6-881f-cd2983a77c78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:27.430410 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a9dc2-769e-41e6-881f-cd2983a77c78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:27.431891 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a9dc2-769e-41e6-881f-cd2983a77c78 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:27.435963 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:27.448774 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-b90a9dc2-769e-41e6-881f-cd2983a77c78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:45:27.448774 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:27.448774 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:27.448774 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:27.448774 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:27.448774 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:27.448774 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:27.448774 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:27.448774 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:27.448774 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:27.448774 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:27.448774 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:27.448774 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:45:27.448774 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:45:27.448774 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:45:27.451266 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:45:27.451266 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:27.451266 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:27.451266 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:27.451266 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:27.451266 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:27.451266 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:27.451266 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:27.451266 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:27.451266 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:27.451266 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:27.451266 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:27.451266 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:27.451266 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:27.451266 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:27.451266 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:27.451266 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:27.452435 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:45:27.452435 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:45:27.452435 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:45:27.452435 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:45:27.452435 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:45:27.452435 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:45:27.452435 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:45:27.452435 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:27.452435 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 294/591] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:45:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:27.452435 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a9dc2-769e-41e6-881f-cd2983a77c78 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:27.459570 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c104501-09e8-4b7a-90cc-4c6079c03280 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:27.509125 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b37a9-3b90-4919-9c26-5536db72d020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:27.509926 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b37a9-3b90-4919-9c26-5536db72d020 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:27.510255 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b37a9-3b90-4919-9c26-5536db72d020 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:27.510538 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b37a9-3b90-4919-9c26-5536db72d020 None admin] PATH_INFO: `/v3/domains` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:27.511290 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20b37a9-3b90-4919-9c26-5536db72d020 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:27.511592 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20b37a9-3b90-4919-9c26-5536db72d020 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:27.512984 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20b37a9-3b90-4919-9c26-5536db72d020 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:27.526484 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 298/592] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:27.527547 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b37a9-3b90-4919-9c26-5536db72d020 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:27.538616 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:27.589764 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a9dc2-769e-41e6-881f-cd2983a77c78 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:27.637190 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53946ddd-9bce-425f-b79f-9f3aab8ef36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:27.638280 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53946ddd-9bce-425f-b79f-9f3aab8ef36a None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:27.638681 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53946ddd-9bce-425f-b79f-9f3aab8ef36a None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:27.639067 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53946ddd-9bce-425f-b79f-9f3aab8ef36a None admin] PATH_INFO: `/v3/users` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:27.640040 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53946ddd-9bce-425f-b79f-9f3aab8ef36a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:27.640461 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53946ddd-9bce-425f-b79f-9f3aab8ef36a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:27.642605 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53946ddd-9bce-425f-b79f-9f3aab8ef36a None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:27.660678 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b37a9-3b90-4919-9c26-5536db72d020 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:27.662622 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 295/593] 10.222.0.30 () {56 vars in 1137 bytes} [Tue Jul 5 21:45:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:27.664224 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53946ddd-9bce-425f-b79f-9f3aab8ef36a None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:27.718691 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b942b33a-8740-4eff-8f4a-76fa5c6ec5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:27.719272 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942b33a-8740-4eff-8f4a-76fa5c6ec5db None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:27.725136 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942b33a-8740-4eff-8f4a-76fa5c6ec5db None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:27.725136 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942b33a-8740-4eff-8f4a-76fa5c6ec5db None admin] PATH_INFO: `/v3/projects` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:27.725136 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b942b33a-8740-4eff-8f4a-76fa5c6ec5db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:27.725136 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b942b33a-8740-4eff-8f4a-76fa5c6ec5db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:27.725136 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b942b33a-8740-4eff-8f4a-76fa5c6ec5db None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:27.738147 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 299/594] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:45:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:27.739019 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b942b33a-8740-4eff-8f4a-76fa5c6ec5db None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:27.749959 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:27.792511 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53946ddd-9bce-425f-b79f-9f3aab8ef36a None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:27.821302 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:27.830298 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d7d9a-8b5e-4974-8c65-a74a6271dbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:27.831118 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d7d9a-8b5e-4974-8c65-a74a6271dbe1 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:27.831419 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d7d9a-8b5e-4974-8c65-a74a6271dbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:27.831700 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d7d9a-8b5e-4974-8c65-a74a6271dbe1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:27.839885 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d7d9a-8b5e-4974-8c65-a74a6271dbe1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:27.841346 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d7d9a-8b5e-4974-8c65-a74a6271dbe1 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:27.854668 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b942b33a-8740-4eff-8f4a-76fa5c6ec5db None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:27.856835 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-762d7d9a-8b5e-4974-8c65-a74a6271dbe1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 21:45:27.856835 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:27.856835 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:27.856835 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:27.856835 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:27.856835 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:27.856835 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:27.856835 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:27.856835 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:27.856835 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:27.856835 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:27.856835 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:27.856835 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:45:27.856835 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:45:27.856835 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:45:27.856835 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:45:27.857867 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:27.857867 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:27.857867 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:45:27.857867 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:45:27.857867 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:45:27.857867 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:45:27.857867 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:27.857867 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:27.857867 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:27.857867 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:27.857867 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:27.857867 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:27.857867 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:27.857867 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:27.857867 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:27.857867 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:27.857867 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:27.857867 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:27.858929 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:27.858929 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:27.858929 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:45:27.858929 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:45:27.858929 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:45:27.858929 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:45:27.858929 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:45:27.858929 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:45:27.858929 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 21:45:27.858929 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:27.858929 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 296/595] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:45:27 2022] GET /identity/v3/users/neutron => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:27.859589 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d7d9a-8b5e-4974-8c65-a74a6271dbe1 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:27.900585 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b42ee-794e-4473-b8ef-8a02bd4a34f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:27.901348 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b42ee-794e-4473-b8ef-8a02bd4a34f8 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:27.901643 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b42ee-794e-4473-b8ef-8a02bd4a34f8 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:27.901931 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b42ee-794e-4473-b8ef-8a02bd4a34f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:27.914038 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b42ee-794e-4473-b8ef-8a02bd4a34f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:27.915757 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b42ee-794e-4473-b8ef-8a02bd4a34f8 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:27.939696 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-c02b42ee-794e-4473-b8ef-8a02bd4a34f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:27.939696 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:27.939696 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:27.939696 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:27.939696 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:27.939696 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:27.939696 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:27.939696 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:27.939696 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:27.939696 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:27.939696 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:27.939696 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:27.939696 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:27.939696 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:27.939696 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:27.940688 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:27.940688 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:27.940688 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:27.940688 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:27.940688 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:27.940688 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:27.940688 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:27.940688 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:27.940688 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:27.940688 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:27.940688 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:27.940688 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:27.940688 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:27.940688 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:27.940688 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:27.940688 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:27.940688 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:27.941647 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:27.941647 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:27.941647 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:27.941647 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:27.946471 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 300/596] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:27.947343 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b42ee-794e-4473-b8ef-8a02bd4a34f8 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:27.965542 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d7d9a-8b5e-4974-8c65-a74a6271dbe1 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:28.002292 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf706911-c150-411a-8040-c586d534d481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:28.003198 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf706911-c150-411a-8040-c586d534d481 None admin] REQUEST_METHOD: `PUT` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:28.003490 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf706911-c150-411a-8040-c586d534d481 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:28.003779 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf706911-c150-411a-8040-c586d534d481 None admin] PATH_INFO: `/v3/projects/93f20f89d0fc4bbf9cf557dd1e14d98d/users/b7f6902012fd4a9283c73b9e2394e0b0/roles/1884e658df064cc2a232687c678d8618` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:28.018248 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:28.019442 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf706911-c150-411a-8040-c586d534d481 None admin] RBAC: Authorizing `identity:create_grant(project_id=93f20f89d0fc4bbf9cf557dd1e14d98d, user_id=b7f6902012fd4a9283c73b9e2394e0b0, role_id=1884e658df064cc2a232687c678d8618)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:28.020835 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf706911-c150-411a-8040-c586d534d481 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:28.066807 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b42ee-794e-4473-b8ef-8a02bd4a34f8 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:28.111600 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 297/597] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:45:27 2022] PUT /identity/v3/projects/93f20f89d0fc4bbf9cf557dd1e14d98d/users/b7f6902012fd4a9283c73b9e2394e0b0/roles/1884e658df064cc2a232687c678d8618 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:45:28.111600 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf706911-c150-411a-8040-c586d534d481 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:28.128456 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4658355-bdbf-4f86-bf4a-f106023c22bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:28.129152 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4658355-bdbf-4f86-bf4a-f106023c22bb None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:28.129441 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4658355-bdbf-4f86-bf4a-f106023c22bb None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:28.129719 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4658355-bdbf-4f86-bf4a-f106023c22bb None admin] PATH_INFO: `/v3/users` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:28.130610 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4658355-bdbf-4f86-bf4a-f106023c22bb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:28.130926 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4658355-bdbf-4f86-bf4a-f106023c22bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:28.134636 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4658355-bdbf-4f86-bf4a-f106023c22bb None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:28.167394 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 301/598] 10.222.0.30 () {56 vars in 1139 bytes} [Tue Jul 5 21:45:27 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:28.171402 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4658355-bdbf-4f86-bf4a-f106023c22bb None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:28.181087 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:28.295798 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf706911-c150-411a-8040-c586d534d481 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:28.313601 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4658355-bdbf-4f86-bf4a-f106023c22bb None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:28.333089 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7bbea-a809-47ed-9579-831e56c82336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:28.333779 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7bbea-a809-47ed-9579-831e56c82336 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:28.334078 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7bbea-a809-47ed-9579-831e56c82336 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:28.334394 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7bbea-a809-47ed-9579-831e56c82336 None admin] PATH_INFO: `/v3/domains` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:28.335360 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7bbea-a809-47ed-9579-831e56c82336 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:28.335684 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7bbea-a809-47ed-9579-831e56c82336 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:28.336812 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:28.337106 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7bbea-a809-47ed-9579-831e56c82336 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:28.349589 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 298/599] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:28.359563 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97fc26a-ff6c-46f4-b366-a86c2c135375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:28.360714 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7bbea-a809-47ed-9579-831e56c82336 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:28.361521 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fc26a-ff6c-46f4-b366-a86c2c135375 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:28.362016 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fc26a-ff6c-46f4-b366-a86c2c135375 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:28.362963 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fc26a-ff6c-46f4-b366-a86c2c135375 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:28.379548 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97fc26a-ff6c-46f4-b366-a86c2c135375 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:28.381396 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97fc26a-ff6c-46f4-b366-a86c2c135375 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:28.402531 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-c97fc26a-ff6c-46f4-b366-a86c2c135375 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:28.402531 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:28.402531 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:28.402531 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:28.402531 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:28.402531 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:28.402531 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:28.402531 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:28.402531 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:28.402531 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:28.402531 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:28.402531 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:28.402531 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:28.402531 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:28.402531 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:28.403559 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:28.403559 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:28.403559 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:28.403559 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:28.403559 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:28.403559 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:28.403559 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:28.403559 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:28.403559 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:28.403559 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:28.403559 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:28.403559 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:28.403559 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:28.403559 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:28.403559 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:28.403559 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:28.403559 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:28.404500 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:28.404500 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:28.404500 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:28.404500 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:28.406911 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 302/600] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:28.412147 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97fc26a-ff6c-46f4-b366-a86c2c135375 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:28.474029 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:28.484029 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7bbea-a809-47ed-9579-831e56c82336 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:28.521095 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d173fa-faca-455b-a207-937ab944fc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:28.521905 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d173fa-faca-455b-a207-937ab944fc3e None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:28.522804 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d173fa-faca-455b-a207-937ab944fc3e None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:28.523092 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d173fa-faca-455b-a207-937ab944fc3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:28.530569 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d173fa-faca-455b-a207-937ab944fc3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:28.532035 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d173fa-faca-455b-a207-937ab944fc3e None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:28.549032 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-22d173fa-faca-455b-a207-937ab944fc3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:45:28.549032 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:28.549032 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:28.549032 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:28.549032 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:28.549032 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:28.549032 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:28.549032 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:28.549032 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:28.549032 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:28.549032 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:28.549032 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:28.549032 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:45:28.549032 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:45:28.549032 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:45:28.549973 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:45:28.549973 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:28.549973 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:28.549973 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:28.549973 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:28.549973 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:28.549973 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:28.549973 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:28.549973 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:28.549973 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:28.549973 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:28.549973 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:28.549973 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:28.549973 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:28.549973 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:28.549973 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:28.549973 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:28.550977 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:45:28.550977 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:45:28.550977 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:45:28.550977 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:45:28.550977 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:45:28.550977 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:45:28.550977 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:45:28.550977 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:28.550977 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 299/601] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:45:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:28.567209 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d173fa-faca-455b-a207-937ab944fc3e None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:28.569853 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97fc26a-ff6c-46f4-b366-a86c2c135375 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:28.607096 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674f57d1-ee57-4a17-902a-209a62fd9350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:28.607808 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f57d1-ee57-4a17-902a-209a62fd9350 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:28.608103 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f57d1-ee57-4a17-902a-209a62fd9350 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:28.608390 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f57d1-ee57-4a17-902a-209a62fd9350 None admin] PATH_INFO: `/v3/domains` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:28.609142 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674f57d1-ee57-4a17-902a-209a62fd9350 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:28.609462 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674f57d1-ee57-4a17-902a-209a62fd9350 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:28.610912 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674f57d1-ee57-4a17-902a-209a62fd9350 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:28.640424 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 303/602] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:28.645461 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674f57d1-ee57-4a17-902a-209a62fd9350 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:28.698868 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d173fa-faca-455b-a207-937ab944fc3e None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:28.702467 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:28.737092 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9030f82-72ea-4056-9cd1-66d7537b3040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:28.737680 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9030f82-72ea-4056-9cd1-66d7537b3040 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:28.737969 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9030f82-72ea-4056-9cd1-66d7537b3040 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:28.738277 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9030f82-72ea-4056-9cd1-66d7537b3040 None admin] PATH_INFO: `/v3/projects` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:28.741816 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9030f82-72ea-4056-9cd1-66d7537b3040 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:28.742241 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9030f82-72ea-4056-9cd1-66d7537b3040 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:28.743712 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9030f82-72ea-4056-9cd1-66d7537b3040 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:28.762244 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 300/603] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:45:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:28.763792 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9030f82-72ea-4056-9cd1-66d7537b3040 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:28.780975 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:28.861303 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674f57d1-ee57-4a17-902a-209a62fd9350 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:28.875790 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9030f82-72ea-4056-9cd1-66d7537b3040 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:28.898748 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc6a94-2515-45b3-acdb-6a7e7e57fe7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:28.900281 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc6a94-2515-45b3-acdb-6a7e7e57fe7d None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:28.900728 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc6a94-2515-45b3-acdb-6a7e7e57fe7d None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:28.901148 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc6a94-2515-45b3-acdb-6a7e7e57fe7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:28.908858 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acc6a94-2515-45b3-acdb-6a7e7e57fe7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:28.910535 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acc6a94-2515-45b3-acdb-6a7e7e57fe7d None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:28.915221 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98994d9-849f-4a23-8716-645454d6698f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:28.916233 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98994d9-849f-4a23-8716-645454d6698f None admin] REQUEST_METHOD: `PUT` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:28.916601 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98994d9-849f-4a23-8716-645454d6698f None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:28.917011 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98994d9-849f-4a23-8716-645454d6698f None admin] PATH_INFO: `/v3/projects/93f20f89d0fc4bbf9cf557dd1e14d98d/users/8688d3d1cf62416da18c3ffb0b79ec54/roles/1884e658df064cc2a232687c678d8618` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:28.927102 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-2acc6a94-2515-45b3-acdb-6a7e7e57fe7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:45:28.927102 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:28.927102 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:28.927102 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:28.927102 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:28.927102 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:28.927102 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:28.927102 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:28.927102 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:28.927102 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:28.927102 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:28.927102 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:28.927102 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:45:28.927102 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:45:28.927102 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:45:28.928249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:45:28.928249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:28.928249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:28.928249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:28.928249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:28.928249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:28.928249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:28.928249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:28.928249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:28.928249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:28.928249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:28.928249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:28.928249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:28.928249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:28.928249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:28.928249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:28.928249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:28.929336 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:45:28.929336 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:45:28.929336 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:45:28.929336 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:45:28.929336 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:45:28.929336 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:45:28.929336 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:45:28.929336 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:28.931712 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 304/604] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:45:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:28.933201 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b5923-8607-4df6-bbe0-26339e911073 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:28.933652 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b5923-8607-4df6-bbe0-26339e911073 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:28.934070 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b5923-8607-4df6-bbe0-26339e911073 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:28.935765 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 305/605] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:45:28.941224 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0bd40a-122a-46e4-9429-8821c7d921cf None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:28.941517 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0bd40a-122a-46e4-9429-8821c7d921cf None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:28.941796 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0bd40a-122a-46e4-9429-8821c7d921cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:28.943034 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98994d9-849f-4a23-8716-645454d6698f None admin] RBAC: Authorizing `identity:create_grant(project_id=93f20f89d0fc4bbf9cf557dd1e14d98d, user_id=8688d3d1cf62416da18c3ffb0b79ec54, role_id=1884e658df064cc2a232687c678d8618)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:28.946022 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98994d9-849f-4a23-8716-645454d6698f None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:28.959199 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-fa0bd40a-122a-46e4-9429-8821c7d921cf None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:28.960553 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-fa0bd40a-122a-46e4-9429-8821c7d921cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:29.033827 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 306/606] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:45:29.035104 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0bd40a-122a-46e4-9429-8821c7d921cf None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:29.055606 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 301/607] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:45:28 2022] PUT /identity/v3/projects/93f20f89d0fc4bbf9cf557dd1e14d98d/users/8688d3d1cf62416da18c3ffb0b79ec54/roles/1884e658df064cc2a232687c678d8618 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:45:29.063552 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98994d9-849f-4a23-8716-645454d6698f None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:29.071826 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:29.210689 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:29.248034 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0bd40a-122a-46e4-9429-8821c7d921cf None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:29.266926 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98994d9-849f-4a23-8716-645454d6698f None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:29.301619 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6136d076-5291-4859-8c69-cf07a3bf808f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:29.302617 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136d076-5291-4859-8c69-cf07a3bf808f None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:29.302911 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136d076-5291-4859-8c69-cf07a3bf808f None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:29.303195 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136d076-5291-4859-8c69-cf07a3bf808f None admin] PATH_INFO: `/v3/projects` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:29.304705 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6136d076-5291-4859-8c69-cf07a3bf808f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:29.305035 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6136d076-5291-4859-8c69-cf07a3bf808f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:29.306544 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6136d076-5291-4859-8c69-cf07a3bf808f None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:29.318914 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50816433-1d90-4d5e-b55b-453dbbf19527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:29.319972 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50816433-1d90-4d5e-b55b-453dbbf19527 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:29.320265 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50816433-1d90-4d5e-b55b-453dbbf19527 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:29.320550 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50816433-1d90-4d5e-b55b-453dbbf19527 None admin] PATH_INFO: `/v3/roles/service` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:29.322022 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 307/608] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:45:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:29.329106 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6136d076-5291-4859-8c69-cf07a3bf808f None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:29.332688 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50816433-1d90-4d5e-b55b-453dbbf19527 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:45:29.341679 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-50816433-1d90-4d5e-b55b-453dbbf19527 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:45:29.341679 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:29.341679 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:29.341679 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:29.341679 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:29.341679 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:29.341679 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:29.341679 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:29.341679 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:29.341679 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:29.341679 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:29.341679 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:29.341679 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:45:29.341679 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:45:29.341679 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:45:29.341679 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:45:29.342833 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:45:29.342833 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:45:29.342833 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:45:29.342833 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:45:29.342833 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:29.342833 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:29.342833 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:29.342833 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:29.342833 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:29.342833 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:29.342833 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:29.342833 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:29.342833 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:29.342833 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:29.342833 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:29.342833 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:29.343739 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:29.343739 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:29.343739 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:29.343739 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:29.343739 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:45:29.343739 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:45:29.343739 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:45:29.343739 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:45:29.343739 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:45:29.343739 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:45:29.343739 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:45:29.343739 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:29.343739 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 302/609] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:45:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:45:29.349968 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50816433-1d90-4d5e-b55b-453dbbf19527 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:29.453689 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:29.497731 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6136d076-5291-4859-8c69-cf07a3bf808f None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:29.568884 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7647e-3e87-4694-9bfc-084819120c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:29.570044 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50816433-1d90-4d5e-b55b-453dbbf19527 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:29.570206 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7647e-3e87-4694-9bfc-084819120c27 None admin] REQUEST_METHOD: `PUT` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:29.570206 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7647e-3e87-4694-9bfc-084819120c27 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:29.570380 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7647e-3e87-4694-9bfc-084819120c27 None admin] PATH_INFO: `/v3/projects/93f20f89d0fc4bbf9cf557dd1e14d98d/users/b59ded30d64d4eeca95c949259faf5ae/roles/1884e658df064cc2a232687c678d8618` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:29.599224 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b7647e-3e87-4694-9bfc-084819120c27 None admin] RBAC: Authorizing `identity:create_grant(project_id=93f20f89d0fc4bbf9cf557dd1e14d98d, user_id=b59ded30d64d4eeca95c949259faf5ae, role_id=1884e658df064cc2a232687c678d8618)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:29.601290 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b7647e-3e87-4694-9bfc-084819120c27 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:29.619122 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:29.631042 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d1a02-2cf7-487b-8bfd-c46d4c3ad25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:29.631951 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d1a02-2cf7-487b-8bfd-c46d4c3ad25a None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:29.632537 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d1a02-2cf7-487b-8bfd-c46d4c3ad25a None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:29.632633 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d1a02-2cf7-487b-8bfd-c46d4c3ad25a None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:29.633370 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d1a02-2cf7-487b-8bfd-c46d4c3ad25a None admin] RBAC: Adding query filter params (name=service) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:29.633686 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d1a02-2cf7-487b-8bfd-c46d4c3ad25a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:29.635126 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d1a02-2cf7-487b-8bfd-c46d4c3ad25a None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:29.644888 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 303/610] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:45:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:29.650471 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d1a02-2cf7-487b-8bfd-c46d4c3ad25a None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:29.683054 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 308/611] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:45:29 2022] PUT /identity/v3/projects/93f20f89d0fc4bbf9cf557dd1e14d98d/users/b59ded30d64d4eeca95c949259faf5ae/roles/1884e658df064cc2a232687c678d8618 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:45:29.716649 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb6909-51c9-4c5b-ae94-d466845445bd None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:29.716649 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb6909-51c9-4c5b-ae94-d466845445bd None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:29.716649 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb6909-51c9-4c5b-ae94-d466845445bd None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:29.717391 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 309/612] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:45:29.723810 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e7f9a-2d63-4e55-81d4-b38bb5523de7 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:29.724453 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e7f9a-2d63-4e55-81d4-b38bb5523de7 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:29.724970 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e7f9a-2d63-4e55-81d4-b38bb5523de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:29.766191 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-184e7f9a-2d63-4e55-81d4-b38bb5523de7 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:29.767794 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-184e7f9a-2d63-4e55-81d4-b38bb5523de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:29.776128 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d1a02-2cf7-487b-8bfd-c46d4c3ad25a None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:29.818001 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c3722-3acd-456e-b84f-ee903495aa56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:29.818877 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c3722-3acd-456e-b84f-ee903495aa56 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:29.820380 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c3722-3acd-456e-b84f-ee903495aa56 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:29.820380 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c3722-3acd-456e-b84f-ee903495aa56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:29.833651 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338c3722-3acd-456e-b84f-ee903495aa56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:29.835988 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338c3722-3acd-456e-b84f-ee903495aa56 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:29.858192 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-338c3722-3acd-456e-b84f-ee903495aa56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:29.858192 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:29.858192 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:29.858192 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:29.858192 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:29.858192 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:29.858192 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:29.858192 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:29.858192 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:29.858192 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:29.858192 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:29.858192 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:29.858192 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:29.858192 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:29.858192 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:29.859233 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:29.859233 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:29.859233 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:29.859233 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:29.859233 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:29.859233 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:29.859233 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:29.859233 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:29.859233 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:29.859233 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:29.859233 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:29.859233 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:29.859233 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:29.859233 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:29.859233 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:29.859233 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:29.859233 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:29.860198 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:29.860198 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:29.860198 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:29.860198 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:29.860198 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 304/613] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:45:29.866493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c3722-3acd-456e-b84f-ee903495aa56 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:29.945612 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 310/614] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:45:29.947325 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:29.973502 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e7f9a-2d63-4e55-81d4-b38bb5523de7 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:30.037642 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c3722-3acd-456e-b84f-ee903495aa56 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:30.056701 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:30.086955 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155718d-8e7e-4c86-9b9f-b0580a7d666f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:30.087994 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155718d-8e7e-4c86-9b9f-b0580a7d666f None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:30.088508 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155718d-8e7e-4c86-9b9f-b0580a7d666f None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:30.091320 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155718d-8e7e-4c86-9b9f-b0580a7d666f None admin] PATH_INFO: `/v3/domains` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:30.092324 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155718d-8e7e-4c86-9b9f-b0580a7d666f None admin] RBAC: Adding query filter params (name=Default) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:30.092874 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155718d-8e7e-4c86-9b9f-b0580a7d666f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:30.095575 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155718d-8e7e-4c86-9b9f-b0580a7d666f None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:30.122677 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 305/615] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:45:30.128337 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155718d-8e7e-4c86-9b9f-b0580a7d666f None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:30.152754 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e7f9a-2d63-4e55-81d4-b38bb5523de7 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:30.204813 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b592c83a-7c1e-4b82-8ebf-7f34fe316d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:30.206095 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592c83a-7c1e-4b82-8ebf-7f34fe316d0a None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:30.214394 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592c83a-7c1e-4b82-8ebf-7f34fe316d0a None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:30.215110 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592c83a-7c1e-4b82-8ebf-7f34fe316d0a None admin] PATH_INFO: `/v3/roles/service` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:30.236150 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b592c83a-7c1e-4b82-8ebf-7f34fe316d0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:45:30.250490 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-b592c83a-7c1e-4b82-8ebf-7f34fe316d0a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:45:30.250490 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:30.250490 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:30.250490 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:30.250490 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:30.250490 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:30.250490 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:30.250490 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:30.250490 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:30.250490 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:30.250490 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:30.250490 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:30.250490 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:45:30.250490 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:45:30.250490 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:45:30.250490 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:45:30.251601 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:45:30.251601 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:45:30.251601 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:45:30.251601 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:45:30.251601 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:30.251601 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:30.251601 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:30.251601 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:30.251601 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:30.251601 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:30.251601 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:30.251601 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:30.251601 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:30.251601 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:30.251601 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:30.251601 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:30.252533 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:30.252533 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:30.252533 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:30.252533 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:30.252533 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:45:30.252533 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:45:30.252533 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:45:30.252533 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:45:30.252533 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:45:30.252533 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:45:30.252533 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:45:30.252533 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:30.253518 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 311/616] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:45:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:30.259748 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b592c83a-7c1e-4b82-8ebf-7f34fe316d0a None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:30.264263 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:30.268172 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155718d-8e7e-4c86-9b9f-b0580a7d666f None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:30.304328 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccfb8d9-a7bf-4c95-bcf3-5a5a5f218d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:30.305135 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccfb8d9-a7bf-4c95-bcf3-5a5a5f218d62 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:30.305421 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccfb8d9-a7bf-4c95-bcf3-5a5a5f218d62 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:30.305699 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccfb8d9-a7bf-4c95-bcf3-5a5a5f218d62 None admin] PATH_INFO: `/v3/users/swift` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:30.322842 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccfb8d9-a7bf-4c95-bcf3-5a5a5f218d62 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:30.324306 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccfb8d9-a7bf-4c95-bcf3-5a5a5f218d62 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:30.345244 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-8ccfb8d9-a7bf-4c95-bcf3-5a5a5f218d62 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 21:45:30.345244 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:30.345244 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:30.345244 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:30.345244 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:30.345244 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:30.345244 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:30.345244 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:30.345244 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:30.345244 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:30.345244 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:30.345244 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:30.345244 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:45:30.345244 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:45:30.345244 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:45:30.345244 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:45:30.346329 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:30.346329 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:30.346329 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:45:30.346329 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:45:30.346329 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:45:30.346329 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:45:30.346329 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:30.346329 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:30.346329 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:30.346329 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:30.346329 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:30.346329 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:30.346329 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:30.346329 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:30.346329 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:30.346329 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:30.346329 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:30.346329 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:30.348826 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:30.348826 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:30.348826 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:45:30.348826 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:45:30.348826 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:45:30.348826 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:45:30.348826 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:45:30.348826 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:45:30.348826 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 21:45:30.348826 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:30.348826 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 306/617] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:45:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:30.356978 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccfb8d9-a7bf-4c95-bcf3-5a5a5f218d62 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:30.424101 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b592c83a-7c1e-4b82-8ebf-7f34fe316d0a None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:30.461291 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:30.497065 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a3ac4-64e9-4e73-9cca-32967320956a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:30.497754 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a3ac4-64e9-4e73-9cca-32967320956a None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:30.498089 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a3ac4-64e9-4e73-9cca-32967320956a None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:30.498401 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a3ac4-64e9-4e73-9cca-32967320956a None admin] PATH_INFO: `/v3/roles` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:30.499169 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98a3ac4-64e9-4e73-9cca-32967320956a None admin] RBAC: Adding query filter params (name=service) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:30.499478 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98a3ac4-64e9-4e73-9cca-32967320956a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:30.500866 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98a3ac4-64e9-4e73-9cca-32967320956a None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:30.518613 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 312/618] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:45:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:30.520862 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccfb8d9-a7bf-4c95-bcf3-5a5a5f218d62 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:30.525368 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a3ac4-64e9-4e73-9cca-32967320956a None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:30.585648 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1fd1fe-61b1-4692-9b2b-739be6d2ed0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:30.586590 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1fd1fe-61b1-4692-9b2b-739be6d2ed0d None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:30.586889 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1fd1fe-61b1-4692-9b2b-739be6d2ed0d None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:30.587175 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1fd1fe-61b1-4692-9b2b-739be6d2ed0d None admin] PATH_INFO: `/v3/users` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:30.588049 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1fd1fe-61b1-4692-9b2b-739be6d2ed0d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:30.588365 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1fd1fe-61b1-4692-9b2b-739be6d2ed0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:30.589968 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1fd1fe-61b1-4692-9b2b-739be6d2ed0d None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:30.610074 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 307/619] 10.222.0.30 () {56 vars in 1135 bytes} [Tue Jul 5 21:45:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:30.615505 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1fd1fe-61b1-4692-9b2b-739be6d2ed0d None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:30.634552 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:30.700226 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a3ac4-64e9-4e73-9cca-32967320956a None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:30.722006 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1fd1fe-61b1-4692-9b2b-739be6d2ed0d None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:30.738744 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc04a4e8-117a-4840-ad27-0c822160cfd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:30.739554 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04a4e8-117a-4840-ad27-0c822160cfd4 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:30.739847 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04a4e8-117a-4840-ad27-0c822160cfd4 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:30.740234 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04a4e8-117a-4840-ad27-0c822160cfd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:30.753058 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc04a4e8-117a-4840-ad27-0c822160cfd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:30.754794 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc04a4e8-117a-4840-ad27-0c822160cfd4 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:30.758900 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8edf13-e189-433d-ae89-6afe16b19ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:30.759711 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8edf13-e189-433d-ae89-6afe16b19ece None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:30.760000 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8edf13-e189-433d-ae89-6afe16b19ece None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:30.760279 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8edf13-e189-433d-ae89-6afe16b19ece None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:30.770503 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8edf13-e189-433d-ae89-6afe16b19ece None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:30.771945 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8edf13-e189-433d-ae89-6afe16b19ece None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:30.774692 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-fc04a4e8-117a-4840-ad27-0c822160cfd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:30.774692 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:30.774692 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:30.774692 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:30.774692 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:30.774692 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:30.774692 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:30.774692 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:30.774692 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:30.774692 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:30.774692 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:30.774692 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:30.774692 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:30.774692 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:30.774692 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:30.775636 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:30.775636 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:30.775636 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:30.775636 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:30.775636 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:30.775636 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:30.775636 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:30.775636 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:30.775636 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:30.775636 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:30.775636 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:30.775636 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:30.775636 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:30.775636 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:30.775636 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:30.775636 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:30.775636 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:30.777288 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:30.777288 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:30.777288 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:30.777288 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:30.777288 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 313/620] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:30.779834 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38df6c0-93e0-413a-8115-02f99c1fdcb4 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:30.779834 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38df6c0-93e0-413a-8115-02f99c1fdcb4 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:30.779834 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38df6c0-93e0-413a-8115-02f99c1fdcb4 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:30.784705 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 314/621] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:45:30.785455 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38df6c0-93e0-413a-8115-02f99c1fdcb4 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:30.791129 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-da8edf13-e189-433d-ae89-6afe16b19ece None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:30.791129 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:30.791129 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:30.791129 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:30.791129 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:30.791129 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:30.791129 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:30.791129 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:30.791129 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:30.791129 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:30.791129 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:30.791129 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:30.791129 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:30.791129 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:30.791129 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:30.793229 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:30.793229 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:30.793229 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:30.793229 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:30.793229 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:30.793229 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:30.793229 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:30.793229 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:30.793229 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:30.793229 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:30.793229 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:30.793229 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:30.793229 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:30.793229 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:30.793229 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:30.793229 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:30.793229 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:30.795534 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:30.795534 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:30.795534 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:30.795534 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:30.795534 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 308/622] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:30.795534 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d881ff-5af5-441f-839d-3a7d8a2d2497 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:30.795534 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d881ff-5af5-441f-839d-3a7d8a2d2497 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:30.798967 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d881ff-5af5-441f-839d-3a7d8a2d2497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:30.816282 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-f2d881ff-5af5-441f-839d-3a7d8a2d2497 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:30.817495 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-f2d881ff-5af5-441f-839d-3a7d8a2d2497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:30.823565 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:30.882710 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:30.888118 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 309/623] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:45:30.888945 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d881ff-5af5-441f-839d-3a7d8a2d2497 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:30.930690 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38df6c0-93e0-413a-8115-02f99c1fdcb4 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:30.979866 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda0152-cdf5-4a77-a3a5-6161049ae98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:30.980814 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda0152-cdf5-4a77-a3a5-6161049ae98a None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:30.981465 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda0152-cdf5-4a77-a3a5-6161049ae98a None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:30.981756 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda0152-cdf5-4a77-a3a5-6161049ae98a None admin] PATH_INFO: `/v3/domains` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:30.982540 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda0152-cdf5-4a77-a3a5-6161049ae98a None admin] RBAC: Adding query filter params (name=Default) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:30.982855 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda0152-cdf5-4a77-a3a5-6161049ae98a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:30.984912 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda0152-cdf5-4a77-a3a5-6161049ae98a None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:30.997986 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d881ff-5af5-441f-839d-3a7d8a2d2497 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:31.002631 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 315/624] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:31.003599 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda0152-cdf5-4a77-a3a5-6161049ae98a None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:31.035579 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde360a-a088-44e3-b8c8-01466aaf0e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:31.036257 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde360a-a088-44e3-b8c8-01466aaf0e45 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:31.036548 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde360a-a088-44e3-b8c8-01466aaf0e45 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:31.036876 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde360a-a088-44e3-b8c8-01466aaf0e45 None admin] PATH_INFO: `/v3/domains` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:31.037693 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde360a-a088-44e3-b8c8-01466aaf0e45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:31.038591 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde360a-a088-44e3-b8c8-01466aaf0e45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:31.040103 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde360a-a088-44e3-b8c8-01466aaf0e45 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:31.057247 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 310/625] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:31.058191 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde360a-a088-44e3-b8c8-01466aaf0e45 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:31.124739 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:31.134620 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda0152-cdf5-4a77-a3a5-6161049ae98a None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:31.142687 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:31.172190 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40237f57-d99d-48a1-a45a-2ae506f6cd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:31.173342 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40237f57-d99d-48a1-a45a-2ae506f6cd8e None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:31.173843 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40237f57-d99d-48a1-a45a-2ae506f6cd8e None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:31.174315 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40237f57-d99d-48a1-a45a-2ae506f6cd8e None admin] PATH_INFO: `/v3/roles/service` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:31.186656 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40237f57-d99d-48a1-a45a-2ae506f6cd8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:45:31.194973 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-40237f57-d99d-48a1-a45a-2ae506f6cd8e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:45:31.194973 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:31.194973 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:31.194973 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:31.194973 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:31.194973 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:31.194973 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:31.194973 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:31.194973 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:31.194973 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:31.194973 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:31.194973 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:31.194973 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:45:31.194973 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:45:31.194973 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:45:31.194973 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:45:31.196184 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:45:31.196184 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:45:31.196184 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:45:31.196184 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:45:31.196184 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:31.196184 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:31.196184 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:31.196184 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:31.196184 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:31.196184 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:31.196184 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:31.196184 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:31.196184 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:31.196184 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:31.196184 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:31.196184 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:31.197219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:31.197219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:31.197219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:31.197219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:31.197219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:45:31.197219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:45:31.197219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:45:31.197219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:45:31.197219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:45:31.197219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:45:31.197219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:45:31.197219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:31.199818 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 316/626] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:45:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:31.200820 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40237f57-d99d-48a1-a45a-2ae506f6cd8e None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:31.209100 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde360a-a088-44e3-b8c8-01466aaf0e45 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:31.247542 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd246d9-eb13-4afd-83cd-89e594dd859a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:31.248702 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd246d9-eb13-4afd-83cd-89e594dd859a None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:31.249222 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd246d9-eb13-4afd-83cd-89e594dd859a None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:31.249740 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd246d9-eb13-4afd-83cd-89e594dd859a None admin] PATH_INFO: `/v3/users/nova` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:31.260853 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd246d9-eb13-4afd-83cd-89e594dd859a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:31.263100 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd246d9-eb13-4afd-83cd-89e594dd859a None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:31.284088 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-9bd246d9-eb13-4afd-83cd-89e594dd859a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:45:31.284088 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:31.284088 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:31.284088 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:31.284088 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:31.284088 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:31.284088 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:31.284088 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:31.284088 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:31.284088 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:31.284088 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:31.284088 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:31.284088 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:45:31.284088 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:45:31.284088 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:45:31.284088 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:45:31.285553 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:31.285553 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:31.285553 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:45:31.285553 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:45:31.285553 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:45:31.285553 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:45:31.285553 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:31.285553 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:31.285553 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:31.285553 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:31.285553 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:31.285553 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:31.285553 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:31.285553 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:31.285553 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:31.285553 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:31.285553 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:31.285553 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:31.286614 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:31.286614 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:31.286614 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:45:31.286614 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:45:31.286614 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:45:31.286614 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:45:31.286614 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:45:31.286614 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:45:31.286614 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:45:31.286614 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:31.286614 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 311/627] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Jul 5 21:45:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:31.286614 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd246d9-eb13-4afd-83cd-89e594dd859a None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:31.333600 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40237f57-d99d-48a1-a45a-2ae506f6cd8e None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:31.386596 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d896b2-0aa8-4fe2-b844-68cd0676c435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:31.388225 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d896b2-0aa8-4fe2-b844-68cd0676c435 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:31.389142 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d896b2-0aa8-4fe2-b844-68cd0676c435 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:31.389915 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d896b2-0aa8-4fe2-b844-68cd0676c435 None admin] PATH_INFO: `/v3/projects/service` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:31.400604 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d896b2-0aa8-4fe2-b844-68cd0676c435 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:31.403060 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d896b2-0aa8-4fe2-b844-68cd0676c435 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:31.411679 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd246d9-eb13-4afd-83cd-89e594dd859a None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:31.424716 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-d5d896b2-0aa8-4fe2-b844-68cd0676c435 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:45:31.424716 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:31.424716 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:31.424716 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:31.424716 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:31.424716 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:31.424716 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:31.424716 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:31.424716 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:31.424716 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:31.424716 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:31.424716 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:31.424716 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:45:31.424716 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:45:31.424716 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:45:31.426040 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:45:31.426040 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:31.426040 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:31.426040 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:31.426040 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:31.426040 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:31.426040 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:31.426040 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:31.426040 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:31.426040 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:31.426040 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:31.426040 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:31.426040 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:31.426040 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:31.426040 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:31.426040 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:31.426040 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:31.427067 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:45:31.427067 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:45:31.427067 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:45:31.427067 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:45:31.427067 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:45:31.427067 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:45:31.427067 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:45:31.427067 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:31.430202 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 317/628] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:45:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:31.431281 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d896b2-0aa8-4fe2-b844-68cd0676c435 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:31.438374 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:31.459670 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735100a-320a-44bb-89af-8c389f8c8289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:31.465917 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735100a-320a-44bb-89af-8c389f8c8289 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:31.465917 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735100a-320a-44bb-89af-8c389f8c8289 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:31.465917 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735100a-320a-44bb-89af-8c389f8c8289 None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:31.466204 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:31.466307 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3735100a-320a-44bb-89af-8c389f8c8289 None admin] RBAC: Adding query filter params (name=service) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:31.466307 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3735100a-320a-44bb-89af-8c389f8c8289 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:31.466307 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3735100a-320a-44bb-89af-8c389f8c8289 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:31.477708 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 312/629] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:45:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:31.477708 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735100a-320a-44bb-89af-8c389f8c8289 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:31.568964 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d896b2-0aa8-4fe2-b844-68cd0676c435 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:31.585547 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735100a-320a-44bb-89af-8c389f8c8289 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:31.608480 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1818d274-be8e-416d-94c6-40f695c1b377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:31.609160 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818d274-be8e-416d-94c6-40f695c1b377 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:31.609449 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818d274-be8e-416d-94c6-40f695c1b377 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:31.609730 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818d274-be8e-416d-94c6-40f695c1b377 None admin] PATH_INFO: `/v3/users` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:31.610614 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1818d274-be8e-416d-94c6-40f695c1b377 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:31.610935 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1818d274-be8e-416d-94c6-40f695c1b377 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:31.612385 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1818d274-be8e-416d-94c6-40f695c1b377 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:31.623058 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da017ab6-1e7b-47ec-af4e-1bf40c657794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:31.624557 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da017ab6-1e7b-47ec-af4e-1bf40c657794 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:31.624850 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da017ab6-1e7b-47ec-af4e-1bf40c657794 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:31.625133 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da017ab6-1e7b-47ec-af4e-1bf40c657794 None admin] PATH_INFO: `/v3/projects` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:31.625937 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da017ab6-1e7b-47ec-af4e-1bf40c657794 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:31.626284 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da017ab6-1e7b-47ec-af4e-1bf40c657794 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:31.627727 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da017ab6-1e7b-47ec-af4e-1bf40c657794 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:31.637530 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 318/630] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Jul 5 21:45:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:31.637530 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1818d274-be8e-416d-94c6-40f695c1b377 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:31.641689 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 313/631] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:45:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:31.642636 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44a5bf-9fa0-4f82-ba16-e8f92347414d None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:31.642997 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44a5bf-9fa0-4f82-ba16-e8f92347414d None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:31.643350 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44a5bf-9fa0-4f82-ba16-e8f92347414d None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:31.649190 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 314/632] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:45:31.649190 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44a5bf-9fa0-4f82-ba16-e8f92347414d None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:31.695942 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:31.716151 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:31.748855 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1818d274-be8e-416d-94c6-40f695c1b377 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:31.766204 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44a5bf-9fa0-4f82-ba16-e8f92347414d None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:31.788808 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e9b77-fca4-4dee-bf71-ce7971a5abd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:31.789713 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e9b77-fca4-4dee-bf71-ce7971a5abd3 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:31.789999 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e9b77-fca4-4dee-bf71-ce7971a5abd3 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:31.790306 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e9b77-fca4-4dee-bf71-ce7971a5abd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:31.801332 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e9b77-fca4-4dee-bf71-ce7971a5abd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:31.802879 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e9b77-fca4-4dee-bf71-ce7971a5abd3 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:31.805268 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1391ae8-2255-41ad-b835-2f0870efa3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:31.806258 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1391ae8-2255-41ad-b835-2f0870efa3c0 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:31.806559 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1391ae8-2255-41ad-b835-2f0870efa3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:31.806849 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1391ae8-2255-41ad-b835-2f0870efa3c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:31.820811 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-352e9b77-fca4-4dee-bf71-ce7971a5abd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:31.820811 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:31.820811 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:31.820811 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:31.820811 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:31.820811 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:31.820811 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:31.820811 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:31.820811 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:31.820811 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:31.820811 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:31.820811 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:31.820811 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:31.820811 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:31.820811 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:31.821991 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:31.821991 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:31.821991 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:31.821991 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:31.821991 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:31.821991 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:31.821991 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:31.821991 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:31.821991 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:31.821991 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:31.821991 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:31.821991 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:31.821991 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:31.821991 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:31.821991 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:31.821991 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:31.821991 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:31.823191 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:31.823191 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:31.823191 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:31.823191 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:31.826564 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 319/633] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:31.827446 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e9b77-fca4-4dee-bf71-ce7971a5abd3 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:31.888423 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1391ae8-2255-41ad-b835-2f0870efa3c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:31.889998 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1391ae8-2255-41ad-b835-2f0870efa3c0 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:31.933375 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:31.933814 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e9b77-fca4-4dee-bf71-ce7971a5abd3 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:31.958275 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:31.970334 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923323c-2c46-479d-9628-fad40b98a47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:31.971240 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923323c-2c46-479d-9628-fad40b98a47a None admin] REQUEST_METHOD: `PUT` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:31.971562 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923323c-2c46-479d-9628-fad40b98a47a None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:31.971926 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923323c-2c46-479d-9628-fad40b98a47a None admin] PATH_INFO: `/v3/projects/93f20f89d0fc4bbf9cf557dd1e14d98d/users/ba028a9695364d54a73b01c986300344/roles/1884e658df064cc2a232687c678d8618` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:31.988308 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8923323c-2c46-479d-9628-fad40b98a47a None admin] RBAC: Authorizing `identity:create_grant(project_id=93f20f89d0fc4bbf9cf557dd1e14d98d, user_id=ba028a9695364d54a73b01c986300344, role_id=1884e658df064cc2a232687c678d8618)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:31.989846 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8923323c-2c46-479d-9628-fad40b98a47a None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:32.001441 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 315/634] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:45:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:45:32.002976 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830476f-77de-41b4-b1b9-4c794ef2ad29 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:32.003301 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830476f-77de-41b4-b1b9-4c794ef2ad29 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:32.003598 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830476f-77de-41b4-b1b9-4c794ef2ad29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:32.020892 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-7830476f-77de-41b4-b1b9-4c794ef2ad29 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:32.022759 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-7830476f-77de-41b4-b1b9-4c794ef2ad29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:32.060096 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 320/635] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:45:31 2022] PUT /identity/v3/projects/93f20f89d0fc4bbf9cf557dd1e14d98d/users/ba028a9695364d54a73b01c986300344/roles/1884e658df064cc2a232687c678d8618 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:45:32.061362 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923323c-2c46-479d-9628-fad40b98a47a None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:32.105009 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 316/636] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:45:32.106586 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7830476f-77de-41b4-b1b9-4c794ef2ad29 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:32.186670 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923323c-2c46-479d-9628-fad40b98a47a None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:32.190236 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:32.229153 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c790043-d5b5-4031-b6a2-e63ea3a51445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:32.229834 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c790043-d5b5-4031-b6a2-e63ea3a51445 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:32.230145 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c790043-d5b5-4031-b6a2-e63ea3a51445 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:32.230447 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c790043-d5b5-4031-b6a2-e63ea3a51445 None admin] PATH_INFO: `/v3/domains` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:32.231189 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c790043-d5b5-4031-b6a2-e63ea3a51445 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:32.231503 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c790043-d5b5-4031-b6a2-e63ea3a51445 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:32.232883 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c790043-d5b5-4031-b6a2-e63ea3a51445 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:32.235727 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7830476f-77de-41b4-b1b9-4c794ef2ad29 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:32.245612 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 321/637] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:32.246967 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ce45a-483c-4d5c-9727-8bca92b64aca None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:32.247262 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ce45a-483c-4d5c-9727-8bca92b64aca None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:32.247546 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ce45a-483c-4d5c-9727-8bca92b64aca None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:32.249054 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 322/638] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:45:32.249766 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ce45a-483c-4d5c-9727-8bca92b64aca None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:32.276516 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f00bb5-9356-45cf-a64e-415c81e25ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:32.277334 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f00bb5-9356-45cf-a64e-415c81e25ca6 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:32.277631 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f00bb5-9356-45cf-a64e-415c81e25ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:32.277923 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f00bb5-9356-45cf-a64e-415c81e25ca6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:32.287654 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:32.288578 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f00bb5-9356-45cf-a64e-415c81e25ca6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:32.290039 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f00bb5-9356-45cf-a64e-415c81e25ca6 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:32.308253 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-d7f00bb5-9356-45cf-a64e-415c81e25ca6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:32.308253 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:32.308253 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:32.308253 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:32.308253 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:32.308253 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:32.308253 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:32.308253 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:32.308253 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:32.308253 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:32.308253 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:32.308253 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:32.308253 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:32.308253 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:32.308253 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:32.309275 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:32.309275 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:32.309275 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:32.309275 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:32.309275 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:32.309275 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:32.309275 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:32.309275 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:32.309275 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:32.309275 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:32.309275 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:32.309275 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:32.309275 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:32.309275 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:32.309275 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:32.309275 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:32.309275 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:32.310659 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:32.310659 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:32.310659 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:32.310659 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:32.310659 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 317/639] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:32.314710 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f00bb5-9356-45cf-a64e-415c81e25ca6 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:32.371136 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ce45a-483c-4d5c-9727-8bca92b64aca None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:32.414723 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a69148-de60-41c2-851c-133ebc4157d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:32.415480 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a69148-de60-41c2-851c-133ebc4157d3 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:32.415770 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a69148-de60-41c2-851c-133ebc4157d3 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:32.416225 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a69148-de60-41c2-851c-133ebc4157d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:32.422047 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f00bb5-9356-45cf-a64e-415c81e25ca6 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:32.427686 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a69148-de60-41c2-851c-133ebc4157d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:45:32.435761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-b3a69148-de60-41c2-851c-133ebc4157d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:45:32.435761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:32.435761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:32.435761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:32.435761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:32.435761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:32.435761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:32.435761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:32.435761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:32.435761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:32.435761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:32.435761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:32.435761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:45:32.435761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:45:32.435761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:45:32.435761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:45:32.437034 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:45:32.437034 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:45:32.437034 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:45:32.437034 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:45:32.437034 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:32.437034 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:32.437034 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:32.437034 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:32.437034 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:32.437034 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:32.437034 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:32.437034 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:32.437034 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:32.437034 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:32.437034 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:32.437034 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:32.437963 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:32.437963 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:32.437963 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:32.437963 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:32.437963 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:45:32.437963 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:45:32.437963 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:45:32.437963 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:45:32.437963 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:45:32.437963 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:45:32.437963 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:45:32.437963 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:32.437963 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 323/640] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:45:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:32.438741 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507231f-cd44-4a03-84af-db783ca2063c None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:32.438741 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507231f-cd44-4a03-84af-db783ca2063c None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:32.438741 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507231f-cd44-4a03-84af-db783ca2063c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:32.452513 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:32.455659 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-8507231f-cd44-4a03-84af-db783ca2063c None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:32.456852 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-8507231f-cd44-4a03-84af-db783ca2063c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:32.465843 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb80e3-8f13-4255-b398-2f4865ef4ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:32.466687 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb80e3-8f13-4255-b398-2f4865ef4ba1 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:32.466983 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb80e3-8f13-4255-b398-2f4865ef4ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:32.467273 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb80e3-8f13-4255-b398-2f4865ef4ba1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:32.477018 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fb80e3-8f13-4255-b398-2f4865ef4ba1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:32.478850 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fb80e3-8f13-4255-b398-2f4865ef4ba1 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:32.495807 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-b3fb80e3-8f13-4255-b398-2f4865ef4ba1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 21:45:32.495807 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:32.495807 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:32.495807 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:32.495807 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:32.495807 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:32.495807 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:32.495807 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:32.495807 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:32.495807 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:32.495807 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:32.495807 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:32.495807 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:45:32.495807 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:45:32.495807 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:45:32.495807 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:45:32.496885 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:32.496885 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:32.496885 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:45:32.496885 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:45:32.496885 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:45:32.496885 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:45:32.496885 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:32.496885 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:32.496885 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:32.496885 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:32.496885 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:32.496885 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:32.496885 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:32.496885 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:32.496885 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:32.496885 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:32.496885 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:32.496885 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:32.497881 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:32.497881 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:32.497881 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:45:32.497881 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:45:32.497881 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:45:32.497881 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:45:32.497881 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:45:32.497881 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:45:32.497881 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 21:45:32.497881 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:32.497881 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 318/641] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:45:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:32.498546 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb80e3-8f13-4255-b398-2f4865ef4ba1 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:32.534224 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 324/642] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:45:32.535022 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8507231f-cd44-4a03-84af-db783ca2063c None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:32.561298 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:32.620479 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb80e3-8f13-4255-b398-2f4865ef4ba1 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:32.640542 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8507231f-cd44-4a03-84af-db783ca2063c None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:32.658920 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c9955-b21e-49c3-9a31-587a07684c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:32.659526 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c9955-b21e-49c3-9a31-587a07684c77 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:32.659817 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c9955-b21e-49c3-9a31-587a07684c77 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:32.660101 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c9955-b21e-49c3-9a31-587a07684c77 None admin] PATH_INFO: `/v3/domains` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:32.660835 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c9955-b21e-49c3-9a31-587a07684c77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:32.661145 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c9955-b21e-49c3-9a31-587a07684c77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:32.662549 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c9955-b21e-49c3-9a31-587a07684c77 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:32.679459 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 319/643] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:32.679459 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c9955-b21e-49c3-9a31-587a07684c77 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:32.682174 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e223139-5386-4dea-becd-4c9907b34e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:32.682749 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e223139-5386-4dea-becd-4c9907b34e94 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:32.683044 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e223139-5386-4dea-becd-4c9907b34e94 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:32.683333 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e223139-5386-4dea-becd-4c9907b34e94 None admin] PATH_INFO: `/v3/roles` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:32.684103 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e223139-5386-4dea-becd-4c9907b34e94 None admin] RBAC: Adding query filter params (name=service) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:32.684421 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e223139-5386-4dea-becd-4c9907b34e94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:32.685818 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e223139-5386-4dea-becd-4c9907b34e94 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:32.700792 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 325/644] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:45:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:32.700792 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e223139-5386-4dea-becd-4c9907b34e94 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:32.733417 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:32.794070 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:32.796016 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c9955-b21e-49c3-9a31-587a07684c77 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:32.810514 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e223139-5386-4dea-becd-4c9907b34e94 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:32.832070 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ed88d-f599-4d10-b99f-ab92fee21d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:32.832747 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ed88d-f599-4d10-b99f-ab92fee21d21 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:32.833061 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ed88d-f599-4d10-b99f-ab92fee21d21 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:32.833375 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ed88d-f599-4d10-b99f-ab92fee21d21 None admin] PATH_INFO: `/v3/users` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:32.834157 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12ed88d-f599-4d10-b99f-ab92fee21d21 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:32.834481 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12ed88d-f599-4d10-b99f-ab92fee21d21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:32.835969 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12ed88d-f599-4d10-b99f-ab92fee21d21 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:32.846962 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5febd728-924c-4c3f-864e-91eae9b19f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:32.847761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febd728-924c-4c3f-864e-91eae9b19f9a None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:32.848046 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febd728-924c-4c3f-864e-91eae9b19f9a None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:32.848325 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febd728-924c-4c3f-864e-91eae9b19f9a None admin] PATH_INFO: `/v3/roles/service` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:32.857036 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 320/645] 10.222.0.30 () {56 vars in 1137 bytes} [Tue Jul 5 21:45:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:32.857868 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ed88d-f599-4d10-b99f-ab92fee21d21 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:32.864373 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5febd728-924c-4c3f-864e-91eae9b19f9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:45:32.872363 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-5febd728-924c-4c3f-864e-91eae9b19f9a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:45:32.872363 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:32.872363 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:32.872363 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:32.872363 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:32.872363 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:32.872363 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:32.872363 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:32.872363 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:32.872363 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:32.872363 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:32.872363 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:32.872363 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:45:32.872363 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:45:32.872363 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:45:32.872363 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:45:32.873374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:45:32.873374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:45:32.873374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:45:32.873374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:45:32.873374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:32.873374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:32.873374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:32.873374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:32.873374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:32.873374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:32.873374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:32.873374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:32.873374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:32.873374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:32.873374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:32.873374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:32.874317 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:32.874317 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:32.874317 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:32.874317 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:32.874317 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:45:32.874317 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:45:32.874317 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:45:32.874317 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:45:32.874317 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:45:32.874317 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:45:32.874317 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:45:32.874317 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:32.874317 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 326/646] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:45:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:32.875678 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5febd728-924c-4c3f-864e-91eae9b19f9a None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:32.962589 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:32.967212 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ed88d-f599-4d10-b99f-ab92fee21d21 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:32.977195 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5febd728-924c-4c3f-864e-91eae9b19f9a None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:33.002150 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a0774b-bfc4-4baf-8ceb-fc9a28e054f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:33.002958 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0774b-bfc4-4baf-8ceb-fc9a28e054f2 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:33.003259 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0774b-bfc4-4baf-8ceb-fc9a28e054f2 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:33.003520 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0774b-bfc4-4baf-8ceb-fc9a28e054f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:33.011414 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a0774b-bfc4-4baf-8ceb-fc9a28e054f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:33.012284 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac078896-4e04-4d82-af4c-3e8fe5dd35c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:33.012877 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a0774b-bfc4-4baf-8ceb-fc9a28e054f2 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:33.013076 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac078896-4e04-4d82-af4c-3e8fe5dd35c4 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:33.013366 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac078896-4e04-4d82-af4c-3e8fe5dd35c4 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:33.013646 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac078896-4e04-4d82-af4c-3e8fe5dd35c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:33.025095 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac078896-4e04-4d82-af4c-3e8fe5dd35c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:33.026578 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac078896-4e04-4d82-af4c-3e8fe5dd35c4 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:33.026975 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-f6a0774b-bfc4-4baf-8ceb-fc9a28e054f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:45:33.026975 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:33.026975 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:33.026975 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:33.026975 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:33.026975 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:33.026975 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:33.026975 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:33.026975 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:33.026975 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:33.026975 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:33.026975 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:33.026975 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:45:33.026975 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:45:33.026975 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:45:33.027948 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:45:33.027948 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:33.027948 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:33.027948 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:33.027948 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:33.027948 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:33.027948 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:33.027948 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:33.027948 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:33.027948 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:33.027948 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:33.027948 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:33.027948 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:33.027948 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:33.027948 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:33.027948 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:33.027948 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:33.028998 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:45:33.028998 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:45:33.028998 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:45:33.028998 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:45:33.028998 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:45:33.028998 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:45:33.028998 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:45:33.028998 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:33.028998 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 321/647] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:45:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:33.028998 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a0774b-bfc4-4baf-8ceb-fc9a28e054f2 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:33.032324 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:33.047624 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-ac078896-4e04-4d82-af4c-3e8fe5dd35c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:33.047624 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:33.047624 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:33.047624 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:33.047624 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:33.047624 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:33.047624 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:33.047624 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:33.047624 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:33.047624 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:33.047624 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:33.047624 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:33.047624 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:33.047624 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:33.047624 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:33.048647 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:33.048647 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:33.048647 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:33.048647 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:33.048647 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:33.048647 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:33.048647 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:33.048647 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:33.048647 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:33.048647 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:33.048647 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:33.048647 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:33.048647 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:33.048647 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:33.048647 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:33.048647 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:33.048647 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:33.049605 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:33.049605 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:33.049605 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:33.049605 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:33.049605 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 327/648] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:33.049605 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac078896-4e04-4d82-af4c-3e8fe5dd35c4 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:33.143955 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a0774b-bfc4-4baf-8ceb-fc9a28e054f2 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:33.164567 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac078896-4e04-4d82-af4c-3e8fe5dd35c4 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:33.186701 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd14807-8cc9-4bc8-8322-f54ccb51e899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:33.187371 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd14807-8cc9-4bc8-8322-f54ccb51e899 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:33.187920 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd14807-8cc9-4bc8-8322-f54ccb51e899 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:33.188211 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd14807-8cc9-4bc8-8322-f54ccb51e899 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:33.200568 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cac8f9-b5ad-4802-ab01-5010b2200a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:33.201270 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cac8f9-b5ad-4802-ab01-5010b2200a81 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:33.201561 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cac8f9-b5ad-4802-ab01-5010b2200a81 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:33.201849 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cac8f9-b5ad-4802-ab01-5010b2200a81 None admin] PATH_INFO: `/v3/roles` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:33.202686 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cac8f9-b5ad-4802-ab01-5010b2200a81 None admin] RBAC: Adding query filter params (name=service) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:33.203000 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cac8f9-b5ad-4802-ab01-5010b2200a81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:33.204459 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cac8f9-b5ad-4802-ab01-5010b2200a81 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:33.218802 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 328/649] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:45:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:33.218802 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cac8f9-b5ad-4802-ab01-5010b2200a81 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:33.228838 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:33.276158 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd14807-8cc9-4bc8-8322-f54ccb51e899 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:33.277638 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd14807-8cc9-4bc8-8322-f54ccb51e899 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:33.279721 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:33.325465 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cac8f9-b5ad-4802-ab01-5010b2200a81 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:33.367181 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95114f3-3310-46e7-aa4f-2cd02ed26468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:33.368285 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95114f3-3310-46e7-aa4f-2cd02ed26468 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:33.368577 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95114f3-3310-46e7-aa4f-2cd02ed26468 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:33.368861 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95114f3-3310-46e7-aa4f-2cd02ed26468 None admin] PATH_INFO: `/v3/projects` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:33.369660 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95114f3-3310-46e7-aa4f-2cd02ed26468 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:33.369974 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95114f3-3310-46e7-aa4f-2cd02ed26468 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:33.371849 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95114f3-3310-46e7-aa4f-2cd02ed26468 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:33.388295 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 322/650] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:45:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:45:33.388295 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd14807-8cc9-4bc8-8322-f54ccb51e899 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:33.389952 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 329/651] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:45:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:33.390995 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95114f3-3310-46e7-aa4f-2cd02ed26468 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:33.452655 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:33.498198 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd14807-8cc9-4bc8-8322-f54ccb51e899 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:33.502786 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95114f3-3310-46e7-aa4f-2cd02ed26468 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:33.522899 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:33.536004 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8eef28-c02b-4f9d-94e1-746b9f9e08d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:33.536822 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8eef28-c02b-4f9d-94e1-746b9f9e08d3 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:33.537039 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8eef28-c02b-4f9d-94e1-746b9f9e08d3 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:33.537331 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8eef28-c02b-4f9d-94e1-746b9f9e08d3 None admin] PATH_INFO: `/v3/domains` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:33.538417 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8eef28-c02b-4f9d-94e1-746b9f9e08d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:33.538740 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8eef28-c02b-4f9d-94e1-746b9f9e08d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:33.540127 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8eef28-c02b-4f9d-94e1-746b9f9e08d3 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:33.540357 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83db41-704d-4dcd-8f08-600df4a39c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:33.541153 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83db41-704d-4dcd-8f08-600df4a39c84 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:33.541439 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83db41-704d-4dcd-8f08-600df4a39c84 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:33.541724 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83db41-704d-4dcd-8f08-600df4a39c84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:33.557553 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 323/652] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:33.558529 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8eef28-c02b-4f9d-94e1-746b9f9e08d3 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:33.560269 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d83db41-704d-4dcd-8f08-600df4a39c84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:33.561745 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d83db41-704d-4dcd-8f08-600df4a39c84 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:33.582330 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-8d83db41-704d-4dcd-8f08-600df4a39c84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:33.582330 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:33.582330 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:33.582330 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:33.582330 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:33.582330 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:33.582330 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:33.582330 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:33.582330 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:33.582330 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:33.582330 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:33.582330 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:33.582330 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:33.582330 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:33.582330 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:33.583438 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:33.583438 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:33.583438 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:33.583438 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:33.583438 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:33.583438 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:33.583438 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:33.583438 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:33.583438 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:33.583438 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:33.583438 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:33.583438 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:33.583438 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:33.583438 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:33.583438 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:33.583438 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:33.583438 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:33.584400 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:33.584400 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:33.584400 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:33.584400 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:33.584400 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 330/653] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:33.584400 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83db41-704d-4dcd-8f08-600df4a39c84 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:33.676006 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8eef28-c02b-4f9d-94e1-746b9f9e08d3 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:33.694849 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83db41-704d-4dcd-8f08-600df4a39c84 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:33.699584 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:33.714829 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f716e-4b2f-4817-81a9-93e0e4fd5343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:33.715808 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f716e-4b2f-4817-81a9-93e0e4fd5343 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:33.715994 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f716e-4b2f-4817-81a9-93e0e4fd5343 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:33.716270 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f716e-4b2f-4817-81a9-93e0e4fd5343 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:33.728576 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f716e-4b2f-4817-81a9-93e0e4fd5343 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:33.730089 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f716e-4b2f-4817-81a9-93e0e4fd5343 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:33.733936 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e75d7-6e6c-4ea4-bf0d-5835108d1cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:33.734638 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e75d7-6e6c-4ea4-bf0d-5835108d1cbd None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:33.734931 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e75d7-6e6c-4ea4-bf0d-5835108d1cbd None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:33.735215 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e75d7-6e6c-4ea4-bf0d-5835108d1cbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:33.736072 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e75d7-6e6c-4ea4-bf0d-5835108d1cbd None admin] RBAC: Adding query filter params (role.id=1884e658df064cc2a232687c678d8618, scope.project.id=93f20f89d0fc4bbf9cf557dd1e14d98d, user.id=f5d82e71aafe4b6ebcf60c23c050aafb) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:33.736395 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e75d7-6e6c-4ea4-bf0d-5835108d1cbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:33.737833 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e75d7-6e6c-4ea4-bf0d-5835108d1cbd None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:33.751112 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 331/654] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:45:33 2022] GET /identity/v3/role_assignments?user.id=f5d82e71aafe4b6ebcf60c23c050aafb&scope.project.id=93f20f89d0fc4bbf9cf557dd1e14d98d&role.id=1884e658df064cc2a232687c678d8618 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:33.751112 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e75d7-6e6c-4ea4-bf0d-5835108d1cbd None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:33.751399 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-9f4f716e-4b2f-4817-81a9-93e0e4fd5343 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:33.751399 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:33.751399 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:33.751399 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:33.751399 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:33.751399 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:33.751399 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:33.751399 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:33.751399 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:33.751399 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:33.751399 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:33.751399 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:33.751399 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:33.751399 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:33.751399 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:33.752358 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:33.752358 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:33.752358 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:33.752358 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:33.752358 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:33.752358 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:33.752358 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:33.752358 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:33.752358 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:33.752358 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:33.752358 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:33.752358 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:33.752358 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:33.752358 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:33.752358 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:33.752358 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:33.752358 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:33.753323 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:33.753323 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:33.753323 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:33.753323 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:33.753323 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 324/655] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:33.753323 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f716e-4b2f-4817-81a9-93e0e4fd5343 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:33.799445 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:33.878980 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f716e-4b2f-4817-81a9-93e0e4fd5343 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:33.880995 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e75d7-6e6c-4ea4-bf0d-5835108d1cbd None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:33.918910 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeab23b-330e-4d9c-8e04-9fdf720ae2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:33.919735 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeab23b-330e-4d9c-8e04-9fdf720ae2ff None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:33.920028 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeab23b-330e-4d9c-8e04-9fdf720ae2ff None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:33.920144 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe92c07c-d18d-471f-aa9a-6a12a1ad0db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:33.920312 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeab23b-330e-4d9c-8e04-9fdf720ae2ff None admin] PATH_INFO: `/v3/users/glance` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:33.921122 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92c07c-d18d-471f-aa9a-6a12a1ad0db5 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:33.921578 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92c07c-d18d-471f-aa9a-6a12a1ad0db5 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:33.922011 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92c07c-d18d-471f-aa9a-6a12a1ad0db5 None admin] PATH_INFO: `/v3/domains` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:33.922940 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe92c07c-d18d-471f-aa9a-6a12a1ad0db5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:33.923325 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe92c07c-d18d-471f-aa9a-6a12a1ad0db5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:33.924858 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe92c07c-d18d-471f-aa9a-6a12a1ad0db5 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:33.930497 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeab23b-330e-4d9c-8e04-9fdf720ae2ff None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:33.932005 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeab23b-330e-4d9c-8e04-9fdf720ae2ff None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:33.945575 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 325/656] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:33.947445 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe92c07c-d18d-471f-aa9a-6a12a1ad0db5 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:33.952154 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-7eeab23b-330e-4d9c-8e04-9fdf720ae2ff None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 05 21:45:33.952154 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:33.952154 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:33.952154 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:33.952154 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:33.952154 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:33.952154 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:33.952154 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:33.952154 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:33.952154 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:33.952154 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:33.952154 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:33.952154 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:45:33.952154 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:45:33.952154 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:45:33.952154 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:45:33.953199 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:33.953199 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:33.953199 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:45:33.953199 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:45:33.953199 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:45:33.953199 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:45:33.953199 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:33.953199 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:33.953199 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:33.953199 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:33.953199 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:33.953199 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:33.953199 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:33.953199 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:33.953199 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:33.953199 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:33.953199 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:33.953199 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:33.954492 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:33.954492 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:33.954492 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:45:33.954492 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:45:33.954492 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:45:33.954492 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:45:33.954492 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:45:33.954492 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:45:33.954492 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 05 21:45:33.954492 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:33.954492 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 332/657] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:45:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:33.955359 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeab23b-330e-4d9c-8e04-9fdf720ae2ff None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:33.991424 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:34.082435 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe92c07c-d18d-471f-aa9a-6a12a1ad0db5 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:34.090198 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:34.097920 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeab23b-330e-4d9c-8e04-9fdf720ae2ff None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:34.130746 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba2c96-a5da-4c38-98b4-945130604433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:34.132390 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba2c96-a5da-4c38-98b4-945130604433 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:34.132812 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba2c96-a5da-4c38-98b4-945130604433 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:34.133235 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba2c96-a5da-4c38-98b4-945130604433 None admin] PATH_INFO: `/v3/domains` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:34.133984 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ba2c96-a5da-4c38-98b4-945130604433 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:34.134565 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ba2c96-a5da-4c38-98b4-945130604433 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:34.136816 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ba2c96-a5da-4c38-98b4-945130604433 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:34.140074 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d22088-cb56-418f-b76a-1b09a2ecdbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:34.140963 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d22088-cb56-418f-b76a-1b09a2ecdbd0 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:34.141324 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d22088-cb56-418f-b76a-1b09a2ecdbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:34.141677 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d22088-cb56-418f-b76a-1b09a2ecdbd0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:34.150490 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d22088-cb56-418f-b76a-1b09a2ecdbd0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:34.151822 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 326/658] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:34.152130 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d22088-cb56-418f-b76a-1b09a2ecdbd0 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:34.152789 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba2c96-a5da-4c38-98b4-945130604433 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:34.172699 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-97d22088-cb56-418f-b76a-1b09a2ecdbd0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 21:45:34.172699 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:34.172699 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:34.172699 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:34.172699 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:34.172699 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:34.172699 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:34.172699 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:34.172699 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:34.172699 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:34.172699 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:34.172699 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:34.172699 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:45:34.172699 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:45:34.172699 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:45:34.172699 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:45:34.173804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:34.173804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:34.173804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:45:34.173804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:45:34.173804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:45:34.173804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:45:34.173804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:34.173804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:34.173804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:34.173804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:34.173804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:34.173804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:34.173804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:34.173804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:34.173804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:34.173804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:34.173804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:34.173804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:34.175196 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:34.175196 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:34.175196 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:45:34.175196 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:45:34.175196 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:45:34.175196 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:45:34.175196 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:45:34.175196 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:45:34.175196 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 21:45:34.175196 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:34.175196 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 333/659] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:45:33 2022] GET /identity/v3/users/neutron => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:34.175196 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d22088-cb56-418f-b76a-1b09a2ecdbd0 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:34.252604 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:34.264021 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba2c96-a5da-4c38-98b4-945130604433 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:34.286437 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d22088-cb56-418f-b76a-1b09a2ecdbd0 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:34.302838 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c31196-bc66-41a5-b72d-6eaa0dd71bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:34.303775 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c31196-bc66-41a5-b72d-6eaa0dd71bd6 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:34.304088 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c31196-bc66-41a5-b72d-6eaa0dd71bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:34.304375 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c31196-bc66-41a5-b72d-6eaa0dd71bd6 None admin] PATH_INFO: `/v3/users` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:34.305229 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c31196-bc66-41a5-b72d-6eaa0dd71bd6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:34.305539 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c31196-bc66-41a5-b72d-6eaa0dd71bd6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:34.307020 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c31196-bc66-41a5-b72d-6eaa0dd71bd6 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:34.325474 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 327/660] 10.222.0.30 () {56 vars in 1137 bytes} [Tue Jul 5 21:45:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:34.327159 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5d883-b1ea-4bf5-8102-e67541c9fb9a None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:34.327657 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5d883-b1ea-4bf5-8102-e67541c9fb9a None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:34.328125 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5d883-b1ea-4bf5-8102-e67541c9fb9a None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:34.329558 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 328/661] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:45:34.330627 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5d883-b1ea-4bf5-8102-e67541c9fb9a None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:34.336712 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687127c-b2b2-4cee-b2a2-dba6c3c809f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:34.337476 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687127c-b2b2-4cee-b2a2-dba6c3c809f5 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:34.337766 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687127c-b2b2-4cee-b2a2-dba6c3c809f5 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:34.338051 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687127c-b2b2-4cee-b2a2-dba6c3c809f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:34.346162 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687127c-b2b2-4cee-b2a2-dba6c3c809f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:34.347734 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687127c-b2b2-4cee-b2a2-dba6c3c809f5 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:34.363715 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-b687127c-b2b2-4cee-b2a2-dba6c3c809f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:45:34.363715 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:34.363715 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:34.363715 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:34.363715 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:34.363715 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:34.363715 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:34.363715 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:34.363715 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:34.363715 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:34.363715 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:34.363715 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:34.363715 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:45:34.363715 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:45:34.363715 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:45:34.364735 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:45:34.364735 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:34.364735 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:34.364735 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:34.364735 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:34.364735 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:34.364735 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:34.364735 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:34.364735 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:34.364735 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:34.364735 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:34.364735 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:34.364735 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:34.364735 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:34.364735 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:34.364735 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:34.364735 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:34.365697 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:45:34.365697 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:45:34.365697 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:45:34.365697 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:45:34.365697 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:45:34.365697 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:45:34.365697 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:45:34.365697 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:34.365697 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 334/662] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:45:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:34.366860 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687127c-b2b2-4cee-b2a2-dba6c3c809f5 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:34.385904 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:34.452250 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5d883-b1ea-4bf5-8102-e67541c9fb9a None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:34.480754 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687127c-b2b2-4cee-b2a2-dba6c3c809f5 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:34.488390 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ecac7f-8cf6-4634-b062-cd98dd03a5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:34.489072 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecac7f-8cf6-4634-b062-cd98dd03a5d2 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:34.489369 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecac7f-8cf6-4634-b062-cd98dd03a5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:34.489684 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecac7f-8cf6-4634-b062-cd98dd03a5d2 None admin] PATH_INFO: `/v3/users` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:34.490533 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ecac7f-8cf6-4634-b062-cd98dd03a5d2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:34.491416 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ecac7f-8cf6-4634-b062-cd98dd03a5d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:34.492904 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ecac7f-8cf6-4634-b062-cd98dd03a5d2 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:34.510814 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 329/663] 10.222.0.30 () {56 vars in 1139 bytes} [Tue Jul 5 21:45:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:34.512129 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df9315-3b73-4f63-8d61-3d2f43095eea None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:34.512440 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df9315-3b73-4f63-8d61-3d2f43095eea None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:34.512924 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df9315-3b73-4f63-8d61-3d2f43095eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:34.526635 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3875df-caf6-40e4-a037-5d182068bf39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:34.528257 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3875df-caf6-40e4-a037-5d182068bf39 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:34.528757 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3875df-caf6-40e4-a037-5d182068bf39 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:34.529288 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3875df-caf6-40e4-a037-5d182068bf39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:34.531477 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-11df9315-3b73-4f63-8d61-3d2f43095eea None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:34.532673 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-11df9315-3b73-4f63-8d61-3d2f43095eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:34.534806 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:34.611353 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 330/664] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:45:34.612643 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df9315-3b73-4f63-8d61-3d2f43095eea None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:34.628826 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3875df-caf6-40e4-a037-5d182068bf39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:34.630745 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3875df-caf6-40e4-a037-5d182068bf39 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:34.648731 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:34.729801 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df9315-3b73-4f63-8d61-3d2f43095eea None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:34.747728 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 335/665] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:45:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:45:34.747728 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3875df-caf6-40e4-a037-5d182068bf39 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:34.765845 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6942a1-10c7-4f90-9646-e2bd93e8c44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:34.766563 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6942a1-10c7-4f90-9646-e2bd93e8c44b None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:34.766850 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6942a1-10c7-4f90-9646-e2bd93e8c44b None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:34.767131 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6942a1-10c7-4f90-9646-e2bd93e8c44b None admin] PATH_INFO: `/v3/projects` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:34.767926 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6942a1-10c7-4f90-9646-e2bd93e8c44b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:34.768237 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6942a1-10c7-4f90-9646-e2bd93e8c44b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:34.769675 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6942a1-10c7-4f90-9646-e2bd93e8c44b None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:34.777835 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:34.783220 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 331/666] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:45:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:34.789276 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6942a1-10c7-4f90-9646-e2bd93e8c44b None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:34.856401 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3875df-caf6-40e4-a037-5d182068bf39 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:34.872556 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:34.893283 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ec47b-e605-45b2-af30-e9b23f39cddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:34.893940 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ec47b-e605-45b2-af30-e9b23f39cddb None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:34.895339 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ec47b-e605-45b2-af30-e9b23f39cddb None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:34.895339 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ec47b-e605-45b2-af30-e9b23f39cddb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:34.896784 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6942a1-10c7-4f90-9646-e2bd93e8c44b None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:34.936055 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8731a5-f618-4794-b02e-8d481ecd62f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:34.937297 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8731a5-f618-4794-b02e-8d481ecd62f1 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:34.938261 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8731a5-f618-4794-b02e-8d481ecd62f1 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:34.938768 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8731a5-f618-4794-b02e-8d481ecd62f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:34.952654 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8731a5-f618-4794-b02e-8d481ecd62f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:45:34.963012 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-ac8731a5-f618-4794-b02e-8d481ecd62f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:45:34.963012 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:34.963012 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:34.963012 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:34.963012 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:34.963012 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:34.963012 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:34.963012 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:34.963012 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:34.963012 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:34.963012 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:34.963012 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:34.963012 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:45:34.963012 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:45:34.963012 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:45:34.963012 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:45:34.964175 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:45:34.964175 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:45:34.964175 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:45:34.964175 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:45:34.964175 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:34.964175 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:34.964175 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:34.964175 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:34.964175 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:34.964175 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:34.964175 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:34.964175 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:34.964175 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:34.964175 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:34.964175 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:34.964175 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:34.965172 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:34.965172 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:34.965172 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:34.965172 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:34.965172 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:45:34.965172 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:45:34.965172 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:45:34.965172 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:45:34.965172 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:45:34.965172 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:45:34.965172 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:45:34.965172 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:34.966991 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8ec47b-e605-45b2-af30-e9b23f39cddb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:34.967461 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 332/667] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:45:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:34.968411 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8731a5-f618-4794-b02e-8d481ecd62f1 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:34.968524 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8ec47b-e605-45b2-af30-e9b23f39cddb None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:35.034370 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:35.082023 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 336/668] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:45:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:45:35.082969 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ec47b-e605-45b2-af30-e9b23f39cddb None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:35.088233 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8731a5-f618-4794-b02e-8d481ecd62f1 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:35.099014 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:35.125868 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd415b-65dc-4d50-811d-058118751a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:35.126637 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd415b-65dc-4d50-811d-058118751a49 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:35.126932 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd415b-65dc-4d50-811d-058118751a49 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:35.127216 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd415b-65dc-4d50-811d-058118751a49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:35.139489 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd415b-65dc-4d50-811d-058118751a49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:35.140955 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd415b-65dc-4d50-811d-058118751a49 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:35.159055 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-18cd415b-65dc-4d50-811d-058118751a49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:35.159055 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:35.159055 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:35.159055 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:35.159055 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:35.159055 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:35.159055 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:35.159055 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:35.159055 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:35.159055 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:35.159055 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:35.159055 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:35.159055 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:35.159055 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:35.159055 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:35.160246 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:35.160246 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:35.160246 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:35.160246 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:35.160246 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:35.160246 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:35.160246 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:35.160246 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:35.160246 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:35.160246 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:35.160246 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:35.160246 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:35.160246 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:35.160246 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:35.160246 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:35.160246 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:35.160246 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:35.161240 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:35.161240 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:35.161240 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:35.161240 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:35.161240 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 333/669] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:35.161240 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd415b-65dc-4d50-811d-058118751a49 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:35.196423 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ec47b-e605-45b2-af30-e9b23f39cddb None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:35.232856 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0db197-4b11-48b5-8b00-36f67632d178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:35.237600 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0db197-4b11-48b5-8b00-36f67632d178 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:35.237600 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0db197-4b11-48b5-8b00-36f67632d178 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:35.237600 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0db197-4b11-48b5-8b00-36f67632d178 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:35.237600 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0db197-4b11-48b5-8b00-36f67632d178 None admin] RBAC: Adding query filter params (role.id=1884e658df064cc2a232687c678d8618, scope.project.id=93f20f89d0fc4bbf9cf557dd1e14d98d, user.id=b7f6902012fd4a9283c73b9e2394e0b0) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:35.237600 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0db197-4b11-48b5-8b00-36f67632d178 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:35.237994 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0db197-4b11-48b5-8b00-36f67632d178 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:35.254169 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 337/670] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:45:35 2022] GET /identity/v3/role_assignments?user.id=b7f6902012fd4a9283c73b9e2394e0b0&scope.project.id=93f20f89d0fc4bbf9cf557dd1e14d98d&role.id=1884e658df064cc2a232687c678d8618 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:35.254169 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0db197-4b11-48b5-8b00-36f67632d178 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:35.281896 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd415b-65dc-4d50-811d-058118751a49 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:35.297514 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:35.329760 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6511e8fd-2968-4949-b4ae-96165a563b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:35.330900 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6511e8fd-2968-4949-b4ae-96165a563b6c None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:35.331310 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6511e8fd-2968-4949-b4ae-96165a563b6c None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:35.331820 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6511e8fd-2968-4949-b4ae-96165a563b6c None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:35.333091 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6511e8fd-2968-4949-b4ae-96165a563b6c None admin] RBAC: Adding query filter params (name=service) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:35.333747 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6511e8fd-2968-4949-b4ae-96165a563b6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:35.335534 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6511e8fd-2968-4949-b4ae-96165a563b6c None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:35.349715 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 334/671] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:45:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:35.351017 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6511e8fd-2968-4949-b4ae-96165a563b6c None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:35.374301 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:35.400025 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0db197-4b11-48b5-8b00-36f67632d178 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:35.447808 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2242bf2-1357-4546-a28c-086e2eec9b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:35.448635 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2242bf2-1357-4546-a28c-086e2eec9b2e None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:35.448918 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2242bf2-1357-4546-a28c-086e2eec9b2e None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:35.449194 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2242bf2-1357-4546-a28c-086e2eec9b2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:35.462521 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2242bf2-1357-4546-a28c-086e2eec9b2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:35.463994 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2242bf2-1357-4546-a28c-086e2eec9b2e None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:35.498242 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-e2242bf2-1357-4546-a28c-086e2eec9b2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:35.498242 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:35.498242 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:35.498242 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:35.498242 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:35.498242 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:35.498242 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:35.498242 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:35.498242 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:35.498242 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:35.498242 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:35.498242 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:35.498242 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:35.498242 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:35.498242 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:35.499302 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:35.499302 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:35.499302 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:35.499302 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:35.499302 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:35.499302 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:35.499302 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:35.499302 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:35.499302 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:35.499302 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:35.499302 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:35.499302 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:35.499302 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:35.499302 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:35.499302 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:35.499302 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:35.499302 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:35.500440 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:35.500440 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:35.500440 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:35.500440 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:35.500440 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 338/672] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:35.501492 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2242bf2-1357-4546-a28c-086e2eec9b2e None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:35.512590 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6511e8fd-2968-4949-b4ae-96165a563b6c None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:35.574685 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477938e7-37cc-430b-a646-051e15394ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:35.575385 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477938e7-37cc-430b-a646-051e15394ec8 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:35.575682 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477938e7-37cc-430b-a646-051e15394ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:35.575975 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477938e7-37cc-430b-a646-051e15394ec8 None admin] PATH_INFO: `/v3/domains` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:35.576865 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477938e7-37cc-430b-a646-051e15394ec8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:35.577184 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477938e7-37cc-430b-a646-051e15394ec8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:35.578644 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477938e7-37cc-430b-a646-051e15394ec8 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:35.593106 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 335/673] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:35.593993 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477938e7-37cc-430b-a646-051e15394ec8 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:35.633866 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:35.651404 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2242bf2-1357-4546-a28c-086e2eec9b2e None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:35.696102 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:35.705494 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd95b92a-ce5a-4fe9-ae66-9467a85974d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:35.707130 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95b92a-ce5a-4fe9-ae66-9467a85974d3 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:35.707858 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95b92a-ce5a-4fe9-ae66-9467a85974d3 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:35.708545 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95b92a-ce5a-4fe9-ae66-9467a85974d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:35.721900 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477938e7-37cc-430b-a646-051e15394ec8 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:35.727587 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd95b92a-ce5a-4fe9-ae66-9467a85974d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:35.730852 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd95b92a-ce5a-4fe9-ae66-9467a85974d3 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:35.753870 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-fd95b92a-ce5a-4fe9-ae66-9467a85974d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:35.753870 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:35.753870 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:35.753870 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:35.753870 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:35.753870 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:35.753870 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:35.753870 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:35.753870 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:35.753870 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:35.753870 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:35.753870 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:35.753870 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:35.753870 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:35.753870 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:35.755205 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:35.755205 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:35.755205 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:35.755205 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:35.755205 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:35.755205 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:35.755205 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:35.755205 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:35.755205 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:35.755205 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:35.755205 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:35.755205 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:35.755205 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:35.755205 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:35.755205 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:35.755205 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:35.755205 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:35.756969 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:35.756969 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:35.756969 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:35.756969 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:35.758980 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 339/674] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:35.760218 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd95b92a-ce5a-4fe9-ae66-9467a85974d3 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:35.764313 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24384aa4-a590-4074-b13d-f227312814f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:35.764971 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24384aa4-a590-4074-b13d-f227312814f6 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:35.765259 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24384aa4-a590-4074-b13d-f227312814f6 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:35.765548 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24384aa4-a590-4074-b13d-f227312814f6 None admin] PATH_INFO: `/v3/domains` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:35.766349 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24384aa4-a590-4074-b13d-f227312814f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:35.766669 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24384aa4-a590-4074-b13d-f227312814f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:35.768423 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24384aa4-a590-4074-b13d-f227312814f6 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:35.788929 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 336/675] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:35.790791 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24384aa4-a590-4074-b13d-f227312814f6 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:35.901026 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:35.903185 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd95b92a-ce5a-4fe9-ae66-9467a85974d3 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:35.911279 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24384aa4-a590-4074-b13d-f227312814f6 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:35.941952 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03642a3e-e840-4d3c-ab1a-b133b12c86f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:35.943372 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03642a3e-e840-4d3c-ab1a-b133b12c86f2 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:35.944644 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03642a3e-e840-4d3c-ab1a-b133b12c86f2 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:35.945138 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03642a3e-e840-4d3c-ab1a-b133b12c86f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:35.948960 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f1f28f-7eaf-4607-adf8-7e7e5e1e6519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:35.949641 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1f28f-7eaf-4607-adf8-7e7e5e1e6519 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:35.949932 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1f28f-7eaf-4607-adf8-7e7e5e1e6519 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:35.950244 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1f28f-7eaf-4607-adf8-7e7e5e1e6519 None admin] PATH_INFO: `/v3/domains` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:35.951107 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f1f28f-7eaf-4607-adf8-7e7e5e1e6519 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:35.951424 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f1f28f-7eaf-4607-adf8-7e7e5e1e6519 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:35.952817 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f1f28f-7eaf-4607-adf8-7e7e5e1e6519 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:35.956972 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03642a3e-e840-4d3c-ab1a-b133b12c86f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:35.958678 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03642a3e-e840-4d3c-ab1a-b133b12c86f2 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:35.967308 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 337/676] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:35.968167 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f1f28f-7eaf-4607-adf8-7e7e5e1e6519 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:35.975169 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-03642a3e-e840-4d3c-ab1a-b133b12c86f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:45:35.975169 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:35.975169 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:35.975169 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:35.975169 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:35.975169 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:35.975169 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:35.975169 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:35.975169 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:35.975169 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:35.975169 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:35.975169 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:35.975169 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:45:35.975169 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:45:35.975169 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:45:35.976378 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:45:35.976378 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:35.976378 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:35.976378 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:35.976378 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:35.976378 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:35.976378 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:35.976378 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:35.976378 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:35.976378 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:35.976378 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:35.976378 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:35.976378 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:35.976378 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:35.976378 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:35.976378 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:35.976378 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:35.977530 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:45:35.977530 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:45:35.977530 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:45:35.977530 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:45:35.977530 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:45:35.977530 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:45:35.977530 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:45:35.977530 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:35.980397 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 340/677] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:45:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:35.981486 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03642a3e-e840-4d3c-ab1a-b133b12c86f2 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:36.035289 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:36.082924 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f1f28f-7eaf-4607-adf8-7e7e5e1e6519 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:36.106313 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03642a3e-e840-4d3c-ab1a-b133b12c86f2 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:36.124515 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a187ed-0455-4d3e-9242-922cd1258182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:36.125335 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a187ed-0455-4d3e-9242-922cd1258182 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:36.125669 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a187ed-0455-4d3e-9242-922cd1258182 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:36.125963 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a187ed-0455-4d3e-9242-922cd1258182 None admin] PATH_INFO: `/v3/projects/service` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:36.134015 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a187ed-0455-4d3e-9242-922cd1258182 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:36.135566 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a187ed-0455-4d3e-9242-922cd1258182 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:36.150766 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-45a187ed-0455-4d3e-9242-922cd1258182 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:45:36.150766 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:36.150766 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:36.150766 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:36.150766 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:36.150766 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:36.150766 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:36.150766 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:36.150766 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:36.150766 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:36.150766 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:36.150766 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:36.150766 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:45:36.150766 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:45:36.150766 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:45:36.151840 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:45:36.151840 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:36.151840 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:36.151840 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:36.151840 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:36.151840 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:36.151840 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:36.151840 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:36.151840 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:36.151840 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:36.151840 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:36.151840 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:36.151840 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:36.151840 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:36.151840 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:36.151840 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:36.151840 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:36.152862 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:45:36.152862 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:45:36.152862 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:45:36.152862 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:45:36.152862 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:45:36.152862 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:45:36.152862 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:45:36.152862 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:36.154820 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b8c07-c32a-41dc-95ac-0e4ab8aa2acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:36.154820 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b8c07-c32a-41dc-95ac-0e4ab8aa2acf None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:36.154820 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b8c07-c32a-41dc-95ac-0e4ab8aa2acf None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:36.154820 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b8c07-c32a-41dc-95ac-0e4ab8aa2acf None admin] PATH_INFO: `/v3/users/swift` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:36.156952 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 338/678] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:45:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:36.157828 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a187ed-0455-4d3e-9242-922cd1258182 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:36.164593 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b8c07-c32a-41dc-95ac-0e4ab8aa2acf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:36.166396 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b8c07-c32a-41dc-95ac-0e4ab8aa2acf None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:36.175369 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:36.186671 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-119b8c07-c32a-41dc-95ac-0e4ab8aa2acf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 21:45:36.186671 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:36.186671 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:36.186671 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:36.186671 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:36.186671 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:36.186671 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:36.186671 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:36.186671 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:36.186671 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:36.186671 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:36.186671 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:36.186671 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:45:36.186671 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:45:36.186671 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:45:36.186671 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:45:36.196877 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:36.196877 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:36.196877 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:45:36.196877 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:45:36.196877 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:45:36.196877 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:45:36.196877 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:36.196877 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:36.196877 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:36.196877 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:36.196877 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:36.196877 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:36.196877 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:36.196877 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:36.196877 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:36.196877 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:36.196877 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:36.196877 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:36.201299 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:36.201299 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:36.201299 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:45:36.201299 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:45:36.201299 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:45:36.201299 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:45:36.201299 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:45:36.201299 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:45:36.201299 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 21:45:36.201299 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:36.201299 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 341/679] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:45:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:36.201299 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6797a-8b50-47dc-9c55-f3963460f630 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:36.201299 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6797a-8b50-47dc-9c55-f3963460f630 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:36.208015 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6797a-8b50-47dc-9c55-f3963460f630 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:36.208015 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 342/680] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:45:36.208015 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6797a-8b50-47dc-9c55-f3963460f630 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:36.282356 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a187ed-0455-4d3e-9242-922cd1258182 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:36.305931 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6797a-8b50-47dc-9c55-f3963460f630 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:36.308219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:36.320080 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bfc866-ee0f-4843-96a8-bec88071b675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:36.320775 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bfc866-ee0f-4843-96a8-bec88071b675 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:36.321054 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bfc866-ee0f-4843-96a8-bec88071b675 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:36.321309 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bfc866-ee0f-4843-96a8-bec88071b675 None admin] PATH_INFO: `/v3/projects` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:36.322109 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bfc866-ee0f-4843-96a8-bec88071b675 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:36.322445 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bfc866-ee0f-4843-96a8-bec88071b675 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:36.323896 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bfc866-ee0f-4843-96a8-bec88071b675 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:36.343206 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 339/681] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:45:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:36.343206 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bfc866-ee0f-4843-96a8-bec88071b675 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:36.353585 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee69d02-2352-4fca-bb4c-e1b498151ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:36.354285 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee69d02-2352-4fca-bb4c-e1b498151ada None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:36.354588 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee69d02-2352-4fca-bb4c-e1b498151ada None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:36.354846 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee69d02-2352-4fca-bb4c-e1b498151ada None admin] PATH_INFO: `/v3/projects` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:36.355646 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee69d02-2352-4fca-bb4c-e1b498151ada None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:36.355991 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee69d02-2352-4fca-bb4c-e1b498151ada None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:36.357390 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee69d02-2352-4fca-bb4c-e1b498151ada None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:36.370224 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 343/682] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:45:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:36.375873 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfbd555-ac6b-4db8-86ed-6d2e3cd6ad2f None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:36.376299 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfbd555-ac6b-4db8-86ed-6d2e3cd6ad2f None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:36.376588 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfbd555-ac6b-4db8-86ed-6d2e3cd6ad2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:36.392761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-4dfbd555-ac6b-4db8-86ed-6d2e3cd6ad2f None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:36.394292 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-4dfbd555-ac6b-4db8-86ed-6d2e3cd6ad2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:36.419989 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:36.451708 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bfc866-ee0f-4843-96a8-bec88071b675 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:36.486159 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 344/683] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:45:36.486159 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfbd555-ac6b-4db8-86ed-6d2e3cd6ad2f None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:36.492719 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c10c0-7291-4c73-be00-80fa347e4027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:36.493412 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c10c0-7291-4c73-be00-80fa347e4027 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:36.493700 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c10c0-7291-4c73-be00-80fa347e4027 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:36.493979 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c10c0-7291-4c73-be00-80fa347e4027 None admin] PATH_INFO: `/v3/users` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:36.494876 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2c10c0-7291-4c73-be00-80fa347e4027 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:36.495196 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2c10c0-7291-4c73-be00-80fa347e4027 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:36.496732 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2c10c0-7291-4c73-be00-80fa347e4027 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:36.515288 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 340/684] 10.222.0.30 () {56 vars in 1135 bytes} [Tue Jul 5 21:45:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:36.516165 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c10c0-7291-4c73-be00-80fa347e4027 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:36.607694 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:36.617114 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfbd555-ac6b-4db8-86ed-6d2e3cd6ad2f None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:36.625582 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c10c0-7291-4c73-be00-80fa347e4027 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:36.655573 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:36.656534 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01541933-f4de-4758-b419-9c8f41e963f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:36.657220 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01541933-f4de-4758-b419-9c8f41e963f1 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:36.657510 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01541933-f4de-4758-b419-9c8f41e963f1 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:36.657789 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01541933-f4de-4758-b419-9c8f41e963f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:36.658734 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01541933-f4de-4758-b419-9c8f41e963f1 None admin] RBAC: Adding query filter params (role.id=1884e658df064cc2a232687c678d8618, scope.project.id=93f20f89d0fc4bbf9cf557dd1e14d98d, user.id=8688d3d1cf62416da18c3ffb0b79ec54) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:36.659034 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01541933-f4de-4758-b419-9c8f41e963f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:36.660440 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01541933-f4de-4758-b419-9c8f41e963f1 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:36.663265 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4825b84d-1597-486b-801e-4547b14c7139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:36.666177 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825b84d-1597-486b-801e-4547b14c7139 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:36.666177 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825b84d-1597-486b-801e-4547b14c7139 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:36.666177 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825b84d-1597-486b-801e-4547b14c7139 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:36.666177 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4825b84d-1597-486b-801e-4547b14c7139 None admin] RBAC: Adding query filter params (role.id=1884e658df064cc2a232687c678d8618, scope.project.id=93f20f89d0fc4bbf9cf557dd1e14d98d, user.id=b59ded30d64d4eeca95c949259faf5ae) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:36.666177 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4825b84d-1597-486b-801e-4547b14c7139 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:36.675093 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4825b84d-1597-486b-801e-4547b14c7139 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:36.675280 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 345/685] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:45:36 2022] GET /identity/v3/role_assignments?user.id=8688d3d1cf62416da18c3ffb0b79ec54&scope.project.id=93f20f89d0fc4bbf9cf557dd1e14d98d&role.id=1884e658df064cc2a232687c678d8618 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:36.675280 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01541933-f4de-4758-b419-9c8f41e963f1 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:36.675460 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 341/686] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:45:36 2022] GET /identity/v3/role_assignments?user.id=b59ded30d64d4eeca95c949259faf5ae&scope.project.id=93f20f89d0fc4bbf9cf557dd1e14d98d&role.id=1884e658df064cc2a232687c678d8618 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:36.675460 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4825b84d-1597-486b-801e-4547b14c7139 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:36.887717 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4825b84d-1597-486b-801e-4547b14c7139 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:36.889436 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01541933-f4de-4758-b419-9c8f41e963f1 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:36.935005 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aebdee9-28ab-44d2-bcf3-b92f0f64bfea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:36.935871 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637580b-6e57-4a91-b3cd-3043c3d96252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:36.936735 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebdee9-28ab-44d2-bcf3-b92f0f64bfea None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:36.937686 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637580b-6e57-4a91-b3cd-3043c3d96252 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:36.938159 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebdee9-28ab-44d2-bcf3-b92f0f64bfea None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:36.938597 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebdee9-28ab-44d2-bcf3-b92f0f64bfea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:36.939668 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637580b-6e57-4a91-b3cd-3043c3d96252 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:36.940121 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637580b-6e57-4a91-b3cd-3043c3d96252 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:36.958346 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637580b-6e57-4a91-b3cd-3043c3d96252 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:45:36.966878 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-9637580b-6e57-4a91-b3cd-3043c3d96252 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:45:36.966878 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:36.966878 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:36.966878 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:36.966878 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:36.966878 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:36.966878 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:36.966878 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:36.966878 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:36.966878 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:36.966878 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:36.966878 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:36.966878 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:45:36.966878 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:45:36.966878 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:45:36.966878 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:45:36.968098 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:45:36.968098 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:45:36.968098 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:45:36.968098 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:45:36.968098 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:36.968098 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:36.968098 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:36.968098 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:36.968098 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:36.968098 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:36.968098 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:36.968098 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:36.968098 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:36.968098 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:36.968098 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:36.968098 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:36.969204 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:36.969204 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:36.969204 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:36.969204 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:36.969204 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:45:36.969204 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:45:36.969204 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:45:36.969204 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:45:36.969204 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:45:36.969204 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:45:36.969204 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:45:36.969204 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:36.970508 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 346/687] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:45:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:36.977259 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637580b-6e57-4a91-b3cd-3043c3d96252 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:37.002496 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:37.021393 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aebdee9-28ab-44d2-bcf3-b92f0f64bfea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:37.022734 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:37.028456 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aebdee9-28ab-44d2-bcf3-b92f0f64bfea None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:37.093229 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637580b-6e57-4a91-b3cd-3043c3d96252 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:37.132397 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60afe2-f0e4-4411-a6f9-5eb0b294475c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:37.133200 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60afe2-f0e4-4411-a6f9-5eb0b294475c None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:37.133704 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60afe2-f0e4-4411-a6f9-5eb0b294475c None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:37.133875 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60afe2-f0e4-4411-a6f9-5eb0b294475c None admin] PATH_INFO: `/v3/roles` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:37.134818 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a60afe2-f0e4-4411-a6f9-5eb0b294475c None admin] RBAC: Adding query filter params (name=admin) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:37.135162 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a60afe2-f0e4-4411-a6f9-5eb0b294475c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:37.137038 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a60afe2-f0e4-4411-a6f9-5eb0b294475c None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:37.142150 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 342/688] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:45:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:45:37.147779 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 347/689] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:45:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:45:37.148236 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aebdee9-28ab-44d2-bcf3-b92f0f64bfea None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:37.153166 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60afe2-f0e4-4411-a6f9-5eb0b294475c None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:37.254570 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:37.274907 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:37.278681 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60afe2-f0e4-4411-a6f9-5eb0b294475c None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:37.288898 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aebdee9-28ab-44d2-bcf3-b92f0f64bfea None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:37.331288 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b986e5a-147a-41fe-b48f-6eda26f4d02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:37.332528 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b986e5a-147a-41fe-b48f-6eda26f4d02c None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:37.334142 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b986e5a-147a-41fe-b48f-6eda26f4d02c None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:37.335212 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b986e5a-147a-41fe-b48f-6eda26f4d02c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:37.357022 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b986e5a-147a-41fe-b48f-6eda26f4d02c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:37.360068 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b986e5a-147a-41fe-b48f-6eda26f4d02c None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:37.375917 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744a80a-4f3e-4da8-aab5-aaf2349b8415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:37.377164 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744a80a-4f3e-4da8-aab5-aaf2349b8415 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:37.377674 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744a80a-4f3e-4da8-aab5-aaf2349b8415 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:37.378197 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744a80a-4f3e-4da8-aab5-aaf2349b8415 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:37.401910 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8744a80a-4f3e-4da8-aab5-aaf2349b8415 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:37.403770 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8744a80a-4f3e-4da8-aab5-aaf2349b8415 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:37.408067 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-9b986e5a-147a-41fe-b48f-6eda26f4d02c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:37.408067 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:37.408067 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:37.408067 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:37.408067 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:37.408067 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:37.408067 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:37.408067 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:37.408067 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:37.408067 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:37.408067 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:37.408067 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:37.408067 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:37.408067 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:37.408067 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:37.409037 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:37.409037 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:37.409037 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:37.409037 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:37.409037 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:37.409037 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:37.409037 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:37.409037 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:37.409037 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:37.409037 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:37.409037 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:37.409037 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:37.409037 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:37.409037 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:37.409037 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:37.409037 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:37.409037 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:37.410009 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:37.410009 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:37.410009 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:37.410009 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:37.412288 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 343/690] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:37.418419 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b986e5a-147a-41fe-b48f-6eda26f4d02c None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:37.440757 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-8744a80a-4f3e-4da8-aab5-aaf2349b8415 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:37.440757 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:37.440757 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:37.440757 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:37.440757 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:37.440757 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:37.440757 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:37.440757 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:37.440757 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:37.440757 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:37.440757 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:37.440757 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:37.440757 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:37.440757 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:37.440757 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:37.441779 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:37.441779 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:37.441779 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:37.441779 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:37.441779 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:37.441779 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:37.441779 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:37.441779 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:37.441779 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:37.441779 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:37.441779 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:37.441779 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:37.441779 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:37.441779 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:37.441779 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:37.441779 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:37.441779 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:37.442785 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:37.442785 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:37.442785 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:37.442785 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:37.442785 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 348/691] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:37.453371 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744a80a-4f3e-4da8-aab5-aaf2349b8415 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:37.610391 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744a80a-4f3e-4da8-aab5-aaf2349b8415 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:37.616186 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b986e5a-147a-41fe-b48f-6eda26f4d02c None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:37.645819 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:37.653453 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78886a0e-0e5c-4b4a-82d7-6c0c3b623067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:37.659621 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78886a0e-0e5c-4b4a-82d7-6c0c3b623067 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:37.659621 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78886a0e-0e5c-4b4a-82d7-6c0c3b623067 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:37.659621 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78886a0e-0e5c-4b4a-82d7-6c0c3b623067 None admin] PATH_INFO: `/v3/domains` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:37.659621 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78886a0e-0e5c-4b4a-82d7-6c0c3b623067 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:37.659621 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78886a0e-0e5c-4b4a-82d7-6c0c3b623067 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:37.659621 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78886a0e-0e5c-4b4a-82d7-6c0c3b623067 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:37.664344 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daeb80b-3e82-4b72-b2f9-3b8eb1204737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:37.665115 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daeb80b-3e82-4b72-b2f9-3b8eb1204737 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:37.665479 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daeb80b-3e82-4b72-b2f9-3b8eb1204737 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:37.665839 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daeb80b-3e82-4b72-b2f9-3b8eb1204737 None admin] PATH_INFO: `/v3/domains` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:37.666705 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daeb80b-3e82-4b72-b2f9-3b8eb1204737 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:37.667086 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daeb80b-3e82-4b72-b2f9-3b8eb1204737 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:37.669107 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daeb80b-3e82-4b72-b2f9-3b8eb1204737 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:37.678245 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 349/692] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:37.679656 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a88c7-f2f3-4a55-9fff-d376de168efe None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:37.679955 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a88c7-f2f3-4a55-9fff-d376de168efe None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:37.680239 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a88c7-f2f3-4a55-9fff-d376de168efe None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:37.683594 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 350/693] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:45:37.684716 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a88c7-f2f3-4a55-9fff-d376de168efe None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:37.691912 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 344/694] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:37.698259 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c7181-e1dd-4fbc-a680-77695c22d090 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:37.698825 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c7181-e1dd-4fbc-a680-77695c22d090 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:37.699315 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c7181-e1dd-4fbc-a680-77695c22d090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:37.717419 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:37.725841 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-6d4c7181-e1dd-4fbc-a680-77695c22d090 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:37.729808 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-6d4c7181-e1dd-4fbc-a680-77695c22d090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:37.821313 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a88c7-f2f3-4a55-9fff-d376de168efe None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:37.826265 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 345/695] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:45:37.828071 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c7181-e1dd-4fbc-a680-77695c22d090 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:37.883605 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7bb765-3c8f-4df0-bab1-77a5ed59636a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:37.884868 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7bb765-3c8f-4df0-bab1-77a5ed59636a None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:37.885162 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7bb765-3c8f-4df0-bab1-77a5ed59636a None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:37.885442 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7bb765-3c8f-4df0-bab1-77a5ed59636a None admin] PATH_INFO: `/v3/users/nova` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:37.895442 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7bb765-3c8f-4df0-bab1-77a5ed59636a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:37.897466 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7bb765-3c8f-4df0-bab1-77a5ed59636a None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:37.916376 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-4c7bb765-3c8f-4df0-bab1-77a5ed59636a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:45:37.916376 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:37.916376 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:37.916376 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:37.916376 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:37.916376 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:37.916376 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:37.916376 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:37.916376 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:37.916376 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:37.916376 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:37.916376 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:37.916376 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:45:37.916376 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:45:37.916376 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:45:37.916376 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:45:37.917450 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:37.917450 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:37.917450 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:45:37.917450 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:45:37.917450 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:45:37.917450 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:45:37.917450 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:37.917450 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:37.917450 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:37.917450 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:37.917450 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:37.917450 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:37.917450 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:37.917450 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:37.917450 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:37.917450 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:37.917450 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:37.917450 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:37.918507 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:37.918507 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:37.918507 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:45:37.918507 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:45:37.918507 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:45:37.918507 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:45:37.918507 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:45:37.918507 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:45:37.918507 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:45:37.918507 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:37.918507 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 351/696] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Jul 5 21:45:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:37.919156 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7bb765-3c8f-4df0-bab1-77a5ed59636a None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:37.951390 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c7181-e1dd-4fbc-a680-77695c22d090 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:37.990473 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5279a4-5a7b-457c-8920-1f42247ed650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:37.992396 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5279a4-5a7b-457c-8920-1f42247ed650 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:37.992935 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5279a4-5a7b-457c-8920-1f42247ed650 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:37.993459 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5279a4-5a7b-457c-8920-1f42247ed650 None admin] PATH_INFO: `/v3/projects/service` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:37.994303 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:37.997229 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:38.002214 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5279a4-5a7b-457c-8920-1f42247ed650 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:38.010179 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5279a4-5a7b-457c-8920-1f42247ed650 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:38.018754 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-9c5279a4-5a7b-457c-8920-1f42247ed650 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:45:38.018754 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:38.018754 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:38.018754 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:38.018754 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:38.018754 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:38.018754 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:38.018754 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:38.018754 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:38.018754 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:38.018754 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:38.018754 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:38.018754 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:45:38.018754 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:45:38.018754 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:45:38.019711 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:45:38.019711 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:38.019711 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:38.019711 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:38.019711 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:38.019711 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:38.019711 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:38.019711 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:38.019711 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:38.019711 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:38.019711 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:38.019711 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:38.019711 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:38.019711 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:38.019711 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:38.019711 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:38.019711 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:38.020679 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:45:38.020679 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:45:38.020679 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:45:38.020679 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:45:38.020679 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:45:38.020679 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:45:38.020679 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:45:38.020679 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:38.025221 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 346/697] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:45:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:38.026096 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5279a4-5a7b-457c-8920-1f42247ed650 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:38.061351 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7bb765-3c8f-4df0-bab1-77a5ed59636a None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:38.113760 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ba89c-d93e-4310-b59e-886e2831d05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:38.115246 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ba89c-d93e-4310-b59e-886e2831d05d None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:38.116110 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ba89c-d93e-4310-b59e-886e2831d05d None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:38.116708 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ba89c-d93e-4310-b59e-886e2831d05d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:38.118064 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ba89c-d93e-4310-b59e-886e2831d05d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:38.119747 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ba89c-d93e-4310-b59e-886e2831d05d None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:38.135855 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-858ba89c-d93e-4310-b59e-886e2831d05d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 21:45:38.135855 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:38.135855 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:45:38.135855 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:45:38.135855 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:45:38.135855 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:45:38.135855 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:45:38.135855 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:45:38.135855 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 21:45:38.135855 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:38.135855 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:45:38.135855 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:38.135855 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:38.135855 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:38.135855 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:38.135855 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:38.136968 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:38.136968 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:38.136968 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:38.136968 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:38.136968 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:38.136968 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:38.136968 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:38.136968 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:45:38.136968 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:45:38.136968 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:45:38.136968 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:45:38.136968 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:38.136968 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:38.136968 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:38.136968 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:38.136968 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:38.137983 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:38.137983 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:38.137983 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:38.137983 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:38.137983 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:38.137983 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:38.137983 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:38.137983 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:38.137983 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:38.137983 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:38.137983 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:38.137983 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:45:38.137983 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:45:38.137983 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 21:45:38.137983 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:38.138906 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5279a4-5a7b-457c-8920-1f42247ed650 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:38.145752 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 352/698] 10.222.0.30 () {56 vars in 1129 bytes} [Tue Jul 5 21:45:37 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:38.147075 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ba89c-d93e-4310-b59e-886e2831d05d None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:38.172955 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c0bdc0-e828-4bf1-b8fd-f2efa3cf5582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:38.173683 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0bdc0-e828-4bf1-b8fd-f2efa3cf5582 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:38.173975 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0bdc0-e828-4bf1-b8fd-f2efa3cf5582 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:38.174331 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0bdc0-e828-4bf1-b8fd-f2efa3cf5582 None admin] PATH_INFO: `/v3/users` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:38.175131 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c0bdc0-e828-4bf1-b8fd-f2efa3cf5582 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:38.175441 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c0bdc0-e828-4bf1-b8fd-f2efa3cf5582 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:38.176969 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c0bdc0-e828-4bf1-b8fd-f2efa3cf5582 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:38.200830 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 347/699] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Jul 5 21:45:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:38.201574 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c0bdc0-e828-4bf1-b8fd-f2efa3cf5582 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:38.261572 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ba89c-d93e-4310-b59e-886e2831d05d None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:38.262591 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:38.277890 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:38.299729 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce7629-114c-4b84-849c-00192a8e3b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:38.301232 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce7629-114c-4b84-849c-00192a8e3b3e None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:38.301753 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce7629-114c-4b84-849c-00192a8e3b3e None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:38.302645 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce7629-114c-4b84-849c-00192a8e3b3e None admin] PATH_INFO: `/v3/projects` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:38.305037 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ce7629-114c-4b84-849c-00192a8e3b3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:38.305703 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ce7629-114c-4b84-849c-00192a8e3b3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:38.308054 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ce7629-114c-4b84-849c-00192a8e3b3e None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:38.310579 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c0bdc0-e828-4bf1-b8fd-f2efa3cf5582 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:38.329519 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 353/700] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:45:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:38.330453 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce7629-114c-4b84-849c-00192a8e3b3e None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:38.356771 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c695d95-2bda-461e-b1a8-63c55f30ce5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:38.357457 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c695d95-2bda-461e-b1a8-63c55f30ce5b None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:38.357741 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c695d95-2bda-461e-b1a8-63c55f30ce5b None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:38.358016 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c695d95-2bda-461e-b1a8-63c55f30ce5b None admin] PATH_INFO: `/v3/services` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:38.359849 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c695d95-2bda-461e-b1a8-63c55f30ce5b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:38.360163 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c695d95-2bda-461e-b1a8-63c55f30ce5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:38.361536 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c695d95-2bda-461e-b1a8-63c55f30ce5b None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:38.371703 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 348/701] 10.222.0.30 () {56 vars in 1124 bytes} [Tue Jul 5 21:45:38 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:38.371703 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c695d95-2bda-461e-b1a8-63c55f30ce5b None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:38.462053 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce7629-114c-4b84-849c-00192a8e3b3e None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:38.496734 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c695d95-2bda-461e-b1a8-63c55f30ce5b None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:38.498641 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193c60c-f6b2-412f-88a3-988d4f216244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:38.499303 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193c60c-f6b2-412f-88a3-988d4f216244 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:38.499592 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193c60c-f6b2-412f-88a3-988d4f216244 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:38.499872 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193c60c-f6b2-412f-88a3-988d4f216244 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:38.521888 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:38.549532 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:38.565018 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ec2de-9ea2-4245-bd2f-85e29624ce60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:38.565018 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ec2de-9ea2-4245-bd2f-85e29624ce60 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:38.565018 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ec2de-9ea2-4245-bd2f-85e29624ce60 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:38.565018 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ec2de-9ea2-4245-bd2f-85e29624ce60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:38.565493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772ec2de-9ea2-4245-bd2f-85e29624ce60 None admin] RBAC: Adding query filter params (role.id=1884e658df064cc2a232687c678d8618, scope.project.id=93f20f89d0fc4bbf9cf557dd1e14d98d, user.id=ba028a9695364d54a73b01c986300344) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:38.565493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772ec2de-9ea2-4245-bd2f-85e29624ce60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:38.565493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772ec2de-9ea2-4245-bd2f-85e29624ce60 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:38.570387 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 349/702] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:45:38 2022] GET /identity/v3/role_assignments?user.id=ba028a9695364d54a73b01c986300344&scope.project.id=93f20f89d0fc4bbf9cf557dd1e14d98d&role.id=1884e658df064cc2a232687c678d8618 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:38.571357 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ec2de-9ea2-4245-bd2f-85e29624ce60 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:38.590723 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3193c60c-f6b2-412f-88a3-988d4f216244 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:38.593036 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3193c60c-f6b2-412f-88a3-988d4f216244 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:38.709061 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ec2de-9ea2-4245-bd2f-85e29624ce60 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:38.715784 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 354/703] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:45:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:45:38.721715 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193c60c-f6b2-412f-88a3-988d4f216244 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:38.751993 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3ab7b-aaed-49b8-8f0b-cf1db7b117c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:38.753171 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3ab7b-aaed-49b8-8f0b-cf1db7b117c2 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:38.753618 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3ab7b-aaed-49b8-8f0b-cf1db7b117c2 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:38.754067 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3ab7b-aaed-49b8-8f0b-cf1db7b117c2 None admin] PATH_INFO: `/v3/services` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:38.755021 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f3ab7b-aaed-49b8-8f0b-cf1db7b117c2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:38.755512 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f3ab7b-aaed-49b8-8f0b-cf1db7b117c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:38.757676 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f3ab7b-aaed-49b8-8f0b-cf1db7b117c2 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:38.764606 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 350/704] 10.222.0.30 () {56 vars in 1124 bytes} [Tue Jul 5 21:45:38 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:38.820507 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:38.851701 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193c60c-f6b2-412f-88a3-988d4f216244 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:38.897690 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf20ac7-2b28-43fc-b882-0f9493b9b805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:38.898698 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf20ac7-2b28-43fc-b882-0f9493b9b805 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:38.899068 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf20ac7-2b28-43fc-b882-0f9493b9b805 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:38.899464 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf20ac7-2b28-43fc-b882-0f9493b9b805 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:38.912132 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf20ac7-2b28-43fc-b882-0f9493b9b805 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:38.914406 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf20ac7-2b28-43fc-b882-0f9493b9b805 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:38.937583 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-fcf20ac7-2b28-43fc-b882-0f9493b9b805 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:38.937583 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:38.937583 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:38.937583 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:38.937583 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:38.937583 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:38.937583 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:38.937583 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:38.937583 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:38.937583 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:38.937583 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:38.937583 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:38.937583 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:38.937583 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:38.937583 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:38.938813 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:38.938813 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:38.938813 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:38.938813 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:38.938813 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:38.938813 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:38.938813 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:38.938813 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:38.938813 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:38.938813 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:38.938813 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:38.938813 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:38.938813 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:38.938813 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:38.938813 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:38.938813 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:38.938813 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:38.939998 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:38.939998 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:38.939998 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:38.939998 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:38.941501 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 355/705] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:38.949396 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3ab7b-aaed-49b8-8f0b-cf1db7b117c2 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:39.013625 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:39.076383 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3ab7b-aaed-49b8-8f0b-cf1db7b117c2 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:39.111108 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d54f0-4a6a-4ac1-b8ce-40971c6056a1 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:39.111765 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d54f0-4a6a-4ac1-b8ce-40971c6056a1 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:39.112284 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d54f0-4a6a-4ac1-b8ce-40971c6056a1 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:39.113988 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf047f-eca0-4736-b14c-0b2ee809fb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:39.114418 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 356/706] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:45:39.115284 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf047f-eca0-4736-b14c-0b2ee809fb08 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:39.115284 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf047f-eca0-4736-b14c-0b2ee809fb08 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:39.115284 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf047f-eca0-4736-b14c-0b2ee809fb08 None admin] PATH_INFO: `/v3/domains` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:39.117438 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cf047f-eca0-4736-b14c-0b2ee809fb08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:39.117438 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cf047f-eca0-4736-b14c-0b2ee809fb08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:39.118589 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cf047f-eca0-4736-b14c-0b2ee809fb08 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:39.120225 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88911d-17ef-48d9-84ee-c825513a797d None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:39.121591 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88911d-17ef-48d9-84ee-c825513a797d None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:39.121934 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88911d-17ef-48d9-84ee-c825513a797d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:39.132605 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 351/707] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:39.138706 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf047f-eca0-4736-b14c-0b2ee809fb08 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:39.151971 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-1f88911d-17ef-48d9-84ee-c825513a797d None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:39.153195 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-1f88911d-17ef-48d9-84ee-c825513a797d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:39.256125 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 357/708] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:45:39.257773 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3dbc4-2fce-4dee-ace2-45748376aced None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:39.258241 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3dbc4-2fce-4dee-ace2-45748376aced None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:39.258614 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3dbc4-2fce-4dee-ace2-45748376aced None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:39.264242 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 358/709] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:45:39.265701 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba821ad-ac96-48d9-aaf6-b896c70216e6 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:39.266068 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba821ad-ac96-48d9-aaf6-b896c70216e6 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:39.266456 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba821ad-ac96-48d9-aaf6-b896c70216e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:39.269457 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf047f-eca0-4736-b14c-0b2ee809fb08 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:39.283072 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:39.292925 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-aba821ad-ac96-48d9-aaf6-b896c70216e6 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:39.294350 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-aba821ad-ac96-48d9-aaf6-b896c70216e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:39.328145 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930ea0e-25b6-4b71-a25f-0e2b0e84c835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:39.329275 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930ea0e-25b6-4b71-a25f-0e2b0e84c835 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:39.329975 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930ea0e-25b6-4b71-a25f-0e2b0e84c835 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:39.330311 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930ea0e-25b6-4b71-a25f-0e2b0e84c835 None admin] PATH_INFO: `/v3/projects/service` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:39.340422 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8930ea0e-25b6-4b71-a25f-0e2b0e84c835 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:39.342487 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8930ea0e-25b6-4b71-a25f-0e2b0e84c835 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:39.353734 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:39.362850 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-8930ea0e-25b6-4b71-a25f-0e2b0e84c835 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:45:39.362850 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:39.362850 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:39.362850 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:39.362850 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:39.362850 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:39.362850 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:39.362850 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:39.362850 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:39.362850 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:39.362850 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:39.362850 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:39.362850 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:45:39.362850 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:45:39.362850 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:45:39.364077 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:45:39.364077 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:39.364077 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:39.364077 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:39.364077 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:39.364077 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:39.364077 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:39.364077 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:39.364077 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:39.364077 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:39.364077 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:39.364077 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:39.364077 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:39.364077 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:39.364077 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:39.364077 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:39.364077 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:39.365348 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:45:39.365348 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:45:39.365348 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:45:39.365348 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:45:39.365348 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:45:39.365348 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:45:39.365348 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:45:39.365348 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:39.370772 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 352/710] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:45:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:45:39.370772 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930ea0e-25b6-4b71-a25f-0e2b0e84c835 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:39.386261 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 359/711] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:45:39.387456 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba821ad-ac96-48d9-aaf6-b896c70216e6 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:39.501945 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930ea0e-25b6-4b71-a25f-0e2b0e84c835 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:39.538024 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba821ad-ac96-48d9-aaf6-b896c70216e6 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:39.542708 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ffd8c-77b9-4d25-a93c-92bc803d95ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:39.543711 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ffd8c-77b9-4d25-a93c-92bc803d95ca None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:39.544174 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ffd8c-77b9-4d25-a93c-92bc803d95ca None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:39.544599 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ffd8c-77b9-4d25-a93c-92bc803d95ca None admin] PATH_INFO: `/v3/services/network` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:39.545410 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ffd8c-77b9-4d25-a93c-92bc803d95ca None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:39.547008 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ffd8c-77b9-4d25-a93c-92bc803d95ca None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:39.562660 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-242ffd8c-77b9-4d25-a93c-92bc803d95ca None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 21:45:39.562660 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:39.562660 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:45:39.562660 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:45:39.562660 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:45:39.562660 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:45:39.562660 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:45:39.562660 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:45:39.562660 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 21:45:39.562660 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:39.562660 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:45:39.562660 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:39.562660 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:39.562660 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:39.562660 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:39.562660 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:39.562660 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:39.564015 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:39.564015 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:39.564015 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:39.564015 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:39.564015 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:39.564015 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:39.564015 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:45:39.564015 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:45:39.564015 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:45:39.564015 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:45:39.564015 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:39.564015 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:39.564015 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:39.564015 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:39.564015 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:39.564015 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:39.565246 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:39.565246 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:39.565246 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:39.565246 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:39.565246 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:39.565246 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:39.565246 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:39.565246 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:39.565246 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:39.565246 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:39.565246 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:45:39.565246 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:45:39.565246 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 21:45:39.565246 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:39.568140 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 353/712] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:45:39 2022] GET /identity/v3/services/network => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:39.569717 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ffd8c-77b9-4d25-a93c-92bc803d95ca None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:39.578540 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49361f12-b5f0-4b2c-b5fa-6294ae1f4d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:39.579219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49361f12-b5f0-4b2c-b5fa-6294ae1f4d36 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:39.579511 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49361f12-b5f0-4b2c-b5fa-6294ae1f4d36 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:39.579795 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49361f12-b5f0-4b2c-b5fa-6294ae1f4d36 None admin] PATH_INFO: `/v3/projects` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:39.580605 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49361f12-b5f0-4b2c-b5fa-6294ae1f4d36 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:39.581484 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49361f12-b5f0-4b2c-b5fa-6294ae1f4d36 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:39.583035 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49361f12-b5f0-4b2c-b5fa-6294ae1f4d36 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:39.605139 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 360/713] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:45:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:39.606258 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49361f12-b5f0-4b2c-b5fa-6294ae1f4d36 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:39.612145 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:39.659466 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:39.690998 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ffd8c-77b9-4d25-a93c-92bc803d95ca None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:39.718204 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49361f12-b5f0-4b2c-b5fa-6294ae1f4d36 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:39.729637 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb91ffc-4b18-44eb-b949-d76be62a7c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:39.730488 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb91ffc-4b18-44eb-b949-d76be62a7c80 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:39.730781 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb91ffc-4b18-44eb-b949-d76be62a7c80 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:39.731068 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb91ffc-4b18-44eb-b949-d76be62a7c80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:39.743126 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb91ffc-4b18-44eb-b949-d76be62a7c80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:39.744315 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb91ffc-4b18-44eb-b949-d76be62a7c80 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:39.758421 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd557415-a348-4d40-9dae-9a2f5eb496d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:39.759347 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd557415-a348-4d40-9dae-9a2f5eb496d4 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:39.759795 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd557415-a348-4d40-9dae-9a2f5eb496d4 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:39.760232 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd557415-a348-4d40-9dae-9a2f5eb496d4 None admin] PATH_INFO: `/v3/services` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:39.761103 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd557415-a348-4d40-9dae-9a2f5eb496d4 None admin] RBAC: Adding query filter params (name=network) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:39.761600 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd557415-a348-4d40-9dae-9a2f5eb496d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:39.763133 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-4bb91ffc-4b18-44eb-b949-d76be62a7c80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:39.763133 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:39.763133 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:39.763133 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:39.763133 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:39.763133 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:39.763133 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:39.763133 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:39.763133 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:39.763133 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:39.763133 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:39.763133 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:39.763133 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:39.763133 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:39.763133 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:39.764245 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:39.764245 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:39.764245 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:39.764245 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:39.764245 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:39.764245 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:39.764245 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:39.764245 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:39.764245 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:39.764245 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:39.764245 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:39.764245 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:39.764245 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:39.764245 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:39.764245 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:39.764245 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:39.764245 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:39.765459 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:39.765459 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:39.765459 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:39.765459 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:39.765965 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd557415-a348-4d40-9dae-9a2f5eb496d4 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:39.769178 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 354/714] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:39.770021 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb91ffc-4b18-44eb-b949-d76be62a7c80 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:39.772454 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 361/715] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Jul 5 21:45:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:39.773418 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd557415-a348-4d40-9dae-9a2f5eb496d4 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:39.859505 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:39.879289 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb91ffc-4b18-44eb-b949-d76be62a7c80 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:39.881283 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd557415-a348-4d40-9dae-9a2f5eb496d4 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:39.892374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:39.918463 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9eb55a-751f-43e2-94d0-e4ebd89aee67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:39.918693 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09505af4-84fd-492c-a7d2-6a685374bddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:39.919357 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09505af4-84fd-492c-a7d2-6a685374bddd None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:39.919651 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09505af4-84fd-492c-a7d2-6a685374bddd None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:39.919935 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09505af4-84fd-492c-a7d2-6a685374bddd None admin] PATH_INFO: `/v3/domains` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:39.920051 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9eb55a-751f-43e2-94d0-e4ebd89aee67 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:39.920479 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9eb55a-751f-43e2-94d0-e4ebd89aee67 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:39.920672 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09505af4-84fd-492c-a7d2-6a685374bddd None admin] RBAC: Adding query filter params (name=Default) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:39.920985 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09505af4-84fd-492c-a7d2-6a685374bddd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:39.921244 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9eb55a-751f-43e2-94d0-e4ebd89aee67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:39.922283 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9eb55a-751f-43e2-94d0-e4ebd89aee67 None admin] RBAC: Adding query filter params (role.id=e1c574c9973548ebb0e8d9e0656ccabd, scope.project.id=93f20f89d0fc4bbf9cf557dd1e14d98d, user.id=f5d82e71aafe4b6ebcf60c23c050aafb) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:39.922455 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09505af4-84fd-492c-a7d2-6a685374bddd None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:39.923007 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9eb55a-751f-43e2-94d0-e4ebd89aee67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:39.924623 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9eb55a-751f-43e2-94d0-e4ebd89aee67 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:39.935323 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 362/716] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:39.935964 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 355/717] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:45:39 2022] GET /identity/v3/role_assignments?user.id=f5d82e71aafe4b6ebcf60c23c050aafb&scope.project.id=93f20f89d0fc4bbf9cf557dd1e14d98d&role.id=e1c574c9973548ebb0e8d9e0656ccabd => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:39.942305 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09505af4-84fd-492c-a7d2-6a685374bddd None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:39.947673 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9eb55a-751f-43e2-94d0-e4ebd89aee67 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:40.051037 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09505af4-84fd-492c-a7d2-6a685374bddd None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:40.092495 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f57b5-1963-4729-8996-3b94b793fc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:40.093188 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f57b5-1963-4729-8996-3b94b793fc1d None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:40.093476 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f57b5-1963-4729-8996-3b94b793fc1d None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:40.093858 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f57b5-1963-4729-8996-3b94b793fc1d None admin] PATH_INFO: `/v3/services` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:40.094518 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f57b5-1963-4729-8996-3b94b793fc1d None admin] RBAC: Adding query filter params (type=network) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:40.094835 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f57b5-1963-4729-8996-3b94b793fc1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:40.096234 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f57b5-1963-4729-8996-3b94b793fc1d None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:40.103222 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 363/718] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Jul 5 21:45:39 2022] GET /identity/v3/services?type=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:40.107501 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9eb55a-751f-43e2-94d0-e4ebd89aee67 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:40.154872 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95abf8a5-2a2d-4702-8906-a4817a0de2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:40.155882 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abf8a5-2a2d-4702-8906-a4817a0de2ea None admin] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:40.156342 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abf8a5-2a2d-4702-8906-a4817a0de2ea None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:40.156806 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abf8a5-2a2d-4702-8906-a4817a0de2ea None admin] PATH_INFO: `/v3/users` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:40.157749 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95abf8a5-2a2d-4702-8906-a4817a0de2ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:40.159500 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95abf8a5-2a2d-4702-8906-a4817a0de2ea None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:40.272294 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 356/719] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:45:39 2022] POST /identity/v3/users => generated 254 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:45:41.116055 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435ac91-04c3-4450-bde0-d74c0bb3c88c None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:41.116770 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435ac91-04c3-4450-bde0-d74c0bb3c88c None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:41.116770 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435ac91-04c3-4450-bde0-d74c0bb3c88c None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:41.118373 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 364/720] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:45:41.123683 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea01f9b-091c-4f41-97a5-0355765461e0 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:41.124126 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea01f9b-091c-4f41-97a5-0355765461e0 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:41.124419 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea01f9b-091c-4f41-97a5-0355765461e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:41.129764 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:41.143396 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-5ea01f9b-091c-4f41-97a5-0355765461e0 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:41.144601 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-5ea01f9b-091c-4f41-97a5-0355765461e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:41.155450 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbea68e-f94a-4abd-9ad4-8dc1963dad2f None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:41.155450 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbea68e-f94a-4abd-9ad4-8dc1963dad2f None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:41.155450 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbea68e-f94a-4abd-9ad4-8dc1963dad2f None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:41.155450 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 365/721] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:45:41.155998 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df700aea-785a-48c1-99e7-3725c083131b None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:41.156286 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df700aea-785a-48c1-99e7-3725c083131b None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:41.156567 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df700aea-785a-48c1-99e7-3725c083131b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:41.178741 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-df700aea-785a-48c1-99e7-3725c083131b None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:41.180054 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-df700aea-785a-48c1-99e7-3725c083131b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:41.229878 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:41.252074 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 357/722] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:45:41.280640 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea01f9b-091c-4f41-97a5-0355765461e0 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:41.314028 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 366/723] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:45:41.346155 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df700aea-785a-48c1-99e7-3725c083131b None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:41.488945 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea01f9b-091c-4f41-97a5-0355765461e0 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:41.502941 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df700aea-785a-48c1-99e7-3725c083131b None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:41.546004 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:41.557564 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d264c8e3-9c78-4bed-92ff-6b08466114b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:41.566258 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264c8e3-9c78-4bed-92ff-6b08466114b8 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:41.566258 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264c8e3-9c78-4bed-92ff-6b08466114b8 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:41.566258 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264c8e3-9c78-4bed-92ff-6b08466114b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:41.574254 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270426a0-b54f-4b08-bb65-eecc6694b026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:41.574982 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270426a0-b54f-4b08-bb65-eecc6694b026 None admin] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:41.575278 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270426a0-b54f-4b08-bb65-eecc6694b026 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:41.575567 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270426a0-b54f-4b08-bb65-eecc6694b026 None admin] PATH_INFO: `/v3/services` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:41.576334 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270426a0-b54f-4b08-bb65-eecc6694b026 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:41.577728 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270426a0-b54f-4b08-bb65-eecc6694b026 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:41.581797 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d264c8e3-9c78-4bed-92ff-6b08466114b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:45:41.589602 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-d264c8e3-9c78-4bed-92ff-6b08466114b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:45:41.589602 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:41.589602 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:41.589602 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:41.589602 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:41.589602 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:41.589602 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:41.589602 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:41.589602 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:41.589602 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:41.589602 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:41.589602 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:41.589602 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:45:41.589602 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:45:41.589602 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:45:41.589602 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:45:41.590824 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:45:41.590824 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:45:41.590824 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:45:41.590824 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:45:41.590824 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:41.590824 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:41.590824 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:41.590824 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:41.590824 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:41.590824 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:41.590824 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:41.590824 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:41.590824 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:41.590824 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:41.590824 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:41.590824 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:41.591933 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:41.591933 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:41.591933 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:41.591933 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:41.591933 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:45:41.591933 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:45:41.591933 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:45:41.591933 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:45:41.591933 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:45:41.591933 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:45:41.591933 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:45:41.591933 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:41.595373 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 358/724] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:45:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:41.597908 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d264c8e3-9c78-4bed-92ff-6b08466114b8 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:41.701228 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 367/725] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Jul 5 21:45:41 2022] POST /identity/v3/services => generated 251 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:45:41.739675 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d264c8e3-9c78-4bed-92ff-6b08466114b8 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:41.786610 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37914fa-3e8e-4f0a-89b9-4f71753adc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:41.787420 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37914fa-3e8e-4f0a-89b9-4f71753adc80 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:41.787744 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37914fa-3e8e-4f0a-89b9-4f71753adc80 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:41.788029 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37914fa-3e8e-4f0a-89b9-4f71753adc80 None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:41.788802 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37914fa-3e8e-4f0a-89b9-4f71753adc80 None admin] RBAC: Adding query filter params (name=admin) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:41.789115 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37914fa-3e8e-4f0a-89b9-4f71753adc80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:41.790570 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37914fa-3e8e-4f0a-89b9-4f71753adc80 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:41.800372 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 359/726] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:45:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:41.810686 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270426a0-b54f-4b08-bb65-eecc6694b026 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:41.845877 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:41.940142 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270426a0-b54f-4b08-bb65-eecc6694b026 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:41.989505 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f037d-8439-4958-be0d-6eeca7cc3ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:41.990429 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f037d-8439-4958-be0d-6eeca7cc3ee5 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:41.990803 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f037d-8439-4958-be0d-6eeca7cc3ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:41.991040 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f037d-8439-4958-be0d-6eeca7cc3ee5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:42.002838 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f037d-8439-4958-be0d-6eeca7cc3ee5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:42.004304 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f037d-8439-4958-be0d-6eeca7cc3ee5 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:42.023298 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-4f5f037d-8439-4958-be0d-6eeca7cc3ee5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:42.023298 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:42.023298 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:42.023298 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:42.023298 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:42.023298 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:42.023298 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:42.023298 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:42.023298 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:42.023298 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:42.023298 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:42.023298 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:42.023298 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:42.023298 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:42.023298 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:42.025544 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:42.025544 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:42.025544 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:42.025544 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:42.025544 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:42.025544 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:42.025544 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:42.025544 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:42.025544 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:42.025544 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:42.025544 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:42.025544 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:42.025544 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:42.025544 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:42.025544 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:42.025544 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:42.025544 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:42.026903 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:42.026903 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:42.026903 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:42.026903 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:42.026903 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 368/727] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:42.030163 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37914fa-3e8e-4f0a-89b9-4f71753adc80 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:42.092608 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:42.150555 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37914fa-3e8e-4f0a-89b9-4f71753adc80 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:42.187229 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae88b8-e8e3-427b-9629-9b02d856931e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:42.187915 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae88b8-e8e3-427b-9629-9b02d856931e None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:42.188207 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae88b8-e8e3-427b-9629-9b02d856931e None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:42.188490 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae88b8-e8e3-427b-9629-9b02d856931e None admin] PATH_INFO: `/v3/domains` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:42.189230 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae88b8-e8e3-427b-9629-9b02d856931e None admin] RBAC: Adding query filter params (name=Default) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:42.189543 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae88b8-e8e3-427b-9629-9b02d856931e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:42.191028 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae88b8-e8e3-427b-9629-9b02d856931e None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:42.204355 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 360/728] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:42.211481 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f037d-8439-4958-be0d-6eeca7cc3ee5 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:42.300765 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:42.333472 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f037d-8439-4958-be0d-6eeca7cc3ee5 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:42.387075 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e7c11-1ad1-4691-959e-69afdbcd9c84 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:42.387718 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e7c11-1ad1-4691-959e-69afdbcd9c84 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:42.388206 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e7c11-1ad1-4691-959e-69afdbcd9c84 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:42.389869 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 361/729] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:45:42.390607 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc50bc-66a9-4b43-aa1a-67cb728e5da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:42.391722 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc50bc-66a9-4b43-aa1a-67cb728e5da7 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:42.392244 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc50bc-66a9-4b43-aa1a-67cb728e5da7 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:42.392714 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc50bc-66a9-4b43-aa1a-67cb728e5da7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:42.395058 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda518a-1126-4cde-b539-38e4250fcedc None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:42.395427 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda518a-1126-4cde-b539-38e4250fcedc None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:42.395783 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda518a-1126-4cde-b539-38e4250fcedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:42.401595 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc50bc-66a9-4b43-aa1a-67cb728e5da7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:42.403334 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc50bc-66a9-4b43-aa1a-67cb728e5da7 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:42.433144 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-4eda518a-1126-4cde-b539-38e4250fcedc None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:42.434695 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-4eda518a-1126-4cde-b539-38e4250fcedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:42.437943 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-81bc50bc-66a9-4b43-aa1a-67cb728e5da7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 21:45:42.437943 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:42.437943 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:42.437943 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:42.437943 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:42.437943 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:42.437943 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:42.437943 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:42.437943 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:42.437943 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:42.437943 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:42.437943 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:42.437943 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:45:42.437943 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:45:42.437943 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:45:42.437943 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:45:42.439010 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:42.439010 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:42.439010 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:45:42.439010 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:45:42.439010 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:45:42.439010 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:45:42.439010 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:42.439010 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:42.439010 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:42.439010 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:42.439010 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:42.439010 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:42.439010 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:42.439010 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:42.439010 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:42.439010 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:42.439010 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:42.439010 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:42.440048 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:42.440048 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:42.440048 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:45:42.440048 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:45:42.440048 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:45:42.440048 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:45:42.440048 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:45:42.440048 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:45:42.440048 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 21:45:42.440048 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:42.447380 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 369/730] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:45:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:42.448493 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc50bc-66a9-4b43-aa1a-67cb728e5da7 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:42.547732 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 362/731] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:42 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 21:45:42.578534 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda518a-1126-4cde-b539-38e4250fcedc None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:42.628609 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:42.654208 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc50bc-66a9-4b43-aa1a-67cb728e5da7 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:42.699455 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265d5fb-1fc0-4b8a-8119-476b709a25c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:42.700618 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265d5fb-1fc0-4b8a-8119-476b709a25c6 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:42.701227 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265d5fb-1fc0-4b8a-8119-476b709a25c6 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:42.701743 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265d5fb-1fc0-4b8a-8119-476b709a25c6 None admin] PATH_INFO: `/v3/users` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:42.702851 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7265d5fb-1fc0-4b8a-8119-476b709a25c6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:42.703504 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7265d5fb-1fc0-4b8a-8119-476b709a25c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:42.705277 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7265d5fb-1fc0-4b8a-8119-476b709a25c6 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:42.706853 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda518a-1126-4cde-b539-38e4250fcedc None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:42.708870 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:42.727346 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 370/732] 10.222.0.30 () {56 vars in 1135 bytes} [Tue Jul 5 21:45:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:42.729462 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f5adf-b321-4861-99ed-11eeffe0b633 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:42.729975 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f5adf-b321-4861-99ed-11eeffe0b633 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:42.730489 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f5adf-b321-4861-99ed-11eeffe0b633 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:42.736249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 371/733] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:45:42.737244 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f5adf-b321-4861-99ed-11eeffe0b633 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:42.745747 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ef21f-7fce-450f-bccb-636379daca30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:42.746765 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ef21f-7fce-450f-bccb-636379daca30 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:42.747156 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ef21f-7fce-450f-bccb-636379daca30 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:42.747579 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ef21f-7fce-450f-bccb-636379daca30 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:42.762159 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844ef21f-7fce-450f-bccb-636379daca30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:45:42.775544 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-844ef21f-7fce-450f-bccb-636379daca30 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:45:42.775544 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:42.775544 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:42.775544 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:42.775544 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:42.775544 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:42.775544 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:42.775544 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:42.775544 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:42.775544 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:42.775544 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:42.775544 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:42.775544 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:45:42.775544 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:45:42.775544 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:45:42.775544 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:45:42.776706 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:45:42.776706 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:45:42.776706 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:45:42.776706 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:45:42.776706 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:42.776706 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:42.776706 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:42.776706 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:42.776706 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:42.776706 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:42.776706 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:42.776706 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:42.776706 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:42.776706 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:42.776706 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:42.776706 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:42.777623 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:42.777623 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:42.777623 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:42.777623 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:42.777623 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:45:42.777623 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:45:42.777623 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:45:42.777623 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:45:42.777623 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:45:42.777623 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:45:42.777623 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:45:42.777623 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:42.782203 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 363/734] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:45:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:45:42.783733 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc488f-b4d9-4725-9132-1bc10e37f7b8 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:42.784027 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc488f-b4d9-4725-9132-1bc10e37f7b8 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:42.784308 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc488f-b4d9-4725-9132-1bc10e37f7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:42.809740 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-dafc488f-b4d9-4725-9132-1bc10e37f7b8 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:42.811439 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-dafc488f-b4d9-4725-9132-1bc10e37f7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:42.868059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f5adf-b321-4861-99ed-11eeffe0b633 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:42.904745 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c552a-357e-47a9-bde8-743025742e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:42.905406 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c552a-357e-47a9-bde8-743025742e4a None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:42.905693 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c552a-357e-47a9-bde8-743025742e4a None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:42.905973 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c552a-357e-47a9-bde8-743025742e4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:42.909405 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 364/735] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:42 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 21:45:42.911422 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc488f-b4d9-4725-9132-1bc10e37f7b8 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:42.946498 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:42.995372 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:43.003143 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c552a-357e-47a9-bde8-743025742e4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:43.004680 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c552a-357e-47a9-bde8-743025742e4a None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:43.043713 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc488f-b4d9-4725-9132-1bc10e37f7b8 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:43.088505 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fdf242-7e4e-4d97-a5d7-898433047003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:43.089100 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdf242-7e4e-4d97-a5d7-898433047003 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:43.089388 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdf242-7e4e-4d97-a5d7-898433047003 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:43.089669 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdf242-7e4e-4d97-a5d7-898433047003 None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:43.090530 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fdf242-7e4e-4d97-a5d7-898433047003 None admin] RBAC: Adding query filter params (name=admin) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:43.091062 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fdf242-7e4e-4d97-a5d7-898433047003 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:43.092231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fdf242-7e4e-4d97-a5d7-898433047003 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:43.106088 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 365/736] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:45:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:43.106088 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fdf242-7e4e-4d97-a5d7-898433047003 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:43.123728 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 372/737] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:45:42 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 21:45:43.125082 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2d0b1-f063-472f-8026-df7f63d3a9d2 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:43.125377 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2d0b1-f063-472f-8026-df7f63d3a9d2 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:43.125659 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2d0b1-f063-472f-8026-df7f63d3a9d2 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:43.127074 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 373/738] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:45:43.127632 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2d0b1-f063-472f-8026-df7f63d3a9d2 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:43.214673 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:43.223892 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fdf242-7e4e-4d97-a5d7-898433047003 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:43.231217 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:43.239758 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2d0b1-f063-472f-8026-df7f63d3a9d2 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:43.259976 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff3b68-0a0a-433d-b972-780fe43fe2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:43.260650 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff3b68-0a0a-433d-b972-780fe43fe2ab None admin] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:43.260935 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff3b68-0a0a-433d-b972-780fe43fe2ab None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:43.261213 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff3b68-0a0a-433d-b972-780fe43fe2ab None admin] PATH_INFO: `/v3/services` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:43.261946 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ff3b68-0a0a-433d-b972-780fe43fe2ab None admin] RBAC: Authorizing `identity:create_service()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:43.263360 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ff3b68-0a0a-433d-b972-780fe43fe2ab None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:43.277366 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c677b23-24fd-448f-b5c1-49760f2791bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:43.278195 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c677b23-24fd-448f-b5c1-49760f2791bd None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:43.278486 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c677b23-24fd-448f-b5c1-49760f2791bd None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:43.278764 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c677b23-24fd-448f-b5c1-49760f2791bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:43.289817 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c677b23-24fd-448f-b5c1-49760f2791bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:43.292236 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c677b23-24fd-448f-b5c1-49760f2791bd None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:43.308743 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-3c677b23-24fd-448f-b5c1-49760f2791bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:43.308743 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:43.308743 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:43.308743 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:43.308743 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:43.308743 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:43.308743 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:43.308743 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:43.308743 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:43.308743 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:43.308743 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:43.308743 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:43.308743 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:43.308743 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:43.308743 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:43.309954 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:43.309954 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:43.309954 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:43.309954 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:43.309954 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:43.309954 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:43.309954 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:43.309954 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:43.309954 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:43.309954 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:43.309954 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:43.309954 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:43.309954 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:43.309954 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:43.309954 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:43.309954 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:43.309954 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:43.315465 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:43.315465 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:43.315465 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:43.315465 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:43.315465 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 374/739] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:43.315465 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c677b23-24fd-448f-b5c1-49760f2791bd None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:43.374243 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 366/740] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Jul 5 21:45:43 2022] POST /identity/v3/services => generated 240 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:45:43.376078 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d717c16-882f-49a3-b259-f1844273c47b None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:43.376562 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d717c16-882f-49a3-b259-f1844273c47b None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:43.377559 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d717c16-882f-49a3-b259-f1844273c47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:43.427333 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-3d717c16-882f-49a3-b259-f1844273c47b None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:43.427980 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c677b23-24fd-448f-b5c1-49760f2791bd None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:43.428627 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-3d717c16-882f-49a3-b259-f1844273c47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:43.499683 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed819b-ca44-4124-b020-1afafbfd6cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:43.500513 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed819b-ca44-4124-b020-1afafbfd6cd1 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:43.500804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed819b-ca44-4124-b020-1afafbfd6cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:43.501084 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed819b-ca44-4124-b020-1afafbfd6cd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:43.513205 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 367/741] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:45:43.514623 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d717c16-882f-49a3-b259-f1844273c47b None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:43.516052 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed819b-ca44-4124-b020-1afafbfd6cd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:43.517867 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed819b-ca44-4124-b020-1afafbfd6cd1 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:43.520930 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:43.549499 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-94ed819b-ca44-4124-b020-1afafbfd6cd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:43.549499 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:43.549499 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:43.549499 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:43.549499 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:43.549499 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:43.549499 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:43.549499 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:43.549499 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:43.549499 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:43.549499 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:43.549499 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:43.549499 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:43.549499 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:43.549499 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:43.550866 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:43.550866 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:43.550866 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:43.550866 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:43.550866 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:43.550866 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:43.550866 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:43.550866 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:43.550866 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:43.550866 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:43.550866 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:43.550866 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:43.550866 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:43.550866 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:43.550866 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:43.550866 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:43.550866 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:43.552372 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:43.552372 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:43.552372 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:43.552372 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:43.552372 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 375/742] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:43.554451 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed819b-ca44-4124-b020-1afafbfd6cd1 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:43.619710 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:43.642752 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d717c16-882f-49a3-b259-f1844273c47b None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:43.678374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed819b-ca44-4124-b020-1afafbfd6cd1 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:43.692461 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d794cf8-b119-450e-b63c-1acaea09e1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:43.693481 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d794cf8-b119-450e-b63c-1acaea09e1ec None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:43.693932 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d794cf8-b119-450e-b63c-1acaea09e1ec None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:43.694736 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d794cf8-b119-450e-b63c-1acaea09e1ec None admin] PATH_INFO: `/v3/domains` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:43.695819 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d794cf8-b119-450e-b63c-1acaea09e1ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:43.696198 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d794cf8-b119-450e-b63c-1acaea09e1ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:43.698320 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d794cf8-b119-450e-b63c-1acaea09e1ec None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:43.714066 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 368/743] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:43.714935 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d794cf8-b119-450e-b63c-1acaea09e1ec None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:43.722436 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d0437-ceae-4363-9f16-7005c60d2a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:43.723256 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d0437-ceae-4363-9f16-7005c60d2a57 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:43.723544 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d0437-ceae-4363-9f16-7005c60d2a57 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:43.723831 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d0437-ceae-4363-9f16-7005c60d2a57 None admin] PATH_INFO: `/v3/roles/service` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:43.736045 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0d0437-ceae-4363-9f16-7005c60d2a57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:45:43.744374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-ac0d0437-ceae-4363-9f16-7005c60d2a57 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:45:43.744374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:43.744374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:43.744374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:43.744374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:43.744374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:43.744374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:43.744374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:43.744374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:43.744374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:43.744374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:43.744374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:43.744374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:45:43.744374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:45:43.744374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:45:43.744374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:45:43.745468 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:45:43.745468 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:45:43.745468 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:45:43.745468 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:45:43.745468 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:43.745468 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:43.745468 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:43.745468 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:43.745468 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:43.745468 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:43.745468 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:43.745468 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:43.745468 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:43.745468 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:43.745468 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:43.745468 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:43.746416 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:43.746416 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:43.746416 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:43.746416 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:43.746416 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:45:43.746416 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:45:43.746416 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:45:43.746416 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:45:43.746416 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:45:43.746416 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:45:43.746416 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:45:43.746416 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:43.746416 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 376/744] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:45:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:43.750887 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d0437-ceae-4363-9f16-7005c60d2a57 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:43.831763 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:43.842980 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d794cf8-b119-450e-b63c-1acaea09e1ec None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:43.882204 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b120b-b1f3-4b8c-9322-e8d798046833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:43.883910 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b120b-b1f3-4b8c-9322-e8d798046833 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:43.884396 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b120b-b1f3-4b8c-9322-e8d798046833 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:43.885138 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b120b-b1f3-4b8c-9322-e8d798046833 None admin] PATH_INFO: `/v3/domains` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:43.886342 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b120b-b1f3-4b8c-9322-e8d798046833 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:43.887250 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b120b-b1f3-4b8c-9322-e8d798046833 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:43.889379 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b120b-b1f3-4b8c-9322-e8d798046833 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:43.893468 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d0437-ceae-4363-9f16-7005c60d2a57 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:43.905808 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 369/745] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:43.907580 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b120b-b1f3-4b8c-9322-e8d798046833 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:43.911356 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:43.933844 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9767ae-a0f0-4aff-9421-34ba09deb299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:43.934728 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9767ae-a0f0-4aff-9421-34ba09deb299 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:43.935024 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9767ae-a0f0-4aff-9421-34ba09deb299 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:43.935416 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9767ae-a0f0-4aff-9421-34ba09deb299 None admin] PATH_INFO: `/v3/users/nova` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:43.946881 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9767ae-a0f0-4aff-9421-34ba09deb299 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:43.949000 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9767ae-a0f0-4aff-9421-34ba09deb299 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:43.968380 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-de9767ae-a0f0-4aff-9421-34ba09deb299 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:45:43.968380 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:43.968380 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:43.968380 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:43.968380 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:43.968380 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:43.968380 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:43.968380 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:43.968380 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:43.968380 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:43.968380 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:43.968380 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:43.968380 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:45:43.968380 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:45:43.968380 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:45:43.968380 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:45:43.969471 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:43.969471 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:43.969471 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:45:43.969471 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:45:43.969471 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:45:43.969471 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:45:43.969471 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:43.969471 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:43.969471 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:43.969471 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:43.969471 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:43.969471 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:43.969471 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:43.969471 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:43.969471 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:43.969471 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:43.969471 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:43.969471 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:43.970698 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:43.970698 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:43.970698 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:45:43.970698 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:45:43.970698 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:45:43.970698 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:45:43.970698 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:45:43.970698 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:45:43.970698 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:45:43.970698 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:43.970698 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 377/746] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Jul 5 21:45:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:43.971469 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9767ae-a0f0-4aff-9421-34ba09deb299 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:44.035801 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b120b-b1f3-4b8c-9322-e8d798046833 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:44.082378 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce90ead-3235-43f6-bf2c-300c2cfc0a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:44.083560 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce90ead-3235-43f6-bf2c-300c2cfc0a70 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:44.084008 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce90ead-3235-43f6-bf2c-300c2cfc0a70 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:44.084706 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce90ead-3235-43f6-bf2c-300c2cfc0a70 None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:44.086024 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce90ead-3235-43f6-bf2c-300c2cfc0a70 None admin] RBAC: Adding query filter params (name=service) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:44.086595 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce90ead-3235-43f6-bf2c-300c2cfc0a70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:44.088039 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce90ead-3235-43f6-bf2c-300c2cfc0a70 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:44.099286 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 370/747] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:45:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:44.101387 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce90ead-3235-43f6-bf2c-300c2cfc0a70 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:44.108664 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9767ae-a0f0-4aff-9421-34ba09deb299 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:44.126255 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:44.152574 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7073eba-72fe-4aa1-9e88-abeb48b1b5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:44.153304 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7073eba-72fe-4aa1-9e88-abeb48b1b5d8 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:44.153596 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7073eba-72fe-4aa1-9e88-abeb48b1b5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:44.153880 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7073eba-72fe-4aa1-9e88-abeb48b1b5d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:44.164595 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7073eba-72fe-4aa1-9e88-abeb48b1b5d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:44.167491 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7073eba-72fe-4aa1-9e88-abeb48b1b5d8 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:44.180627 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:44.188677 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-f7073eba-72fe-4aa1-9e88-abeb48b1b5d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:45:44.188677 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:44.188677 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:44.188677 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:44.188677 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:44.188677 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:44.188677 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:44.188677 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:44.188677 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:44.188677 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:44.188677 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:44.188677 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:44.188677 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:45:44.188677 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:45:44.188677 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:45:44.195293 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:45:44.195293 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:44.195293 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:44.195293 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:44.195293 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:44.195293 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:44.195293 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:44.195293 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:44.195293 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:44.195293 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:44.195293 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:44.195293 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:44.195293 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:44.195293 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:44.195293 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:44.195293 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:44.195293 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:44.196253 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:45:44.196253 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:45:44.196253 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:45:44.196253 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:45:44.196253 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:45:44.196253 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:45:44.196253 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:45:44.196253 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:44.196253 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 378/748] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:45:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:44.196253 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7073eba-72fe-4aa1-9e88-abeb48b1b5d8 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:44.238735 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce90ead-3235-43f6-bf2c-300c2cfc0a70 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:44.287003 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a672d-3036-4ea4-917b-e730c56c648b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:44.288411 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a672d-3036-4ea4-917b-e730c56c648b None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:44.288803 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a672d-3036-4ea4-917b-e730c56c648b None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:44.289226 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a672d-3036-4ea4-917b-e730c56c648b None admin] PATH_INFO: `/v3/users` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:44.290701 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4a672d-3036-4ea4-917b-e730c56c648b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:44.291130 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4a672d-3036-4ea4-917b-e730c56c648b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:44.293594 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4a672d-3036-4ea4-917b-e730c56c648b None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:44.317894 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7073eba-72fe-4aa1-9e88-abeb48b1b5d8 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:44.318480 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 371/749] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Jul 5 21:45:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:44.319750 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a672d-3036-4ea4-917b-e730c56c648b None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:44.357709 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21ccb6-7da7-46de-b99f-8ede7ccfb0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:44.359142 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21ccb6-7da7-46de-b99f-8ede7ccfb0a1 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:44.359794 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21ccb6-7da7-46de-b99f-8ede7ccfb0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:44.360282 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21ccb6-7da7-46de-b99f-8ede7ccfb0a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:44.376334 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca21ccb6-7da7-46de-b99f-8ede7ccfb0a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:44.378116 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca21ccb6-7da7-46de-b99f-8ede7ccfb0a1 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:44.396581 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-ca21ccb6-7da7-46de-b99f-8ede7ccfb0a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:44.396581 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:44.396581 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:44.396581 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:44.396581 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:44.396581 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:44.396581 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:44.396581 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:44.396581 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:44.396581 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:44.396581 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:44.396581 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:44.396581 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:44.396581 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:44.396581 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:44.398106 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:44.398106 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:44.398106 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:44.398106 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:44.398106 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:44.398106 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:44.398106 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:44.398106 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:44.398106 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:44.398106 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:44.398106 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:44.398106 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:44.398106 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:44.398106 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:44.398106 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:44.398106 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:44.398106 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:44.399175 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:44.399175 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:44.399175 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:44.399175 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:44.401459 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 379/750] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:44.402636 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21ccb6-7da7-46de-b99f-8ede7ccfb0a1 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:44.438623 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:44.447235 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a672d-3036-4ea4-917b-e730c56c648b None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:44.471347 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:44.485461 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e831b-4efd-4a61-8e90-eb5619b212e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:44.486666 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e831b-4efd-4a61-8e90-eb5619b212e4 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:44.487114 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e831b-4efd-4a61-8e90-eb5619b212e4 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:44.487681 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e831b-4efd-4a61-8e90-eb5619b212e4 None admin] PATH_INFO: `/v3/projects` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:44.489401 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e831b-4efd-4a61-8e90-eb5619b212e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:44.489877 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e831b-4efd-4a61-8e90-eb5619b212e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:44.491553 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e831b-4efd-4a61-8e90-eb5619b212e4 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:44.510046 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 372/751] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:45:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:44.510965 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e831b-4efd-4a61-8e90-eb5619b212e4 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:44.520528 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21ccb6-7da7-46de-b99f-8ede7ccfb0a1 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:44.562162 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420fc4a7-2941-462e-825a-af55de1c6110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:44.563021 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fc4a7-2941-462e-825a-af55de1c6110 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:44.563487 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fc4a7-2941-462e-825a-af55de1c6110 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:44.563836 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fc4a7-2941-462e-825a-af55de1c6110 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:44.574675 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420fc4a7-2941-462e-825a-af55de1c6110 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:44.576162 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420fc4a7-2941-462e-825a-af55de1c6110 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:44.595207 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-420fc4a7-2941-462e-825a-af55de1c6110 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:44.595207 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:44.595207 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:44.595207 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:44.595207 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:44.595207 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:44.595207 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:44.595207 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:44.595207 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:44.595207 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:44.595207 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:44.595207 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:44.595207 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:44.595207 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:44.595207 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:44.596452 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:44.596452 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:44.596452 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:44.596452 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:44.596452 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:44.596452 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:44.596452 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:44.596452 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:44.596452 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:44.596452 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:44.596452 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:44.596452 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:44.596452 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:44.596452 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:44.596452 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:44.596452 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:44.596452 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:44.597434 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:44.597434 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:44.597434 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:44.597434 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:44.597434 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 380/752] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:44.598105 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22696729-5f89-4079-b841-7f676b5c8d77 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:44.598258 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22696729-5f89-4079-b841-7f676b5c8d77 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:44.598463 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22696729-5f89-4079-b841-7f676b5c8d77 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:44.600668 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 381/753] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:45:44.601450 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22696729-5f89-4079-b841-7f676b5c8d77 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:44.635000 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e831b-4efd-4a61-8e90-eb5619b212e4 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:44.672917 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448bd7e5-be47-4c0d-b701-33c1915e63c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:44.673866 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448bd7e5-be47-4c0d-b701-33c1915e63c1 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:44.674373 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448bd7e5-be47-4c0d-b701-33c1915e63c1 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:44.674941 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448bd7e5-be47-4c0d-b701-33c1915e63c1 None admin] PATH_INFO: `/v3/domains` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:44.676001 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448bd7e5-be47-4c0d-b701-33c1915e63c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:44.676418 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448bd7e5-be47-4c0d-b701-33c1915e63c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:44.677803 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448bd7e5-be47-4c0d-b701-33c1915e63c1 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:44.684627 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:44.691332 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 373/754] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:44.692296 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448bd7e5-be47-4c0d-b701-33c1915e63c1 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:44.713259 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22696729-5f89-4079-b841-7f676b5c8d77 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:44.745252 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:44.749604 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e2d92-3290-470b-8fd1-b2fb8968c369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:44.750314 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e2d92-3290-470b-8fd1-b2fb8968c369 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:44.750589 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e2d92-3290-470b-8fd1-b2fb8968c369 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:44.750871 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e2d92-3290-470b-8fd1-b2fb8968c369 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:44.752065 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e2d92-3290-470b-8fd1-b2fb8968c369 None admin] RBAC: Adding query filter params (role.id=e1c574c9973548ebb0e8d9e0656ccabd, scope.project.id=93f20f89d0fc4bbf9cf557dd1e14d98d, user.id=ba028a9695364d54a73b01c986300344) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:44.752533 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e2d92-3290-470b-8fd1-b2fb8968c369 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:44.753817 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e2d92-3290-470b-8fd1-b2fb8968c369 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:44.760153 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 382/755] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:45:44 2022] GET /identity/v3/role_assignments?user.id=ba028a9695364d54a73b01c986300344&scope.project.id=93f20f89d0fc4bbf9cf557dd1e14d98d&role.id=e1c574c9973548ebb0e8d9e0656ccabd => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:44.761363 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00fc46f-7a1b-4475-b6f1-fae021c105eb None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:44.761656 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00fc46f-7a1b-4475-b6f1-fae021c105eb None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:44.761937 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00fc46f-7a1b-4475-b6f1-fae021c105eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:44.780588 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-f00fc46f-7a1b-4475-b6f1-fae021c105eb None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:44.781886 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-f00fc46f-7a1b-4475-b6f1-fae021c105eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:44.838588 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448bd7e5-be47-4c0d-b701-33c1915e63c1 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:44.870151 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 383/756] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:45:44.870151 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00fc46f-7a1b-4475-b6f1-fae021c105eb None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:44.907696 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488534a3-c050-43c4-816a-7ffc5b8dd96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:44.909054 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488534a3-c050-43c4-816a-7ffc5b8dd96e None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:44.909650 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488534a3-c050-43c4-816a-7ffc5b8dd96e None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:44.910513 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488534a3-c050-43c4-816a-7ffc5b8dd96e None admin] PATH_INFO: `/v3/domains` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:44.911279 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488534a3-c050-43c4-816a-7ffc5b8dd96e None admin] RBAC: Adding query filter params (name=Default) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:44.911593 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488534a3-c050-43c4-816a-7ffc5b8dd96e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:44.915787 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488534a3-c050-43c4-816a-7ffc5b8dd96e None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:44.934316 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 374/757] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:44.935567 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488534a3-c050-43c4-816a-7ffc5b8dd96e None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:44.970331 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:45.001961 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00fc46f-7a1b-4475-b6f1-fae021c105eb None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:45.047494 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ccd5d1-9ff2-4a21-85ff-0b312a8b64ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:45.049052 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ccd5d1-9ff2-4a21-85ff-0b312a8b64ca None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:45.050051 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ccd5d1-9ff2-4a21-85ff-0b312a8b64ca None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:45.050591 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ccd5d1-9ff2-4a21-85ff-0b312a8b64ca None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:45.061183 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ccd5d1-9ff2-4a21-85ff-0b312a8b64ca None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:45.063681 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ccd5d1-9ff2-4a21-85ff-0b312a8b64ca None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:45.071922 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488534a3-c050-43c4-816a-7ffc5b8dd96e None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:45.073689 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:45.086147 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-a1ccd5d1-9ff2-4a21-85ff-0b312a8b64ca None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 21:45:45.086147 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:45.086147 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:45.086147 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:45.086147 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:45.086147 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:45.086147 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:45.086147 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:45.086147 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:45.086147 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:45.086147 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:45.086147 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:45.086147 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:45:45.086147 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:45:45.086147 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:45:45.086147 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:45:45.087297 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:45.087297 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:45.087297 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:45:45.087297 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:45:45.087297 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:45:45.087297 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:45:45.087297 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:45.087297 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:45.087297 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:45.087297 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:45.087297 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:45.087297 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:45.087297 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:45.087297 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:45.087297 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:45.087297 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:45.087297 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:45.087297 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:45.088337 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:45.088337 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:45.088337 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:45:45.088337 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:45:45.088337 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:45:45.088337 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:45:45.088337 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:45:45.088337 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:45:45.088337 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 21:45:45.088337 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:45.096122 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 384/758] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Jul 5 21:45:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:45.096122 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ccd5d1-9ff2-4a21-85ff-0b312a8b64ca None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:45.120856 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b9e1f-8e8b-4af7-8f06-fd8049f092d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:45.122019 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b9e1f-8e8b-4af7-8f06-fd8049f092d2 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:45.122513 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b9e1f-8e8b-4af7-8f06-fd8049f092d2 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:45.123024 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b9e1f-8e8b-4af7-8f06-fd8049f092d2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:45.124959 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0b9e1f-8e8b-4af7-8f06-fd8049f092d2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:45.126592 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0b9e1f-8e8b-4af7-8f06-fd8049f092d2 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:45.140348 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-2b0b9e1f-8e8b-4af7-8f06-fd8049f092d2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 21:45:45.140348 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:45.140348 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:45:45.140348 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:45:45.140348 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:45:45.140348 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:45:45.140348 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:45:45.140348 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:45:45.140348 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 21:45:45.140348 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:45.140348 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:45:45.140348 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:45.140348 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:45.140348 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:45.140348 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:45.140348 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:45.141562 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:45.141562 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:45.141562 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:45.141562 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:45.141562 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:45.141562 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:45.141562 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:45.141562 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:45:45.141562 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:45:45.141562 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:45:45.141562 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:45:45.141562 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:45.141562 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:45.141562 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:45.141562 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:45.141562 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:45.142785 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:45.142785 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:45.142785 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:45.142785 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:45.142785 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:45.142785 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:45.142785 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:45.142785 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:45.142785 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:45.142785 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:45.142785 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:45.142785 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:45:45.142785 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:45:45.142785 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 21:45:45.142785 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:45.145410 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 375/759] 10.222.0.30 () {56 vars in 1129 bytes} [Tue Jul 5 21:45:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:45.146388 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b9e1f-8e8b-4af7-8f06-fd8049f092d2 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:45.227881 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ccd5d1-9ff2-4a21-85ff-0b312a8b64ca None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:45.258105 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b9e1f-8e8b-4af7-8f06-fd8049f092d2 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:45.262934 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:45.269027 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54495be0-59ec-439b-9a94-9dff1eccf81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:45.269977 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54495be0-59ec-439b-9a94-9dff1eccf81e None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:45.270363 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54495be0-59ec-439b-9a94-9dff1eccf81e None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:45.270756 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54495be0-59ec-439b-9a94-9dff1eccf81e None admin] PATH_INFO: `/v3/projects/service` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:45.278977 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54495be0-59ec-439b-9a94-9dff1eccf81e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:45.280714 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54495be0-59ec-439b-9a94-9dff1eccf81e None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:45.296065 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-54495be0-59ec-439b-9a94-9dff1eccf81e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:45:45.296065 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:45.296065 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:45.296065 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:45.296065 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:45.296065 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:45.296065 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:45.296065 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:45.296065 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:45.296065 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:45.296065 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:45.296065 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:45.296065 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:45:45.296065 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:45:45.296065 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:45:45.297059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:45:45.297059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:45.297059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:45.297059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:45.297059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:45.297059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:45.297059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:45.297059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:45.297059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:45.297059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:45.297059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:45.297059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:45.297059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:45.297059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:45.297059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:45.297059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:45.297059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:45.298043 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:45:45.298043 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:45:45.298043 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:45:45.298043 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:45:45.298043 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:45:45.298043 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:45:45.298043 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:45:45.298043 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:45.302209 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 385/760] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:45:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:45.304307 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54495be0-59ec-439b-9a94-9dff1eccf81e None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:45.306733 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2618cf-1f1f-413b-864a-5e5dc3d0b16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:45.308156 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2618cf-1f1f-413b-864a-5e5dc3d0b16f None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:45.308877 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2618cf-1f1f-413b-864a-5e5dc3d0b16f None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:45.309602 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2618cf-1f1f-413b-864a-5e5dc3d0b16f None admin] PATH_INFO: `/v3/users` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:45.310925 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2618cf-1f1f-413b-864a-5e5dc3d0b16f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:45.311471 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2618cf-1f1f-413b-864a-5e5dc3d0b16f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:45.313147 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2618cf-1f1f-413b-864a-5e5dc3d0b16f None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:45.332056 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 376/761] 10.222.0.30 () {56 vars in 1149 bytes} [Tue Jul 5 21:45:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:45.333311 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2618cf-1f1f-413b-864a-5e5dc3d0b16f None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:45.363643 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:45.421873 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54495be0-59ec-439b-9a94-9dff1eccf81e None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:45.444551 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2618cf-1f1f-413b-864a-5e5dc3d0b16f None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:45.458896 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4304881-6de8-45fe-bca7-22f9612b54e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:45.459789 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4304881-6de8-45fe-bca7-22f9612b54e6 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:45.460085 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4304881-6de8-45fe-bca7-22f9612b54e6 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:45.460371 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4304881-6de8-45fe-bca7-22f9612b54e6 None admin] PATH_INFO: `/v3/services` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:45.461101 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4304881-6de8-45fe-bca7-22f9612b54e6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:45.461419 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4304881-6de8-45fe-bca7-22f9612b54e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:45.462852 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4304881-6de8-45fe-bca7-22f9612b54e6 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:45.472754 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 386/762] 10.222.0.30 () {56 vars in 1124 bytes} [Tue Jul 5 21:45:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:45.473650 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4304881-6de8-45fe-bca7-22f9612b54e6 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:45.484675 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7397e39-2f8e-470b-8f6d-206495f21e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:45.485640 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7397e39-2f8e-470b-8f6d-206495f21e94 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:45.486201 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7397e39-2f8e-470b-8f6d-206495f21e94 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:45.486695 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7397e39-2f8e-470b-8f6d-206495f21e94 None admin] PATH_INFO: `/v3/projects` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:45.487726 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7397e39-2f8e-470b-8f6d-206495f21e94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:45.488250 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7397e39-2f8e-470b-8f6d-206495f21e94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:45.489907 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7397e39-2f8e-470b-8f6d-206495f21e94 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:45.502705 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 377/763] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:45:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:45.507998 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7397e39-2f8e-470b-8f6d-206495f21e94 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:45.541169 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:45.595963 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4304881-6de8-45fe-bca7-22f9612b54e6 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:45.613018 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:45.628938 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7397e39-2f8e-470b-8f6d-206495f21e94 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:45.632784 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2465fe12-8ceb-4dbd-8941-c53c4750b89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:45.633444 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465fe12-8ceb-4dbd-8941-c53c4750b89c None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:45.633737 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465fe12-8ceb-4dbd-8941-c53c4750b89c None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:45.634076 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465fe12-8ceb-4dbd-8941-c53c4750b89c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:45.666947 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994fd2e7-b5e9-4e3c-a3b8-311cda319eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:45.667930 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fd2e7-b5e9-4e3c-a3b8-311cda319eba None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:45.668218 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fd2e7-b5e9-4e3c-a3b8-311cda319eba None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:45.668498 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fd2e7-b5e9-4e3c-a3b8-311cda319eba None admin] PATH_INFO: `/v3/services` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:45.669245 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994fd2e7-b5e9-4e3c-a3b8-311cda319eba None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:45.669560 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994fd2e7-b5e9-4e3c-a3b8-311cda319eba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:45.670980 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994fd2e7-b5e9-4e3c-a3b8-311cda319eba None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:45.676008 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 378/764] 10.222.0.30 () {56 vars in 1124 bytes} [Tue Jul 5 21:45:45 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:45.676771 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994fd2e7-b5e9-4e3c-a3b8-311cda319eba None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:45.710461 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2465fe12-8ceb-4dbd-8941-c53c4750b89c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:45.712201 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2465fe12-8ceb-4dbd-8941-c53c4750b89c None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:45.769960 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:45.787639 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994fd2e7-b5e9-4e3c-a3b8-311cda319eba None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:45.826924 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202e5ad-81b2-4c1c-9156-81d383b10075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:45.827829 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202e5ad-81b2-4c1c-9156-81d383b10075 None admin] REQUEST_METHOD: `PUT` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:45.828113 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202e5ad-81b2-4c1c-9156-81d383b10075 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:45.828390 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202e5ad-81b2-4c1c-9156-81d383b10075 None admin] PATH_INFO: `/v3/projects/93f20f89d0fc4bbf9cf557dd1e14d98d/users/f5d82e71aafe4b6ebcf60c23c050aafb/roles/e1c574c9973548ebb0e8d9e0656ccabd` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:45.829209 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 387/765] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:45:45 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:45:45.830447 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4202e5ad-81b2-4c1c-9156-81d383b10075 None admin] RBAC: Authorizing `identity:create_grant(project_id=93f20f89d0fc4bbf9cf557dd1e14d98d, user_id=f5d82e71aafe4b6ebcf60c23c050aafb, role_id=e1c574c9973548ebb0e8d9e0656ccabd)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:45.830577 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9f901-af75-49a7-9395-71a1d7628361 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:45.830758 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9f901-af75-49a7-9395-71a1d7628361 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:45.831031 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9f901-af75-49a7-9395-71a1d7628361 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:45.831889 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4202e5ad-81b2-4c1c-9156-81d383b10075 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:45.834176 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 388/766] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:45:45.834176 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9f901-af75-49a7-9395-71a1d7628361 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:45.910695 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 379/767] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:45:45 2022] PUT /identity/v3/projects/93f20f89d0fc4bbf9cf557dd1e14d98d/users/f5d82e71aafe4b6ebcf60c23c050aafb/roles/e1c574c9973548ebb0e8d9e0656ccabd => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:45:45.911798 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202e5ad-81b2-4c1c-9156-81d383b10075 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:45.926251 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:45.957371 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9f901-af75-49a7-9395-71a1d7628361 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:46.007814 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af22fa3-4e00-496b-8938-e91eff804e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:46.008765 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af22fa3-4e00-496b-8938-e91eff804e6d None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:46.009058 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af22fa3-4e00-496b-8938-e91eff804e6d None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:46.009338 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af22fa3-4e00-496b-8938-e91eff804e6d None admin] PATH_INFO: `/v3/endpoints` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:46.010254 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af22fa3-4e00-496b-8938-e91eff804e6d None admin] RBAC: Adding query filter params (interface=public, service_id=8a3b5eca8c6c4d21bd8af3b94312bb89, region_id=RegionOne) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:46.010990 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af22fa3-4e00-496b-8938-e91eff804e6d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:46.012770 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af22fa3-4e00-496b-8938-e91eff804e6d None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:46.029585 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 389/768] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Jul 5 21:45:45 2022] GET /identity/v3/endpoints?service_id=8a3b5eca8c6c4d21bd8af3b94312bb89&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:46.029585 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c87bc7-c960-4451-94d4-74413bc4e21b None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:46.029585 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c87bc7-c960-4451-94d4-74413bc4e21b None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:46.029585 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c87bc7-c960-4451-94d4-74413bc4e21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:46.054618 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-57c87bc7-c960-4451-94d4-74413bc4e21b None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:46.056712 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-57c87bc7-c960-4451-94d4-74413bc4e21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:46.066985 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202e5ad-81b2-4c1c-9156-81d383b10075 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:46.079276 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:46.118649 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b213c2-b0be-4315-977b-9e386c24c931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:46.119462 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b213c2-b0be-4315-977b-9e386c24c931 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:46.119750 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b213c2-b0be-4315-977b-9e386c24c931 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:46.120036 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b213c2-b0be-4315-977b-9e386c24c931 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:46.132857 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b213c2-b0be-4315-977b-9e386c24c931 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:46.134495 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b213c2-b0be-4315-977b-9e386c24c931 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:46.152476 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 390/769] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:45:46.153640 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c87bc7-c960-4451-94d4-74413bc4e21b None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:46.159317 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-e6b213c2-b0be-4315-977b-9e386c24c931 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:46.159317 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:46.159317 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:46.159317 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:46.159317 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:46.159317 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:46.159317 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:46.159317 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:46.159317 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:46.159317 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:46.159317 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:46.159317 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:46.159317 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:46.159317 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:46.159317 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:46.160480 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:46.160480 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:46.160480 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:46.160480 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:46.160480 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:46.160480 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:46.160480 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:46.160480 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:46.160480 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:46.160480 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:46.160480 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:46.160480 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:46.160480 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:46.160480 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:46.160480 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:46.160480 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:46.160480 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:46.161690 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:46.161690 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:46.161690 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:46.161690 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:46.161690 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 380/770] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:46.165908 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b213c2-b0be-4315-977b-9e386c24c931 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:46.251544 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:46.270909 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c87bc7-c960-4451-94d4-74413bc4e21b None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:46.302972 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b213c2-b0be-4315-977b-9e386c24c931 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:46.307654 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a86ef3e-3b1d-4e01-981a-8d1c8ddf7897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:46.307953 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a86ef3e-3b1d-4e01-981a-8d1c8ddf7897 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:46.308244 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a86ef3e-3b1d-4e01-981a-8d1c8ddf7897 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:46.308525 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a86ef3e-3b1d-4e01-981a-8d1c8ddf7897 None admin] PATH_INFO: `/v3/services` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:46.309225 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a86ef3e-3b1d-4e01-981a-8d1c8ddf7897 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:46.310670 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a86ef3e-3b1d-4e01-981a-8d1c8ddf7897 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:46.322219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 391/771] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Jul 5 21:45:46 2022] GET /identity/v3/services => generated 772 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:46.322219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a86ef3e-3b1d-4e01-981a-8d1c8ddf7897 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:46.352589 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:46.376378 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984fe24c-d320-4c9b-b040-1d15c96c039c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:46.377115 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fe24c-d320-4c9b-b040-1d15c96c039c None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:46.377400 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fe24c-d320-4c9b-b040-1d15c96c039c None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:46.377680 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fe24c-d320-4c9b-b040-1d15c96c039c None admin] PATH_INFO: `/v3/domains` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:46.378527 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984fe24c-d320-4c9b-b040-1d15c96c039c None admin] RBAC: Adding query filter params (name=Default) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:46.378912 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984fe24c-d320-4c9b-b040-1d15c96c039c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:46.380335 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984fe24c-d320-4c9b-b040-1d15c96c039c None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:46.414019 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 381/772] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:46.419956 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984fe24c-d320-4c9b-b040-1d15c96c039c None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:46.498199 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a86ef3e-3b1d-4e01-981a-8d1c8ddf7897 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:46.543241 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bac404-d9de-4062-a4c7-705f673c2647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:46.544453 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bac404-d9de-4062-a4c7-705f673c2647 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:46.545035 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bac404-d9de-4062-a4c7-705f673c2647 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:46.545524 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bac404-d9de-4062-a4c7-705f673c2647 None admin] PATH_INFO: `/v3/services/network` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:46.546554 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bac404-d9de-4062-a4c7-705f673c2647 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:46.548160 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bac404-d9de-4062-a4c7-705f673c2647 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:46.566019 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984fe24c-d320-4c9b-b040-1d15c96c039c None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:46.568037 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-07bac404-d9de-4062-a4c7-705f673c2647 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 21:45:46.568037 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:46.568037 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:45:46.568037 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:45:46.568037 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:45:46.568037 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:45:46.568037 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:45:46.568037 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:45:46.568037 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 21:45:46.568037 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:46.568037 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:45:46.568037 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:46.568037 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:46.568037 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:46.568037 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:46.568037 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:46.568037 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:46.569536 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:46.569536 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:46.569536 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:46.569536 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:46.569536 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:46.569536 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:46.569536 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:45:46.569536 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:45:46.569536 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:45:46.569536 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:45:46.569536 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:46.569536 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:46.569536 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:46.569536 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:46.569536 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:46.569536 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:46.570478 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:46.570478 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:46.570478 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:46.570478 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:46.570478 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:46.570478 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:46.570478 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:46.570478 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:46.570478 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:46.570478 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:46.570478 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:45:46.570478 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:45:46.570478 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 21:45:46.570478 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:46.573977 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 392/773] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:45:46 2022] GET /identity/v3/services/network => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:46.580340 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bac404-d9de-4062-a4c7-705f673c2647 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:46.596199 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:46.612007 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c1a75-ae60-47d8-a5d2-89169ebb1f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:46.614203 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c1a75-ae60-47d8-a5d2-89169ebb1f10 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:46.614203 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c1a75-ae60-47d8-a5d2-89169ebb1f10 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:46.614203 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c1a75-ae60-47d8-a5d2-89169ebb1f10 None admin] PATH_INFO: `/v3/projects/service` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:46.622463 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c1a75-ae60-47d8-a5d2-89169ebb1f10 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:46.624160 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c1a75-ae60-47d8-a5d2-89169ebb1f10 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:46.640170 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-634c1a75-ae60-47d8-a5d2-89169ebb1f10 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:45:46.640170 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:46.640170 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:46.640170 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:46.640170 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:46.640170 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:46.640170 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:46.640170 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:46.640170 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:46.640170 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:46.640170 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:46.640170 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:46.640170 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:45:46.640170 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:45:46.640170 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:45:46.641212 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:45:46.641212 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:46.641212 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:46.641212 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:46.641212 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:46.641212 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:46.641212 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:46.641212 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:46.641212 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:46.641212 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:46.641212 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:46.641212 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:46.641212 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:46.641212 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:46.641212 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:46.641212 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:46.641212 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:46.647942 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:45:46.647942 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:45:46.647942 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:45:46.647942 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:45:46.647942 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:45:46.647942 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:45:46.647942 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:45:46.647942 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:46.647942 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 382/774] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:45:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:45:46.649953 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c1a75-ae60-47d8-a5d2-89169ebb1f10 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:46.684202 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:46.707694 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bac404-d9de-4062-a4c7-705f673c2647 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:46.746304 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3dea7-dd41-48d0-8d7d-ffdb11cb629e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:46.747382 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3dea7-dd41-48d0-8d7d-ffdb11cb629e None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:46.747900 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3dea7-dd41-48d0-8d7d-ffdb11cb629e None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:46.748507 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3dea7-dd41-48d0-8d7d-ffdb11cb629e None admin] PATH_INFO: `/v3/services` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:46.749540 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf3dea7-dd41-48d0-8d7d-ffdb11cb629e None admin] RBAC: Adding query filter params (name=network) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:46.750059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf3dea7-dd41-48d0-8d7d-ffdb11cb629e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:46.751789 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf3dea7-dd41-48d0-8d7d-ffdb11cb629e None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:46.762330 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 393/775] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Jul 5 21:45:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:45:46.763989 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3dea7-dd41-48d0-8d7d-ffdb11cb629e None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:46.855707 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c1a75-ae60-47d8-a5d2-89169ebb1f10 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:46.874463 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3dea7-dd41-48d0-8d7d-ffdb11cb629e None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:46.911857 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26820c1-8d22-4bb9-b843-d29ef3608daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:46.913758 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26820c1-8d22-4bb9-b843-d29ef3608daf None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:46.914333 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26820c1-8d22-4bb9-b843-d29ef3608daf None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:46.914853 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26820c1-8d22-4bb9-b843-d29ef3608daf None admin] PATH_INFO: `/v3/services` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:46.915841 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26820c1-8d22-4bb9-b843-d29ef3608daf None admin] RBAC: Adding query filter params (type=network) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:46.916360 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26820c1-8d22-4bb9-b843-d29ef3608daf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:46.918087 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26820c1-8d22-4bb9-b843-d29ef3608daf None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:46.928617 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 394/776] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Jul 5 21:45:46 2022] GET /identity/v3/services?type=network => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:45:46.930319 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26820c1-8d22-4bb9-b843-d29ef3608daf None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:46.931029 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ed717-8360-4387-9e4c-983e83e31565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:46.931935 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ed717-8360-4387-9e4c-983e83e31565 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:46.932810 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ed717-8360-4387-9e4c-983e83e31565 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:46.935630 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ed717-8360-4387-9e4c-983e83e31565 None admin] PATH_INFO: `/v3/projects` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:46.936669 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ed717-8360-4387-9e4c-983e83e31565 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:46.937197 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ed717-8360-4387-9e4c-983e83e31565 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:46.942064 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ed717-8360-4387-9e4c-983e83e31565 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:46.947537 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:46.959136 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 383/777] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:45:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:45:46.966871 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152cf2eb-bac7-484d-bc03-b4ef3d243ac1 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:46.966871 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152cf2eb-bac7-484d-bc03-b4ef3d243ac1 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:46.966871 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152cf2eb-bac7-484d-bc03-b4ef3d243ac1 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:46.970447 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 384/778] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:46 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:45:46.971395 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152cf2eb-bac7-484d-bc03-b4ef3d243ac1 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:47.030185 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:47.058710 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26820c1-8d22-4bb9-b843-d29ef3608daf None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:47.101060 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef326605-f291-415d-8e2c-6e5def94bf03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:47.101994 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef326605-f291-415d-8e2c-6e5def94bf03 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:47.102515 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef326605-f291-415d-8e2c-6e5def94bf03 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:47.103308 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef326605-f291-415d-8e2c-6e5def94bf03 None admin] PATH_INFO: `/v3/endpoints` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:47.104486 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef326605-f291-415d-8e2c-6e5def94bf03 None admin] RBAC: Adding query filter params (interface=public, service_id=16bb446791d8416cab2494c621ecc60d, region_id=RegionOne) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:47.104959 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef326605-f291-415d-8e2c-6e5def94bf03 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:47.105347 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152cf2eb-bac7-484d-bc03-b4ef3d243ac1 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:47.106776 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef326605-f291-415d-8e2c-6e5def94bf03 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:47.117418 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 395/779] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Jul 5 21:45:46 2022] GET /identity/v3/endpoints?service_id=16bb446791d8416cab2494c621ecc60d&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:47.119086 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b8eb9-62c1-4c36-b440-04681805bf35 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:47.119580 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b8eb9-62c1-4c36-b440-04681805bf35 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:47.120000 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b8eb9-62c1-4c36-b440-04681805bf35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:47.139633 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-1e1b8eb9-62c1-4c36-b440-04681805bf35 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:47.141093 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-1e1b8eb9-62c1-4c36-b440-04681805bf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:47.158851 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9e6a7-4cfd-4a9c-b4a0-992d18280187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:47.159513 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9e6a7-4cfd-4a9c-b4a0-992d18280187 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:47.159901 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9e6a7-4cfd-4a9c-b4a0-992d18280187 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:47.160283 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9e6a7-4cfd-4a9c-b4a0-992d18280187 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:47.161237 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9e6a7-4cfd-4a9c-b4a0-992d18280187 None admin] RBAC: Adding query filter params (role.id=1884e658df064cc2a232687c678d8618, scope.project.id=93f20f89d0fc4bbf9cf557dd1e14d98d, user.id=5fb6e97b5a864998a407db6a3bf21d79) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:47.161691 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9e6a7-4cfd-4a9c-b4a0-992d18280187 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:47.163974 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9e6a7-4cfd-4a9c-b4a0-992d18280187 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:47.170091 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 385/780] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:45:46 2022] GET /identity/v3/role_assignments?user.id=5fb6e97b5a864998a407db6a3bf21d79&scope.project.id=93f20f89d0fc4bbf9cf557dd1e14d98d&role.id=1884e658df064cc2a232687c678d8618 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:47.171245 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9e6a7-4cfd-4a9c-b4a0-992d18280187 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:47.266454 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:47.276840 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 396/781] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:45:47.317978 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b8eb9-62c1-4c36-b440-04681805bf35 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:47.343823 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9e6a7-4cfd-4a9c-b4a0-992d18280187 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:47.351208 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:47.423545 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e264697-2f05-4da6-a629-46c1fe60b3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:47.424154 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e264697-2f05-4da6-a629-46c1fe60b3d7 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:47.424454 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e264697-2f05-4da6-a629-46c1fe60b3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:47.424746 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e264697-2f05-4da6-a629-46c1fe60b3d7 None admin] PATH_INFO: `/v3/services` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:47.425460 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e264697-2f05-4da6-a629-46c1fe60b3d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:47.426884 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e264697-2f05-4da6-a629-46c1fe60b3d7 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:47.442173 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 386/782] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Jul 5 21:45:47 2022] GET /identity/v3/services => generated 772 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:47.452661 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b8eb9-62c1-4c36-b440-04681805bf35 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:47.504727 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c13863-9e32-4182-b7f1-e05660ded611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:47.505537 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c13863-9e32-4182-b7f1-e05660ded611 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:47.505878 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c13863-9e32-4182-b7f1-e05660ded611 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:47.507019 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c13863-9e32-4182-b7f1-e05660ded611 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:47.519667 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c13863-9e32-4182-b7f1-e05660ded611 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:45:47.528124 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-20c13863-9e32-4182-b7f1-e05660ded611 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:45:47.528124 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:47.528124 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:47.528124 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:47.528124 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:47.528124 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:47.528124 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:47.528124 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:47.528124 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:47.528124 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:47.528124 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:47.528124 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:47.528124 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:45:47.528124 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:45:47.528124 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:45:47.528124 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:45:47.529163 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:45:47.529163 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:45:47.529163 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:45:47.529163 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:45:47.529163 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:47.529163 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:47.529163 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:47.529163 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:47.529163 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:47.529163 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:47.529163 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:47.529163 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:47.529163 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:47.529163 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:47.529163 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:47.529163 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:47.530081 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:47.530081 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:47.530081 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:47.530081 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:47.530081 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:45:47.530081 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:45:47.530081 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:45:47.530081 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:45:47.530081 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:45:47.530081 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:45:47.530081 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:45:47.530081 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:47.530081 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 397/783] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:45:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:47.535591 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e264697-2f05-4da6-a629-46c1fe60b3d7 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:47.681374 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e264697-2f05-4da6-a629-46c1fe60b3d7 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:47.721366 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ab382-22df-49b4-bc98-388733897d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:47.722061 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ab382-22df-49b4-bc98-388733897d8f None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:47.722381 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ab382-22df-49b4-bc98-388733897d8f None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:47.722665 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ab382-22df-49b4-bc98-388733897d8f None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:47.723441 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ab382-22df-49b4-bc98-388733897d8f None admin] RBAC: Adding query filter params (name=admin) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:47.723750 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ab382-22df-49b4-bc98-388733897d8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:47.727942 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ab382-22df-49b4-bc98-388733897d8f None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:47.738777 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 387/784] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:45:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:47.745026 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c13863-9e32-4182-b7f1-e05660ded611 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:47.822414 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:47.890689 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c13863-9e32-4182-b7f1-e05660ded611 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:47.939939 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e8b8e-1d8f-4225-a0c2-750e28784c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:47.941118 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e8b8e-1d8f-4225-a0c2-750e28784c44 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:47.941614 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e8b8e-1d8f-4225-a0c2-750e28784c44 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:47.942099 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e8b8e-1d8f-4225-a0c2-750e28784c44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:47.960463 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e8b8e-1d8f-4225-a0c2-750e28784c44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:47.962326 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e8b8e-1d8f-4225-a0c2-750e28784c44 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:47.986274 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-0a9e8b8e-1d8f-4225-a0c2-750e28784c44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:47.986274 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:47.986274 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:47.986274 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:47.986274 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:47.986274 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:47.986274 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:47.986274 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:47.986274 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:47.986274 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:47.986274 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:47.986274 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:47.986274 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:47.986274 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:47.986274 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:47.987382 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:47.987382 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:47.987382 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:47.987382 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:47.987382 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:47.987382 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:47.987382 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:47.987382 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:47.987382 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:47.987382 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:47.987382 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:47.987382 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:47.987382 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:47.987382 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:47.987382 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:47.987382 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:47.987382 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:47.988347 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:47.988347 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:47.988347 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:47.988347 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:47.990345 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 398/785] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:47.996164 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ab382-22df-49b4-bc98-388733897d8f None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:48.061151 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:48.121143 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ab382-22df-49b4-bc98-388733897d8f None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:48.157223 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5031ad4-ce83-481a-b7aa-e2d8a6cf6d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:48.157898 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5031ad4-ce83-481a-b7aa-e2d8a6cf6d43 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:48.158265 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5031ad4-ce83-481a-b7aa-e2d8a6cf6d43 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:48.158554 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5031ad4-ce83-481a-b7aa-e2d8a6cf6d43 None admin] PATH_INFO: `/v3/domains` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:48.159296 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5031ad4-ce83-481a-b7aa-e2d8a6cf6d43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:48.159607 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5031ad4-ce83-481a-b7aa-e2d8a6cf6d43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:48.160995 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5031ad4-ce83-481a-b7aa-e2d8a6cf6d43 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:48.174448 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 388/786] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:48.180008 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e8b8e-1d8f-4225-a0c2-750e28784c44 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:48.342371 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e8b8e-1d8f-4225-a0c2-750e28784c44 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:48.356365 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:48.389637 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9f395-94e2-4bd8-9155-e5206588aeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:48.390519 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9f395-94e2-4bd8-9155-e5206588aeb2 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:48.390810 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9f395-94e2-4bd8-9155-e5206588aeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:48.391093 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9f395-94e2-4bd8-9155-e5206588aeb2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:48.400721 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc9f395-94e2-4bd8-9155-e5206588aeb2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:48.402234 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc9f395-94e2-4bd8-9155-e5206588aeb2 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:48.422788 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-bdc9f395-94e2-4bd8-9155-e5206588aeb2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 21:45:48.422788 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:48.422788 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:48.422788 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:48.422788 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:48.422788 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:48.422788 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:48.422788 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:48.422788 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:48.422788 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:48.422788 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:48.422788 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:48.422788 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:45:48.422788 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:45:48.422788 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:45:48.422788 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:45:48.423856 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:48.423856 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:48.423856 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:45:48.423856 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:45:48.423856 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:45:48.423856 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:45:48.423856 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:48.423856 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:48.423856 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:48.423856 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:48.423856 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:48.423856 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:48.423856 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:48.423856 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:48.423856 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:48.423856 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:48.423856 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:48.423856 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:48.424870 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:48.424870 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:48.424870 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:45:48.424870 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:45:48.424870 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:45:48.424870 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:45:48.424870 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:45:48.424870 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:45:48.424870 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 21:45:48.424870 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:48.424870 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 399/787] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:45:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:48.429837 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5031ad4-ce83-481a-b7aa-e2d8a6cf6d43 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:48.435029 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e92e98-7afe-40e6-a5c5-7118f1829da3 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:48.435326 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e92e98-7afe-40e6-a5c5-7118f1829da3 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:48.435613 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e92e98-7afe-40e6-a5c5-7118f1829da3 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:48.437209 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 400/788] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:45:48.442182 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9dc4da-3495-4642-b124-9097b344dc91 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:48.442506 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9dc4da-3495-4642-b124-9097b344dc91 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:48.442925 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9dc4da-3495-4642-b124-9097b344dc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:48.463018 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-6f9dc4da-3495-4642-b124-9097b344dc91 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:48.464235 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-6f9dc4da-3495-4642-b124-9097b344dc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:48.572630 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 401/789] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:45:48.597029 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:48.599665 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9dc4da-3495-4642-b124-9097b344dc91 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:48.613856 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5031ad4-ce83-481a-b7aa-e2d8a6cf6d43 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:48.707885 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca96b0-473e-44b9-9d12-53eda1541526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:48.708640 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca96b0-473e-44b9-9d12-53eda1541526 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:48.708928 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca96b0-473e-44b9-9d12-53eda1541526 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:48.709812 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca96b0-473e-44b9-9d12-53eda1541526 None admin] PATH_INFO: `/v3/users` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:48.710802 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca96b0-473e-44b9-9d12-53eda1541526 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:48.711121 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca96b0-473e-44b9-9d12-53eda1541526 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:48.712594 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca96b0-473e-44b9-9d12-53eda1541526 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:48.715308 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9dc4da-3495-4642-b124-9097b344dc91 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:48.717043 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:48.750923 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 389/790] 10.222.0.30 () {56 vars in 1135 bytes} [Tue Jul 5 21:45:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:48.757448 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca96b0-473e-44b9-9d12-53eda1541526 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:48.763107 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116ea36-3c00-4d61-8980-efdbd31078cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:48.764228 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116ea36-3c00-4d61-8980-efdbd31078cd None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:48.764737 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116ea36-3c00-4d61-8980-efdbd31078cd None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:48.765236 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116ea36-3c00-4d61-8980-efdbd31078cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:48.778579 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8116ea36-3c00-4d61-8980-efdbd31078cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:45:48.787357 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-8116ea36-3c00-4d61-8980-efdbd31078cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:45:48.787357 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:48.787357 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:48.787357 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:48.787357 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:48.787357 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:48.787357 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:48.787357 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:48.787357 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:48.787357 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:48.787357 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:48.787357 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:48.787357 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:45:48.787357 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:45:48.787357 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:45:48.787357 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:45:48.788966 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:45:48.788966 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:45:48.788966 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:45:48.788966 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:45:48.788966 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:48.788966 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:48.788966 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:48.788966 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:48.788966 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:48.788966 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:48.788966 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:48.788966 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:48.788966 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:48.788966 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:48.788966 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:48.788966 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:48.789901 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:48.789901 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:48.789901 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:48.789901 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:48.789901 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:45:48.789901 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:45:48.789901 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:45:48.789901 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:45:48.789901 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:45:48.789901 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:45:48.789901 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:45:48.789901 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:48.792982 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 402/791] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:45:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:48.798520 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116ea36-3c00-4d61-8980-efdbd31078cd None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:48.921951 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca96b0-473e-44b9-9d12-53eda1541526 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:48.983715 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116ea36-3c00-4d61-8980-efdbd31078cd None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:48.992917 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e43cb5-db77-40cf-a4ed-fd4d4190f252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:48.994019 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e43cb5-db77-40cf-a4ed-fd4d4190f252 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:48.995059 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e43cb5-db77-40cf-a4ed-fd4d4190f252 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:48.995564 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e43cb5-db77-40cf-a4ed-fd4d4190f252 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:49.010615 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e43cb5-db77-40cf-a4ed-fd4d4190f252 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:49.013099 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e43cb5-db77-40cf-a4ed-fd4d4190f252 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:49.024042 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58c790-5baa-47a6-b40e-28e648b3eea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:49.024777 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58c790-5baa-47a6-b40e-28e648b3eea5 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:49.025067 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58c790-5baa-47a6-b40e-28e648b3eea5 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:49.025350 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58c790-5baa-47a6-b40e-28e648b3eea5 None admin] PATH_INFO: `/v3/roles` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:49.026364 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:49.027806 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e58c790-5baa-47a6-b40e-28e648b3eea5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:49.028248 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e58c790-5baa-47a6-b40e-28e648b3eea5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:49.029671 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e58c790-5baa-47a6-b40e-28e648b3eea5 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:49.038985 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-56e43cb5-db77-40cf-a4ed-fd4d4190f252 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:49.038985 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:49.038985 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:49.038985 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:49.038985 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:49.038985 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:49.038985 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:49.038985 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:49.038985 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:49.038985 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:49.038985 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:49.038985 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:49.038985 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:49.038985 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:49.038985 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:49.051703 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:49.051703 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:49.051703 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:49.051703 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:49.051703 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:49.051703 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:49.051703 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:49.051703 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:49.051703 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:49.051703 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:49.051703 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:49.051703 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:49.051703 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:49.051703 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:49.051703 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:49.051703 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:49.051703 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:49.052713 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:49.052713 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:49.052713 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:49.052713 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:49.052713 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 390/793] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:45:49.052713 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc087b-45bf-4e12-a2a8-b49447cdc187 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:49.052713 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc087b-45bf-4e12-a2a8-b49447cdc187 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:49.052713 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc087b-45bf-4e12-a2a8-b49447cdc187 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:49.053340 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 403/793] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:45:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:49.053474 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 391/794] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:45:49.053609 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58c790-5baa-47a6-b40e-28e648b3eea5 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:49.053751 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc087b-45bf-4e12-a2a8-b49447cdc187 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:49.085337 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:49.177692 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58c790-5baa-47a6-b40e-28e648b3eea5 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:49.185915 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc087b-45bf-4e12-a2a8-b49447cdc187 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:49.216771 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0133a-2559-48a8-a462-b36a4628743f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:49.218016 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0133a-2559-48a8-a462-b36a4628743f None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:49.218641 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0133a-2559-48a8-a462-b36a4628743f None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:49.219087 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0133a-2559-48a8-a462-b36a4628743f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:49.223169 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c40d3-ae66-4eff-a964-551355a05806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:49.223947 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c40d3-ae66-4eff-a964-551355a05806 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:49.224397 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c40d3-ae66-4eff-a964-551355a05806 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:49.224808 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c40d3-ae66-4eff-a964-551355a05806 None admin] PATH_INFO: `/v3/domains` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:49.226251 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c40d3-ae66-4eff-a964-551355a05806 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:49.226666 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c40d3-ae66-4eff-a964-551355a05806 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:49.228579 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c40d3-ae66-4eff-a964-551355a05806 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:49.232884 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde0133a-2559-48a8-a462-b36a4628743f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:49.234642 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde0133a-2559-48a8-a462-b36a4628743f None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:49.241205 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 392/795] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:49.242802 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d16b13-a9c2-4b27-8a72-10a4e36151b0 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:49.243211 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d16b13-a9c2-4b27-8a72-10a4e36151b0 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:49.243757 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d16b13-a9c2-4b27-8a72-10a4e36151b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:49.255521 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-dde0133a-2559-48a8-a462-b36a4628743f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:49.255521 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:49.255521 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:49.255521 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:49.255521 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:49.255521 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:49.255521 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:49.255521 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:49.255521 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:49.255521 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:49.255521 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:49.255521 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:49.255521 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:49.255521 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:49.255521 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:49.257115 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:49.257115 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:49.257115 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:49.257115 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:49.257115 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:49.257115 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:49.257115 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:49.257115 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:49.257115 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:49.257115 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:49.257115 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:49.257115 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:49.257115 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:49.257115 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:49.257115 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:49.257115 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:49.257115 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:49.258106 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:49.258106 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:49.258106 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:49.258106 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:49.260210 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 404/796] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:45:49.261179 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0133a-2559-48a8-a462-b36a4628743f None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:49.267249 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-62d16b13-a9c2-4b27-8a72-10a4e36151b0 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:49.268566 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-62d16b13-a9c2-4b27-8a72-10a4e36151b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:49.328579 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:49.346413 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 393/797] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:45:49.347446 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d16b13-a9c2-4b27-8a72-10a4e36151b0 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:49.352475 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:49.381391 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0133a-2559-48a8-a462-b36a4628743f None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:49.422828 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adbad5e-9618-49c3-8a88-95aa9264dbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:49.424291 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adbad5e-9618-49c3-8a88-95aa9264dbf0 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:49.424805 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adbad5e-9618-49c3-8a88-95aa9264dbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:49.425336 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adbad5e-9618-49c3-8a88-95aa9264dbf0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:49.434847 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adbad5e-9618-49c3-8a88-95aa9264dbf0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:49.436709 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adbad5e-9618-49c3-8a88-95aa9264dbf0 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:49.452567 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-6adbad5e-9618-49c3-8a88-95aa9264dbf0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:45:49.452567 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:49.452567 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:49.452567 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:49.452567 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:49.452567 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:49.452567 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:49.452567 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:49.452567 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:49.452567 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:49.452567 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:49.452567 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:49.452567 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:45:49.452567 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:45:49.452567 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:45:49.453628 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:45:49.453628 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:49.453628 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:49.453628 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:49.453628 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:49.453628 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:49.453628 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:49.453628 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:49.453628 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:49.453628 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:49.453628 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:49.453628 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:49.453628 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:49.453628 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:49.453628 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:49.453628 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:49.453628 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:49.454626 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:45:49.454626 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:45:49.454626 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:45:49.454626 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:45:49.454626 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:45:49.454626 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:45:49.454626 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:45:49.454626 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:49.457292 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 405/798] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:45:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:49.458557 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adbad5e-9618-49c3-8a88-95aa9264dbf0 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:49.470807 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d16b13-a9c2-4b27-8a72-10a4e36151b0 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:49.509504 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5fb72-3d1f-4354-b4d2-3e526fa2b262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:49.510357 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5fb72-3d1f-4354-b4d2-3e526fa2b262 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:49.510479 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5fb72-3d1f-4354-b4d2-3e526fa2b262 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:49.510767 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5fb72-3d1f-4354-b4d2-3e526fa2b262 None admin] PATH_INFO: `/v3/domains` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:49.511730 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc5fb72-3d1f-4354-b4d2-3e526fa2b262 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:49.512042 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc5fb72-3d1f-4354-b4d2-3e526fa2b262 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:49.513443 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc5fb72-3d1f-4354-b4d2-3e526fa2b262 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:49.530501 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 394/799] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:49.531397 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5fb72-3d1f-4354-b4d2-3e526fa2b262 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:49.580418 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adbad5e-9618-49c3-8a88-95aa9264dbf0 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:49.585492 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:49.622451 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3eff72-4694-4eb3-9aca-ebba001c64f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:49.624191 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3eff72-4694-4eb3-9aca-ebba001c64f6 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:49.624701 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3eff72-4694-4eb3-9aca-ebba001c64f6 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:49.625261 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3eff72-4694-4eb3-9aca-ebba001c64f6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:49.626853 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3eff72-4694-4eb3-9aca-ebba001c64f6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:49.628236 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3eff72-4694-4eb3-9aca-ebba001c64f6 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:49.632481 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:49.642598 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-ff3eff72-4694-4eb3-9aca-ebba001c64f6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 21:45:49.642598 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:49.642598 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:45:49.642598 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:45:49.642598 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:45:49.642598 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:45:49.642598 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:45:49.642598 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:45:49.642598 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 21:45:49.642598 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:49.642598 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:45:49.642598 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:49.642598 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:49.642598 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:49.642598 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:49.642598 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:49.650235 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:49.650235 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:49.650235 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:49.650235 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:49.650235 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:49.650235 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:49.650235 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:49.650235 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:45:49.650235 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:45:49.650235 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:45:49.650235 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:45:49.650235 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:49.650235 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:49.650235 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:49.650235 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:49.650235 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:49.651184 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:49.651184 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:49.651184 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:49.651184 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:49.651184 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:49.651184 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:49.651184 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:49.651184 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:49.651184 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:49.651184 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:49.651184 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:49.651184 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:45:49.651184 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:45:49.651184 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 21:45:49.651184 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:49.652084 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5fb72-3d1f-4354-b4d2-3e526fa2b262 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:49.652173 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 406/800] 10.222.0.30 () {56 vars in 1129 bytes} [Tue Jul 5 21:45:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:49.652173 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3eff72-4694-4eb3-9aca-ebba001c64f6 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:49.698348 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483caca-da05-49aa-acdd-f44f728b3fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:49.699861 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483caca-da05-49aa-acdd-f44f728b3fe1 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:49.700667 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483caca-da05-49aa-acdd-f44f728b3fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:49.701178 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483caca-da05-49aa-acdd-f44f728b3fe1 None admin] PATH_INFO: `/v3/projects` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:49.702526 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b483caca-da05-49aa-acdd-f44f728b3fe1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:49.703525 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b483caca-da05-49aa-acdd-f44f728b3fe1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:49.705745 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b483caca-da05-49aa-acdd-f44f728b3fe1 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:49.720451 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 395/801] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:45:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:49.721397 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483caca-da05-49aa-acdd-f44f728b3fe1 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:49.769306 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3eff72-4694-4eb3-9aca-ebba001c64f6 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:49.807353 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc31bf10-e320-45b6-8c8d-4c97158b6ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:49.808160 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31bf10-e320-45b6-8c8d-4c97158b6ae9 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:49.808451 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31bf10-e320-45b6-8c8d-4c97158b6ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:49.808731 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31bf10-e320-45b6-8c8d-4c97158b6ae9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:49.817250 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc31bf10-e320-45b6-8c8d-4c97158b6ae9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:49.818755 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc31bf10-e320-45b6-8c8d-4c97158b6ae9 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:49.835888 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-bc31bf10-e320-45b6-8c8d-4c97158b6ae9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:45:49.835888 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:49.835888 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:49.835888 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:49.835888 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:49.835888 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:49.835888 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:49.835888 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:49.835888 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:49.835888 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:49.835888 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:49.835888 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:49.835888 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:45:49.835888 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:45:49.835888 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:45:49.835888 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:45:49.836963 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:49.836963 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:49.836963 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:45:49.836963 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:45:49.836963 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:45:49.836963 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:45:49.836963 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:49.836963 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:49.836963 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:49.836963 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:49.836963 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:49.836963 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:49.836963 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:49.836963 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:49.836963 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:49.836963 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:49.836963 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:49.836963 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:49.838739 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:49.838739 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:49.838739 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:45:49.838739 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:45:49.838739 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:45:49.838739 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:45:49.838739 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:45:49.838739 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:45:49.838739 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:45:49.838739 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:49.838739 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 407/802] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Jul 5 21:45:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:49.838739 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc31bf10-e320-45b6-8c8d-4c97158b6ae9 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:49.848661 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483caca-da05-49aa-acdd-f44f728b3fe1 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:49.862607 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:49.889931 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b95596-95d7-4ab4-97e4-d0b845c1d486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:49.890802 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b95596-95d7-4ab4-97e4-d0b845c1d486 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:49.891097 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b95596-95d7-4ab4-97e4-d0b845c1d486 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:49.891432 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b95596-95d7-4ab4-97e4-d0b845c1d486 None admin] PATH_INFO: `/v3/services` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:49.892170 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b95596-95d7-4ab4-97e4-d0b845c1d486 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:49.892486 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b95596-95d7-4ab4-97e4-d0b845c1d486 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:49.893999 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b95596-95d7-4ab4-97e4-d0b845c1d486 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:49.900425 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:49.905986 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 396/803] 10.222.0.30 () {56 vars in 1124 bytes} [Tue Jul 5 21:45:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:49.907250 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221bd26c-aa0a-4fab-a9ac-4c0d7a611dd5 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:49.907552 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221bd26c-aa0a-4fab-a9ac-4c0d7a611dd5 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:49.907891 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221bd26c-aa0a-4fab-a9ac-4c0d7a611dd5 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:49.910179 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 397/804] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:45:49.910179 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221bd26c-aa0a-4fab-a9ac-4c0d7a611dd5 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:49.949056 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc31bf10-e320-45b6-8c8d-4c97158b6ae9 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:49.984492 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7feb300-6611-41c4-b6b1-9af2d9d0632b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:49.985388 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7feb300-6611-41c4-b6b1-9af2d9d0632b None admin] REQUEST_METHOD: `PUT` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:49.985685 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7feb300-6611-41c4-b6b1-9af2d9d0632b None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:49.985970 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7feb300-6611-41c4-b6b1-9af2d9d0632b None admin] PATH_INFO: `/v3/projects/93f20f89d0fc4bbf9cf557dd1e14d98d/users/ba028a9695364d54a73b01c986300344/roles/e1c574c9973548ebb0e8d9e0656ccabd` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:49.988028 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7feb300-6611-41c4-b6b1-9af2d9d0632b None admin] RBAC: Authorizing `identity:create_grant(project_id=93f20f89d0fc4bbf9cf557dd1e14d98d, user_id=ba028a9695364d54a73b01c986300344, role_id=e1c574c9973548ebb0e8d9e0656ccabd)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:49.989474 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7feb300-6611-41c4-b6b1-9af2d9d0632b None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:50.015540 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221bd26c-aa0a-4fab-a9ac-4c0d7a611dd5 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:50.050462 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9baad-a418-416e-af82-366ac56a631d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:50.051142 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9baad-a418-416e-af82-366ac56a631d None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:50.051437 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9baad-a418-416e-af82-366ac56a631d None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:50.051723 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9baad-a418-416e-af82-366ac56a631d None admin] PATH_INFO: `/v3/users` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:50.051967 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 408/805] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:45:49 2022] PUT /identity/v3/projects/93f20f89d0fc4bbf9cf557dd1e14d98d/users/ba028a9695364d54a73b01c986300344/roles/e1c574c9973548ebb0e8d9e0656ccabd => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:45:50.052609 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad9baad-a418-416e-af82-366ac56a631d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:50.052880 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7feb300-6611-41c4-b6b1-9af2d9d0632b None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:50.053131 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad9baad-a418-416e-af82-366ac56a631d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:50.054658 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad9baad-a418-416e-af82-366ac56a631d None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:50.075808 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 398/806] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Jul 5 21:45:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:50.077141 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a5b40-bbb6-4b43-95fd-ec511e1bddfd None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:50.077594 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a5b40-bbb6-4b43-95fd-ec511e1bddfd None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:50.077838 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a5b40-bbb6-4b43-95fd-ec511e1bddfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:50.098045 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-e39a5b40-bbb6-4b43-95fd-ec511e1bddfd None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:50.099381 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-e39a5b40-bbb6-4b43-95fd-ec511e1bddfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:50.132769 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:50.178929 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 399/807] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:45:50.180818 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266416a2-0aa8-4eb9-8f9f-3a80ffd9b589 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:50.181217 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266416a2-0aa8-4eb9-8f9f-3a80ffd9b589 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:50.181600 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266416a2-0aa8-4eb9-8f9f-3a80ffd9b589 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:50.183280 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 400/808] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:45:50.184017 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266416a2-0aa8-4eb9-8f9f-3a80ffd9b589 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:50.198797 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7feb300-6611-41c4-b6b1-9af2d9d0632b None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:50.225954 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:50.242036 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4eb1e-bd63-4e92-828e-6d92701a52cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:50.242775 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4eb1e-bd63-4e92-828e-6d92701a52cc None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:50.243068 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4eb1e-bd63-4e92-828e-6d92701a52cc None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:50.243353 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4eb1e-bd63-4e92-828e-6d92701a52cc None admin] PATH_INFO: `/v3/services` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:50.244088 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e4eb1e-bd63-4e92-828e-6d92701a52cc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:50.244404 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e4eb1e-bd63-4e92-828e-6d92701a52cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:50.245828 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e4eb1e-bd63-4e92-828e-6d92701a52cc None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:50.254211 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 409/809] 10.222.0.30 () {56 vars in 1124 bytes} [Tue Jul 5 21:45:50 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:50.254211 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f182d4-7f9c-4762-8490-190d83ed09be None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:50.254211 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f182d4-7f9c-4762-8490-190d83ed09be None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:50.254211 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f182d4-7f9c-4762-8490-190d83ed09be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:50.303460 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-a8f182d4-7f9c-4762-8490-190d83ed09be None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:50.304667 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-a8f182d4-7f9c-4762-8490-190d83ed09be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:50.325892 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266416a2-0aa8-4eb9-8f9f-3a80ffd9b589 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:50.364292 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ca47a-b2e3-49ff-894b-6f752487e355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:50.364952 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ca47a-b2e3-49ff-894b-6f752487e355 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:50.365238 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ca47a-b2e3-49ff-894b-6f752487e355 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:50.366086 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ca47a-b2e3-49ff-894b-6f752487e355 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:50.377966 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 410/810] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:45:50.379088 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f182d4-7f9c-4762-8490-190d83ed09be None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:50.405577 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:50.447289 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473ca47a-b2e3-49ff-894b-6f752487e355 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:50.448766 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473ca47a-b2e3-49ff-894b-6f752487e355 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:50.509052 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f182d4-7f9c-4762-8490-190d83ed09be None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:50.525477 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:50.550938 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d0fd2-839a-4d63-b6a5-c96402d90677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:50.551755 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d0fd2-839a-4d63-b6a5-c96402d90677 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:50.552042 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d0fd2-839a-4d63-b6a5-c96402d90677 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:50.552322 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d0fd2-839a-4d63-b6a5-c96402d90677 None admin] PATH_INFO: `/v3/roles/service` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:50.567175 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4d0fd2-839a-4d63-b6a5-c96402d90677 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:45:50.575754 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 401/811] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:45:50 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:45:50.575754 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ca47a-b2e3-49ff-894b-6f752487e355 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:50.576322 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-8a4d0fd2-839a-4d63-b6a5-c96402d90677 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:45:50.576322 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:50.576322 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:50.576322 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:50.576322 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:50.576322 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:50.576322 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:50.576322 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:50.576322 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:50.576322 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:50.576322 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:50.576322 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:50.576322 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:45:50.576322 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:45:50.576322 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:45:50.576322 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:45:50.577339 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:45:50.577339 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:45:50.577339 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:45:50.577339 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:45:50.577339 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:50.577339 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:50.577339 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:50.577339 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:50.577339 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:50.577339 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:50.577339 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:50.577339 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:50.577339 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:50.577339 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:50.577339 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:50.577339 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:50.578282 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:50.578282 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:50.578282 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:50.578282 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:50.578282 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:45:50.578282 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:45:50.578282 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:45:50.578282 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:45:50.578282 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:45:50.578282 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:45:50.578282 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:45:50.578282 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:50.578282 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 411/812] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:45:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:50.578282 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d0fd2-839a-4d63-b6a5-c96402d90677 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:50.647691 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:50.684484 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d0fd2-839a-4d63-b6a5-c96402d90677 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:50.688661 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ca47a-b2e3-49ff-894b-6f752487e355 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:50.722566 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76bedc6-aba6-4dc4-a789-df48560ce02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:50.723459 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76bedc6-aba6-4dc4-a789-df48560ce02c None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:50.723751 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76bedc6-aba6-4dc4-a789-df48560ce02c None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:50.724033 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76bedc6-aba6-4dc4-a789-df48560ce02c None admin] PATH_INFO: `/v3/services/network` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:50.724700 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76bedc6-aba6-4dc4-a789-df48560ce02c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:50.725594 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d38be6-10d3-4064-9ee9-bfeaefe9df33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:50.726112 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76bedc6-aba6-4dc4-a789-df48560ce02c None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:50.726299 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d38be6-10d3-4064-9ee9-bfeaefe9df33 None admin] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:50.726582 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d38be6-10d3-4064-9ee9-bfeaefe9df33 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:50.726861 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d38be6-10d3-4064-9ee9-bfeaefe9df33 None admin] PATH_INFO: `/v3/endpoints` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:50.727607 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d38be6-10d3-4064-9ee9-bfeaefe9df33 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:50.729216 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d38be6-10d3-4064-9ee9-bfeaefe9df33 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:50.738761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-f76bedc6-aba6-4dc4-a789-df48560ce02c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 21:45:50.738761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:50.738761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:45:50.738761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:45:50.738761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:45:50.738761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:45:50.738761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:45:50.738761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:45:50.738761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 21:45:50.738761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:50.738761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:45:50.738761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:50.738761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:50.738761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:50.738761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:50.738761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:50.738761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:50.739832 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:50.739832 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:50.739832 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:50.739832 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:50.739832 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:50.739832 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:50.739832 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:45:50.739832 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:45:50.739832 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:45:50.739832 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:45:50.739832 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:50.739832 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:50.739832 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:50.739832 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:50.739832 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:50.739832 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:50.740932 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:50.740932 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:50.740932 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:50.740932 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:50.740932 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:50.740932 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:50.740932 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:50.740932 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:50.740932 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:50.740932 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:50.740932 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:45:50.740932 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:45:50.740932 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 21:45:50.740932 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:50.745430 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 412/813] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:45:50 2022] GET /identity/v3/services/network => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:50.746233 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76bedc6-aba6-4dc4-a789-df48560ce02c None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:50.788628 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:50.846160 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 402/814] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Jul 5 21:45:50 2022] POST /identity/v3/endpoints => generated 346 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:45:50.846160 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d38be6-10d3-4064-9ee9-bfeaefe9df33 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:50.865564 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76bedc6-aba6-4dc4-a789-df48560ce02c None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:50.925562 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab1819-0fe9-4e4a-a516-a2cafc5ff45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:50.927210 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab1819-0fe9-4e4a-a516-a2cafc5ff45d None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:50.927571 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab1819-0fe9-4e4a-a516-a2cafc5ff45d None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:50.927979 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab1819-0fe9-4e4a-a516-a2cafc5ff45d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:50.944642 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ab1819-0fe9-4e4a-a516-a2cafc5ff45d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:50.947239 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ab1819-0fe9-4e4a-a516-a2cafc5ff45d None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:50.956661 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d38be6-10d3-4064-9ee9-bfeaefe9df33 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:50.971750 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-16ab1819-0fe9-4e4a-a516-a2cafc5ff45d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:50.971750 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:50.971750 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:50.971750 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:50.971750 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:50.971750 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:50.971750 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:50.971750 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:50.971750 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:50.971750 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:50.971750 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:50.971750 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:50.971750 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:50.971750 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:50.971750 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:50.972933 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:50.972933 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:50.972933 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:50.972933 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:50.972933 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:50.972933 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:50.972933 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:50.972933 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:50.972933 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:50.972933 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:50.972933 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:50.972933 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:50.972933 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:50.972933 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:50.972933 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:50.972933 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:50.972933 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:50.974192 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:50.974192 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:50.974192 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:50.974192 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:50.981571 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 413/815] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:50.983122 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:50.983895 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab1819-0fe9-4e4a-a516-a2cafc5ff45d None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:51.002646 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af6baf-d40a-4850-95d5-391ec751ce48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:51.003444 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af6baf-d40a-4850-95d5-391ec751ce48 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:51.003805 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af6baf-d40a-4850-95d5-391ec751ce48 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:51.004155 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af6baf-d40a-4850-95d5-391ec751ce48 None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:51.005006 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88af6baf-d40a-4850-95d5-391ec751ce48 None admin] RBAC: Adding query filter params (name=service) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:51.005380 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88af6baf-d40a-4850-95d5-391ec751ce48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:51.007486 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88af6baf-d40a-4850-95d5-391ec751ce48 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:51.021322 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 403/816] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:45:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:51.021322 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af6baf-d40a-4850-95d5-391ec751ce48 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:51.116756 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:51.131513 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab1819-0fe9-4e4a-a516-a2cafc5ff45d None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:51.141799 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af6baf-d40a-4850-95d5-391ec751ce48 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:51.176417 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a097a4-a40a-4678-b22b-ad271f454405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:51.177250 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a097a4-a40a-4678-b22b-ad271f454405 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:51.177564 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a097a4-a40a-4678-b22b-ad271f454405 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:51.178729 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a097a4-a40a-4678-b22b-ad271f454405 None admin] PATH_INFO: `/v3/services` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:51.179519 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a097a4-a40a-4678-b22b-ad271f454405 None admin] RBAC: Adding query filter params (name=network) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:51.179897 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a097a4-a40a-4678-b22b-ad271f454405 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:51.181373 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a097a4-a40a-4678-b22b-ad271f454405 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:51.182266 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855dd02-17ab-4977-892c-5a4e9cb7ab9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:51.183286 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855dd02-17ab-4977-892c-5a4e9cb7ab9d None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:51.183788 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855dd02-17ab-4977-892c-5a4e9cb7ab9d None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:51.184368 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855dd02-17ab-4977-892c-5a4e9cb7ab9d None admin] PATH_INFO: `/v3/domains` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:51.185291 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7855dd02-17ab-4977-892c-5a4e9cb7ab9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:51.185776 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7855dd02-17ab-4977-892c-5a4e9cb7ab9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:51.187444 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7855dd02-17ab-4977-892c-5a4e9cb7ab9d None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:51.190238 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 414/817] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Jul 5 21:45:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:51.191496 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a097a4-a40a-4678-b22b-ad271f454405 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:51.206249 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 404/818] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:51.207369 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855dd02-17ab-4977-892c-5a4e9cb7ab9d None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:51.253869 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:51.318855 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855dd02-17ab-4977-892c-5a4e9cb7ab9d None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:51.331743 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a097a4-a40a-4678-b22b-ad271f454405 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:51.362846 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7564964d-a1b9-45a9-8b8a-1c5b9a0d3959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:51.364116 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564964d-a1b9-45a9-8b8a-1c5b9a0d3959 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:51.364818 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564964d-a1b9-45a9-8b8a-1c5b9a0d3959 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:51.365282 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564964d-a1b9-45a9-8b8a-1c5b9a0d3959 None admin] PATH_INFO: `/v3/services` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:51.366389 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7564964d-a1b9-45a9-8b8a-1c5b9a0d3959 None admin] RBAC: Adding query filter params (type=network) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:51.367221 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7564964d-a1b9-45a9-8b8a-1c5b9a0d3959 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:51.369228 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7564964d-a1b9-45a9-8b8a-1c5b9a0d3959 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:51.372280 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8a0bb-35fa-4bd3-b6fa-412b6e1354f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:51.373243 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8a0bb-35fa-4bd3-b6fa-412b6e1354f3 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:51.373633 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8a0bb-35fa-4bd3-b6fa-412b6e1354f3 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:51.373916 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8a0bb-35fa-4bd3-b6fa-412b6e1354f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:51.375945 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 405/819] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Jul 5 21:45:51 2022] GET /identity/v3/services?type=network => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:51.377070 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7564964d-a1b9-45a9-8b8a-1c5b9a0d3959 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:51.391963 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d8a0bb-35fa-4bd3-b6fa-412b6e1354f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:51.394155 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d8a0bb-35fa-4bd3-b6fa-412b6e1354f3 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:51.417026 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-93d8a0bb-35fa-4bd3-b6fa-412b6e1354f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:51.417026 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:51.417026 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:51.417026 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:51.417026 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:51.417026 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:51.417026 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:51.417026 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:51.417026 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:51.417026 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:51.417026 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:51.417026 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:51.417026 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:51.417026 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:51.417026 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:51.418264 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:51.418264 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:51.418264 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:51.418264 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:51.418264 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:51.418264 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:51.418264 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:51.418264 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:51.418264 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:51.418264 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:51.418264 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:51.418264 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:51.418264 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:51.418264 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:51.418264 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:51.418264 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:51.418264 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:51.419261 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:51.419261 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:51.419261 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:51.419261 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:51.419261 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 415/820] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:51.419558 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8a0bb-35fa-4bd3-b6fa-412b6e1354f3 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:51.426164 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:51.500173 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7564964d-a1b9-45a9-8b8a-1c5b9a0d3959 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:51.503036 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:51.540530 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b88176e-43fb-4795-abd5-b0ad71584799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:51.541629 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88176e-43fb-4795-abd5-b0ad71584799 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:51.542156 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88176e-43fb-4795-abd5-b0ad71584799 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:51.543725 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88176e-43fb-4795-abd5-b0ad71584799 None admin] PATH_INFO: `/v3/projects/service` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:51.552069 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b88176e-43fb-4795-abd5-b0ad71584799 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:51.556083 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b88176e-43fb-4795-abd5-b0ad71584799 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:51.574272 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-3b88176e-43fb-4795-abd5-b0ad71584799 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:45:51.574272 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:51.574272 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:51.574272 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:51.574272 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:51.574272 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:51.574272 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:51.574272 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:51.574272 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:51.574272 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:51.574272 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:51.574272 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:51.574272 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:45:51.574272 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:45:51.574272 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:45:51.575564 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:45:51.575564 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:51.575564 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:51.575564 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:51.575564 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:51.575564 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:51.575564 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:51.575564 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:51.575564 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:51.575564 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:51.575564 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:51.575564 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:51.575564 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:51.575564 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:51.575564 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:51.575564 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:51.575564 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:51.576998 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:45:51.576998 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:45:51.576998 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:45:51.576998 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:45:51.576998 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:45:51.576998 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:45:51.576998 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:45:51.576998 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:51.581256 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 406/821] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:45:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:51.582309 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b88176e-43fb-4795-abd5-b0ad71584799 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:51.670336 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8a0bb-35fa-4bd3-b6fa-412b6e1354f3 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:51.697342 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b88176e-43fb-4795-abd5-b0ad71584799 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:51.708564 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c815b-930b-435d-9638-e243561a9731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:51.710678 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c815b-930b-435d-9638-e243561a9731 None admin] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:51.711200 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c815b-930b-435d-9638-e243561a9731 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:51.711696 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c815b-930b-435d-9638-e243561a9731 None admin] PATH_INFO: `/v3/endpoints` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:51.712762 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c815b-930b-435d-9638-e243561a9731 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:51.714476 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c815b-930b-435d-9638-e243561a9731 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:51.735121 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeca248-74b4-4a5c-a8ae-6bf9acf67328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:51.740144 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeca248-74b4-4a5c-a8ae-6bf9acf67328 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:51.740144 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeca248-74b4-4a5c-a8ae-6bf9acf67328 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:51.740144 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeca248-74b4-4a5c-a8ae-6bf9acf67328 None admin] PATH_INFO: `/v3/domains` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:51.740144 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeca248-74b4-4a5c-a8ae-6bf9acf67328 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:51.740144 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeca248-74b4-4a5c-a8ae-6bf9acf67328 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:51.740144 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeca248-74b4-4a5c-a8ae-6bf9acf67328 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:51.756438 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 407/822] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:51.756438 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeca248-74b4-4a5c-a8ae-6bf9acf67328 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:51.784096 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:51.793994 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 416/823] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Jul 5 21:45:51 2022] POST /identity/v3/endpoints => generated 327 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:45:51.795407 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c815b-930b-435d-9638-e243561a9731 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:51.889505 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeca248-74b4-4a5c-a8ae-6bf9acf67328 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:51.894600 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:51.985969 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c815b-930b-435d-9638-e243561a9731 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:51.986908 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d8498-22e6-41da-9eb8-5c059a48dc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:51.987600 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d8498-22e6-41da-9eb8-5c059a48dc22 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:51.987894 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d8498-22e6-41da-9eb8-5c059a48dc22 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:51.989706 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d8498-22e6-41da-9eb8-5c059a48dc22 None admin] PATH_INFO: `/v3/projects` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:51.992158 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99d8498-22e6-41da-9eb8-5c059a48dc22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:51.992482 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99d8498-22e6-41da-9eb8-5c059a48dc22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:51.993979 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99d8498-22e6-41da-9eb8-5c059a48dc22 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:52.019935 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 408/824] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:45:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:52.035755 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d8498-22e6-41da-9eb8-5c059a48dc22 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:52.048602 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6225f-a9ac-443a-8a4d-a39e2a6123a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:52.049673 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6225f-a9ac-443a-8a4d-a39e2a6123a6 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:52.050168 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6225f-a9ac-443a-8a4d-a39e2a6123a6 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:52.051035 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6225f-a9ac-443a-8a4d-a39e2a6123a6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:52.062895 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f6225f-a9ac-443a-8a4d-a39e2a6123a6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:52.064773 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f6225f-a9ac-443a-8a4d-a39e2a6123a6 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:52.083967 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-d5f6225f-a9ac-443a-8a4d-a39e2a6123a6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 21:45:52.083967 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:52.083967 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:52.083967 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:52.083967 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:52.083967 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:52.083967 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:52.083967 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:52.083967 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:52.083967 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:52.083967 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:52.083967 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:52.083967 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:45:52.083967 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:45:52.083967 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:45:52.083967 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:45:52.085770 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:52.085770 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:52.085770 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:45:52.085770 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:45:52.085770 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:45:52.085770 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:45:52.085770 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:52.085770 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:52.085770 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:52.085770 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:52.085770 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:52.085770 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:52.085770 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:52.085770 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:52.085770 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:52.085770 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:52.085770 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:52.085770 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:52.087121 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:52.087121 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:52.087121 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:45:52.087121 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:45:52.087121 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:45:52.087121 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:45:52.087121 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:45:52.087121 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:45:52.087121 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 21:45:52.087121 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:52.090398 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 417/825] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Jul 5 21:45:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:52.097404 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6225f-a9ac-443a-8a4d-a39e2a6123a6 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:52.154146 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:52.175434 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d8498-22e6-41da-9eb8-5c059a48dc22 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:52.219043 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6225f-a9ac-443a-8a4d-a39e2a6123a6 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:52.246647 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:52.263981 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2862f29-7b38-4881-a814-f4df371d17fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:52.264812 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2862f29-7b38-4881-a814-f4df371d17fa None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:52.265309 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2862f29-7b38-4881-a814-f4df371d17fa None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:52.265692 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2862f29-7b38-4881-a814-f4df371d17fa None admin] PATH_INFO: `/v3/users` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:52.266922 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2862f29-7b38-4881-a814-f4df371d17fa None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:52.267340 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2862f29-7b38-4881-a814-f4df371d17fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:52.268954 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2862f29-7b38-4881-a814-f4df371d17fa None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:52.291088 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 418/826] 10.222.0.30 () {56 vars in 1149 bytes} [Tue Jul 5 21:45:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:52.292471 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765646d1-2c49-4d1a-8cc6-a2a807231b73 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:52.292762 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765646d1-2c49-4d1a-8cc6-a2a807231b73 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:52.293057 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765646d1-2c49-4d1a-8cc6-a2a807231b73 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:52.295964 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 419/827] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:45:52.296852 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765646d1-2c49-4d1a-8cc6-a2a807231b73 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:52.342113 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231e09f-4475-4d83-9446-75f56050b0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:52.342792 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231e09f-4475-4d83-9446-75f56050b0b7 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:52.343073 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231e09f-4475-4d83-9446-75f56050b0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:52.343540 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231e09f-4475-4d83-9446-75f56050b0b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:52.344183 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231e09f-4475-4d83-9446-75f56050b0b7 None admin] RBAC: Adding query filter params (role.id=e1c574c9973548ebb0e8d9e0656ccabd, scope.project.id=93f20f89d0fc4bbf9cf557dd1e14d98d, user.id=f5d82e71aafe4b6ebcf60c23c050aafb) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:52.344496 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231e09f-4475-4d83-9446-75f56050b0b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:52.345975 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231e09f-4475-4d83-9446-75f56050b0b7 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:52.359366 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 409/828] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:45:52 2022] GET /identity/v3/role_assignments?user.id=f5d82e71aafe4b6ebcf60c23c050aafb&scope.project.id=93f20f89d0fc4bbf9cf557dd1e14d98d&role.id=e1c574c9973548ebb0e8d9e0656ccabd => generated 608 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:52.359366 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd624f-7bb6-4839-80aa-e3272130b10e None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:52.359366 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd624f-7bb6-4839-80aa-e3272130b10e None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:52.359366 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd624f-7bb6-4839-80aa-e3272130b10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:52.382933 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-52bd624f-7bb6-4839-80aa-e3272130b10e None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:52.384320 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-52bd624f-7bb6-4839-80aa-e3272130b10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:52.417339 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765646d1-2c49-4d1a-8cc6-a2a807231b73 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:52.463204 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a41555-16a0-43cd-a3a4-5f8d7e86559f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:52.464123 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a41555-16a0-43cd-a3a4-5f8d7e86559f None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:52.464481 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a41555-16a0-43cd-a3a4-5f8d7e86559f None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:52.464830 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a41555-16a0-43cd-a3a4-5f8d7e86559f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:52.478406 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a41555-16a0-43cd-a3a4-5f8d7e86559f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:52.480059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a41555-16a0-43cd-a3a4-5f8d7e86559f None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:52.484847 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 410/829] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:45:52.502804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-65a41555-16a0-43cd-a3a4-5f8d7e86559f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:52.502804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:52.502804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:52.502804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:52.502804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:52.502804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:52.502804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:52.502804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:52.502804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:52.502804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:52.502804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:52.502804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:52.502804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:52.502804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:52.502804 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:52.503826 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:52.503826 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:52.503826 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:52.503826 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:52.503826 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:52.503826 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:52.503826 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:52.503826 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:52.503826 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:52.503826 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:52.503826 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:52.503826 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:52.503826 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:52.503826 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:52.503826 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:52.503826 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:52.503826 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:52.504821 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:52.504821 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:52.504821 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:52.504821 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:52.504821 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 420/830] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:52.511380 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd624f-7bb6-4839-80aa-e3272130b10e None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:52.512842 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a41555-16a0-43cd-a3a4-5f8d7e86559f None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:52.560175 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:52.617828 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:52.650640 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd624f-7bb6-4839-80aa-e3272130b10e None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:52.652177 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a41555-16a0-43cd-a3a4-5f8d7e86559f None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:52.691417 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5304a5a0-1c5f-4df3-9fb1-09f8f7e04cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:52.692227 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304a5a0-1c5f-4df3-9fb1-09f8f7e04cbd None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:52.692595 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304a5a0-1c5f-4df3-9fb1-09f8f7e04cbd None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:52.692954 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304a5a0-1c5f-4df3-9fb1-09f8f7e04cbd None admin] PATH_INFO: `/v3/domains` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:52.694525 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5304a5a0-1c5f-4df3-9fb1-09f8f7e04cbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:52.694925 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5304a5a0-1c5f-4df3-9fb1-09f8f7e04cbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:52.696402 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5304a5a0-1c5f-4df3-9fb1-09f8f7e04cbd None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:52.696605 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ddc8f-5bf8-48aa-a42c-cb37a3b4f688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:52.697424 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ddc8f-5bf8-48aa-a42c-cb37a3b4f688 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:52.697710 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ddc8f-5bf8-48aa-a42c-cb37a3b4f688 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:52.697992 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ddc8f-5bf8-48aa-a42c-cb37a3b4f688 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:52.708817 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6ddc8f-5bf8-48aa-a42c-cb37a3b4f688 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:45:52.711432 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 411/831] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:52.719655 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5304a5a0-1c5f-4df3-9fb1-09f8f7e04cbd None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:52.720364 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-db6ddc8f-5bf8-48aa-a42c-cb37a3b4f688 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:45:52.720364 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:52.720364 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:52.720364 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:52.720364 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:52.720364 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:52.720364 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:52.720364 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:52.720364 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:52.720364 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:52.720364 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:52.720364 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:52.720364 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:45:52.720364 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:45:52.720364 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:45:52.720364 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:45:52.721370 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:45:52.721370 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:45:52.721370 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:45:52.721370 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:45:52.721370 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:52.721370 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:52.721370 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:52.721370 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:52.721370 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:52.721370 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:52.721370 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:52.721370 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:52.721370 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:52.721370 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:52.721370 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:52.721370 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:52.722334 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:52.722334 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:52.722334 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:52.722334 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:52.722334 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:45:52.722334 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:45:52.722334 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:45:52.722334 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:45:52.722334 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:45:52.722334 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:45:52.722334 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:45:52.722334 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:52.725702 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 421/832] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:45:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:52.732042 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ddc8f-5bf8-48aa-a42c-cb37a3b4f688 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:52.828895 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:52.841910 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5304a5a0-1c5f-4df3-9fb1-09f8f7e04cbd None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:52.846602 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ddc8f-5bf8-48aa-a42c-cb37a3b4f688 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:52.885105 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece3194-3c3c-4caf-9012-d9663492d76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:52.886727 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece3194-3c3c-4caf-9012-d9663492d76b None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:52.887351 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece3194-3c3c-4caf-9012-d9663492d76b None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:52.887919 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece3194-3c3c-4caf-9012-d9663492d76b None admin] PATH_INFO: `/v3/projects/service` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:52.891083 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:52.896099 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e9544-51b6-47b8-a40a-a1130fe305a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:52.897739 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e9544-51b6-47b8-a40a-a1130fe305a5 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:52.898112 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e9544-51b6-47b8-a40a-a1130fe305a5 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:52.898524 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e9544-51b6-47b8-a40a-a1130fe305a5 None admin] PATH_INFO: `/v3/roles` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:52.898865 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece3194-3c3c-4caf-9012-d9663492d76b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:52.904809 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6e9544-51b6-47b8-a40a-a1130fe305a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:52.904809 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6e9544-51b6-47b8-a40a-a1130fe305a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:52.905005 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece3194-3c3c-4caf-9012-d9663492d76b None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:52.905100 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6e9544-51b6-47b8-a40a-a1130fe305a5 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:52.916562 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 422/833] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:45:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:45:52.919116 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e9544-51b6-47b8-a40a-a1130fe305a5 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:52.919763 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-dece3194-3c3c-4caf-9012-d9663492d76b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:45:52.919763 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:52.919763 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:52.919763 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:52.919763 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:52.919763 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:52.919763 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:52.919763 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:52.919763 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:52.919763 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:52.919763 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:52.919763 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:52.919763 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:45:52.919763 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:45:52.919763 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:45:52.920690 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:45:52.920690 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:52.920690 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:52.920690 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:52.920690 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:52.920690 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:52.920690 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:52.920690 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:52.920690 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:52.920690 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:52.920690 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:52.920690 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:52.920690 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:52.920690 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:52.920690 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:52.920690 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:52.920690 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:52.921660 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:45:52.921660 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:45:52.921660 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:45:52.921660 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:45:52.921660 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:45:52.921660 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:45:52.921660 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:45:52.921660 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:52.922143 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 412/834] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:45:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:45:52.927693 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece3194-3c3c-4caf-9012-d9663492d76b None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:53.027192 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e9544-51b6-47b8-a40a-a1130fe305a5 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:53.041271 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece3194-3c3c-4caf-9012-d9663492d76b None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:53.063026 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a42bfe-ab64-4b83-ad66-10954c70b9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:53.063830 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a42bfe-ab64-4b83-ad66-10954c70b9fa None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:53.064118 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a42bfe-ab64-4b83-ad66-10954c70b9fa None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:53.064410 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a42bfe-ab64-4b83-ad66-10954c70b9fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:53.076226 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a42bfe-ab64-4b83-ad66-10954c70b9fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:53.077694 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a42bfe-ab64-4b83-ad66-10954c70b9fa None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:53.079526 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e82d83-366d-41fc-90e9-c308621e7d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:53.080150 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e82d83-366d-41fc-90e9-c308621e7d86 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:53.080449 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e82d83-366d-41fc-90e9-c308621e7d86 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:53.080745 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e82d83-366d-41fc-90e9-c308621e7d86 None admin] PATH_INFO: `/v3/projects` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:53.081555 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e82d83-366d-41fc-90e9-c308621e7d86 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:53.081877 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e82d83-366d-41fc-90e9-c308621e7d86 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:53.083343 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e82d83-366d-41fc-90e9-c308621e7d86 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:53.096509 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 413/835] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:45:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:45:53.097745 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-97a42bfe-ab64-4b83-ad66-10954c70b9fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:53.097745 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:53.097745 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:53.097745 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:53.097745 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:53.097745 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:53.097745 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:53.097745 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:53.097745 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:53.097745 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:53.097745 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:53.097745 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:53.097745 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:53.097745 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:53.097745 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:53.098734 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:53.098734 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:53.098734 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:53.098734 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:53.098734 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:53.098734 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:53.098734 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:53.098734 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:53.098734 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:53.098734 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:53.098734 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:53.098734 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:53.098734 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:53.098734 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:53.098734 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:53.098734 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:53.098734 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:53.100258 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:53.100258 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:53.100258 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:53.100258 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:53.101076 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732e3a7-3ec8-4ab2-8cf5-64e4ce1d7cb2 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:53.101076 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732e3a7-3ec8-4ab2-8cf5-64e4ce1d7cb2 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:53.101076 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732e3a7-3ec8-4ab2-8cf5-64e4ce1d7cb2 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:53.103078 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 423/836] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:53.104335 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a42bfe-ab64-4b83-ad66-10954c70b9fa None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:53.104582 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 414/837] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:45:53.107806 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6607087-d643-4b47-9d3a-5c02df4d29e1 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:53.108227 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6607087-d643-4b47-9d3a-5c02df4d29e1 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:53.108626 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6607087-d643-4b47-9d3a-5c02df4d29e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:53.109766 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:53.126911 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-a6607087-d643-4b47-9d3a-5c02df4d29e1 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:53.128139 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-a6607087-d643-4b47-9d3a-5c02df4d29e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:53.184281 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:53.204398 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 415/838] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:53 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:45:53.207228 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6607087-d643-4b47-9d3a-5c02df4d29e1 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:53.217599 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a42bfe-ab64-4b83-ad66-10954c70b9fa None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:53.255624 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d3a7cb-056f-41ca-b1ec-5c893959935b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:53.257347 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3a7cb-056f-41ca-b1ec-5c893959935b None admin] REQUEST_METHOD: `PUT` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:53.257646 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3a7cb-056f-41ca-b1ec-5c893959935b None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:53.257936 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3a7cb-056f-41ca-b1ec-5c893959935b None admin] PATH_INFO: `/v3/projects/93f20f89d0fc4bbf9cf557dd1e14d98d/users/5fb6e97b5a864998a407db6a3bf21d79/roles/1884e658df064cc2a232687c678d8618` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:53.274756 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d3a7cb-056f-41ca-b1ec-5c893959935b None admin] RBAC: Authorizing `identity:create_grant(project_id=93f20f89d0fc4bbf9cf557dd1e14d98d, user_id=5fb6e97b5a864998a407db6a3bf21d79, role_id=1884e658df064cc2a232687c678d8618)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:53.276244 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d3a7cb-056f-41ca-b1ec-5c893959935b None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:53.317428 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6607087-d643-4b47-9d3a-5c02df4d29e1 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:53.352686 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ead43f-a8f1-4bc8-af48-d66297638716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:53.353623 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ead43f-a8f1-4bc8-af48-d66297638716 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:53.353922 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ead43f-a8f1-4bc8-af48-d66297638716 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:53.354237 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ead43f-a8f1-4bc8-af48-d66297638716 None admin] PATH_INFO: `/v3/domains` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:53.355064 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ead43f-a8f1-4bc8-af48-d66297638716 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:53.355385 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ead43f-a8f1-4bc8-af48-d66297638716 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:53.360908 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 424/839] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:45:53 2022] PUT /identity/v3/projects/93f20f89d0fc4bbf9cf557dd1e14d98d/users/5fb6e97b5a864998a407db6a3bf21d79/roles/1884e658df064cc2a232687c678d8618 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:45:53.361057 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ead43f-a8f1-4bc8-af48-d66297638716 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:53.361142 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d3a7cb-056f-41ca-b1ec-5c893959935b None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:53.375374 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 416/840] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:53.377022 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ead43f-a8f1-4bc8-af48-d66297638716 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:53.433259 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:53.454276 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:53.501103 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ead43f-a8f1-4bc8-af48-d66297638716 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:53.507948 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d3a7cb-056f-41ca-b1ec-5c893959935b None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:53.544712 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e00477-f2ea-4c80-8fce-b4dde0083acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:53.545850 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e00477-f2ea-4c80-8fce-b4dde0083acf None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:53.546396 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e00477-f2ea-4c80-8fce-b4dde0083acf None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:53.546889 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e00477-f2ea-4c80-8fce-b4dde0083acf None admin] PATH_INFO: `/v3/users/swift` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:53.548543 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c5ed8-5f39-4954-8f5b-11ed52640228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:53.549869 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c5ed8-5f39-4954-8f5b-11ed52640228 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:53.549869 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c5ed8-5f39-4954-8f5b-11ed52640228 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:53.550042 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c5ed8-5f39-4954-8f5b-11ed52640228 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:53.551738 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c5ed8-5f39-4954-8f5b-11ed52640228 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:53.553296 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c5ed8-5f39-4954-8f5b-11ed52640228 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:53.560925 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e00477-f2ea-4c80-8fce-b4dde0083acf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:53.561902 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e00477-f2ea-4c80-8fce-b4dde0083acf None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:53.568952 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-3e5c5ed8-5f39-4954-8f5b-11ed52640228 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 21:45:53.568952 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:53.568952 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:45:53.568952 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:45:53.568952 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:45:53.568952 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:45:53.568952 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:45:53.568952 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:45:53.568952 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 21:45:53.568952 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:53.568952 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:45:53.568952 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:53.568952 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:53.568952 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:53.568952 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:53.568952 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:53.568952 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:53.570059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:53.570059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:53.570059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:53.570059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:53.570059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:53.570059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:53.570059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:45:53.570059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:45:53.570059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:45:53.570059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:45:53.570059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:53.570059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:53.570059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:53.570059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:53.570059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:53.570059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:53.571488 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:53.571488 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:53.571488 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:53.571488 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:53.571488 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:53.571488 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:53.571488 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:53.571488 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:53.571488 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:53.571488 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:53.571488 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:45:53.571488 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:45:53.571488 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 21:45:53.571488 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:53.571488 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 425/841] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:45:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:53.576662 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c5ed8-5f39-4954-8f5b-11ed52640228 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:53.578756 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-d4e00477-f2ea-4c80-8fce-b4dde0083acf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 21:45:53.578756 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:53.578756 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:53.578756 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:53.578756 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:53.578756 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:53.578756 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:53.578756 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:53.578756 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:53.578756 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:53.578756 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:53.578756 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:53.578756 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:45:53.578756 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:45:53.578756 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:45:53.578756 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:45:53.579769 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:53.579769 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:53.579769 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:45:53.579769 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:45:53.579769 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:45:53.579769 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:45:53.579769 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:53.579769 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:53.579769 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:53.579769 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:53.579769 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:53.579769 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:53.579769 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:53.579769 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:53.579769 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:53.579769 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:53.579769 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:53.579769 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:53.580821 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:53.580821 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:53.580821 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:45:53.580821 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:45:53.580821 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:45:53.580821 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:45:53.580821 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:45:53.580821 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:45:53.580821 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 21:45:53.580821 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:53.580821 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 417/842] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:45:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:45:53.587455 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e00477-f2ea-4c80-8fce-b4dde0083acf None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:53.700773 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c5ed8-5f39-4954-8f5b-11ed52640228 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:53.717591 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e00477-f2ea-4c80-8fce-b4dde0083acf None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:53.718440 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:53.723616 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:53.740891 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80bd870-8bc3-4bf1-a8e8-3fa32989ef03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:53.742584 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80bd870-8bc3-4bf1-a8e8-3fa32989ef03 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:53.743005 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80bd870-8bc3-4bf1-a8e8-3fa32989ef03 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:53.743567 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80bd870-8bc3-4bf1-a8e8-3fa32989ef03 None admin] PATH_INFO: `/v3/services` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:53.744316 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80bd870-8bc3-4bf1-a8e8-3fa32989ef03 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:53.744635 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80bd870-8bc3-4bf1-a8e8-3fa32989ef03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:53.746045 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80bd870-8bc3-4bf1-a8e8-3fa32989ef03 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:53.758541 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 426/843] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:45:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:53.761179 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80bd870-8bc3-4bf1-a8e8-3fa32989ef03 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:53.766705 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4808d-4d6f-4173-bcf3-80ac837b1a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:53.767409 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4808d-4d6f-4173-bcf3-80ac837b1a35 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:53.767702 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4808d-4d6f-4173-bcf3-80ac837b1a35 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:53.767987 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4808d-4d6f-4173-bcf3-80ac837b1a35 None admin] PATH_INFO: `/v3/users` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:53.768859 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4808d-4d6f-4173-bcf3-80ac837b1a35 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:53.769180 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4808d-4d6f-4173-bcf3-80ac837b1a35 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:53.770668 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4808d-4d6f-4173-bcf3-80ac837b1a35 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:53.792186 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 418/844] 10.222.0.30 () {56 vars in 1135 bytes} [Tue Jul 5 21:45:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:45:53.797828 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4808d-4d6f-4173-bcf3-80ac837b1a35 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:53.875454 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80bd870-8bc3-4bf1-a8e8-3fa32989ef03 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:53.912108 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4808d-4d6f-4173-bcf3-80ac837b1a35 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:53.913872 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c136f2-9505-44b5-8e55-2938af65190c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:53.914703 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c136f2-9505-44b5-8e55-2938af65190c None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:53.915104 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c136f2-9505-44b5-8e55-2938af65190c None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:53.915396 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c136f2-9505-44b5-8e55-2938af65190c None admin] PATH_INFO: `/v3/services` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:53.916124 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c136f2-9505-44b5-8e55-2938af65190c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:53.916441 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c136f2-9505-44b5-8e55-2938af65190c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:53.917831 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c136f2-9505-44b5-8e55-2938af65190c None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:53.930645 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 427/845] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:45:53 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:45:53.953445 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c976a51-46d6-4c66-b6ae-3311c2a295bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:53.954097 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c976a51-46d6-4c66-b6ae-3311c2a295bb None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:53.954428 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c976a51-46d6-4c66-b6ae-3311c2a295bb None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:53.954718 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c976a51-46d6-4c66-b6ae-3311c2a295bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:53.993681 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:54.038170 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c976a51-46d6-4c66-b6ae-3311c2a295bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:54.039718 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c976a51-46d6-4c66-b6ae-3311c2a295bb None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:54.156418 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 419/846] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:45:53 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 05 21:45:54.162051 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c136f2-9505-44b5-8e55-2938af65190c None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:54.214330 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:54.275344 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c136f2-9505-44b5-8e55-2938af65190c None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:54.319424 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c66e8-3504-4b1d-ac65-d94019a9b861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:54.320240 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c66e8-3504-4b1d-ac65-d94019a9b861 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:54.320581 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c66e8-3504-4b1d-ac65-d94019a9b861 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:54.320868 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c66e8-3504-4b1d-ac65-d94019a9b861 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:54.332366 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8c66e8-3504-4b1d-ac65-d94019a9b861 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:54.333833 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8c66e8-3504-4b1d-ac65-d94019a9b861 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:54.352225 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-ee8c66e8-3504-4b1d-ac65-d94019a9b861 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:54.352225 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:54.352225 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:54.352225 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:54.352225 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:54.352225 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:54.352225 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:54.352225 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:54.352225 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:54.352225 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:54.352225 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:54.352225 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:54.352225 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:54.352225 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:54.352225 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:54.353506 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:54.353506 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:54.353506 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:54.353506 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:54.353506 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:54.353506 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:54.353506 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:54.353506 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:54.353506 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:54.353506 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:54.353506 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:54.353506 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:54.353506 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:54.353506 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:54.353506 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:54.353506 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:54.353506 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:54.354922 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:54.354922 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:54.354922 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:54.354922 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:54.354922 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 428/847] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:54.359365 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c976a51-46d6-4c66-b6ae-3311c2a295bb None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:54.429132 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:54.472251 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c976a51-46d6-4c66-b6ae-3311c2a295bb None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:54.510935 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5f143-32d0-4355-bf5f-f364e2050fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:54.511614 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5f143-32d0-4355-bf5f-f364e2050fa7 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:54.511909 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5f143-32d0-4355-bf5f-f364e2050fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:54.512195 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5f143-32d0-4355-bf5f-f364e2050fa7 None admin] PATH_INFO: `/v3/domains` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:54.512932 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5f143-32d0-4355-bf5f-f364e2050fa7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:54.513243 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5f143-32d0-4355-bf5f-f364e2050fa7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:54.514663 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5f143-32d0-4355-bf5f-f364e2050fa7 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:54.527755 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 420/848] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:54.533276 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c66e8-3504-4b1d-ac65-d94019a9b861 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:54.606750 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511a78d-2da5-4124-ad90-4904b9cb7547 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:54.607095 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511a78d-2da5-4124-ad90-4904b9cb7547 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:54.607369 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511a78d-2da5-4124-ad90-4904b9cb7547 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:54.609969 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 421/849] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:45:54.613905 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b8dd8-ef59-4daf-bbb6-1666a2f34737 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:54.614244 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b8dd8-ef59-4daf-bbb6-1666a2f34737 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:54.614535 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b8dd8-ef59-4daf-bbb6-1666a2f34737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:54.632401 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-b19b8dd8-ef59-4daf-bbb6-1666a2f34737 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:54.633626 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-b19b8dd8-ef59-4daf-bbb6-1666a2f34737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:54.644307 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:54.650934 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c66e8-3504-4b1d-ac65-d94019a9b861 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:54.688288 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4528b9-4f85-4358-ac28-91042c6911d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:54.689097 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4528b9-4f85-4358-ac28-91042c6911d0 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:54.689391 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4528b9-4f85-4358-ac28-91042c6911d0 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:54.689672 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4528b9-4f85-4358-ac28-91042c6911d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:54.697764 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4528b9-4f85-4358-ac28-91042c6911d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:54.699258 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4528b9-4f85-4358-ac28-91042c6911d0 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:54.714243 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 422/850] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:54 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:45:54.714449 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-ca4528b9-4f85-4358-ac28-91042c6911d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:45:54.714449 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:54.714449 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:54.714449 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:54.714449 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:54.714449 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:54.714449 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:54.714449 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:54.714449 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:54.714449 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:54.714449 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:54.714449 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:54.714449 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:45:54.714449 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:45:54.714449 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:45:54.715388 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:45:54.715388 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:54.715388 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:54.715388 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:54.715388 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:54.715388 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:54.715388 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:54.715388 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:54.715388 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:54.715388 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:54.715388 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:54.715388 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:54.715388 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:54.715388 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:54.715388 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:54.715388 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:54.715388 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:54.716358 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:45:54.716358 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:45:54.716358 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:45:54.716358 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:45:54.716358 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:45:54.716358 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:45:54.716358 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:45:54.716358 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:54.716358 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 429/851] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:45:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:54.723187 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b8dd8-ef59-4daf-bbb6-1666a2f34737 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:54.732247 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4528b9-4f85-4358-ac28-91042c6911d0 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:54.781870 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:54.836735 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b8dd8-ef59-4daf-bbb6-1666a2f34737 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:54.868929 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4528b9-4f85-4358-ac28-91042c6911d0 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:54.876461 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5f61a-ba44-4004-b049-86349db30aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:54.877529 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5f61a-ba44-4004-b049-86349db30aad None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:54.878037 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5f61a-ba44-4004-b049-86349db30aad None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:54.878562 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5f61a-ba44-4004-b049-86349db30aad None admin] PATH_INFO: `/v3/projects` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:54.879676 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac5f61a-ba44-4004-b049-86349db30aad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:54.880195 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac5f61a-ba44-4004-b049-86349db30aad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:54.882742 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac5f61a-ba44-4004-b049-86349db30aad None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:54.900838 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 423/852] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:45:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:45:54.902086 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5f61a-ba44-4004-b049-86349db30aad None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:54.908737 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce209cb-b4a1-4fd5-9e96-11e402b0295f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:54.909571 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce209cb-b4a1-4fd5-9e96-11e402b0295f None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:54.909867 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce209cb-b4a1-4fd5-9e96-11e402b0295f None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:54.910173 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce209cb-b4a1-4fd5-9e96-11e402b0295f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:54.910856 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce209cb-b4a1-4fd5-9e96-11e402b0295f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:54.912274 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce209cb-b4a1-4fd5-9e96-11e402b0295f None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:54.929436 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-fce209cb-b4a1-4fd5-9e96-11e402b0295f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 21:45:54.929436 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:54.929436 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:45:54.929436 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:45:54.929436 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:45:54.929436 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:45:54.929436 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:45:54.929436 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:45:54.929436 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 21:45:54.929436 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:54.929436 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:45:54.929436 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:54.929436 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:54.929436 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:54.929436 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:54.929436 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:54.930568 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:54.930568 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:54.930568 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:54.930568 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:54.930568 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:54.930568 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:54.930568 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:54.930568 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:45:54.930568 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:45:54.930568 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:45:54.930568 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:45:54.930568 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:54.930568 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:54.930568 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:54.930568 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:54.930568 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:54.931477 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:54.931477 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:54.931477 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:54.931477 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:54.931477 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:54.931477 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:54.931477 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:54.931477 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:54.931477 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:54.931477 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:54.931477 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:54.931477 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:45:54.931477 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:45:54.931477 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 21:45:54.931477 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:54.934209 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 430/853] 10.222.0.30 () {56 vars in 1132 bytes} [Tue Jul 5 21:45:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:45:54.937288 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce209cb-b4a1-4fd5-9e96-11e402b0295f None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:54.966803 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:55.022197 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5f61a-ba44-4004-b049-86349db30aad None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:55.036376 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:55.060610 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a9cda-aa6c-4c18-8ae3-5d03f39bd840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:55.061752 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a9cda-aa6c-4c18-8ae3-5d03f39bd840 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:55.062284 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a9cda-aa6c-4c18-8ae3-5d03f39bd840 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:55.062801 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a9cda-aa6c-4c18-8ae3-5d03f39bd840 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:55.063943 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a9cda-aa6c-4c18-8ae3-5d03f39bd840 None admin] RBAC: Adding query filter params (role.id=e1c574c9973548ebb0e8d9e0656ccabd, scope.project.id=93f20f89d0fc4bbf9cf557dd1e14d98d, user.id=ba028a9695364d54a73b01c986300344) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:55.064497 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce209cb-b4a1-4fd5-9e96-11e402b0295f None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:55.064760 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a9cda-aa6c-4c18-8ae3-5d03f39bd840 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:55.066635 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a9cda-aa6c-4c18-8ae3-5d03f39bd840 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:55.082584 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 424/854] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:45:54 2022] GET /identity/v3/role_assignments?user.id=ba028a9695364d54a73b01c986300344&scope.project.id=93f20f89d0fc4bbf9cf557dd1e14d98d&role.id=e1c574c9973548ebb0e8d9e0656ccabd => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:55.104106 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70907d-20ff-444b-9120-709a4d868c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:55.104807 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70907d-20ff-444b-9120-709a4d868c2a None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:55.105099 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70907d-20ff-444b-9120-709a4d868c2a None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:55.105381 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70907d-20ff-444b-9120-709a4d868c2a None admin] PATH_INFO: `/v3/services` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:55.106147 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70907d-20ff-444b-9120-709a4d868c2a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:55.106468 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70907d-20ff-444b-9120-709a4d868c2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:55.107913 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70907d-20ff-444b-9120-709a4d868c2a None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:55.118305 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 431/855] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Jul 5 21:45:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:45:55.120705 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a9cda-aa6c-4c18-8ae3-5d03f39bd840 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:55.242159 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a9cda-aa6c-4c18-8ae3-5d03f39bd840 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:55.286655 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b95a767-226f-46b6-bfd3-f2f6c5e0ea08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:55.288318 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95a767-226f-46b6-bfd3-f2f6c5e0ea08 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:55.288599 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95a767-226f-46b6-bfd3-f2f6c5e0ea08 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:55.288874 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95a767-226f-46b6-bfd3-f2f6c5e0ea08 None admin] PATH_INFO: `/v3/services` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:55.289600 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b95a767-226f-46b6-bfd3-f2f6c5e0ea08 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:55.289903 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b95a767-226f-46b6-bfd3-f2f6c5e0ea08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:55.291324 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b95a767-226f-46b6-bfd3-f2f6c5e0ea08 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:55.296751 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 425/856] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Jul 5 21:45:55 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:55.561768 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701c901-e891-46d2-84fb-3b700448af99 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:55.562098 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701c901-e891-46d2-84fb-3b700448af99 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:55.562411 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701c901-e891-46d2-84fb-3b700448af99 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:55.564054 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 432/857] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:45:55.570257 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de34d2-fd61-48d6-8305-e84eb23276bd None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:55.570574 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de34d2-fd61-48d6-8305-e84eb23276bd None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:55.570850 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de34d2-fd61-48d6-8305-e84eb23276bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:55.589941 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-15de34d2-fd61-48d6-8305-e84eb23276bd None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:55.591196 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-15de34d2-fd61-48d6-8305-e84eb23276bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:55.634322 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:55.670587 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 426/858] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:55 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:45:55.703027 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8701c901-e891-46d2-84fb-3b700448af99 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:55.793953 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:55.815521 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8701c901-e891-46d2-84fb-3b700448af99 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:55.853030 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc6966-43a2-44ef-a8c7-8b0c2f2161df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:55.854100 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc6966-43a2-44ef-a8c7-8b0c2f2161df None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:55.854422 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc6966-43a2-44ef-a8c7-8b0c2f2161df None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:55.854705 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc6966-43a2-44ef-a8c7-8b0c2f2161df None admin] PATH_INFO: `/v3/roles/service` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:55.865790 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc6966-43a2-44ef-a8c7-8b0c2f2161df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:45:55.873916 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-e8bc6966-43a2-44ef-a8c7-8b0c2f2161df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:45:55.873916 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:55.873916 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:55.873916 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:55.873916 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:55.873916 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:55.873916 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:55.873916 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:55.873916 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:55.873916 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:55.873916 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:55.873916 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:55.873916 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:45:55.873916 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:45:55.873916 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:45:55.873916 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:45:55.875056 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:45:55.875056 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:45:55.875056 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:45:55.875056 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:45:55.875056 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:55.875056 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:55.875056 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:55.875056 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:55.875056 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:55.875056 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:55.875056 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:55.875056 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:55.875056 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:55.875056 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:55.875056 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:55.875056 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:55.876046 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:55.876046 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:55.876046 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:55.876046 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:55.876046 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:45:55.876046 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:45:55.876046 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:45:55.876046 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:45:55.876046 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:45:55.876046 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:45:55.876046 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:45:55.876046 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:55.876046 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 433/859] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:45:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:55.881787 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de34d2-fd61-48d6-8305-e84eb23276bd None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:55.993522 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de34d2-fd61-48d6-8305-e84eb23276bd None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:56.031729 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1676079-35ba-4ff8-a25f-15bd4cc074eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:56.032425 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1676079-35ba-4ff8-a25f-15bd4cc074eb None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:56.032719 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1676079-35ba-4ff8-a25f-15bd4cc074eb None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:56.033004 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1676079-35ba-4ff8-a25f-15bd4cc074eb None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:56.033771 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1676079-35ba-4ff8-a25f-15bd4cc074eb None admin] RBAC: Adding query filter params (name=service) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:56.034087 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1676079-35ba-4ff8-a25f-15bd4cc074eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:56.035490 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1676079-35ba-4ff8-a25f-15bd4cc074eb None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:56.044787 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 427/860] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:45:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:56.051219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc6966-43a2-44ef-a8c7-8b0c2f2161df None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:56.115832 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d2597-f6a2-467a-a169-5accc3ede630 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:56.116178 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d2597-f6a2-467a-a169-5accc3ede630 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:56.116471 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d2597-f6a2-467a-a169-5accc3ede630 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:56.117999 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 428/861] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:45:56.123200 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0efa7ba-5f14-406f-8de9-5a6844d0bc1c None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:56.123743 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0efa7ba-5f14-406f-8de9-5a6844d0bc1c None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:56.124265 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0efa7ba-5f14-406f-8de9-5a6844d0bc1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:56.142701 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-e0efa7ba-5f14-406f-8de9-5a6844d0bc1c None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:56.144505 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-e0efa7ba-5f14-406f-8de9-5a6844d0bc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:56.168400 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc6966-43a2-44ef-a8c7-8b0c2f2161df None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:56.173993 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:56.216139 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e1d2a8-b3e1-449c-885b-45b6e01a2fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:56.216959 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1d2a8-b3e1-449c-885b-45b6e01a2fec None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:56.217251 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1d2a8-b3e1-449c-885b-45b6e01a2fec None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:56.217546 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1d2a8-b3e1-449c-885b-45b6e01a2fec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:56.224962 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 429/862] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:56 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:45:56.235867 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e1d2a8-b3e1-449c-885b-45b6e01a2fec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:56.245771 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e1d2a8-b3e1-449c-885b-45b6e01a2fec None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:56.245771 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:56.247526 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0efa7ba-5f14-406f-8de9-5a6844d0bc1c None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:56.268465 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-20e1d2a8-b3e1-449c-885b-45b6e01a2fec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:56.268465 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:56.268465 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:56.268465 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:56.268465 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:56.268465 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:56.268465 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:56.268465 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:56.268465 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:56.268465 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:56.268465 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:56.268465 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:56.268465 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:56.268465 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:56.268465 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:56.269519 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:56.269519 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:56.269519 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:56.269519 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:56.269519 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:56.269519 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:56.269519 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:56.269519 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:56.269519 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:56.269519 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:56.269519 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:56.269519 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:56.269519 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:56.269519 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:56.269519 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:56.269519 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:56.269519 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:56.270580 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:56.270580 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:56.270580 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:56.270580 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:56.273562 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 434/863] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:56.279728 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e1d2a8-b3e1-449c-885b-45b6e01a2fec None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:56.377871 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0efa7ba-5f14-406f-8de9-5a6844d0bc1c None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:56.415679 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e1d2a8-b3e1-449c-885b-45b6e01a2fec None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:56.430548 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f93e8-9490-4c35-b18b-b81dbf96ad8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:56.432065 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f93e8-9490-4c35-b18b-b81dbf96ad8a None admin] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:56.432595 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f93e8-9490-4c35-b18b-b81dbf96ad8a None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:56.433368 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f93e8-9490-4c35-b18b-b81dbf96ad8a None admin] PATH_INFO: `/v3/services` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:56.434441 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2f93e8-9490-4c35-b18b-b81dbf96ad8a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:56.436702 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2f93e8-9490-4c35-b18b-b81dbf96ad8a None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:56.454781 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa51ef-9c99-4d73-9e62-d954b8a68a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:56.460990 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa51ef-9c99-4d73-9e62-d954b8a68a99 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:56.460990 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa51ef-9c99-4d73-9e62-d954b8a68a99 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:56.460990 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa51ef-9c99-4d73-9e62-d954b8a68a99 None admin] PATH_INFO: `/v3/domains` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:56.460990 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffa51ef-9c99-4d73-9e62-d954b8a68a99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:56.460990 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffa51ef-9c99-4d73-9e62-d954b8a68a99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:56.460990 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffa51ef-9c99-4d73-9e62-d954b8a68a99 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:56.472934 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 435/864] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:56.479113 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa51ef-9c99-4d73-9e62-d954b8a68a99 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:56.516147 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 430/865] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Jul 5 21:45:56 2022] POST /identity/v3/services => generated 251 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:45:56.554222 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:56.607369 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa51ef-9c99-4d73-9e62-d954b8a68a99 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:56.651818 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058e499-56a8-4f51-ac4e-6cf697dd5f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:56.652569 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058e499-56a8-4f51-ac4e-6cf697dd5f4f None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:56.652857 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058e499-56a8-4f51-ac4e-6cf697dd5f4f None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:56.653136 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058e499-56a8-4f51-ac4e-6cf697dd5f4f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:56.662004 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6058e499-56a8-4f51-ac4e-6cf697dd5f4f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:56.664102 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6058e499-56a8-4f51-ac4e-6cf697dd5f4f None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:56.680504 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-6058e499-56a8-4f51-ac4e-6cf697dd5f4f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 21:45:56.680504 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:56.680504 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:56.680504 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:56.680504 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:56.680504 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:56.680504 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:56.680504 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:56.680504 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:56.680504 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:56.680504 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:56.680504 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:56.680504 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:45:56.680504 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:45:56.680504 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:45:56.680504 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:45:56.681785 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:56.681785 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:56.681785 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:45:56.681785 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:45:56.681785 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:45:56.681785 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:45:56.681785 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:56.681785 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:56.681785 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:56.681785 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:56.681785 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:56.681785 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:56.681785 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:56.681785 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:56.681785 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:56.681785 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:56.681785 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:56.681785 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:56.683275 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:56.683275 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:56.683275 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:45:56.683275 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:45:56.683275 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:45:56.683275 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:45:56.683275 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:45:56.683275 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:45:56.683275 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 21:45:56.683275 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:56.683275 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 436/866] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Jul 5 21:45:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:56.688336 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f93e8-9490-4c35-b18b-b81dbf96ad8a None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:56.717283 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:56.796632 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f93e8-9490-4c35-b18b-b81dbf96ad8a None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:56.832525 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7015d870-1537-4d92-af93-368efd57d828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:56.833273 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015d870-1537-4d92-af93-368efd57d828 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:56.833565 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015d870-1537-4d92-af93-368efd57d828 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:56.833846 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015d870-1537-4d92-af93-368efd57d828 None admin] PATH_INFO: `/v3/users` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:56.835526 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7015d870-1537-4d92-af93-368efd57d828 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:56.835846 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7015d870-1537-4d92-af93-368efd57d828 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:56.837297 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7015d870-1537-4d92-af93-368efd57d828 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:56.855840 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 431/867] 10.222.0.30 () {56 vars in 1149 bytes} [Tue Jul 5 21:45:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:56.861075 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058e499-56a8-4f51-ac4e-6cf697dd5f4f None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:56.977139 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058e499-56a8-4f51-ac4e-6cf697dd5f4f None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:56.991446 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:57.014078 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e856e19-9f58-44a2-aef4-2d7f0127d687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:57.014775 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e856e19-9f58-44a2-aef4-2d7f0127d687 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:57.015068 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e856e19-9f58-44a2-aef4-2d7f0127d687 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:57.015355 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e856e19-9f58-44a2-aef4-2d7f0127d687 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:57.089484 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e856e19-9f58-44a2-aef4-2d7f0127d687 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:57.091044 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e856e19-9f58-44a2-aef4-2d7f0127d687 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:57.204372 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 437/868] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:45:56 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:45:57.210254 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7015d870-1537-4d92-af93-368efd57d828 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:57.294894 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:57.314312 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7015d870-1537-4d92-af93-368efd57d828 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:57.350709 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69dfb9-b502-4411-b578-2ba60964c552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:57.351511 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69dfb9-b502-4411-b578-2ba60964c552 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:57.351795 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69dfb9-b502-4411-b578-2ba60964c552 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:57.352076 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69dfb9-b502-4411-b578-2ba60964c552 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:57.362851 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe69dfb9-b502-4411-b578-2ba60964c552 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:57.364310 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe69dfb9-b502-4411-b578-2ba60964c552 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:57.379542 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff264807-628c-488e-8cb2-a9e70918a400 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:57.380189 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff264807-628c-488e-8cb2-a9e70918a400 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:57.380686 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff264807-628c-488e-8cb2-a9e70918a400 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:57.382953 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 438/869] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:45:57.386787 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-fe69dfb9-b502-4411-b578-2ba60964c552 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:57.386787 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:57.386787 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:57.386787 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:57.386787 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:57.386787 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:57.386787 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:57.386787 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:57.386787 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:57.386787 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:57.386787 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:57.386787 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:57.386787 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:45:57.386787 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:45:57.386787 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:45:57.387756 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:45:57.387756 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:57.387756 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:57.387756 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:57.387756 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:57.387756 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:57.387756 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:57.387756 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:57.387756 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:57.387756 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:57.387756 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:57.387756 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:57.387756 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:57.387756 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:57.387756 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:57.387756 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:57.387756 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:57.388769 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:45:57.388769 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:45:57.388769 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:45:57.388769 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:57.388769 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 432/870] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:45:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:57.390418 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff264807-628c-488e-8cb2-a9e70918a400 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:57.390957 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6920f-995f-4991-b9c4-0cf2c147e85a None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:57.391252 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6920f-995f-4991-b9c4-0cf2c147e85a None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:57.391538 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6920f-995f-4991-b9c4-0cf2c147e85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:57.408604 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:57.414210 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-d3a6920f-995f-4991-b9c4-0cf2c147e85a None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:57.422768 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-d3a6920f-995f-4991-b9c4-0cf2c147e85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:57.491414 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 433/871] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:57 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:45:57.493155 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4a717-80b7-4ad6-a3fe-ee5ec0f70bc6 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:57.493449 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4a717-80b7-4ad6-a3fe-ee5ec0f70bc6 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:57.493732 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4a717-80b7-4ad6-a3fe-ee5ec0f70bc6 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:57.495191 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 434/872] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:45:57.500254 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e0d9f-5704-4f15-be26-5db455887b9e None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:57.500549 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e0d9f-5704-4f15-be26-5db455887b9e None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:57.500813 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e0d9f-5704-4f15-be26-5db455887b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:57.511576 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff264807-628c-488e-8cb2-a9e70918a400 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:57.517917 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-0b3e0d9f-5704-4f15-be26-5db455887b9e None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:57.519218 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-0b3e0d9f-5704-4f15-be26-5db455887b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:57.557863 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e08ab-4cff-4331-afb1-06609fd29e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:57.558599 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e08ab-4cff-4331-afb1-06609fd29e63 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:57.559010 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e08ab-4cff-4331-afb1-06609fd29e63 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:57.559292 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e08ab-4cff-4331-afb1-06609fd29e63 None admin] PATH_INFO: `/v3/domains` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:57.560032 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6e08ab-4cff-4331-afb1-06609fd29e63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:57.560344 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6e08ab-4cff-4331-afb1-06609fd29e63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:57.561713 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6e08ab-4cff-4331-afb1-06609fd29e63 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:57.579944 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 439/873] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:45:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:57.579944 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e08ab-4cff-4331-afb1-06609fd29e63 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:57.594863 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:57.611181 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 435/874] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:57 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:45:57.612182 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e0d9f-5704-4f15-be26-5db455887b9e None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:57.658957 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:57.693133 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e08ab-4cff-4331-afb1-06609fd29e63 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:57.726879 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e0d9f-5704-4f15-be26-5db455887b9e None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:57.734930 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a43e97-b40f-460d-af4f-f6e4e8ea6292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:57.735773 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a43e97-b40f-460d-af4f-f6e4e8ea6292 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:57.736058 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a43e97-b40f-460d-af4f-f6e4e8ea6292 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:57.736341 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a43e97-b40f-460d-af4f-f6e4e8ea6292 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:57.737014 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a43e97-b40f-460d-af4f-f6e4e8ea6292 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:57.738441 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a43e97-b40f-460d-af4f-f6e4e8ea6292 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:57.750933 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-99a43e97-b40f-460d-af4f-f6e4e8ea6292 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:45:57.750933 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:57.750933 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:45:57.750933 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:45:57.750933 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:45:57.750933 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:45:57.750933 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:45:57.750933 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:45:57.750933 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:45:57.750933 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:57.750933 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:45:57.750933 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:57.750933 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:57.750933 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:57.750933 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:57.750933 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:57.750933 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:57.752172 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:57.752172 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:57.752172 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:57.752172 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:57.752172 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:57.752172 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:57.752172 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:45:57.752172 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:45:57.752172 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:45:57.752172 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:45:57.752172 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:57.752172 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:57.752172 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:57.752172 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:57.752172 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:57.752172 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:57.758817 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:57.758817 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:57.758817 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:57.758817 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:57.758817 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:57.758817 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:57.758817 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:57.758817 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:57.758817 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:57.758817 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:57.758817 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:45:57.758817 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:45:57.758817 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:45:57.758817 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:57.758817 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 440/875] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Jul 5 21:45:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:57.759711 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a43e97-b40f-460d-af4f-f6e4e8ea6292 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:57.768589 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6efc08f-d70b-47a1-b201-9f862f7f22fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:57.769406 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6efc08f-d70b-47a1-b201-9f862f7f22fe None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:57.769698 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6efc08f-d70b-47a1-b201-9f862f7f22fe None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:57.769980 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6efc08f-d70b-47a1-b201-9f862f7f22fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:57.778086 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6efc08f-d70b-47a1-b201-9f862f7f22fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:57.779570 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6efc08f-d70b-47a1-b201-9f862f7f22fe None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:57.794006 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-a6efc08f-d70b-47a1-b201-9f862f7f22fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:45:57.794006 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:57.794006 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:57.794006 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:57.794006 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:57.794006 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:57.794006 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:57.794006 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:57.794006 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:57.794006 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:57.794006 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:57.794006 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:57.794006 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:45:57.794006 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:45:57.794006 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:45:57.795076 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:45:57.795076 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:57.795076 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:57.795076 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:57.795076 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:57.795076 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:57.795076 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:57.795076 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:57.795076 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:57.795076 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:57.795076 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:57.795076 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:57.795076 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:57.795076 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:57.795076 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:57.795076 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:57.795076 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:57.796051 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:45:57.796051 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:45:57.796051 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:45:57.796051 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:45:57.796051 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:45:57.796051 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:45:57.796051 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:45:57.796051 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:45:57.796051 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 436/876] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:45:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:57.796640 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6efc08f-d70b-47a1-b201-9f862f7f22fe None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:57.856450 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:57.885354 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a43e97-b40f-460d-af4f-f6e4e8ea6292 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:57.918491 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6efc08f-d70b-47a1-b201-9f862f7f22fe None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:57.929806 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d0385-b2f0-4051-a024-2a6189048dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:57.930786 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d0385-b2f0-4051-a024-2a6189048dc3 None admin] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:57.931077 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d0385-b2f0-4051-a024-2a6189048dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:57.931354 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d0385-b2f0-4051-a024-2a6189048dc3 None admin] PATH_INFO: `/v3/services` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:57.932247 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d0385-b2f0-4051-a024-2a6189048dc3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:57.934307 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d0385-b2f0-4051-a024-2a6189048dc3 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:57.938078 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:57.952727 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a10d7e-ddc2-426b-9e05-d7210b5f375b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:57.953393 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a10d7e-ddc2-426b-9e05-d7210b5f375b None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:57.953679 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a10d7e-ddc2-426b-9e05-d7210b5f375b None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:57.953957 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a10d7e-ddc2-426b-9e05-d7210b5f375b None admin] PATH_INFO: `/v3/services` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:57.954699 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a10d7e-ddc2-426b-9e05-d7210b5f375b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:57.955008 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a10d7e-ddc2-426b-9e05-d7210b5f375b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:57.956361 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a10d7e-ddc2-426b-9e05-d7210b5f375b None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:57.961059 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 437/877] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Jul 5 21:45:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:57.961822 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a10d7e-ddc2-426b-9e05-d7210b5f375b None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:58.020097 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 441/878] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Jul 5 21:45:57 2022] POST /identity/v3/services => generated 269 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:45:58.021246 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d0385-b2f0-4051-a024-2a6189048dc3 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:58.098866 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a10d7e-ddc2-426b-9e05-d7210b5f375b None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:58.125925 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:58.150432 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d0385-b2f0-4051-a024-2a6189048dc3 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:58.152050 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad8184-8d25-4e29-b2e6-46ed153ebd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:58.154344 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad8184-8d25-4e29-b2e6-46ed153ebd9c None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:58.155216 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad8184-8d25-4e29-b2e6-46ed153ebd9c None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:58.155766 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad8184-8d25-4e29-b2e6-46ed153ebd9c None admin] PATH_INFO: `/v3/projects` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:58.156904 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad8184-8d25-4e29-b2e6-46ed153ebd9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:58.157443 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad8184-8d25-4e29-b2e6-46ed153ebd9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:58.159197 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad8184-8d25-4e29-b2e6-46ed153ebd9c None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:58.180088 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 438/879] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:45:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:58.186199 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad8184-8d25-4e29-b2e6-46ed153ebd9c None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:58.197937 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce4b67-95f5-4e8a-8862-c2fc811060f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:58.198653 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce4b67-95f5-4e8a-8862-c2fc811060f8 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:58.199304 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce4b67-95f5-4e8a-8862-c2fc811060f8 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:58.199593 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce4b67-95f5-4e8a-8862-c2fc811060f8 None admin] PATH_INFO: `/v3/services` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:58.200630 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fce4b67-95f5-4e8a-8862-c2fc811060f8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:58.200951 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fce4b67-95f5-4e8a-8862-c2fc811060f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:58.202545 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fce4b67-95f5-4e8a-8862-c2fc811060f8 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:58.209109 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 442/880] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Jul 5 21:45:58 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:58.313248 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad8184-8d25-4e29-b2e6-46ed153ebd9c None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:58.354691 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c962871-04cd-42a2-be6a-1a9af142af75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:58.355686 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c962871-04cd-42a2-be6a-1a9af142af75 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:58.356152 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c962871-04cd-42a2-be6a-1a9af142af75 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:58.356611 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c962871-04cd-42a2-be6a-1a9af142af75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:58.357636 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c962871-04cd-42a2-be6a-1a9af142af75 None admin] RBAC: Adding query filter params (role.id=1884e658df064cc2a232687c678d8618, scope.project.id=93f20f89d0fc4bbf9cf557dd1e14d98d, user.id=5fb6e97b5a864998a407db6a3bf21d79) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:58.358161 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c962871-04cd-42a2-be6a-1a9af142af75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:58.359905 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c962871-04cd-42a2-be6a-1a9af142af75 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:58.367792 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 439/881] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:45:58 2022] GET /identity/v3/role_assignments?user.id=5fb6e97b5a864998a407db6a3bf21d79&scope.project.id=93f20f89d0fc4bbf9cf557dd1e14d98d&role.id=1884e658df064cc2a232687c678d8618 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:58.680750 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041031d-793a-4823-977f-1b0e8220e323 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:58.681178 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041031d-793a-4823-977f-1b0e8220e323 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:58.681387 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041031d-793a-4823-977f-1b0e8220e323 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:58.682938 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 443/882] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:45:58.688492 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af505bb-0196-4b32-b618-6782359be8ac None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:58.688790 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af505bb-0196-4b32-b618-6782359be8ac None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:58.689071 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af505bb-0196-4b32-b618-6782359be8ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:58.706901 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-4af505bb-0196-4b32-b618-6782359be8ac None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:45:58.708105 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-4af505bb-0196-4b32-b618-6782359be8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:45:58.744466 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:58.778926 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 440/883] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:45:58 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:45:58.802042 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041031d-793a-4823-977f-1b0e8220e323 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:58.862728 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:58.916753 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041031d-793a-4823-977f-1b0e8220e323 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:58.957154 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead49aeb-659c-4b45-a2ba-ada8dca7a2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:58.957963 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead49aeb-659c-4b45-a2ba-ada8dca7a2b2 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:58.958285 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead49aeb-659c-4b45-a2ba-ada8dca7a2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:58.958567 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead49aeb-659c-4b45-a2ba-ada8dca7a2b2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:58.959366 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead49aeb-659c-4b45-a2ba-ada8dca7a2b2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:58.960737 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead49aeb-659c-4b45-a2ba-ada8dca7a2b2 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:58.972656 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-ead49aeb-659c-4b45-a2ba-ada8dca7a2b2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 21:45:58.972656 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:58.972656 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:45:58.972656 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:45:58.972656 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:45:58.972656 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:45:58.972656 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:45:58.972656 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:45:58.972656 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 21:45:58.972656 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:58.972656 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:45:58.972656 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:58.972656 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:45:58.972656 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:45:58.972656 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:45:58.972656 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:45:58.972656 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:45:58.973767 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:45:58.973767 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:45:58.973767 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:45:58.973767 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:45:58.973767 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:45:58.973767 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:45:58.973767 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:45:58.973767 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:45:58.973767 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:45:58.973767 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:45:58.973767 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:45:58.973767 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:45:58.973767 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:45:58.973767 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:45:58.973767 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:45:58.973767 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:45:58.975278 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:45:58.975278 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:45:58.975278 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:45:58.975278 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:45:58.975278 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:45:58.975278 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:45:58.975278 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:45:58.975278 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:45:58.975278 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:45:58.975278 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:45:58.975278 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:45:58.975278 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:45:58.975278 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 21:45:58.975278 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:45:58.975278 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 444/884] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:45:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:45:58.980915 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af505bb-0196-4b32-b618-6782359be8ac None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:59.081618 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af505bb-0196-4b32-b618-6782359be8ac None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:59.116416 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf9922-f6bd-4c2a-901f-2efe5c6b873c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:59.117095 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf9922-f6bd-4c2a-901f-2efe5c6b873c None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:59.117381 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf9922-f6bd-4c2a-901f-2efe5c6b873c None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:59.117661 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf9922-f6bd-4c2a-901f-2efe5c6b873c None admin] PATH_INFO: `/v3/services` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:59.118404 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdf9922-f6bd-4c2a-901f-2efe5c6b873c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:59.118713 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdf9922-f6bd-4c2a-901f-2efe5c6b873c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:59.120092 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdf9922-f6bd-4c2a-901f-2efe5c6b873c None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:59.125142 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 441/885] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:45:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:59.131321 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead49aeb-659c-4b45-a2ba-ada8dca7a2b2 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:59.236021 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead49aeb-659c-4b45-a2ba-ada8dca7a2b2 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:59.259908 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:59.274665 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87dd129-6ce8-4038-a1b2-7d2899ae096f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:59.275625 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87dd129-6ce8-4038-a1b2-7d2899ae096f None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:59.276139 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87dd129-6ce8-4038-a1b2-7d2899ae096f None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:59.276623 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87dd129-6ce8-4038-a1b2-7d2899ae096f None admin] PATH_INFO: `/v3/services` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:59.277558 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87dd129-6ce8-4038-a1b2-7d2899ae096f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:59.278095 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87dd129-6ce8-4038-a1b2-7d2899ae096f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:59.279774 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87dd129-6ce8-4038-a1b2-7d2899ae096f None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:59.285250 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 445/886] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:45:59 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:45:59.291489 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf9922-f6bd-4c2a-901f-2efe5c6b873c None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:59.328829 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:45:59.401857 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf9922-f6bd-4c2a-901f-2efe5c6b873c None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:59.441588 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b8e1e-5e11-48ff-977f-91a4ff339700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:59.442293 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b8e1e-5e11-48ff-977f-91a4ff339700 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:59.442589 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b8e1e-5e11-48ff-977f-91a4ff339700 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:59.442875 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b8e1e-5e11-48ff-977f-91a4ff339700 None admin] PATH_INFO: `/v3/endpoints` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:59.443910 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b8e1e-5e11-48ff-977f-91a4ff339700 None admin] RBAC: Adding query filter params (interface=public, service_id=49d8c860705743ac9cb557fe7371e203, region_id=RegionOne) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:45:59.444234 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b8e1e-5e11-48ff-977f-91a4ff339700 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:59.445629 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b8e1e-5e11-48ff-977f-91a4ff339700 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:59.453984 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 442/887] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Jul 5 21:45:59 2022] GET /identity/v3/endpoints?service_id=49d8c860705743ac9cb557fe7371e203&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:45:59.459689 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87dd129-6ce8-4038-a1b2-7d2899ae096f None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:45:59.563879 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87dd129-6ce8-4038-a1b2-7d2899ae096f None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:45:59.598152 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce8e96-df45-4e31-848e-e5f5109a5cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:45:59.598847 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce8e96-df45-4e31-848e-e5f5109a5cf4 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:45:59.599135 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce8e96-df45-4e31-848e-e5f5109a5cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:45:59.599415 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce8e96-df45-4e31-848e-e5f5109a5cf4 None admin] PATH_INFO: `/v3/services` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:45:59.600781 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ce8e96-df45-4e31-848e-e5f5109a5cf4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:45:59.602161 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ce8e96-df45-4e31-848e-e5f5109a5cf4 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:45:59.608459 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 446/888] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Jul 5 21:45:59 2022] GET /identity/v3/services => generated 1268 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:46:00.324339 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e62d1-7509-450c-986b-760395cec85b None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:00.325028 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e62d1-7509-450c-986b-760395cec85b None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:00.325555 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e62d1-7509-450c-986b-760395cec85b None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:00.326454 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e6d5c-c98a-49dc-8203-b388a64582d1 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:00.326895 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e6d5c-c98a-49dc-8203-b388a64582d1 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:00.327076 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e6d5c-c98a-49dc-8203-b388a64582d1 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:00.328288 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 443/889] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:46:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:46:00.328689 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 447/890] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:46:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:46:00.333702 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af492cb-ec37-4a77-a968-b4996e7d01b9 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:00.334720 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de4b40-d7f7-48d2-a332-3c6f9beb1c8e None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:00.334720 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de4b40-d7f7-48d2-a332-3c6f9beb1c8e None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:00.334884 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de4b40-d7f7-48d2-a332-3c6f9beb1c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:00.335438 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af492cb-ec37-4a77-a968-b4996e7d01b9 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:00.335935 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af492cb-ec37-4a77-a968-b4996e7d01b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:00.354110 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-3af492cb-ec37-4a77-a968-b4996e7d01b9 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:46:00.354349 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-67de4b40-d7f7-48d2-a332-3c6f9beb1c8e None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:46:00.355396 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-67de4b40-d7f7-48d2-a332-3c6f9beb1c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:46:00.356024 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-3af492cb-ec37-4a77-a968-b4996e7d01b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:46:00.415664 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:00.445644 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 444/891] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:46:00 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:46:00.446253 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 448/892] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:46:00 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:46:00.468927 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af492cb-ec37-4a77-a968-b4996e7d01b9 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:00.477225 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de4b40-d7f7-48d2-a332-3c6f9beb1c8e None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:00.499932 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:00.581145 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af492cb-ec37-4a77-a968-b4996e7d01b9 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:00.610606 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de4b40-d7f7-48d2-a332-3c6f9beb1c8e None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:00.619125 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11b11a3-0e47-4580-9687-cb7ebc81e646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:00.620772 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b11a3-0e47-4580-9687-cb7ebc81e646 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:00.622042 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b11a3-0e47-4580-9687-cb7ebc81e646 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:00.622882 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b11a3-0e47-4580-9687-cb7ebc81e646 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:00.624411 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11b11a3-0e47-4580-9687-cb7ebc81e646 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:00.627202 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11b11a3-0e47-4580-9687-cb7ebc81e646 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:00.640610 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-b11b11a3-0e47-4580-9687-cb7ebc81e646 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 21:46:00.640610 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:00.640610 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:46:00.640610 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:46:00.640610 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:46:00.640610 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:46:00.640610 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:46:00.640610 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:46:00.640610 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 21:46:00.640610 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:46:00.640610 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:46:00.640610 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:46:00.640610 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:00.640610 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:00.640610 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:00.640610 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:00.641652 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:00.641652 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:00.641652 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:00.641652 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:00.641652 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:00.641652 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:00.641652 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:00.641652 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:46:00.641652 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:46:00.641652 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:46:00.641652 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:46:00.641652 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:00.641652 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:00.641652 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:46:00.641652 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:46:00.641652 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:46:00.642613 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:46:00.642613 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:46:00.642613 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:46:00.642613 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:46:00.642613 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:46:00.642613 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:46:00.642613 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:46:00.642613 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:46:00.642613 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:46:00.642613 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:46:00.642613 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:46:00.642613 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:46:00.642613 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:46:00.642613 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 21:46:00.642613 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:46:00.645609 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 445/893] 10.222.0.30 () {56 vars in 1132 bytes} [Tue Jul 5 21:46:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:46:00.647798 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f4a00-5d42-4ef9-918f-420b6453d764 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:00.648339 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f4a00-5d42-4ef9-918f-420b6453d764 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:00.648721 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f4a00-5d42-4ef9-918f-420b6453d764 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:00.650266 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3da606-eaee-4b12-87a7-e9efdcb75bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:00.650523 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 446/894] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:46:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:46:00.651411 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3da606-eaee-4b12-87a7-e9efdcb75bb6 None admin] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:00.651709 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3da606-eaee-4b12-87a7-e9efdcb75bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:00.652001 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3da606-eaee-4b12-87a7-e9efdcb75bb6 None admin] PATH_INFO: `/v3/services` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:00.652751 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3da606-eaee-4b12-87a7-e9efdcb75bb6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:00.654607 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3da606-eaee-4b12-87a7-e9efdcb75bb6 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:00.655291 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd84ee-0c6c-40cc-b21f-01e9faaaef71 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:00.655871 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd84ee-0c6c-40cc-b21f-01e9faaaef71 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:00.656358 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd84ee-0c6c-40cc-b21f-01e9faaaef71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:00.674194 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-a9fd84ee-0c6c-40cc-b21f-01e9faaaef71 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:46:00.675380 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-a9fd84ee-0c6c-40cc-b21f-01e9faaaef71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:46:00.735076 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 449/895] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Jul 5 21:46:00 2022] POST /identity/v3/services => generated 241 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:46:00.736143 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3da606-eaee-4b12-87a7-e9efdcb75bb6 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:00.767947 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 447/896] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:46:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:46:00.792745 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd84ee-0c6c-40cc-b21f-01e9faaaef71 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:00.795611 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:00.815152 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:00.871331 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3da606-eaee-4b12-87a7-e9efdcb75bb6 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:00.916641 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30034f-1722-424a-aa95-8144280da52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:00.918098 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30034f-1722-424a-aa95-8144280da52b None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:00.918591 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30034f-1722-424a-aa95-8144280da52b None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:00.918875 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30034f-1722-424a-aa95-8144280da52b None admin] PATH_INFO: `/v3/services` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:00.919598 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e30034f-1722-424a-aa95-8144280da52b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:00.919915 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e30034f-1722-424a-aa95-8144280da52b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:00.921362 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e30034f-1722-424a-aa95-8144280da52b None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:00.928571 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 450/897] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Jul 5 21:46:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:00.934822 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30034f-1722-424a-aa95-8144280da52b None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:00.939595 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd84ee-0c6c-40cc-b21f-01e9faaaef71 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:00.985604 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb9511f-6612-4dcc-b254-e7032b5e63fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:00.986810 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9511f-6612-4dcc-b254-e7032b5e63fd None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:00.987096 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9511f-6612-4dcc-b254-e7032b5e63fd None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:00.987374 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9511f-6612-4dcc-b254-e7032b5e63fd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:01.003431 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb9511f-6612-4dcc-b254-e7032b5e63fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:46:01.015635 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-7fb9511f-6612-4dcc-b254-e7032b5e63fd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 21:46:01.015635 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:01.015635 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:01.015635 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:01.015635 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:01.015635 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:01.015635 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:01.015635 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:01.015635 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:01.015635 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:01.015635 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:01.015635 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:01.015635 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:46:01.015635 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:46:01.015635 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:46:01.015635 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:46:01.016716 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:46:01.016716 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:46:01.016716 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:46:01.016716 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:46:01.016716 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:01.016716 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:01.016716 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:46:01.016716 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:46:01.016716 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:46:01.016716 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:46:01.016716 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:46:01.016716 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:46:01.016716 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:46:01.016716 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:46:01.016716 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:46:01.016716 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:46:01.017699 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:46:01.017699 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:46:01.017699 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:46:01.017699 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:46:01.017699 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:46:01.017699 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:46:01.017699 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:46:01.017699 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:46:01.017699 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:46:01.017699 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:46:01.017699 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 21:46:01.017699 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:46:01.019467 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 448/898] 10.222.0.30 () {56 vars in 1120 bytes} [Tue Jul 5 21:46:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:46:01.026628 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb9511f-6612-4dcc-b254-e7032b5e63fd None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:01.061476 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30034f-1722-424a-aa95-8144280da52b None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:01.063615 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:01.101122 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ab04a-9a21-4637-8acb-a36726ecc2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:01.102227 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ab04a-9a21-4637-8acb-a36726ecc2f4 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:01.102758 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ab04a-9a21-4637-8acb-a36726ecc2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:01.103507 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ab04a-9a21-4637-8acb-a36726ecc2f4 None admin] PATH_INFO: `/v3/services` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:01.104457 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754ab04a-9a21-4637-8acb-a36726ecc2f4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:01.104991 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754ab04a-9a21-4637-8acb-a36726ecc2f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:01.106622 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754ab04a-9a21-4637-8acb-a36726ecc2f4 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:01.112584 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 451/899] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Jul 5 21:46:00 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:01.119432 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ab04a-9a21-4637-8acb-a36726ecc2f4 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:01.128815 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:01.159013 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb9511f-6612-4dcc-b254-e7032b5e63fd None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:01.199535 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd97dbc-a8b3-4b58-8c9d-6780c2ae3724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:01.200629 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd97dbc-a8b3-4b58-8c9d-6780c2ae3724 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:01.201153 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd97dbc-a8b3-4b58-8c9d-6780c2ae3724 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:01.201647 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd97dbc-a8b3-4b58-8c9d-6780c2ae3724 None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:01.202745 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd97dbc-a8b3-4b58-8c9d-6780c2ae3724 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:01.203277 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd97dbc-a8b3-4b58-8c9d-6780c2ae3724 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:01.204935 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd97dbc-a8b3-4b58-8c9d-6780c2ae3724 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:01.219126 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 449/900] 10.222.0.30 () {56 vars in 1115 bytes} [Tue Jul 5 21:46:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:46:01.220502 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd97dbc-a8b3-4b58-8c9d-6780c2ae3724 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:01.253930 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ab04a-9a21-4637-8acb-a36726ecc2f4 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:01.296808 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0567fa-017c-4ad4-95e3-8543dda3da2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:01.297885 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0567fa-017c-4ad4-95e3-8543dda3da2a None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:01.298448 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0567fa-017c-4ad4-95e3-8543dda3da2a None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:01.298960 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0567fa-017c-4ad4-95e3-8543dda3da2a None admin] PATH_INFO: `/v3/endpoints` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:01.300049 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0567fa-017c-4ad4-95e3-8543dda3da2a None admin] RBAC: Adding query filter params (interface=public, service_id=bee707b90b144542b457d7a2211850ae, region_id=RegionOne) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:01.300585 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0567fa-017c-4ad4-95e3-8543dda3da2a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:01.302275 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0567fa-017c-4ad4-95e3-8543dda3da2a None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:01.313920 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 452/901] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Jul 5 21:46:01 2022] GET /identity/v3/endpoints?service_id=bee707b90b144542b457d7a2211850ae&interface=public®ion_id=RegionOne => generated 194 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:46:01.315137 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0567fa-017c-4ad4-95e3-8543dda3da2a None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:01.343400 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd97dbc-a8b3-4b58-8c9d-6780c2ae3724 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:01.357176 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:01.389898 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7ffdb-1453-40de-911c-b9ac237f0af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:01.390640 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7ffdb-1453-40de-911c-b9ac237f0af9 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:01.390929 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7ffdb-1453-40de-911c-b9ac237f0af9 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:01.391230 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7ffdb-1453-40de-911c-b9ac237f0af9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:01.400552 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:01.403429 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf7ffdb-1453-40de-911c-b9ac237f0af9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:01.404872 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf7ffdb-1453-40de-911c-b9ac237f0af9 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:01.422848 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-7bf7ffdb-1453-40de-911c-b9ac237f0af9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:46:01.422848 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:01.422848 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:01.422848 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:01.422848 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:01.422848 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:01.422848 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:01.422848 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:01.422848 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:01.422848 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:01.422848 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:01.422848 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:01.422848 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:46:01.422848 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:46:01.422848 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:46:01.423884 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:46:01.423884 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:01.423884 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:01.423884 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:46:01.423884 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:46:01.423884 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:46:01.423884 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:46:01.423884 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:46:01.423884 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:46:01.423884 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:46:01.423884 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:46:01.423884 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:46:01.423884 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:46:01.423884 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:46:01.423884 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:46:01.423884 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:46:01.423884 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:46:01.424900 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:46:01.424900 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:46:01.424900 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:46:01.424900 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:46:01.429203 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 450/902] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:46:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:46:01.429950 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7ffdb-1453-40de-911c-b9ac237f0af9 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:01.462274 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0567fa-017c-4ad4-95e3-8543dda3da2a None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:01.508982 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd417e04-2441-4a2e-9b19-a8cd2d2ccafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:01.510007 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd417e04-2441-4a2e-9b19-a8cd2d2ccafc None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:01.510570 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd417e04-2441-4a2e-9b19-a8cd2d2ccafc None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:01.511078 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd417e04-2441-4a2e-9b19-a8cd2d2ccafc None admin] PATH_INFO: `/v3/services` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:01.511979 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd417e04-2441-4a2e-9b19-a8cd2d2ccafc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:01.513958 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd417e04-2441-4a2e-9b19-a8cd2d2ccafc None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:01.530737 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 453/903] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Jul 5 21:46:01 2022] GET /identity/v3/services => generated 1497 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:46:01.548891 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7ffdb-1453-40de-911c-b9ac237f0af9 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:01.589193 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15ba881-539e-47bb-8590-f92fcc9a84fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:01.589890 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ba881-539e-47bb-8590-f92fcc9a84fa None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:01.590207 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ba881-539e-47bb-8590-f92fcc9a84fa None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:01.590491 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ba881-539e-47bb-8590-f92fcc9a84fa None admin] PATH_INFO: `/v3/domains` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:01.591339 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15ba881-539e-47bb-8590-f92fcc9a84fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:01.591561 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15ba881-539e-47bb-8590-f92fcc9a84fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:01.592984 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15ba881-539e-47bb-8590-f92fcc9a84fa None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:01.608785 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 451/904] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:46:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:01.614539 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd417e04-2441-4a2e-9b19-a8cd2d2ccafc None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:01.703149 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ad253-174f-42a2-88e0-a6f3d4967dfc None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:01.703505 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ad253-174f-42a2-88e0-a6f3d4967dfc None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:01.703746 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ad253-174f-42a2-88e0-a6f3d4967dfc None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:01.705402 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 452/905] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:46:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:46:01.713991 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9b664-b84a-4734-aa5b-6633a87de13c None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:01.714457 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9b664-b84a-4734-aa5b-6633a87de13c None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:01.715092 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9b664-b84a-4734-aa5b-6633a87de13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:01.725458 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:01.732888 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd417e04-2441-4a2e-9b19-a8cd2d2ccafc None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:01.740518 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-c4c9b664-b84a-4734-aa5b-6633a87de13c None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:46:01.744100 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-c4c9b664-b84a-4734-aa5b-6633a87de13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:46:01.781292 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47cd84d-91c0-4bb2-8f78-4f37920885f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:01.782350 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cd84d-91c0-4bb2-8f78-4f37920885f9 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:01.782741 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cd84d-91c0-4bb2-8f78-4f37920885f9 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:01.783149 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cd84d-91c0-4bb2-8f78-4f37920885f9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:01.794763 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47cd84d-91c0-4bb2-8f78-4f37920885f9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:01.796747 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47cd84d-91c0-4bb2-8f78-4f37920885f9 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:01.801922 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:01.818020 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-b47cd84d-91c0-4bb2-8f78-4f37920885f9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 21:46:01.818020 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:01.818020 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:01.818020 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:01.818020 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:01.818020 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:01.818020 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:01.818020 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:01.818020 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:01.818020 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:01.818020 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:01.818020 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:01.818020 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:46:01.818020 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:46:01.818020 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:46:01.818020 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:46:01.819226 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:01.819226 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:01.819226 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:46:01.819226 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:46:01.819226 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:46:01.819226 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:46:01.819226 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:46:01.819226 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:46:01.819226 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:46:01.819226 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:46:01.819226 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:46:01.819226 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:46:01.819226 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:46:01.819226 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:46:01.819226 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:46:01.819226 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:46:01.819226 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:46:01.819226 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:46:01.820269 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:46:01.820269 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:46:01.820269 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:46:01.820269 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:46:01.820269 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:46:01.820269 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:46:01.820269 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:46:01.820269 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:46:01.820269 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 21:46:01.820269 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:46:01.820872 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 454/906] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Jul 5 21:46:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:46:01.826445 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47cd84d-91c0-4bb2-8f78-4f37920885f9 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:01.827660 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 453/907] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:46:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:46:01.857030 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c9b664-b84a-4734-aa5b-6633a87de13c None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:01.938941 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47cd84d-91c0-4bb2-8f78-4f37920885f9 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:01.972952 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c9b664-b84a-4734-aa5b-6633a87de13c None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:01.980419 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd695863-5cda-43e3-b2f8-2a56e2d0e918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:01.981114 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd695863-5cda-43e3-b2f8-2a56e2d0e918 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:01.981407 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd695863-5cda-43e3-b2f8-2a56e2d0e918 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:01.981756 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd695863-5cda-43e3-b2f8-2a56e2d0e918 None admin] PATH_INFO: `/v3/users` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:01.982676 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd695863-5cda-43e3-b2f8-2a56e2d0e918 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:01.982996 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd695863-5cda-43e3-b2f8-2a56e2d0e918 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:01.984587 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd695863-5cda-43e3-b2f8-2a56e2d0e918 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:02.009468 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 455/908] 10.222.0.30 () {56 vars in 1149 bytes} [Tue Jul 5 21:46:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:46:02.010609 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd695863-5cda-43e3-b2f8-2a56e2d0e918 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:02.015910 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6383163-fdd6-4eda-a07a-82108c39d973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:02.017015 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6383163-fdd6-4eda-a07a-82108c39d973 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:02.017520 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6383163-fdd6-4eda-a07a-82108c39d973 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:02.018014 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6383163-fdd6-4eda-a07a-82108c39d973 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:02.018922 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6383163-fdd6-4eda-a07a-82108c39d973 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:02.020638 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6383163-fdd6-4eda-a07a-82108c39d973 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:02.027496 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:02.036269 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-b6383163-fdd6-4eda-a07a-82108c39d973 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 21:46:02.036269 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:02.036269 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:46:02.036269 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:46:02.036269 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:46:02.036269 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:46:02.036269 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:46:02.036269 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:46:02.036269 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 21:46:02.036269 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:46:02.036269 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:46:02.036269 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:46:02.036269 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:02.036269 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:02.036269 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:02.036269 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:02.036269 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:02.037469 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:02.037469 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:02.037469 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:02.037469 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:02.037469 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:02.037469 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:02.037469 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:46:02.037469 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:46:02.037469 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:46:02.037469 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:46:02.037469 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:02.037469 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:02.037469 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:46:02.037469 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:46:02.037469 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:46:02.037469 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:46:02.038449 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:46:02.038449 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:46:02.038449 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:46:02.038449 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:46:02.038449 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:46:02.038449 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:46:02.038449 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:46:02.038449 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:46:02.038449 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:46:02.038449 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:46:02.038449 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:46:02.038449 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:46:02.038449 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 21:46:02.038449 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:46:02.046051 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 454/909] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:46:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:46:02.050926 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6383163-fdd6-4eda-a07a-82108c39d973 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:02.112724 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:02.141324 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd695863-5cda-43e3-b2f8-2a56e2d0e918 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:02.180949 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6383163-fdd6-4eda-a07a-82108c39d973 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:02.185674 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2584803-a13c-435e-908c-b275a59998ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:02.186676 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2584803-a13c-435e-908c-b275a59998ce None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:02.187206 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2584803-a13c-435e-908c-b275a59998ce None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:02.187707 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2584803-a13c-435e-908c-b275a59998ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:02.221930 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d657abb-c24d-46f6-9862-bb56b9897dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:02.222636 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d657abb-c24d-46f6-9862-bb56b9897dc0 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:02.222926 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d657abb-c24d-46f6-9862-bb56b9897dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:02.223265 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d657abb-c24d-46f6-9862-bb56b9897dc0 None admin] PATH_INFO: `/v3/services` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:02.224175 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d657abb-c24d-46f6-9862-bb56b9897dc0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:02.225038 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d657abb-c24d-46f6-9862-bb56b9897dc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:02.227256 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d657abb-c24d-46f6-9862-bb56b9897dc0 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:02.234162 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 455/910] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:46:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:02.241631 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d657abb-c24d-46f6-9862-bb56b9897dc0 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:02.284179 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2584803-a13c-435e-908c-b275a59998ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:02.286883 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2584803-a13c-435e-908c-b275a59998ce None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:02.305699 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:02.372097 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d657abb-c24d-46f6-9862-bb56b9897dc0 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:02.387572 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:02.424630 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 456/911] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:46:02 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 05 21:46:02.425178 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758adda-9d64-476d-abf8-6da5501c483f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:02.425178 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758adda-9d64-476d-abf8-6da5501c483f None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:02.425178 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758adda-9d64-476d-abf8-6da5501c483f None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:02.425178 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758adda-9d64-476d-abf8-6da5501c483f None admin] PATH_INFO: `/v3/services` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:02.425493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a758adda-9d64-476d-abf8-6da5501c483f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:02.425493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a758adda-9d64-476d-abf8-6da5501c483f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:02.426307 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a758adda-9d64-476d-abf8-6da5501c483f None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:02.427319 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2584803-a13c-435e-908c-b275a59998ce None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:02.448159 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 456/912] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Jul 5 21:46:02 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:46:02.450339 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758adda-9d64-476d-abf8-6da5501c483f None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:02.550852 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2584803-a13c-435e-908c-b275a59998ce None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:02.565733 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:02.572675 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758adda-9d64-476d-abf8-6da5501c483f None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:02.592025 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e09a8-666e-4a5e-b71d-b5b99f5710ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:02.593193 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e09a8-666e-4a5e-b71d-b5b99f5710ce None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:02.593584 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e09a8-666e-4a5e-b71d-b5b99f5710ce None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:02.594270 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e09a8-666e-4a5e-b71d-b5b99f5710ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:02.608342 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38e09a8-666e-4a5e-b71d-b5b99f5710ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:02.610692 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38e09a8-666e-4a5e-b71d-b5b99f5710ce None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:02.614588 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b555fd-2de4-41c2-8f7e-fe7480005339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:02.616084 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b555fd-2de4-41c2-8f7e-fe7480005339 None admin] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:02.616579 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b555fd-2de4-41c2-8f7e-fe7480005339 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:02.617017 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b555fd-2de4-41c2-8f7e-fe7480005339 None admin] PATH_INFO: `/v3/endpoints` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:02.617949 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b555fd-2de4-41c2-8f7e-fe7480005339 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:02.619603 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b555fd-2de4-41c2-8f7e-fe7480005339 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:02.632874 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-c38e09a8-666e-4a5e-b71d-b5b99f5710ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:46:02.632874 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:02.632874 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:02.632874 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:02.632874 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:02.632874 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:02.632874 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:02.632874 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:02.632874 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:02.632874 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:02.632874 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:02.632874 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:02.632874 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:46:02.632874 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:46:02.632874 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:46:02.633905 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:46:02.633905 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:02.633905 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:02.633905 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:46:02.633905 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:46:02.633905 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:46:02.633905 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:46:02.633905 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:46:02.633905 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:46:02.633905 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:46:02.633905 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:46:02.633905 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:46:02.633905 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:46:02.633905 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:46:02.633905 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:46:02.633905 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:46:02.633905 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:46:02.634941 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:46:02.634941 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:46:02.634941 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:46:02.634941 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:46:02.638297 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 457/913] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:46:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:46:02.642233 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e09a8-666e-4a5e-b71d-b5b99f5710ce None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:02.682779 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 457/914] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Jul 5 21:46:02 2022] POST /identity/v3/endpoints => generated 346 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:46:02.764086 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e09a8-666e-4a5e-b71d-b5b99f5710ce None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:02.811779 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996f11c-ae64-4e91-981e-37fad4f1a842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:02.812375 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996f11c-ae64-4e91-981e-37fad4f1a842 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:02.812667 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996f11c-ae64-4e91-981e-37fad4f1a842 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:02.812949 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996f11c-ae64-4e91-981e-37fad4f1a842 None admin] PATH_INFO: `/v3/domains` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:02.813704 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996f11c-ae64-4e91-981e-37fad4f1a842 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:02.814019 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996f11c-ae64-4e91-981e-37fad4f1a842 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:02.815588 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996f11c-ae64-4e91-981e-37fad4f1a842 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:02.829053 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 458/915] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:46:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:46:02.834592 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b555fd-2de4-41c2-8f7e-fe7480005339 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:02.870625 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:02.929337 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41128232-a66e-4efc-8fcf-516ac1ff0fa7 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:02.929638 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41128232-a66e-4efc-8fcf-516ac1ff0fa7 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:02.929926 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41128232-a66e-4efc-8fcf-516ac1ff0fa7 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:02.932187 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 459/916] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:46:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:46:02.938035 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1e4f8-100b-47cc-acea-e13bbf927032 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:02.938356 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1e4f8-100b-47cc-acea-e13bbf927032 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:02.938855 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1e4f8-100b-47cc-acea-e13bbf927032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:02.945462 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b555fd-2de4-41c2-8f7e-fe7480005339 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:02.977293 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-23f1e4f8-100b-47cc-acea-e13bbf927032 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:46:02.979519 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-23f1e4f8-100b-47cc-acea-e13bbf927032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:46:02.982965 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c3cb9-6960-4496-87c1-19313f0ee470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:02.983775 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c3cb9-6960-4496-87c1-19313f0ee470 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:02.984060 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c3cb9-6960-4496-87c1-19313f0ee470 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:02.984337 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c3cb9-6960-4496-87c1-19313f0ee470 None admin] PATH_INFO: `/v3/projects/service` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:02.992148 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81c3cb9-6960-4496-87c1-19313f0ee470 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:02.993668 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81c3cb9-6960-4496-87c1-19313f0ee470 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:02.996759 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:03.008903 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-b81c3cb9-6960-4496-87c1-19313f0ee470 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:46:03.008903 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:03.008903 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:03.008903 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:03.008903 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:03.008903 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:03.008903 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:03.008903 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:03.008903 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:03.008903 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:03.008903 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:03.008903 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:03.008903 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:46:03.008903 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:46:03.008903 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:46:03.009905 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:46:03.009905 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:03.009905 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:03.009905 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:46:03.009905 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:46:03.009905 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:46:03.009905 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:46:03.009905 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:46:03.009905 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:46:03.009905 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:46:03.009905 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:46:03.009905 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:46:03.009905 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:46:03.009905 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:46:03.009905 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:46:03.009905 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:46:03.009905 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:46:03.010950 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:46:03.010950 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:46:03.010950 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:46:03.010950 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:46:03.010950 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:46:03.010950 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:46:03.010950 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:46:03.010950 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:46:03.014481 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 458/917] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:46:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:46:03.015993 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c3cb9-6960-4496-87c1-19313f0ee470 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:03.066325 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 460/918] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:46:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:46:03.083514 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1e4f8-100b-47cc-acea-e13bbf927032 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:03.119121 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:03.129112 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c3cb9-6960-4496-87c1-19313f0ee470 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:03.172559 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ebd92f-38fe-4bca-8d8a-e5911d08331d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:03.173502 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebd92f-38fe-4bca-8d8a-e5911d08331d None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:03.174284 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebd92f-38fe-4bca-8d8a-e5911d08331d None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:03.174586 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebd92f-38fe-4bca-8d8a-e5911d08331d None admin] PATH_INFO: `/v3/projects` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:03.175706 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ebd92f-38fe-4bca-8d8a-e5911d08331d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:03.176027 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ebd92f-38fe-4bca-8d8a-e5911d08331d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:03.178459 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ebd92f-38fe-4bca-8d8a-e5911d08331d None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:03.194445 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 459/919] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:46:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:46:03.201098 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ebd92f-38fe-4bca-8d8a-e5911d08331d None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:03.203910 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1e4f8-100b-47cc-acea-e13bbf927032 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:03.249465 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996b496-4f56-4532-bae5-8c36f5f99f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:03.250832 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996b496-4f56-4532-bae5-8c36f5f99f7e None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:03.251357 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996b496-4f56-4532-bae5-8c36f5f99f7e None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:03.251884 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996b496-4f56-4532-bae5-8c36f5f99f7e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:03.252930 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996b496-4f56-4532-bae5-8c36f5f99f7e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:03.254741 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996b496-4f56-4532-bae5-8c36f5f99f7e None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:03.268774 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-f996b496-4f56-4532-bae5-8c36f5f99f7e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:46:03.268774 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:03.268774 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:46:03.268774 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:46:03.268774 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:46:03.268774 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:46:03.268774 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:46:03.268774 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:46:03.268774 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:46:03.268774 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:46:03.268774 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:46:03.268774 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:46:03.268774 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:03.268774 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:03.268774 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:03.268774 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:03.268774 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:03.273502 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:03.273502 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:03.273502 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:03.273502 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:03.273502 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:03.273502 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:03.273502 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:46:03.273502 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:46:03.273502 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:46:03.273502 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:46:03.273502 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:03.273502 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:03.273502 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:46:03.273502 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:46:03.273502 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:46:03.273502 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:46:03.274443 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:46:03.274443 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:46:03.274443 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:46:03.274443 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:46:03.274443 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:46:03.274443 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:46:03.274443 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:46:03.274443 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:46:03.274443 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:46:03.274443 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:46:03.274443 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:46:03.274443 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:46:03.274443 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:46:03.274443 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:46:03.275853 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 461/920] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Jul 5 21:46:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:46:03.281283 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996b496-4f56-4532-bae5-8c36f5f99f7e None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:03.305694 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:03.317347 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ebd92f-38fe-4bca-8d8a-e5911d08331d None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:03.356132 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4558bb-e8d0-4a3b-8aa8-b0cb8efd6704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:03.356648 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4558bb-e8d0-4a3b-8aa8-b0cb8efd6704 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:03.356937 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4558bb-e8d0-4a3b-8aa8-b0cb8efd6704 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:03.357217 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4558bb-e8d0-4a3b-8aa8-b0cb8efd6704 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:03.358061 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4558bb-e8d0-4a3b-8aa8-b0cb8efd6704 None admin] RBAC: Adding query filter params (role.id=551482a278b94c70a5183d8bcfa58d9b, scope.project.id=93f20f89d0fc4bbf9cf557dd1e14d98d, user.id=5fb6e97b5a864998a407db6a3bf21d79) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:03.358405 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4558bb-e8d0-4a3b-8aa8-b0cb8efd6704 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:03.359865 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4558bb-e8d0-4a3b-8aa8-b0cb8efd6704 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:03.370628 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 460/921] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:46:03 2022] GET /identity/v3/role_assignments?user.id=5fb6e97b5a864998a407db6a3bf21d79&scope.project.id=93f20f89d0fc4bbf9cf557dd1e14d98d&role.id=551482a278b94c70a5183d8bcfa58d9b => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:03.421204 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996b496-4f56-4532-bae5-8c36f5f99f7e None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:03.460606 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5503d749-8b93-4445-acd9-6680ffd1323c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:03.461394 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5503d749-8b93-4445-acd9-6680ffd1323c None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:03.461601 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5503d749-8b93-4445-acd9-6680ffd1323c None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:03.461836 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5503d749-8b93-4445-acd9-6680ffd1323c None admin] PATH_INFO: `/v3/services` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:03.462595 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5503d749-8b93-4445-acd9-6680ffd1323c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:03.462905 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5503d749-8b93-4445-acd9-6680ffd1323c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:03.464300 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5503d749-8b93-4445-acd9-6680ffd1323c None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:03.470060 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 462/922] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Jul 5 21:46:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:03.476851 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4558bb-e8d0-4a3b-8aa8-b0cb8efd6704 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:03.495404 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:03.605989 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4558bb-e8d0-4a3b-8aa8-b0cb8efd6704 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:03.642468 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad1c3b-3daf-4a18-b1e5-0d44218360ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:03.643529 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad1c3b-3daf-4a18-b1e5-0d44218360ff None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:03.644060 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad1c3b-3daf-4a18-b1e5-0d44218360ff None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:03.644552 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad1c3b-3daf-4a18-b1e5-0d44218360ff None admin] PATH_INFO: `/v3/services` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:03.645490 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aad1c3b-3daf-4a18-b1e5-0d44218360ff None admin] RBAC: Adding query filter params (type=object-store) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:03.646010 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aad1c3b-3daf-4a18-b1e5-0d44218360ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:03.648071 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aad1c3b-3daf-4a18-b1e5-0d44218360ff None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:03.654179 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 461/923] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Jul 5 21:46:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:03.662602 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5503d749-8b93-4445-acd9-6680ffd1323c None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:03.704132 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1713c-781e-4285-9451-cca90eb2d814 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:03.704665 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1713c-781e-4285-9451-cca90eb2d814 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:03.705138 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1713c-781e-4285-9451-cca90eb2d814 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:03.706961 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 462/924] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:46:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:46:03.713128 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003351a-37cf-4d49-947b-efcc806b4930 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:03.713426 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003351a-37cf-4d49-947b-efcc806b4930 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:03.713713 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003351a-37cf-4d49-947b-efcc806b4930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:03.731669 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-6003351a-37cf-4d49-947b-efcc806b4930 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:46:03.732903 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-6003351a-37cf-4d49-947b-efcc806b4930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:46:03.757989 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:03.784199 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5503d749-8b93-4445-acd9-6680ffd1323c None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:03.822271 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 463/925] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:46:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:46:03.825242 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328d24d-4e57-4623-8ba5-fc92693c52b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:03.826178 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328d24d-4e57-4623-8ba5-fc92693c52b3 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:03.826652 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328d24d-4e57-4623-8ba5-fc92693c52b3 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:03.827106 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328d24d-4e57-4623-8ba5-fc92693c52b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:03.828072 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1328d24d-4e57-4623-8ba5-fc92693c52b3 None admin] RBAC: Adding query filter params (interface=public, service_id=72f7618fa473415faa909b636a4f382e, region_id=RegionOne) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:03.828572 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1328d24d-4e57-4623-8ba5-fc92693c52b3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:03.830118 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1328d24d-4e57-4623-8ba5-fc92693c52b3 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:03.836530 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 463/926] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Jul 5 21:46:03 2022] GET /identity/v3/endpoints?service_id=72f7618fa473415faa909b636a4f382e&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:03.841017 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6003351a-37cf-4d49-947b-efcc806b4930 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:03.842063 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328d24d-4e57-4623-8ba5-fc92693c52b3 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:03.852000 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:03.960825 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6003351a-37cf-4d49-947b-efcc806b4930 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:03.987128 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328d24d-4e57-4623-8ba5-fc92693c52b3 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:04.009547 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce210254-640f-4bfc-83d9-ad9c70a05316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:04.010567 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce210254-640f-4bfc-83d9-ad9c70a05316 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:04.010867 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce210254-640f-4bfc-83d9-ad9c70a05316 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:04.011153 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce210254-640f-4bfc-83d9-ad9c70a05316 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:04.011825 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce210254-640f-4bfc-83d9-ad9c70a05316 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:04.013229 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce210254-640f-4bfc-83d9-ad9c70a05316 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:04.027239 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2925f-41e8-42db-a7dd-8e9021ed063f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:04.027443 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-ce210254-640f-4bfc-83d9-ad9c70a05316 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 21:46:04.027443 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:04.027443 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:46:04.027443 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:46:04.027443 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:46:04.027443 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:46:04.027443 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:46:04.027443 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:46:04.027443 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 21:46:04.027443 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:46:04.027443 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:46:04.027443 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:46:04.027443 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:04.027443 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:04.027443 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:04.027443 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:04.028535 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:04.028535 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:04.028535 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:04.028535 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:04.028535 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:04.028535 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:04.028535 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:04.028535 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:46:04.028535 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:46:04.028535 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:46:04.028535 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:46:04.028535 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:04.028535 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:04.028535 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:46:04.028535 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:46:04.028535 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:46:04.030041 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:46:04.030041 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:46:04.030041 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:46:04.030041 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:46:04.030041 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:46:04.030041 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:46:04.030041 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:46:04.030041 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:46:04.030041 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:46:04.030041 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:46:04.030041 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:46:04.030041 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:46:04.030041 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:46:04.030041 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 21:46:04.030041 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:46:04.031059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2925f-41e8-42db-a7dd-8e9021ed063f None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:04.031059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2925f-41e8-42db-a7dd-8e9021ed063f None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:04.031212 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 464/927] 10.222.0.30 () {56 vars in 1132 bytes} [Tue Jul 5 21:46:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:46:04.031288 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2925f-41e8-42db-a7dd-8e9021ed063f None admin] PATH_INFO: `/v3/services` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:04.031288 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe2925f-41e8-42db-a7dd-8e9021ed063f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:04.033112 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe2925f-41e8-42db-a7dd-8e9021ed063f None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:04.038153 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce210254-640f-4bfc-83d9-ad9c70a05316 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:04.041284 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 464/928] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Jul 5 21:46:03 2022] GET /identity/v3/services => generated 1497 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:46:04.134095 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:04.170918 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce210254-640f-4bfc-83d9-ad9c70a05316 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:04.212726 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9fab99-87ae-4ff2-8e23-6870ec1d4c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:04.213314 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fab99-87ae-4ff2-8e23-6870ec1d4c66 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:04.213611 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fab99-87ae-4ff2-8e23-6870ec1d4c66 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:04.213896 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fab99-87ae-4ff2-8e23-6870ec1d4c66 None admin] PATH_INFO: `/v3/services` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:04.214652 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9fab99-87ae-4ff2-8e23-6870ec1d4c66 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:04.214965 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9fab99-87ae-4ff2-8e23-6870ec1d4c66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:04.216350 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9fab99-87ae-4ff2-8e23-6870ec1d4c66 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:04.222203 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 465/929] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Jul 5 21:46:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:46:04.229104 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2925f-41e8-42db-a7dd-8e9021ed063f None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:04.239412 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:04.342481 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2925f-41e8-42db-a7dd-8e9021ed063f None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:04.391496 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a057389-0b84-471d-abfd-12028b05b8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:04.392178 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a057389-0b84-471d-abfd-12028b05b8c7 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:04.392471 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a057389-0b84-471d-abfd-12028b05b8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:04.392755 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a057389-0b84-471d-abfd-12028b05b8c7 None admin] PATH_INFO: `/v3/services` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:04.393484 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a057389-0b84-471d-abfd-12028b05b8c7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:04.393802 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a057389-0b84-471d-abfd-12028b05b8c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:04.395235 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a057389-0b84-471d-abfd-12028b05b8c7 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:04.401908 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 465/930] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Jul 5 21:46:04 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:04.407696 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9fab99-87ae-4ff2-8e23-6870ec1d4c66 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:04.518628 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9fab99-87ae-4ff2-8e23-6870ec1d4c66 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:04.559400 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2cffd3-c2c8-473a-8a4e-66e702b4a2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:04.559400 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2cffd3-c2c8-473a-8a4e-66e702b4a2ef None admin] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:04.559400 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2cffd3-c2c8-473a-8a4e-66e702b4a2ef None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:04.559400 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2cffd3-c2c8-473a-8a4e-66e702b4a2ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:04.562150 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2cffd3-c2c8-473a-8a4e-66e702b4a2ef None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:04.562150 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2cffd3-c2c8-473a-8a4e-66e702b4a2ef None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:04.563862 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:04.660154 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 466/931] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Jul 5 21:46:04 2022] POST /identity/v3/endpoints => generated 347 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:46:04.857955 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ba7b7-2f45-42d4-a90c-3b1744514211 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:04.858688 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ba7b7-2f45-42d4-a90c-3b1744514211 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:04.858688 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ba7b7-2f45-42d4-a90c-3b1744514211 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:04.859823 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 466/932] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:46:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:46:04.865937 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f512b-e4c3-4c77-b657-ead322ecccc2 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:04.866257 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f512b-e4c3-4c77-b657-ead322ecccc2 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:04.866541 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f512b-e4c3-4c77-b657-ead322ecccc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:04.885782 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-4d8f512b-e4c3-4c77-b657-ead322ecccc2 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:46:04.887080 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-4d8f512b-e4c3-4c77-b657-ead322ecccc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:46:04.962951 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 467/933] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:46:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:46:04.986942 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ba7b7-2f45-42d4-a90c-3b1744514211 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:05.066527 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:05.100404 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ba7b7-2f45-42d4-a90c-3b1744514211 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:05.136876 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8dd79-f6c1-4d80-9b74-3373a5d20133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:05.137464 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8dd79-f6c1-4d80-9b74-3373a5d20133 None admin] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:05.137750 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8dd79-f6c1-4d80-9b74-3373a5d20133 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:05.138031 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8dd79-f6c1-4d80-9b74-3373a5d20133 None admin] PATH_INFO: `/v3/projects` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:05.138777 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d8dd79-f6c1-4d80-9b74-3373a5d20133 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:05.140268 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d8dd79-f6c1-4d80-9b74-3373a5d20133 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:05.141658 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: WARNING keystone.server.flask.common [None req-82d8dd79-f6c1-4d80-9b74-3373a5d20133 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 05 21:46:05.195940 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.sql.core [None req-82d8dd79-f6c1-4d80-9b74-3373a5d20133 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 05 21:46:05.195940 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 05 21:46:05.195940 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [parameters: {'id': '95f597cb5c3b4cf7aea16ca472ab4a39', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 05 21:46:05.195940 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=244268) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 05 21:46:05.213708 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-82d8dd79-f6c1-4d80-9b74-3373a5d20133 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 95f597cb5c3b4cf7aea16ca472ab4a39.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 95f597cb5c3b4cf7aea16ca472ab4a39. Jul 05 21:46:05.213708 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:05.213708 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 21:46:05.213708 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 21:46:05.213708 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 21:46:05.213708 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 21:46:05.213708 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 21:46:05.213708 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 21:46:05.213708 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 21:46:05.213708 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application conn.query(q) Jul 05 21:46:05.213708 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 21:46:05.213708 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 21:46:05.213708 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 21:46:05.215776 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application result.read() Jul 05 21:46:05.215776 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 21:46:05.215776 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 21:46:05.215776 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 21:46:05.215776 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 21:46:05.215776 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 21:46:05.215776 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 21:46:05.215776 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 21:46:05.215776 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 21:46:05.215776 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 05 21:46:05.215776 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:46:05.215776 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 05 21:46:05.215776 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:46:05.215776 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:05.215776 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 05 21:46:05.215776 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 05 21:46:05.215776 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 05 21:46:05.215776 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 05 21:46:05.218219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 21:46:05.218219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application next(self.gen) Jul 05 21:46:05.218219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 05 21:46:05.218219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application yield resource Jul 05 21:46:05.218219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 21:46:05.218219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application next(self.gen) Jul 05 21:46:05.218219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 05 21:46:05.218219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application self.session.rollback() Jul 05 21:46:05.218219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 05 21:46:05.218219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application self.force_reraise() Jul 05 21:46:05.218219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 05 21:46:05.218219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise self.value Jul 05 21:46:05.218219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 05 21:46:05.218219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 05 21:46:05.218219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 05 21:46:05.218219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application session.commit() Jul 05 21:46:05.218219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 05 21:46:05.226583 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 05 21:46:05.226583 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 05 21:46:05.226583 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application self._prepare_impl() Jul 05 21:46:05.226583 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 05 21:46:05.226583 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application self.session.flush() Jul 05 21:46:05.226583 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 05 21:46:05.226583 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application self._flush(objects) Jul 05 21:46:05.226583 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 05 21:46:05.226583 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 05 21:46:05.226583 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 05 21:46:05.226583 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application compat.raise_( Jul 05 21:46:05.226583 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 21:46:05.226583 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception Jul 05 21:46:05.226583 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 05 21:46:05.226583 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application flush_context.execute() Jul 05 21:46:05.226583 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 05 21:46:05.226583 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rec.execute(self) Jul 05 21:46:05.228597 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 05 21:46:05.228597 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 05 21:46:05.228597 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 05 21:46:05.228597 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 05 21:46:05.228597 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 05 21:46:05.228597 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 05 21:46:05.228597 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 05 21:46:05.228597 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 05 21:46:05.228597 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 05 21:46:05.228597 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 05 21:46:05.228597 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 05 21:46:05.228597 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 05 21:46:05.228597 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 05 21:46:05.228597 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 05 21:46:05.228597 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 05 21:46:05.229761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 05 21:46:05.229761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 21:46:05.229761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception Jul 05 21:46:05.229761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 21:46:05.229761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 21:46:05.229761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 21:46:05.229761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 21:46:05.229761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 21:46:05.229761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 21:46:05.229761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 21:46:05.229761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application conn.query(q) Jul 05 21:46:05.229761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 21:46:05.229761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 21:46:05.229761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 21:46:05.229761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application result.read() Jul 05 21:46:05.229761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 21:46:05.229761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 21:46:05.230989 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 21:46:05.230989 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 21:46:05.230989 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 21:46:05.230989 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 21:46:05.230989 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 21:46:05.230989 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 21:46:05.230989 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 05 21:46:05.230989 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 05 21:46:05.230989 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [parameters: {'id': '95f597cb5c3b4cf7aea16ca472ab4a39', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 05 21:46:05.230989 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 05 21:46:05.230989 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:46:05.230989 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:46:05.230989 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:46:05.230989 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:05.230989 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 05 21:46:05.232111 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 05 21:46:05.232111 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 05 21:46:05.232111 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 05 21:46:05.232111 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 05 21:46:05.232111 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:46:05.232111 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:46:05.232111 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:46:05.232111 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:05.232111 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:05.232111 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:05.232111 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:05.232111 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:05.232111 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:05.232111 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:05.232111 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:05.232111 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:05.232111 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:05.233520 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:05.233520 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 05 21:46:05.233520 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 05 21:46:05.233520 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:05.233520 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:05.233520 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 05 21:46:05.233520 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 05 21:46:05.233520 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 95f597cb5c3b4cf7aea16ca472ab4a39. Jul 05 21:46:05.233520 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:46:05.233520 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 467/934] 10.222.0.30 () {60 vars in 1140 bytes} [Tue Jul 5 21:46:04 2022] POST /identity/v3/projects => generated 262 bytes in 229 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:46:05.234320 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f512b-e4c3-4c77-b657-ead322ecccc2 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:05.345810 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f512b-e4c3-4c77-b657-ead322ecccc2 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:05.365696 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:05.383467 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d837a-62c9-4687-9318-f7df551df0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:05.384501 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d837a-62c9-4687-9318-f7df551df0b2 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:05.384675 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d837a-62c9-4687-9318-f7df551df0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:05.384841 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d837a-62c9-4687-9318-f7df551df0b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:05.391998 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5d837a-62c9-4687-9318-f7df551df0b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:05.393389 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5d837a-62c9-4687-9318-f7df551df0b2 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:05.408801 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-7e5d837a-62c9-4687-9318-f7df551df0b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:46:05.408801 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:05.408801 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:05.408801 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:05.408801 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:05.408801 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:05.408801 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:05.408801 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:05.408801 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:05.408801 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:05.408801 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:05.408801 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:05.408801 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:46:05.408801 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:46:05.408801 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:46:05.411072 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:46:05.411072 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:05.411072 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:05.411072 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:46:05.411072 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:46:05.411072 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:46:05.411072 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:46:05.411072 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:46:05.411072 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:46:05.411072 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:46:05.411072 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:46:05.411072 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:46:05.411072 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:46:05.411072 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:46:05.411072 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:46:05.411072 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:46:05.411072 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:46:05.413397 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:46:05.413397 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:46:05.413397 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:46:05.413397 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:46:05.413397 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:46:05.413397 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:46:05.413397 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:46:05.413397 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:46:05.413397 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 468/935] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:46:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:46:05.418156 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8dd79-f6c1-4d80-9b74-3373a5d20133 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:05.524106 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8dd79-f6c1-4d80-9b74-3373a5d20133 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:05.559339 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:05.563944 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfdb86f-9867-41e6-9c76-8c6e7f84c9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:05.566283 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfdb86f-9867-41e6-9c76-8c6e7f84c9cb None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:05.566283 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfdb86f-9867-41e6-9c76-8c6e7f84c9cb None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:05.566283 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfdb86f-9867-41e6-9c76-8c6e7f84c9cb None admin] PATH_INFO: `/v3/projects` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:05.566696 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfdb86f-9867-41e6-9c76-8c6e7f84c9cb None admin] RBAC: Adding query filter params (name=service) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:05.567220 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfdb86f-9867-41e6-9c76-8c6e7f84c9cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:05.569337 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfdb86f-9867-41e6-9c76-8c6e7f84c9cb None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:05.591669 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 468/936] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Jul 5 21:46:05 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:05.633137 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266604a-3487-4cb5-982d-352a2e87b060 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:05.633700 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266604a-3487-4cb5-982d-352a2e87b060 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:05.633700 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266604a-3487-4cb5-982d-352a2e87b060 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:05.635529 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 469/937] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:46:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:46:05.641405 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb932b8f-57b8-40c0-b80c-f336292c36b7 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:05.641919 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb932b8f-57b8-40c0-b80c-f336292c36b7 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:05.642477 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb932b8f-57b8-40c0-b80c-f336292c36b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:05.662938 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-cb932b8f-57b8-40c0-b80c-f336292c36b7 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:46:05.664788 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-cb932b8f-57b8-40c0-b80c-f336292c36b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:46:05.743628 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 469/938] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:46:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:46:05.768059 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8266604a-3487-4cb5-982d-352a2e87b060 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:05.888549 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8266604a-3487-4cb5-982d-352a2e87b060 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:05.928718 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd68a29-1f5a-4f67-9f5d-26ab03ddbf7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:05.929513 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd68a29-1f5a-4f67-9f5d-26ab03ddbf7f None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:05.929808 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd68a29-1f5a-4f67-9f5d-26ab03ddbf7f None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:05.930087 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd68a29-1f5a-4f67-9f5d-26ab03ddbf7f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:05.941850 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd68a29-1f5a-4f67-9f5d-26ab03ddbf7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:46:05.950964 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-4fd68a29-1f5a-4f67-9f5d-26ab03ddbf7f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 21:46:05.950964 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:05.950964 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:05.950964 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:05.950964 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:05.950964 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:05.950964 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:05.950964 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:05.950964 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:05.950964 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:05.950964 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:05.950964 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:05.950964 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:46:05.950964 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:46:05.950964 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:46:05.950964 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:46:05.952111 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:46:05.952111 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:46:05.952111 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:46:05.952111 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:46:05.952111 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:05.952111 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:05.952111 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:46:05.952111 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:46:05.952111 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:46:05.952111 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:46:05.952111 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:46:05.952111 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:46:05.952111 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:46:05.952111 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:46:05.952111 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:46:05.952111 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:46:05.953058 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:46:05.953058 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:46:05.953058 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:46:05.953058 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:46:05.953058 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:46:05.953058 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:46:05.953058 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:46:05.953058 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:46:05.953058 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:46:05.953058 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:46:05.953058 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 21:46:05.953058 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:46:05.953058 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 470/939] 10.222.0.30 () {56 vars in 1120 bytes} [Tue Jul 5 21:46:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:46:05.958467 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb932b8f-57b8-40c0-b80c-f336292c36b7 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:06.063952 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb932b8f-57b8-40c0-b80c-f336292c36b7 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:06.084336 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:06.103913 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12975665-6db7-4b82-acca-f257b04757aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:06.107238 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12975665-6db7-4b82-acca-f257b04757aa None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:06.107238 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12975665-6db7-4b82-acca-f257b04757aa None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:06.107238 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12975665-6db7-4b82-acca-f257b04757aa None admin] PATH_INFO: `/v3/roles` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:06.107238 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12975665-6db7-4b82-acca-f257b04757aa None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:06.107238 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12975665-6db7-4b82-acca-f257b04757aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:06.108583 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12975665-6db7-4b82-acca-f257b04757aa None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:06.118681 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 470/940] 10.222.0.30 () {56 vars in 1115 bytes} [Tue Jul 5 21:46:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:06.124280 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd68a29-1f5a-4f67-9f5d-26ab03ddbf7f None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:06.169239 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:06.233365 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd68a29-1f5a-4f67-9f5d-26ab03ddbf7f None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:06.270054 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f03f3-3be9-4892-8262-ebbb584b0a02 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:06.270438 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f03f3-3be9-4892-8262-ebbb584b0a02 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:06.270831 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f03f3-3be9-4892-8262-ebbb584b0a02 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:06.272750 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619146fa-540d-44ba-a991-2ebf5bf7d3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:06.273262 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 471/941] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:46:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:46:06.273642 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619146fa-540d-44ba-a991-2ebf5bf7d3d1 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:06.273941 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619146fa-540d-44ba-a991-2ebf5bf7d3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:06.274260 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619146fa-540d-44ba-a991-2ebf5bf7d3d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:06.279784 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99fcfa-197e-4ca8-a552-e204e318b5ef None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:06.280075 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99fcfa-197e-4ca8-a552-e204e318b5ef None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:06.280367 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99fcfa-197e-4ca8-a552-e204e318b5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:06.289334 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619146fa-540d-44ba-a991-2ebf5bf7d3d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:06.290864 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619146fa-540d-44ba-a991-2ebf5bf7d3d1 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:06.301520 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-3f99fcfa-197e-4ca8-a552-e204e318b5ef None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:46:06.303500 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-3f99fcfa-197e-4ca8-a552-e204e318b5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:46:06.310700 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-619146fa-540d-44ba-a991-2ebf5bf7d3d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:46:06.310700 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:06.310700 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:06.310700 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:06.310700 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:06.310700 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:06.310700 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:06.310700 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:06.310700 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:06.310700 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:06.310700 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:06.310700 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:06.310700 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:46:06.310700 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:46:06.310700 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:46:06.311706 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:46:06.311706 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:06.311706 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:06.311706 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:46:06.311706 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:46:06.311706 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:46:06.311706 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:46:06.311706 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:46:06.311706 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:46:06.311706 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:46:06.311706 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:46:06.311706 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:46:06.311706 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:46:06.311706 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:46:06.311706 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:46:06.311706 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:46:06.311706 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:46:06.312701 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:46:06.312701 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:46:06.312701 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:46:06.312701 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:46:06.312701 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 471/942] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:46:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:46:06.318892 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619146fa-540d-44ba-a991-2ebf5bf7d3d1 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:06.409198 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 472/943] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:46:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:46:06.423872 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:06.433931 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99fcfa-197e-4ca8-a552-e204e318b5ef None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:06.440630 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619146fa-540d-44ba-a991-2ebf5bf7d3d1 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:06.478091 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d6c0e-fdff-4bb3-a6cc-57eb7270e05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:06.479479 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d6c0e-fdff-4bb3-a6cc-57eb7270e05d None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:06.479987 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d6c0e-fdff-4bb3-a6cc-57eb7270e05d None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:06.480483 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d6c0e-fdff-4bb3-a6cc-57eb7270e05d None admin] PATH_INFO: `/v3/domains` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:06.481437 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197d6c0e-fdff-4bb3-a6cc-57eb7270e05d None admin] RBAC: Adding query filter params (name=Default) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:06.481959 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197d6c0e-fdff-4bb3-a6cc-57eb7270e05d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:06.483682 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197d6c0e-fdff-4bb3-a6cc-57eb7270e05d None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:06.497887 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 472/944] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:46:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:06.504044 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d6c0e-fdff-4bb3-a6cc-57eb7270e05d None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:06.573603 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99fcfa-197e-4ca8-a552-e204e318b5ef None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:06.587748 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:06.624353 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a256c1bb-4684-4df5-9656-715ee5d4b6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:06.626161 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256c1bb-4684-4df5-9656-715ee5d4b6b8 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:06.626703 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256c1bb-4684-4df5-9656-715ee5d4b6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:06.627480 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256c1bb-4684-4df5-9656-715ee5d4b6b8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:06.628641 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a256c1bb-4684-4df5-9656-715ee5d4b6b8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:06.631475 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a256c1bb-4684-4df5-9656-715ee5d4b6b8 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:06.639120 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d6c0e-fdff-4bb3-a6cc-57eb7270e05d None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:06.648281 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-a256c1bb-4684-4df5-9656-715ee5d4b6b8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:46:06.648281 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:06.648281 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:46:06.648281 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:46:06.648281 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:46:06.648281 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:46:06.648281 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:46:06.648281 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:46:06.648281 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:46:06.648281 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:46:06.648281 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:46:06.648281 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:46:06.648281 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:06.648281 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:06.648281 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:06.648281 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:06.648281 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:06.649387 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:06.649387 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:06.649387 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:06.649387 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:06.649387 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:06.649387 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:06.649387 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:46:06.649387 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:46:06.649387 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:46:06.649387 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:46:06.649387 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:06.649387 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:06.649387 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:46:06.649387 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:46:06.649387 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:46:06.649387 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:46:06.650341 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:46:06.650341 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:46:06.650341 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:46:06.650341 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:46:06.650341 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:46:06.650341 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:46:06.650341 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:46:06.650341 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:46:06.650341 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:46:06.650341 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:46:06.650341 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:46:06.650341 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:46:06.650341 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:46:06.650341 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:46:06.654276 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 473/945] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Jul 5 21:46:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:46:06.657067 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a256c1bb-4684-4df5-9656-715ee5d4b6b8 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:06.683513 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac09009-23ec-4c54-a4f5-97bbc03d88d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:06.684338 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac09009-23ec-4c54-a4f5-97bbc03d88d1 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:06.684633 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac09009-23ec-4c54-a4f5-97bbc03d88d1 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:06.684916 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac09009-23ec-4c54-a4f5-97bbc03d88d1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:06.694076 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac09009-23ec-4c54-a4f5-97bbc03d88d1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:06.695541 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac09009-23ec-4c54-a4f5-97bbc03d88d1 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:06.711621 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-3ac09009-23ec-4c54-a4f5-97bbc03d88d1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 21:46:06.711621 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:06.711621 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:06.711621 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:06.711621 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:06.711621 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:06.711621 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:06.711621 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:06.711621 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:06.711621 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:06.711621 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:06.711621 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:06.711621 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:46:06.711621 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:46:06.711621 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:46:06.711621 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:46:06.712700 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:06.712700 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:06.712700 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:46:06.712700 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:46:06.712700 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:46:06.712700 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:46:06.712700 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:46:06.712700 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:46:06.712700 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:46:06.712700 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:46:06.712700 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:46:06.712700 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:46:06.712700 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:46:06.712700 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:46:06.712700 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:46:06.712700 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:46:06.712700 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:46:06.712700 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:46:06.714244 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:46:06.714244 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:46:06.714244 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:46:06.714244 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:46:06.714244 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:46:06.714244 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:46:06.714244 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:46:06.714244 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:46:06.714244 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 21:46:06.714244 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:46:06.717555 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 473/946] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Jul 5 21:46:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:46:06.718433 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac09009-23ec-4c54-a4f5-97bbc03d88d1 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:06.733651 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:06.805063 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a256c1bb-4684-4df5-9656-715ee5d4b6b8 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:06.831876 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac09009-23ec-4c54-a4f5-97bbc03d88d1 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:06.850060 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc688e47-b108-4d04-9d2d-9d5177db9798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:06.850772 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc688e47-b108-4d04-9d2d-9d5177db9798 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:06.851065 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc688e47-b108-4d04-9d2d-9d5177db9798 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:06.851348 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc688e47-b108-4d04-9d2d-9d5177db9798 None admin] PATH_INFO: `/v3/services` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:06.852076 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc688e47-b108-4d04-9d2d-9d5177db9798 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:06.852389 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc688e47-b108-4d04-9d2d-9d5177db9798 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:06.854033 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc688e47-b108-4d04-9d2d-9d5177db9798 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:06.858920 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 474/947] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Jul 5 21:46:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:46:06.860254 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c971a5-bf96-4274-9258-26f5b2802b2b None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:06.860732 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c971a5-bf96-4274-9258-26f5b2802b2b None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:06.861022 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c971a5-bf96-4274-9258-26f5b2802b2b None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:06.862581 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 475/948] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:46:06.864773 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c971a5-bf96-4274-9258-26f5b2802b2b None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:06.874691 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd50697-a958-4d63-abb0-1ef4b632c8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:06.876307 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd50697-a958-4d63-abb0-1ef4b632c8cc None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:06.876771 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd50697-a958-4d63-abb0-1ef4b632c8cc None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:06.877573 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd50697-a958-4d63-abb0-1ef4b632c8cc None admin] PATH_INFO: `/v3/users` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:06.878953 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd50697-a958-4d63-abb0-1ef4b632c8cc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:06.879715 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd50697-a958-4d63-abb0-1ef4b632c8cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:06.882106 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd50697-a958-4d63-abb0-1ef4b632c8cc None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:06.906691 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 474/949] 10.222.0.30 () {56 vars in 1149 bytes} [Tue Jul 5 21:46:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:06.906691 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf5a83-69cd-4bc4-ae57-b83b1c26e3bf None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:06.906691 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf5a83-69cd-4bc4-ae57-b83b1c26e3bf None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:06.906691 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf5a83-69cd-4bc4-ae57-b83b1c26e3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:06.914720 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:06.921426 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-6faf5a83-69cd-4bc4-ae57-b83b1c26e3bf None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:46:06.922645 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-6faf5a83-69cd-4bc4-ae57-b83b1c26e3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:46:06.980605 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c971a5-bf96-4274-9258-26f5b2802b2b None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:06.991353 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:06.996999 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 475/950] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:46:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:46:06.999180 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf5a83-69cd-4bc4-ae57-b83b1c26e3bf None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:07.021163 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54778803-6da5-461f-a7e8-1d2983f7cc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:07.022399 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54778803-6da5-461f-a7e8-1d2983f7cc5d None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:07.022839 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54778803-6da5-461f-a7e8-1d2983f7cc5d None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:07.023127 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54778803-6da5-461f-a7e8-1d2983f7cc5d None admin] PATH_INFO: `/v3/services` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:07.023849 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54778803-6da5-461f-a7e8-1d2983f7cc5d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:07.024163 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54778803-6da5-461f-a7e8-1d2983f7cc5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:07.025547 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54778803-6da5-461f-a7e8-1d2983f7cc5d None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:07.031165 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 476/951] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Jul 5 21:46:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:46:07.034997 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54778803-6da5-461f-a7e8-1d2983f7cc5d None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:07.109910 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf5a83-69cd-4bc4-ae57-b83b1c26e3bf None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:07.138922 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:07.142745 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54778803-6da5-461f-a7e8-1d2983f7cc5d None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:07.146054 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c560cfa-7d30-4ebf-9b90-328b572f4a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:07.147523 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c560cfa-7d30-4ebf-9b90-328b572f4a76 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:07.147523 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c560cfa-7d30-4ebf-9b90-328b572f4a76 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:07.147719 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c560cfa-7d30-4ebf-9b90-328b572f4a76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:07.157984 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c560cfa-7d30-4ebf-9b90-328b572f4a76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:07.159540 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c560cfa-7d30-4ebf-9b90-328b572f4a76 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:07.177603 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-9c560cfa-7d30-4ebf-9b90-328b572f4a76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:46:07.177603 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:07.177603 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:07.177603 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:07.177603 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:07.177603 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:07.177603 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:07.177603 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:07.177603 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:07.177603 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:07.177603 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:07.177603 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:07.177603 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:46:07.177603 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:46:07.177603 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:46:07.178668 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:46:07.178668 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:07.178668 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:07.178668 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:46:07.178668 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:46:07.178668 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:46:07.178668 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:46:07.178668 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:46:07.178668 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:46:07.178668 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:46:07.178668 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:46:07.178668 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:46:07.178668 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:46:07.178668 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:46:07.178668 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:46:07.178668 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:46:07.178668 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:46:07.179652 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:46:07.179652 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:46:07.179652 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:46:07.179652 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:46:07.179652 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 476/952] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:46:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:46:07.179975 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c560cfa-7d30-4ebf-9b90-328b572f4a76 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:07.182977 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b35db-5ce8-436a-bec5-f4d779f0991f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:07.183829 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b35db-5ce8-436a-bec5-f4d779f0991f None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:07.184122 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b35db-5ce8-436a-bec5-f4d779f0991f None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:07.184407 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b35db-5ce8-436a-bec5-f4d779f0991f None admin] PATH_INFO: `/v3/services/compute` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:07.185080 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6b35db-5ce8-436a-bec5-f4d779f0991f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:07.186487 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6b35db-5ce8-436a-bec5-f4d779f0991f None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:07.199232 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-3d6b35db-5ce8-436a-bec5-f4d779f0991f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 21:46:07.199232 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:07.199232 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:46:07.199232 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:46:07.199232 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:46:07.199232 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:46:07.199232 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:46:07.199232 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:46:07.199232 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 21:46:07.199232 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:46:07.199232 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:46:07.199232 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:46:07.199232 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:07.199232 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:07.199232 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:07.199232 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:07.199232 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:07.205481 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:07.205481 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:07.205481 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:07.205481 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:07.205481 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:07.205481 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:07.205481 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:46:07.205481 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:46:07.205481 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:46:07.205481 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:46:07.205481 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:07.205481 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:07.205481 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:46:07.205481 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:46:07.205481 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:46:07.205481 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:46:07.207684 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:46:07.207684 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:46:07.207684 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:46:07.207684 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:46:07.207684 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:46:07.207684 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:46:07.207684 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:46:07.207684 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:46:07.207684 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:46:07.207684 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:46:07.207684 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:46:07.207684 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:46:07.207684 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 21:46:07.207684 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:46:07.207684 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 477/953] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:46:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:46:07.208770 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b35db-5ce8-436a-bec5-f4d779f0991f None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:07.249407 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:07.304465 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c560cfa-7d30-4ebf-9b90-328b572f4a76 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:07.317470 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b35db-5ce8-436a-bec5-f4d779f0991f None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:07.348368 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ee985-420b-4af1-a018-71a52c3382f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:07.349042 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ee985-420b-4af1-a018-71a52c3382f1 None admin] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:07.349352 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ee985-420b-4af1-a018-71a52c3382f1 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:07.350177 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ee985-420b-4af1-a018-71a52c3382f1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:07.351033 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253ee985-420b-4af1-a018-71a52c3382f1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:07.352419 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253ee985-420b-4af1-a018-71a52c3382f1 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:07.357098 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6525de1e-aa27-4f36-a966-525c194a99d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:07.358105 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525de1e-aa27-4f36-a966-525c194a99d8 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:07.358611 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525de1e-aa27-4f36-a966-525c194a99d8 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:07.358949 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525de1e-aa27-4f36-a966-525c194a99d8 None admin] PATH_INFO: `/v3/domains` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:07.359755 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6525de1e-aa27-4f36-a966-525c194a99d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:07.360188 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6525de1e-aa27-4f36-a966-525c194a99d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:07.361695 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6525de1e-aa27-4f36-a966-525c194a99d8 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:07.376137 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 478/954] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:46:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:07.377548 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6525de1e-aa27-4f36-a966-525c194a99d8 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:07.402284 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:07.431755 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 477/955] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Jul 5 21:46:07 2022] POST /identity/v3/endpoints => generated 349 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:46:07.432719 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ee985-420b-4af1-a018-71a52c3382f1 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:07.507917 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6525de1e-aa27-4f36-a966-525c194a99d8 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:07.569309 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec30ad-8e1a-4a83-9991-ac2f8fa2d7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:07.570415 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec30ad-8e1a-4a83-9991-ac2f8fa2d7d6 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:07.570882 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec30ad-8e1a-4a83-9991-ac2f8fa2d7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:07.571348 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec30ad-8e1a-4a83-9991-ac2f8fa2d7d6 None admin] PATH_INFO: `/v3/services` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:07.572314 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec30ad-8e1a-4a83-9991-ac2f8fa2d7d6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:07.572894 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec30ad-8e1a-4a83-9991-ac2f8fa2d7d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:07.574616 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec30ad-8e1a-4a83-9991-ac2f8fa2d7d6 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:07.581447 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ee985-420b-4af1-a018-71a52c3382f1 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:07.583568 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 479/956] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Jul 5 21:46:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:07.589784 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec30ad-8e1a-4a83-9991-ac2f8fa2d7d6 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:07.592649 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:07.634241 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac41a5-9048-4032-bf6f-80c5c89ccf81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:07.634454 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac41a5-9048-4032-bf6f-80c5c89ccf81 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:07.634554 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac41a5-9048-4032-bf6f-80c5c89ccf81 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:07.634837 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac41a5-9048-4032-bf6f-80c5c89ccf81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:07.644426 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac41a5-9048-4032-bf6f-80c5c89ccf81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:07.646104 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac41a5-9048-4032-bf6f-80c5c89ccf81 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:07.665857 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-f4ac41a5-9048-4032-bf6f-80c5c89ccf81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:46:07.665857 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:07.665857 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:07.665857 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:07.665857 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:07.665857 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:07.665857 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:07.665857 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:07.665857 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:07.665857 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:07.665857 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:07.665857 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:07.665857 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:46:07.665857 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:46:07.665857 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:46:07.666966 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:46:07.666966 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:07.666966 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:07.666966 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:46:07.666966 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:46:07.666966 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:46:07.666966 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:46:07.666966 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:46:07.666966 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:46:07.666966 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:46:07.666966 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:46:07.666966 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:46:07.666966 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:46:07.666966 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:46:07.666966 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:46:07.666966 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:46:07.666966 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:46:07.667957 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:46:07.667957 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:46:07.667957 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:46:07.667957 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:46:07.667957 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:46:07.667957 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:46:07.667957 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:46:07.667957 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:46:07.671142 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 478/957] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:46:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:46:07.675260 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac41a5-9048-4032-bf6f-80c5c89ccf81 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:07.712861 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:07.738710 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec30ad-8e1a-4a83-9991-ac2f8fa2d7d6 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:07.780339 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e570cd-c78b-44b4-b2dc-def9f5fc6575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:07.781438 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e570cd-c78b-44b4-b2dc-def9f5fc6575 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:07.781959 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e570cd-c78b-44b4-b2dc-def9f5fc6575 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:07.782585 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e570cd-c78b-44b4-b2dc-def9f5fc6575 None admin] PATH_INFO: `/v3/services` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:07.783557 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e570cd-c78b-44b4-b2dc-def9f5fc6575 None admin] RBAC: Adding query filter params (type=compute) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:07.784096 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e570cd-c78b-44b4-b2dc-def9f5fc6575 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:07.785934 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e570cd-c78b-44b4-b2dc-def9f5fc6575 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:07.791929 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 480/958] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Jul 5 21:46:07 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:07.802203 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac41a5-9048-4032-bf6f-80c5c89ccf81 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:07.837009 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3535289-017d-4266-8d2b-b6bcc28904c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:07.837702 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3535289-017d-4266-8d2b-b6bcc28904c3 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:07.837995 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3535289-017d-4266-8d2b-b6bcc28904c3 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:07.838320 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3535289-017d-4266-8d2b-b6bcc28904c3 None admin] PATH_INFO: `/v3/projects` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:07.839139 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3535289-017d-4266-8d2b-b6bcc28904c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:07.839457 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3535289-017d-4266-8d2b-b6bcc28904c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:07.840962 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3535289-017d-4266-8d2b-b6bcc28904c3 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:07.855917 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 479/959] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:46:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:46:07.862269 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e570cd-c78b-44b4-b2dc-def9f5fc6575 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:07.906268 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f3b44-0867-432c-9182-35b8fb75cf43 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:07.906268 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f3b44-0867-432c-9182-35b8fb75cf43 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:07.906559 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f3b44-0867-432c-9182-35b8fb75cf43 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:07.908205 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 480/960] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:46:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:46:07.914347 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647056b7-6aaa-4d02-88d1-3b850bfbc86a None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:07.914652 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647056b7-6aaa-4d02-88d1-3b850bfbc86a None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:07.914911 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647056b7-6aaa-4d02-88d1-3b850bfbc86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:07.934847 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-647056b7-6aaa-4d02-88d1-3b850bfbc86a None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:46:07.936093 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-647056b7-6aaa-4d02-88d1-3b850bfbc86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:46:07.961768 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:07.984919 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e570cd-c78b-44b4-b2dc-def9f5fc6575 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:08.030172 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e042682-33e0-471d-a8b7-331fa200ef53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:08.031428 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e042682-33e0-471d-a8b7-331fa200ef53 None admin] REQUEST_METHOD: `PUT` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:08.031945 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e042682-33e0-471d-a8b7-331fa200ef53 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:08.032440 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e042682-33e0-471d-a8b7-331fa200ef53 None admin] PATH_INFO: `/v3/projects/93f20f89d0fc4bbf9cf557dd1e14d98d/users/5fb6e97b5a864998a407db6a3bf21d79/roles/551482a278b94c70a5183d8bcfa58d9b` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:08.034942 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e042682-33e0-471d-a8b7-331fa200ef53 None admin] RBAC: Authorizing `identity:create_grant(project_id=93f20f89d0fc4bbf9cf557dd1e14d98d, user_id=5fb6e97b5a864998a407db6a3bf21d79, role_id=551482a278b94c70a5183d8bcfa58d9b)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:08.036616 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e042682-33e0-471d-a8b7-331fa200ef53 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:08.038222 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 481/961] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:46:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:46:08.055135 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647056b7-6aaa-4d02-88d1-3b850bfbc86a None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:08.115072 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 481/962] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:46:07 2022] PUT /identity/v3/projects/93f20f89d0fc4bbf9cf557dd1e14d98d/users/5fb6e97b5a864998a407db6a3bf21d79/roles/551482a278b94c70a5183d8bcfa58d9b => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:46:08.174472 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647056b7-6aaa-4d02-88d1-3b850bfbc86a None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:08.214639 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe338cef-54ea-4c39-ba01-587254c18176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:08.215356 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe338cef-54ea-4c39-ba01-587254c18176 None admin] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:08.215688 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe338cef-54ea-4c39-ba01-587254c18176 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:08.215975 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe338cef-54ea-4c39-ba01-587254c18176 None admin] PATH_INFO: `/v3/users` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:08.216701 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe338cef-54ea-4c39-ba01-587254c18176 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:08.218190 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe338cef-54ea-4c39-ba01-587254c18176 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:08.219779 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: WARNING keystone.server.flask.common [None req-fe338cef-54ea-4c39-ba01-587254c18176 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 05 21:46:08.259106 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.sql.core [None req-fe338cef-54ea-4c39-ba01-587254c18176 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 05 21:46:08.259106 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 05 21:46:08.259106 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [parameters: {'user_id': '5905fa846afe45c1a21351887f7b1a85', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 05 21:46:08.259106 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=244269) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 05 21:46:08.267569 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-fe338cef-54ea-4c39-ba01-587254c18176 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 05 21:46:08.267569 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:08.267569 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 21:46:08.267569 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 21:46:08.267569 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 21:46:08.267569 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 21:46:08.267569 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 21:46:08.267569 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 21:46:08.267569 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 21:46:08.267569 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application conn.query(q) Jul 05 21:46:08.267569 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 21:46:08.267569 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 21:46:08.267569 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 21:46:08.267569 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application result.read() Jul 05 21:46:08.267569 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 21:46:08.268605 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 21:46:08.268605 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 21:46:08.268605 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 21:46:08.268605 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 21:46:08.268605 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 21:46:08.268605 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 21:46:08.268605 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 21:46:08.268605 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 05 21:46:08.268605 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:46:08.268605 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 05 21:46:08.268605 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:46:08.268605 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:08.268605 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 05 21:46:08.268605 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 05 21:46:08.268605 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 05 21:46:08.268605 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 05 21:46:08.268605 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 21:46:08.268605 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application next(self.gen) Jul 05 21:46:08.269624 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 05 21:46:08.269624 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application yield resource Jul 05 21:46:08.269624 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 21:46:08.269624 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application next(self.gen) Jul 05 21:46:08.269624 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 05 21:46:08.269624 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application self.session.rollback() Jul 05 21:46:08.269624 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 05 21:46:08.269624 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application self.force_reraise() Jul 05 21:46:08.269624 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 05 21:46:08.269624 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise self.value Jul 05 21:46:08.269624 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 05 21:46:08.269624 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 05 21:46:08.269624 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 05 21:46:08.269624 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application session.commit() Jul 05 21:46:08.269624 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 05 21:46:08.269624 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 05 21:46:08.269624 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 05 21:46:08.271484 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application self._prepare_impl() Jul 05 21:46:08.271484 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 05 21:46:08.271484 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application self.session.flush() Jul 05 21:46:08.271484 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 05 21:46:08.271484 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application self._flush(objects) Jul 05 21:46:08.271484 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 05 21:46:08.271484 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 05 21:46:08.271484 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 05 21:46:08.271484 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application compat.raise_( Jul 05 21:46:08.271484 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 21:46:08.271484 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception Jul 05 21:46:08.271484 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 05 21:46:08.271484 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application flush_context.execute() Jul 05 21:46:08.271484 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 05 21:46:08.271484 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rec.execute(self) Jul 05 21:46:08.271484 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 05 21:46:08.271484 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 05 21:46:08.273886 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 05 21:46:08.273886 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 05 21:46:08.273886 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 05 21:46:08.273886 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 05 21:46:08.273886 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 05 21:46:08.273886 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 05 21:46:08.273886 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 05 21:46:08.273886 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 05 21:46:08.273886 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 05 21:46:08.273886 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 05 21:46:08.273886 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 05 21:46:08.273886 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 05 21:46:08.273886 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 05 21:46:08.273886 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 05 21:46:08.273886 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 21:46:08.273886 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception Jul 05 21:46:08.276124 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 21:46:08.276124 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 21:46:08.276124 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 21:46:08.276124 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 21:46:08.276124 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 21:46:08.276124 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 21:46:08.276124 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 21:46:08.276124 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application conn.query(q) Jul 05 21:46:08.276124 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 21:46:08.276124 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 21:46:08.276124 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 21:46:08.276124 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application result.read() Jul 05 21:46:08.276124 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 21:46:08.276124 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 21:46:08.276124 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 21:46:08.276124 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 21:46:08.278206 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 21:46:08.278206 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 21:46:08.278206 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 21:46:08.278206 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 21:46:08.278206 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 05 21:46:08.278206 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 05 21:46:08.278206 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [parameters: {'user_id': '5905fa846afe45c1a21351887f7b1a85', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 05 21:46:08.278206 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 05 21:46:08.278206 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:46:08.278206 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:46:08.278206 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:46:08.278206 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:08.278206 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:08.278206 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:08.278206 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:08.281938 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:08.281938 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:08.281938 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:08.281938 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:08.281938 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:08.281938 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:08.281938 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:08.281938 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 05 21:46:08.281938 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 05 21:46:08.281938 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:08.281938 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:08.281938 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:46:08.281938 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:46:08.281938 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:46:08.281938 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:46:08.281938 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 05 21:46:08.281938 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 05 21:46:08.284876 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 05 21:46:08.284876 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 05 21:46:08.284876 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 05 21:46:08.284876 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 05 21:46:08.284876 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 05 21:46:08.284876 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:46:08.284876 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 482/963] 10.222.0.30 () {60 vars in 1131 bytes} [Tue Jul 5 21:46:08 2022] POST /identity/v3/users => generated 160 bytes in 215 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:46:08.295591 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e042682-33e0-471d-a8b7-331fa200ef53 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:08.297928 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:08.397076 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e042682-33e0-471d-a8b7-331fa200ef53 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:08.433470 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362dd2f-67fa-4a6d-8ca5-9cdddf393d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:08.434643 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362dd2f-67fa-4a6d-8ca5-9cdddf393d9c None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:08.435164 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362dd2f-67fa-4a6d-8ca5-9cdddf393d9c None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:08.435650 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362dd2f-67fa-4a6d-8ca5-9cdddf393d9c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:08.443367 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1362dd2f-67fa-4a6d-8ca5-9cdddf393d9c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:08.445257 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1362dd2f-67fa-4a6d-8ca5-9cdddf393d9c None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:08.460770 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-1362dd2f-67fa-4a6d-8ca5-9cdddf393d9c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 21:46:08.460770 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:08.460770 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:08.460770 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:08.460770 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:08.460770 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:08.460770 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:08.460770 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:08.460770 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:08.460770 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:08.460770 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:08.460770 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:08.460770 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:46:08.460770 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:46:08.460770 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:46:08.460770 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:46:08.461839 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:08.461839 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:08.461839 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:46:08.461839 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:46:08.461839 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:46:08.461839 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:46:08.461839 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:46:08.461839 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:46:08.461839 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:46:08.461839 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:46:08.461839 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:46:08.461839 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:46:08.461839 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:46:08.461839 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:46:08.461839 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:46:08.461839 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:46:08.461839 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:46:08.461839 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:46:08.462921 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:46:08.462921 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:46:08.462921 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:46:08.462921 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:46:08.462921 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:46:08.462921 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:46:08.462921 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:46:08.462921 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:46:08.462921 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 21:46:08.462921 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:46:08.465600 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 482/964] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:46:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:46:08.471221 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe338cef-54ea-4c39-ba01-587254c18176 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:08.493344 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:08.580674 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe338cef-54ea-4c39-ba01-587254c18176 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:08.616908 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2826d-4ca1-4bf4-8074-98ba3f9c0e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:08.617602 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2826d-4ca1-4bf4-8074-98ba3f9c0e15 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:08.617889 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2826d-4ca1-4bf4-8074-98ba3f9c0e15 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:08.618193 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2826d-4ca1-4bf4-8074-98ba3f9c0e15 None admin] PATH_INFO: `/v3/users` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:08.619017 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba2826d-4ca1-4bf4-8074-98ba3f9c0e15 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:08.619326 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba2826d-4ca1-4bf4-8074-98ba3f9c0e15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:08.620981 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba2826d-4ca1-4bf4-8074-98ba3f9c0e15 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:08.666259 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 483/965] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Jul 5 21:46:08 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:09.594625 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d95c3-3344-4acb-9d9d-34199bb8452a None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:09.595181 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d95c3-3344-4acb-9d9d-34199bb8452a None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:09.595181 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d95c3-3344-4acb-9d9d-34199bb8452a None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:09.596735 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 483/966] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:46:09.602476 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592a628-21a1-4326-8bfb-a3a2553ba645 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:09.602777 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592a628-21a1-4326-8bfb-a3a2553ba645 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:09.603066 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592a628-21a1-4326-8bfb-a3a2553ba645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:09.620304 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-f592a628-21a1-4326-8bfb-a3a2553ba645 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:46:09.621840 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-f592a628-21a1-4326-8bfb-a3a2553ba645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:46:09.689251 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 484/967] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:46:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:46:09.712492 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d95c3-3344-4acb-9d9d-34199bb8452a None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:09.781964 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:09.816598 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d95c3-3344-4acb-9d9d-34199bb8452a None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:09.852711 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e399b58-c826-4335-8df4-03557fd4f37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:09.853781 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e399b58-c826-4335-8df4-03557fd4f37e None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:09.854069 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e399b58-c826-4335-8df4-03557fd4f37e None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:09.854378 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e399b58-c826-4335-8df4-03557fd4f37e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:09.855047 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e399b58-c826-4335-8df4-03557fd4f37e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:09.856434 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e399b58-c826-4335-8df4-03557fd4f37e None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:09.869421 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-6e399b58-c826-4335-8df4-03557fd4f37e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:46:09.869421 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:09.869421 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:46:09.869421 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:46:09.869421 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:46:09.869421 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:46:09.869421 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:46:09.869421 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:46:09.869421 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:46:09.869421 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:46:09.869421 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:46:09.869421 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:46:09.869421 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:09.869421 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:09.869421 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:09.869421 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:09.869421 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:09.870614 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:09.870614 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:09.870614 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:09.870614 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:09.870614 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:09.870614 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:09.870614 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:46:09.870614 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:46:09.870614 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:46:09.870614 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:46:09.870614 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:09.870614 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:09.870614 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:46:09.870614 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:46:09.870614 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:46:09.870614 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:46:09.871571 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:46:09.871571 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:46:09.871571 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:46:09.871571 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:46:09.871571 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:46:09.871571 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:46:09.871571 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:46:09.871571 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:46:09.871571 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:46:09.871571 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:46:09.871571 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:46:09.871571 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:46:09.871571 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:46:09.871571 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:46:09.874471 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 484/968] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Jul 5 21:46:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:46:09.876673 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f592a628-21a1-4326-8bfb-a3a2553ba645 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:09.885391 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:09.934665 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fb18c-d362-49e9-843b-6b01301d87e4 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:09.935302 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fb18c-d362-49e9-843b-6b01301d87e4 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:09.935597 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fb18c-d362-49e9-843b-6b01301d87e4 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:09.937634 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 485/969] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:46:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:46:09.942637 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ea663-5ab0-4467-82e0-be1a340f46d6 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:09.942928 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ea663-5ab0-4467-82e0-be1a340f46d6 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:09.943777 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ea663-5ab0-4467-82e0-be1a340f46d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:09.963015 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-c08ea663-5ab0-4467-82e0-be1a340f46d6 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:46:09.964225 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-c08ea663-5ab0-4467-82e0-be1a340f46d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:46:09.989468 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f592a628-21a1-4326-8bfb-a3a2553ba645 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:10.028336 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6cd2cc-71cd-4811-8be8-b238f4618b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:10.029015 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cd2cc-71cd-4811-8be8-b238f4618b4f None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:10.029303 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cd2cc-71cd-4811-8be8-b238f4618b4f None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:10.029591 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cd2cc-71cd-4811-8be8-b238f4618b4f None admin] PATH_INFO: `/v3/services` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:10.030339 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6cd2cc-71cd-4811-8be8-b238f4618b4f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:10.030651 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6cd2cc-71cd-4811-8be8-b238f4618b4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:10.032037 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6cd2cc-71cd-4811-8be8-b238f4618b4f None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:10.042159 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 485/970] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Jul 5 21:46:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:46:10.042338 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 486/971] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:46:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:46:10.045364 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6cd2cc-71cd-4811-8be8-b238f4618b4f None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:10.060127 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ea663-5ab0-4467-82e0-be1a340f46d6 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:10.112819 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:10.125250 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:10.145704 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6cd2cc-71cd-4811-8be8-b238f4618b4f None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:10.166399 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ea663-5ab0-4467-82e0-be1a340f46d6 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:10.184568 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8dc037-ae6b-4ae2-ab67-45d19d7fb43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:10.185250 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8dc037-ae6b-4ae2-ab67-45d19d7fb43e None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:10.185547 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8dc037-ae6b-4ae2-ab67-45d19d7fb43e None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:10.185829 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8dc037-ae6b-4ae2-ab67-45d19d7fb43e None admin] PATH_INFO: `/v3/services` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:10.186587 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8dc037-ae6b-4ae2-ab67-45d19d7fb43e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:10.186898 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8dc037-ae6b-4ae2-ab67-45d19d7fb43e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:10.188280 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8dc037-ae6b-4ae2-ab67-45d19d7fb43e None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:10.193962 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 486/972] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Jul 5 21:46:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:46:10.199534 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8dc037-ae6b-4ae2-ab67-45d19d7fb43e None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:10.204950 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1062f6-9a25-4a7c-86d7-3b4e4049c597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:10.205626 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1062f6-9a25-4a7c-86d7-3b4e4049c597 None admin] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:10.205917 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1062f6-9a25-4a7c-86d7-3b4e4049c597 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:10.206234 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1062f6-9a25-4a7c-86d7-3b4e4049c597 None admin] PATH_INFO: `/v3/services` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:10.206980 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1062f6-9a25-4a7c-86d7-3b4e4049c597 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:10.208349 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1062f6-9a25-4a7c-86d7-3b4e4049c597 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:10.291208 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 487/973] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Jul 5 21:46:10 2022] POST /identity/v3/services => generated 242 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:46:10.291208 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd092b47-742e-4bda-9453-f04b8cb859db None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:10.291208 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd092b47-742e-4bda-9453-f04b8cb859db None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:10.291208 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd092b47-742e-4bda-9453-f04b8cb859db None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:10.291208 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 488/974] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:46:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:46:10.292026 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030a63a-dfc2-4e84-8e26-08685c10a5aa None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:10.292323 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030a63a-dfc2-4e84-8e26-08685c10a5aa None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:10.292611 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030a63a-dfc2-4e84-8e26-08685c10a5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:10.308560 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8dc037-ae6b-4ae2-ab67-45d19d7fb43e None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:10.314297 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-b030a63a-dfc2-4e84-8e26-08685c10a5aa None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:46:10.314297 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-b030a63a-dfc2-4e84-8e26-08685c10a5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:46:10.351402 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:10.359937 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de27702c-e69d-48ac-b3bd-261ff14a97c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:10.360857 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27702c-e69d-48ac-b3bd-261ff14a97c3 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:10.361030 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27702c-e69d-48ac-b3bd-261ff14a97c3 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:10.361397 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27702c-e69d-48ac-b3bd-261ff14a97c3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:10.362277 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de27702c-e69d-48ac-b3bd-261ff14a97c3 None admin] RBAC: Adding query filter params (interface=admin, service_id=72f7618fa473415faa909b636a4f382e, region_id=RegionOne) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:10.362602 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de27702c-e69d-48ac-b3bd-261ff14a97c3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:10.364252 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de27702c-e69d-48ac-b3bd-261ff14a97c3 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:10.371062 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 487/975] 10.222.0.30 () {56 vars in 1249 bytes} [Tue Jul 5 21:46:10 2022] GET /identity/v3/endpoints?service_id=72f7618fa473415faa909b636a4f382e&interface=admin®ion_id=RegionOne => generated 193 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:46:10.376621 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de27702c-e69d-48ac-b3bd-261ff14a97c3 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:10.398552 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 489/976] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:46:10 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:46:10.420152 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030a63a-dfc2-4e84-8e26-08685c10a5aa None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:10.483538 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:10.498167 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de27702c-e69d-48ac-b3bd-261ff14a97c3 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:10.535058 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030a63a-dfc2-4e84-8e26-08685c10a5aa None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:10.537452 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b553f-aa0e-4d30-86b6-a1cea3fbf13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:10.538241 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b553f-aa0e-4d30-86b6-a1cea3fbf13a None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:10.538541 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b553f-aa0e-4d30-86b6-a1cea3fbf13a None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:10.538829 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b553f-aa0e-4d30-86b6-a1cea3fbf13a None admin] PATH_INFO: `/v3/services` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:10.539537 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914b553f-aa0e-4d30-86b6-a1cea3fbf13a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:10.540929 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914b553f-aa0e-4d30-86b6-a1cea3fbf13a None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:10.554764 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 488/977] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Jul 5 21:46:10 2022] GET /identity/v3/services => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:46:10.579281 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c2b1b-f4fa-4a8c-aeed-382873c72c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:10.580134 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c2b1b-f4fa-4a8c-aeed-382873c72c09 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:10.580425 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c2b1b-f4fa-4a8c-aeed-382873c72c09 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:10.580709 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c2b1b-f4fa-4a8c-aeed-382873c72c09 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:10.594303 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4c2b1b-f4fa-4a8c-aeed-382873c72c09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:46:10.603844 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-1f4c2b1b-f4fa-4a8c-aeed-382873c72c09 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 21:46:10.603844 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:10.603844 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:10.603844 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:10.603844 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:10.603844 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:10.603844 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:10.603844 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:10.603844 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:10.603844 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:10.603844 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:10.603844 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:10.603844 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:46:10.603844 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:46:10.603844 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:46:10.603844 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:46:10.605416 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:46:10.605416 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:46:10.605416 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:46:10.605416 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:46:10.605416 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:10.605416 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:10.605416 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:46:10.605416 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:46:10.605416 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:46:10.605416 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:46:10.605416 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:46:10.605416 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:46:10.605416 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:46:10.605416 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:46:10.605416 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:46:10.605416 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:46:10.606427 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:46:10.606427 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:46:10.606427 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:46:10.606427 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:46:10.606427 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:46:10.606427 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:46:10.606427 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:46:10.606427 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:46:10.606427 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:46:10.606427 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:46:10.606427 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 21:46:10.606427 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:46:10.607501 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 490/978] 10.222.0.30 () {56 vars in 1120 bytes} [Tue Jul 5 21:46:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:46:10.611778 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b553f-aa0e-4d30-86b6-a1cea3fbf13a None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:10.681088 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:10.727518 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b553f-aa0e-4d30-86b6-a1cea3fbf13a None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:10.764795 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855bd06-2aed-418b-8838-e69fa19533eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:10.765854 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855bd06-2aed-418b-8838-e69fa19533eb None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:10.766438 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855bd06-2aed-418b-8838-e69fa19533eb None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:10.766937 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855bd06-2aed-418b-8838-e69fa19533eb None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:10.767931 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c855bd06-2aed-418b-8838-e69fa19533eb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:10.768457 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c855bd06-2aed-418b-8838-e69fa19533eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:10.770080 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c855bd06-2aed-418b-8838-e69fa19533eb None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:10.780802 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 489/979] 10.222.0.30 () {56 vars in 1115 bytes} [Tue Jul 5 21:46:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:10.786604 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c2b1b-f4fa-4a8c-aeed-382873c72c09 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:10.895406 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c2b1b-f4fa-4a8c-aeed-382873c72c09 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:10.908711 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:10.930864 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3217b5d-149f-40b1-815d-8bf5ae3c6621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:10.931738 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3217b5d-149f-40b1-815d-8bf5ae3c6621 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:10.931985 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3217b5d-149f-40b1-815d-8bf5ae3c6621 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:10.932270 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3217b5d-149f-40b1-815d-8bf5ae3c6621 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:10.943699 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3217b5d-149f-40b1-815d-8bf5ae3c6621 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:10.945850 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3217b5d-149f-40b1-815d-8bf5ae3c6621 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:10.964110 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-f3217b5d-149f-40b1-815d-8bf5ae3c6621 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:46:10.964110 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:10.964110 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:10.964110 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:10.964110 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:10.964110 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:10.964110 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:10.964110 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:10.964110 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:10.964110 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:10.964110 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:10.964110 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:10.964110 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:46:10.964110 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:46:10.964110 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:46:10.965216 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:46:10.965216 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:10.965216 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:10.965216 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:46:10.965216 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:46:10.965216 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:46:10.965216 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:46:10.965216 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:46:10.965216 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:46:10.965216 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:46:10.965216 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:46:10.965216 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:46:10.965216 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:46:10.965216 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:46:10.965216 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:46:10.965216 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:46:10.965216 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:46:10.966222 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:46:10.966222 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:46:10.966222 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:46:10.966222 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:46:10.966222 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 491/980] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:46:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:46:10.971083 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855bd06-2aed-418b-8838-e69fa19533eb None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:11.080527 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855bd06-2aed-418b-8838-e69fa19533eb None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:11.101173 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:11.115528 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db0bf2-449b-45b8-8e31-34dcc075c5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:11.126392 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db0bf2-449b-45b8-8e31-34dcc075c5ee None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:11.126392 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db0bf2-449b-45b8-8e31-34dcc075c5ee None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:11.126392 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db0bf2-449b-45b8-8e31-34dcc075c5ee None admin] PATH_INFO: `/v3/domains` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:11.126392 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0db0bf2-449b-45b8-8e31-34dcc075c5ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:11.126392 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0db0bf2-449b-45b8-8e31-34dcc075c5ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:11.126392 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0db0bf2-449b-45b8-8e31-34dcc075c5ee None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:11.131835 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 490/981] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:46:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:46:11.137290 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3217b5d-149f-40b1-815d-8bf5ae3c6621 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:11.245205 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3217b5d-149f-40b1-815d-8bf5ae3c6621 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:11.281654 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f550b2bc-af2e-4f7d-a1c9-dd9e3f35fefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:11.282521 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550b2bc-af2e-4f7d-a1c9-dd9e3f35fefa None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:11.282816 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550b2bc-af2e-4f7d-a1c9-dd9e3f35fefa None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:11.283098 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550b2bc-af2e-4f7d-a1c9-dd9e3f35fefa None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:11.291115 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f550b2bc-af2e-4f7d-a1c9-dd9e3f35fefa None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:11.292618 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f550b2bc-af2e-4f7d-a1c9-dd9e3f35fefa None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:11.308334 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-f550b2bc-af2e-4f7d-a1c9-dd9e3f35fefa None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 21:46:11.308334 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:11.308334 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:11.308334 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:11.308334 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:11.308334 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:11.308334 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:11.308334 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:11.308334 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:11.308334 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:11.308334 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:11.308334 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:11.308334 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:46:11.308334 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:46:11.308334 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:46:11.308334 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:46:11.309345 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:11.309345 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:11.309345 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:46:11.309345 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:46:11.309345 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:46:11.309345 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:46:11.309345 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:46:11.309345 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:46:11.309345 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:46:11.309345 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:46:11.309345 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:46:11.309345 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:46:11.309345 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:46:11.309345 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:46:11.309345 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:46:11.309345 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:46:11.309345 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:46:11.309345 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:46:11.310400 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:46:11.310400 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:46:11.310400 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:46:11.310400 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:46:11.310400 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:46:11.310400 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:46:11.310400 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:46:11.310400 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:46:11.310400 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 21:46:11.310400 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:46:11.310400 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 492/982] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Jul 5 21:46:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:46:11.317417 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db0bf2-449b-45b8-8e31-34dcc075c5ee None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:11.425789 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db0bf2-449b-45b8-8e31-34dcc075c5ee None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:11.462392 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b75602-0ea6-44fc-88d4-ad4ef5015c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:11.463078 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b75602-0ea6-44fc-88d4-ad4ef5015c82 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:11.463367 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b75602-0ea6-44fc-88d4-ad4ef5015c82 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:11.463655 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b75602-0ea6-44fc-88d4-ad4ef5015c82 None admin] PATH_INFO: `/v3/users` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:11.464502 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b75602-0ea6-44fc-88d4-ad4ef5015c82 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:11.464818 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b75602-0ea6-44fc-88d4-ad4ef5015c82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:11.466296 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b75602-0ea6-44fc-88d4-ad4ef5015c82 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:11.488330 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 491/983] 10.222.0.30 () {56 vars in 1149 bytes} [Tue Jul 5 21:46:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:11.489780 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f550b2bc-af2e-4f7d-a1c9-dd9e3f35fefa None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:11.517819 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:11.601626 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f550b2bc-af2e-4f7d-a1c9-dd9e3f35fefa None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:11.638462 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced09077-d6fd-492c-a91d-8f93e543ae46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:11.639116 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced09077-d6fd-492c-a91d-8f93e543ae46 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:11.639404 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced09077-d6fd-492c-a91d-8f93e543ae46 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:11.639689 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced09077-d6fd-492c-a91d-8f93e543ae46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:11.714588 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced09077-d6fd-492c-a91d-8f93e543ae46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:11.716058 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced09077-d6fd-492c-a91d-8f93e543ae46 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:11.739828 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:11.815758 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 493/984] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:46:11 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:46:11.821840 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b75602-0ea6-44fc-88d4-ad4ef5015c82 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:11.864488 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:11.925952 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b75602-0ea6-44fc-88d4-ad4ef5015c82 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:11.961913 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83b230-9729-4f1d-b971-c3275b5ed588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:11.962759 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83b230-9729-4f1d-b971-c3275b5ed588 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:11.963054 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83b230-9729-4f1d-b971-c3275b5ed588 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:11.963331 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83b230-9729-4f1d-b971-c3275b5ed588 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:11.974097 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab83b230-9729-4f1d-b971-c3275b5ed588 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:11.976298 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab83b230-9729-4f1d-b971-c3275b5ed588 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:11.994824 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-ab83b230-9729-4f1d-b971-c3275b5ed588 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:46:11.994824 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:11.994824 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:11.994824 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:11.994824 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:11.994824 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:11.994824 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:11.994824 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:11.994824 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:11.994824 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:11.994824 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:11.994824 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:11.994824 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:46:11.994824 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:46:11.994824 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:46:11.995826 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:46:11.995826 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:11.995826 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:11.995826 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:46:11.995826 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:46:11.995826 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:46:11.995826 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:46:11.995826 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:46:11.995826 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:46:11.995826 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:46:11.995826 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:46:11.995826 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:46:11.995826 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:46:11.995826 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:46:11.995826 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:46:11.995826 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:46:11.995826 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:46:11.996842 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:46:11.996842 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:46:11.996842 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:46:11.996842 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:46:11.998211 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 492/985] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:46:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:46:12.001711 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced09077-d6fd-492c-a91d-8f93e543ae46 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:12.104243 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced09077-d6fd-492c-a91d-8f93e543ae46 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:12.128326 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:12.140603 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a976d3-fbd6-4396-a63b-e4a25a18dea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:12.141278 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a976d3-fbd6-4396-a63b-e4a25a18dea0 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:12.141570 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a976d3-fbd6-4396-a63b-e4a25a18dea0 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:12.141856 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a976d3-fbd6-4396-a63b-e4a25a18dea0 None admin] PATH_INFO: `/v3/domains` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:12.142625 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a976d3-fbd6-4396-a63b-e4a25a18dea0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:12.142943 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a976d3-fbd6-4396-a63b-e4a25a18dea0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:12.144330 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a976d3-fbd6-4396-a63b-e4a25a18dea0 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:12.157207 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 494/986] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:46:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:12.162651 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83b230-9729-4f1d-b971-c3275b5ed588 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:12.256840 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:12.267223 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83b230-9729-4f1d-b971-c3275b5ed588 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:12.304050 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9587068e-1f99-481d-a06b-68857ba1bdad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:12.304863 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9587068e-1f99-481d-a06b-68857ba1bdad None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:12.305153 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9587068e-1f99-481d-a06b-68857ba1bdad None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:12.305433 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9587068e-1f99-481d-a06b-68857ba1bdad None admin] PATH_INFO: `/v3/projects/service` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:12.312492 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9587068e-1f99-481d-a06b-68857ba1bdad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:12.313954 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9587068e-1f99-481d-a06b-68857ba1bdad None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:12.328068 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-9587068e-1f99-481d-a06b-68857ba1bdad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:46:12.328068 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:12.328068 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:12.328068 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:12.328068 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:12.328068 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:12.328068 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:12.328068 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:12.328068 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:12.328068 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:12.328068 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:12.328068 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:12.328068 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:46:12.328068 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:46:12.328068 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:46:12.329041 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:46:12.329041 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:12.329041 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:12.329041 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:46:12.329041 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:46:12.329041 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:46:12.329041 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:46:12.329041 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:46:12.329041 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:46:12.329041 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:46:12.329041 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:46:12.329041 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:46:12.329041 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:46:12.329041 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:46:12.329041 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:46:12.329041 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:46:12.329041 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:46:12.330064 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:46:12.330064 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:46:12.330064 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:46:12.330064 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:46:12.330064 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:46:12.330064 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:46:12.330064 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:46:12.330064 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:46:12.338161 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 493/987] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:46:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:46:12.338309 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a976d3-fbd6-4396-a63b-e4a25a18dea0 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:12.351928 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891b37f-c231-4b43-a717-4ccd02751f74 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:12.352224 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891b37f-c231-4b43-a717-4ccd02751f74 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:12.352512 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891b37f-c231-4b43-a717-4ccd02751f74 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:12.354371 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 494/988] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:46:12.358925 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e598e-2e75-4697-a590-01c14e4c57fb None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:12.359221 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e598e-2e75-4697-a590-01c14e4c57fb None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:12.359507 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e598e-2e75-4697-a590-01c14e4c57fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:12.377103 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-db6e598e-2e75-4697-a590-01c14e4c57fb None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:46:12.378340 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-db6e598e-2e75-4697-a590-01c14e4c57fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:46:12.449853 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 495/989] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:46:12 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:46:12.451339 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a976d3-fbd6-4396-a63b-e4a25a18dea0 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:12.472142 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e598e-2e75-4697-a590-01c14e4c57fb None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:12.489510 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8bceb7-abe2-46b9-ae5b-de2285e76029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:12.490263 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8bceb7-abe2-46b9-ae5b-de2285e76029 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:12.490559 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8bceb7-abe2-46b9-ae5b-de2285e76029 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:12.490844 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8bceb7-abe2-46b9-ae5b-de2285e76029 None admin] PATH_INFO: `/v3/projects` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:12.491779 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8bceb7-abe2-46b9-ae5b-de2285e76029 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:12.492095 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8bceb7-abe2-46b9-ae5b-de2285e76029 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:12.493703 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8bceb7-abe2-46b9-ae5b-de2285e76029 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:12.509219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 495/990] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:46:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:12.515038 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8bceb7-abe2-46b9-ae5b-de2285e76029 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:12.570910 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:12.573499 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:12.591279 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e598e-2e75-4697-a590-01c14e4c57fb None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:12.628092 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16695d-b31b-492b-89ca-569bfea5dce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:12.628809 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16695d-b31b-492b-89ca-569bfea5dce5 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:12.629102 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16695d-b31b-492b-89ca-569bfea5dce5 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:12.629384 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16695d-b31b-492b-89ca-569bfea5dce5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:12.630067 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a16695d-b31b-492b-89ca-569bfea5dce5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:12.632016 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a16695d-b31b-492b-89ca-569bfea5dce5 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:12.633651 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8bceb7-abe2-46b9-ae5b-de2285e76029 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:12.643569 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-8a16695d-b31b-492b-89ca-569bfea5dce5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 21:46:12.643569 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:12.643569 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:46:12.643569 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:46:12.643569 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:46:12.643569 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:46:12.643569 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:46:12.643569 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:46:12.643569 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 21:46:12.643569 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:46:12.643569 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:46:12.643569 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:46:12.643569 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:12.643569 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:12.643569 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:12.643569 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:12.643569 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:12.644707 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:12.644707 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:12.644707 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:12.644707 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:12.644707 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:12.644707 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:12.644707 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:46:12.644707 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:46:12.644707 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:46:12.644707 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:46:12.644707 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:12.644707 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:12.644707 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:46:12.644707 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:46:12.644707 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:46:12.644707 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:46:12.645650 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:46:12.645650 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:46:12.645650 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:46:12.645650 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:46:12.645650 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:46:12.645650 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:46:12.645650 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:46:12.645650 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:46:12.645650 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:46:12.645650 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:46:12.645650 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:46:12.645650 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:46:12.645650 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 21:46:12.645650 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:46:12.645650 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 496/991] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:46:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:46:12.647768 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a1245-884f-449f-9c98-5e3408236f31 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:12.648062 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a1245-884f-449f-9c98-5e3408236f31 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:12.648398 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a1245-884f-449f-9c98-5e3408236f31 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:12.649841 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 497/992] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:46:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:46:12.651186 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a1245-884f-449f-9c98-5e3408236f31 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:12.673756 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d5d84-149b-46d8-bfd8-4ed6755d013b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:12.674602 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d5d84-149b-46d8-bfd8-4ed6755d013b None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:12.674895 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d5d84-149b-46d8-bfd8-4ed6755d013b None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:12.675176 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d5d84-149b-46d8-bfd8-4ed6755d013b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:12.676019 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8d5d84-149b-46d8-bfd8-4ed6755d013b None admin] RBAC: Adding query filter params (role.id=551482a278b94c70a5183d8bcfa58d9b, scope.project.id=93f20f89d0fc4bbf9cf557dd1e14d98d, user.id=5fb6e97b5a864998a407db6a3bf21d79) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:12.676332 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8d5d84-149b-46d8-bfd8-4ed6755d013b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:12.677788 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8d5d84-149b-46d8-bfd8-4ed6755d013b None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:12.683876 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 496/993] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:46:12 2022] GET /identity/v3/role_assignments?user.id=5fb6e97b5a864998a407db6a3bf21d79&scope.project.id=93f20f89d0fc4bbf9cf557dd1e14d98d&role.id=551482a278b94c70a5183d8bcfa58d9b => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:12.685060 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb7942-73ae-458d-87ee-99b00d50fb66 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:12.685350 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb7942-73ae-458d-87ee-99b00d50fb66 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:12.685629 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb7942-73ae-458d-87ee-99b00d50fb66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:12.704095 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-d3eb7942-73ae-458d-87ee-99b00d50fb66 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:46:12.705339 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-d3eb7942-73ae-458d-87ee-99b00d50fb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:46:12.769581 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a1245-884f-449f-9c98-5e3408236f31 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:12.790357 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 497/994] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:46:12 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:46:12.811018 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b360d6-60ee-4d86-a4f8-eeeb6407f36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:12.811717 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b360d6-60ee-4d86-a4f8-eeeb6407f36b None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:12.812013 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b360d6-60ee-4d86-a4f8-eeeb6407f36b None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:12.812302 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b360d6-60ee-4d86-a4f8-eeeb6407f36b None admin] PATH_INFO: `/v3/services` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:12.812893 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb7942-73ae-458d-87ee-99b00d50fb66 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:12.813057 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b360d6-60ee-4d86-a4f8-eeeb6407f36b None admin] RBAC: Adding query filter params (name=compute) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:12.813355 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b360d6-60ee-4d86-a4f8-eeeb6407f36b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:12.814818 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b360d6-60ee-4d86-a4f8-eeeb6407f36b None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:12.820675 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 498/995] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Jul 5 21:46:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:46:12.827540 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b360d6-60ee-4d86-a4f8-eeeb6407f36b None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:12.839917 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:12.860908 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:12.936585 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb7942-73ae-458d-87ee-99b00d50fb66 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:12.941148 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b360d6-60ee-4d86-a4f8-eeeb6407f36b None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:12.974395 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205b5df-283d-4b12-bdd7-7b5b8f400622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:12.975231 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205b5df-283d-4b12-bdd7-7b5b8f400622 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:12.975515 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205b5df-283d-4b12-bdd7-7b5b8f400622 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:12.975797 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205b5df-283d-4b12-bdd7-7b5b8f400622 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:12.976456 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4205b5df-283d-4b12-bdd7-7b5b8f400622 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:12.977490 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182237f-e143-4e12-a242-48fb5f34d63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:12.977842 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4205b5df-283d-4b12-bdd7-7b5b8f400622 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:12.978257 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182237f-e143-4e12-a242-48fb5f34d63c None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:12.978756 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182237f-e143-4e12-a242-48fb5f34d63c None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:12.979058 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182237f-e143-4e12-a242-48fb5f34d63c None admin] PATH_INFO: `/v3/services` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:12.979794 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182237f-e143-4e12-a242-48fb5f34d63c None admin] RBAC: Adding query filter params (type=compute) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:12.980104 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182237f-e143-4e12-a242-48fb5f34d63c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:12.981481 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182237f-e143-4e12-a242-48fb5f34d63c None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:12.991982 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 499/996] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Jul 5 21:46:12 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:46:12.992161 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-4205b5df-283d-4b12-bdd7-7b5b8f400622 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:46:12.992161 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:12.992161 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:46:12.992161 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:46:12.992161 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:46:12.992161 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:46:12.992161 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:46:12.992161 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:46:12.992161 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:46:12.992161 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:46:12.992161 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:46:12.992161 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:46:12.992161 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:12.992161 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:12.992161 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:12.992161 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:12.992161 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:12.993173 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:12.993173 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:12.993173 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:12.993173 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:12.993173 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:12.993173 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:12.993173 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:46:12.993173 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:46:12.993173 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:46:12.993173 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:46:12.993173 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:12.993173 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:12.993173 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:46:12.993173 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:46:12.993173 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:46:12.993173 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:46:12.994108 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:46:12.994108 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:46:12.994108 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:46:12.994108 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:46:12.994108 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:46:12.994108 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:46:12.994108 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:46:12.994108 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:46:12.994108 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:46:12.994108 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:46:12.994108 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:46:12.994108 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:46:12.994108 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 21:46:12.994108 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:46:12.994961 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182237f-e143-4e12-a242-48fb5f34d63c None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:12.997286 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 498/997] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Jul 5 21:46:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:46:12.998109 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205b5df-283d-4b12-bdd7-7b5b8f400622 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:13.075942 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:13.111494 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205b5df-283d-4b12-bdd7-7b5b8f400622 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:13.113190 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:13.114562 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182237f-e143-4e12-a242-48fb5f34d63c None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:13.150438 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e67c3c-ea3e-4fce-8c9f-e9086eeb0ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:13.151120 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e67c3c-ea3e-4fce-8c9f-e9086eeb0ba2 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:13.151407 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e67c3c-ea3e-4fce-8c9f-e9086eeb0ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:13.151692 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e67c3c-ea3e-4fce-8c9f-e9086eeb0ba2 None admin] PATH_INFO: `/v3/services` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:13.152442 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e67c3c-ea3e-4fce-8c9f-e9086eeb0ba2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:13.152758 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e67c3c-ea3e-4fce-8c9f-e9086eeb0ba2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:13.153668 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad87aca2-2ed1-49b5-b504-6439a665f7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:13.154161 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e67c3c-ea3e-4fce-8c9f-e9086eeb0ba2 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:13.154360 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87aca2-2ed1-49b5-b504-6439a665f7c2 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:13.154653 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87aca2-2ed1-49b5-b504-6439a665f7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:13.154936 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87aca2-2ed1-49b5-b504-6439a665f7c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:13.155749 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad87aca2-2ed1-49b5-b504-6439a665f7c2 None admin] RBAC: Adding query filter params (interface=public, service_id=b0ba904e7fc7458dad748c03fbce51ba, region_id=RegionOne) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:13.156074 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad87aca2-2ed1-49b5-b504-6439a665f7c2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:13.157439 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad87aca2-2ed1-49b5-b504-6439a665f7c2 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:13.159756 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 499/998] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Jul 5 21:46:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:13.167927 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 500/999] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Jul 5 21:46:12 2022] GET /identity/v3/endpoints?service_id=b0ba904e7fc7458dad748c03fbce51ba&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:13.168125 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e67c3c-ea3e-4fce-8c9f-e9086eeb0ba2 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:13.168568 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad87aca2-2ed1-49b5-b504-6439a665f7c2 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:13.279901 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e67c3c-ea3e-4fce-8c9f-e9086eeb0ba2 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:13.287612 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad87aca2-2ed1-49b5-b504-6439a665f7c2 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:13.317108 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eaba31-7369-40ae-9667-733decca97a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:13.318234 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eaba31-7369-40ae-9667-733decca97a3 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:13.318726 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eaba31-7369-40ae-9667-733decca97a3 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:13.319203 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eaba31-7369-40ae-9667-733decca97a3 None admin] PATH_INFO: `/v3/services` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:13.320168 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eaba31-7369-40ae-9667-733decca97a3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:13.320701 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eaba31-7369-40ae-9667-733decca97a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:13.322630 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eaba31-7369-40ae-9667-733decca97a3 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:13.325947 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb26b8b-13da-41ef-909a-71ce8366ba5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:13.326674 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb26b8b-13da-41ef-909a-71ce8366ba5d None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:13.326967 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb26b8b-13da-41ef-909a-71ce8366ba5d None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:13.327254 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb26b8b-13da-41ef-909a-71ce8366ba5d None admin] PATH_INFO: `/v3/services` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:13.327723 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 500/1000] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Jul 5 21:46:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:13.328026 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb26b8b-13da-41ef-909a-71ce8366ba5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:13.329480 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb26b8b-13da-41ef-909a-71ce8366ba5d None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:13.331394 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:13.333249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eaba31-7369-40ae-9667-733decca97a3 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:13.337639 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 501/1001] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Jul 5 21:46:13 2022] GET /identity/v3/services => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:46:13.371753 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:13.454713 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eaba31-7369-40ae-9667-733decca97a3 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:13.494204 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b778a-ebe2-45d1-b46f-1e8fb83d6290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:13.494832 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b778a-ebe2-45d1-b46f-1e8fb83d6290 None admin] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:13.495737 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b778a-ebe2-45d1-b46f-1e8fb83d6290 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:13.495737 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b778a-ebe2-45d1-b46f-1e8fb83d6290 None admin] PATH_INFO: `/v3/endpoints` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:13.496149 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b778a-ebe2-45d1-b46f-1e8fb83d6290 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:13.497531 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b778a-ebe2-45d1-b46f-1e8fb83d6290 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:13.569041 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 501/1002] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Jul 5 21:46:13 2022] POST /identity/v3/endpoints => generated 325 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:46:14.770218 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa27ea5-1236-4f88-8ef3-93a481c837cf None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:14.771016 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa27ea5-1236-4f88-8ef3-93a481c837cf None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:14.771016 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa27ea5-1236-4f88-8ef3-93a481c837cf None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:14.773138 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 502/1003] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:46:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:46:14.778156 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01c1c7-e383-4a2e-8888-e9e2cc8a8c8b None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:14.778552 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01c1c7-e383-4a2e-8888-e9e2cc8a8c8b None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:14.778735 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01c1c7-e383-4a2e-8888-e9e2cc8a8c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:14.795810 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-ab01c1c7-e383-4a2e-8888-e9e2cc8a8c8b None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:46:14.796996 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-ab01c1c7-e383-4a2e-8888-e9e2cc8a8c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:46:14.872604 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 502/1004] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:46:14 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:46:14.895033 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa27ea5-1236-4f88-8ef3-93a481c837cf None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:14.999051 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa27ea5-1236-4f88-8ef3-93a481c837cf None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:15.033605 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893fce68-d8a1-4f7d-9524-68c14b48ec18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:15.034428 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893fce68-d8a1-4f7d-9524-68c14b48ec18 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:15.034718 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893fce68-d8a1-4f7d-9524-68c14b48ec18 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:15.035000 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893fce68-d8a1-4f7d-9524-68c14b48ec18 None admin] PATH_INFO: `/v3/services/image` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:15.035654 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893fce68-d8a1-4f7d-9524-68c14b48ec18 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:15.037228 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893fce68-d8a1-4f7d-9524-68c14b48ec18 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:15.048870 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-893fce68-d8a1-4f7d-9524-68c14b48ec18 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 21:46:15.048870 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:15.048870 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:46:15.048870 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:46:15.048870 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:46:15.048870 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:46:15.048870 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:46:15.048870 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:46:15.048870 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 21:46:15.048870 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:46:15.048870 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:46:15.048870 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:46:15.048870 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:15.048870 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:15.048870 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:15.048870 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:15.048870 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:15.050006 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:15.050006 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:15.050006 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:15.050006 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:15.050006 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:15.050006 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:15.050006 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:46:15.050006 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:46:15.050006 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:46:15.050006 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:46:15.050006 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:15.050006 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:15.050006 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:46:15.050006 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:46:15.050006 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:46:15.050006 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:46:15.051495 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:46:15.051495 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:46:15.051495 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:46:15.051495 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:46:15.051495 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:46:15.051495 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:46:15.051495 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:46:15.051495 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:46:15.051495 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:46:15.051495 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:46:15.051495 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:46:15.051495 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:46:15.051495 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 21:46:15.051495 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:46:15.053226 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 503/1005] 10.222.0.30 () {56 vars in 1105 bytes} [Tue Jul 5 21:46:14 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:46:15.056556 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab01c1c7-e383-4a2e-8888-e9e2cc8a8c8b None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:15.075713 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:15.160073 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab01c1c7-e383-4a2e-8888-e9e2cc8a8c8b None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:15.194871 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954580e4-d782-493f-b5d1-d1f702cf9089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:15.195551 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954580e4-d782-493f-b5d1-d1f702cf9089 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:15.195846 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954580e4-d782-493f-b5d1-d1f702cf9089 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:15.196129 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954580e4-d782-493f-b5d1-d1f702cf9089 None admin] PATH_INFO: `/v3/services` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:15.196851 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954580e4-d782-493f-b5d1-d1f702cf9089 None admin] RBAC: Adding query filter params (name=image) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:15.197166 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954580e4-d782-493f-b5d1-d1f702cf9089 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:15.198589 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954580e4-d782-493f-b5d1-d1f702cf9089 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:15.208207 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 503/1006] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:46:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:15.209992 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893fce68-d8a1-4f7d-9524-68c14b48ec18 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:15.276721 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:15.315945 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893fce68-d8a1-4f7d-9524-68c14b48ec18 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:15.351687 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c0a07-6598-4df4-a1d1-f4d35973c2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:15.352362 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c0a07-6598-4df4-a1d1-f4d35973c2dc None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:15.352648 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c0a07-6598-4df4-a1d1-f4d35973c2dc None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:15.352925 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c0a07-6598-4df4-a1d1-f4d35973c2dc None admin] PATH_INFO: `/v3/services` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:15.353900 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c0a07-6598-4df4-a1d1-f4d35973c2dc None admin] RBAC: Adding query filter params (type=image) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:15.354237 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c0a07-6598-4df4-a1d1-f4d35973c2dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:15.355613 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c0a07-6598-4df4-a1d1-f4d35973c2dc None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:15.360480 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 504/1007] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:46:15 2022] GET /identity/v3/services?type=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:15.395308 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815b27a-0240-4f23-81ce-bfd397181065 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:15.395689 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815b27a-0240-4f23-81ce-bfd397181065 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:15.395884 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815b27a-0240-4f23-81ce-bfd397181065 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:15.398115 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 504/1008] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:46:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:46:15.403637 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede0152-35a8-4d82-9ad1-53bda04acc65 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:15.403923 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede0152-35a8-4d82-9ad1-53bda04acc65 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:15.404206 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede0152-35a8-4d82-9ad1-53bda04acc65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:15.422510 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-6ede0152-35a8-4d82-9ad1-53bda04acc65 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:46:15.423661 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-6ede0152-35a8-4d82-9ad1-53bda04acc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:46:15.499221 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 505/1009] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:46:15 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:46:15.523362 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b815b27a-0240-4f23-81ce-bfd397181065 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:15.612990 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:15.633976 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b815b27a-0240-4f23-81ce-bfd397181065 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:15.659565 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38328746-ec53-4e75-ad5c-370086f03fc1 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:15.659861 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38328746-ec53-4e75-ad5c-370086f03fc1 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:15.660149 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38328746-ec53-4e75-ad5c-370086f03fc1 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:15.661560 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 506/1010] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:46:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:46:15.667294 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f18db-ed9b-45da-94de-c4c1e7876b71 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:15.667592 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f18db-ed9b-45da-94de-c4c1e7876b71 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:15.667882 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f18db-ed9b-45da-94de-c4c1e7876b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:15.672075 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ec6ca-80e0-4d8e-b4fc-e7397408bc0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:15.673143 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ec6ca-80e0-4d8e-b4fc-e7397408bc0f None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:15.673380 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ec6ca-80e0-4d8e-b4fc-e7397408bc0f None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:15.674317 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ec6ca-80e0-4d8e-b4fc-e7397408bc0f None admin] PATH_INFO: `/v3/services/compute` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:15.675023 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0ec6ca-80e0-4d8e-b4fc-e7397408bc0f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:15.676411 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0ec6ca-80e0-4d8e-b4fc-e7397408bc0f None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:15.687310 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-9f2f18db-ed9b-45da-94de-c4c1e7876b71 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:46:15.688505 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-9f2f18db-ed9b-45da-94de-c4c1e7876b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:46:15.689259 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-3d0ec6ca-80e0-4d8e-b4fc-e7397408bc0f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 21:46:15.689259 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:15.689259 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:46:15.689259 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:46:15.689259 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:46:15.689259 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:46:15.689259 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:46:15.689259 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:46:15.689259 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 21:46:15.689259 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:46:15.689259 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:46:15.689259 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:46:15.689259 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:15.689259 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:15.689259 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:15.689259 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:15.689259 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:15.690336 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:15.690336 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:15.690336 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:15.690336 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:15.690336 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:15.690336 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:15.690336 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:46:15.690336 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:46:15.690336 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:46:15.690336 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:46:15.690336 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:15.690336 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:15.690336 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:46:15.690336 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:46:15.690336 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:46:15.690336 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:46:15.691265 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:46:15.691265 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:46:15.691265 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:46:15.691265 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:46:15.691265 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:46:15.691265 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:46:15.691265 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:46:15.691265 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:46:15.691265 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:46:15.691265 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:46:15.691265 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:46:15.691265 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:46:15.691265 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 21:46:15.691265 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:46:15.691265 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 505/1011] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:46:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:46:15.697142 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ec6ca-80e0-4d8e-b4fc-e7397408bc0f None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:15.752800 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:15.769643 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 507/1012] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:46:15 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:46:15.793254 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f18db-ed9b-45da-94de-c4c1e7876b71 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:15.812133 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ec6ca-80e0-4d8e-b4fc-e7397408bc0f None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:15.848086 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0f45d-b42c-4429-9e03-22dbc5769884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:15.848765 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0f45d-b42c-4429-9e03-22dbc5769884 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:15.849060 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0f45d-b42c-4429-9e03-22dbc5769884 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:15.849507 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0f45d-b42c-4429-9e03-22dbc5769884 None admin] PATH_INFO: `/v3/services` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:15.850311 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc0f45d-b42c-4429-9e03-22dbc5769884 None admin] RBAC: Adding query filter params (name=compute) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:15.850630 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc0f45d-b42c-4429-9e03-22dbc5769884 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:15.852014 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc0f45d-b42c-4429-9e03-22dbc5769884 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:15.857312 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 506/1013] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Jul 5 21:46:15 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:46:15.862634 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0f45d-b42c-4429-9e03-22dbc5769884 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:15.874355 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:15.905542 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f18db-ed9b-45da-94de-c4c1e7876b71 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:15.943351 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce060c-30d8-4a45-96c9-c0525f56e0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:15.944206 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce060c-30d8-4a45-96c9-c0525f56e0c8 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:15.944499 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce060c-30d8-4a45-96c9-c0525f56e0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:15.944782 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce060c-30d8-4a45-96c9-c0525f56e0c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:15.946066 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce060c-30d8-4a45-96c9-c0525f56e0c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:15.947545 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce060c-30d8-4a45-96c9-c0525f56e0c8 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:15.949198 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 508/1014] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:46:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:15.954807 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce060c-30d8-4a45-96c9-c0525f56e0c8 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:15.968595 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0f45d-b42c-4429-9e03-22dbc5769884 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:16.003939 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1407c7-1b08-4d8e-91e8-322063696aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:16.004617 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1407c7-1b08-4d8e-91e8-322063696aac None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:16.004915 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1407c7-1b08-4d8e-91e8-322063696aac None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:16.005201 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1407c7-1b08-4d8e-91e8-322063696aac None admin] PATH_INFO: `/v3/services` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:16.006411 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1407c7-1b08-4d8e-91e8-322063696aac None admin] RBAC: Adding query filter params (type=compute) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:16.006738 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1407c7-1b08-4d8e-91e8-322063696aac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:16.008125 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1407c7-1b08-4d8e-91e8-322063696aac None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:16.017609 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 507/1015] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Jul 5 21:46:15 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:46:16.018694 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1407c7-1b08-4d8e-91e8-322063696aac None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:16.020465 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:16.068663 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce060c-30d8-4a45-96c9-c0525f56e0c8 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:16.092092 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:16.108950 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f15274-a99e-491d-a709-824662fb6d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:16.109632 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f15274-a99e-491d-a709-824662fb6d25 None admin] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:16.109926 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f15274-a99e-491d-a709-824662fb6d25 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:16.110244 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f15274-a99e-491d-a709-824662fb6d25 None admin] PATH_INFO: `/v3/projects` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:16.110963 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f15274-a99e-491d-a709-824662fb6d25 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:16.112402 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f15274-a99e-491d-a709-824662fb6d25 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:16.124843 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1407c7-1b08-4d8e-91e8-322063696aac None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:16.158226 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55946b-8f0a-4a45-baae-4a26f986aeb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:16.158894 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55946b-8f0a-4a45-baae-4a26f986aeb8 None admin] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:16.159184 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55946b-8f0a-4a45-baae-4a26f986aeb8 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:16.159462 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55946b-8f0a-4a45-baae-4a26f986aeb8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:16.160206 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f55946b-8f0a-4a45-baae-4a26f986aeb8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:16.161572 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f55946b-8f0a-4a45-baae-4a26f986aeb8 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:16.196828 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 509/1016] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Jul 5 21:46:15 2022] POST /identity/v3/projects => generated 311 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:46:16.290722 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 508/1017] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Jul 5 21:46:16 2022] POST /identity/v3/endpoints => generated 334 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:46:17.402862 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44c48d-8fd9-4130-8693-7dea6c012ab1 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:17.403402 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44c48d-8fd9-4130-8693-7dea6c012ab1 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:17.403402 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44c48d-8fd9-4130-8693-7dea6c012ab1 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:17.404859 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 510/1018] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:46:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:46:17.409970 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed20b49-eba9-4516-acdb-3799640ef973 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:17.410452 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed20b49-eba9-4516-acdb-3799640ef973 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:17.410602 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed20b49-eba9-4516-acdb-3799640ef973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:17.428747 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-4ed20b49-eba9-4516-acdb-3799640ef973 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:46:17.429968 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-4ed20b49-eba9-4516-acdb-3799640ef973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:46:17.507344 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 509/1019] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:46:17 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:46:17.530733 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c44c48d-8fd9-4130-8693-7dea6c012ab1 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:17.638978 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c44c48d-8fd9-4130-8693-7dea6c012ab1 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:17.647896 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:17.672630 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e5eb14-a417-42e7-8928-9923b0fabde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:17.673234 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5eb14-a417-42e7-8928-9923b0fabde7 None admin] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:17.673574 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5eb14-a417-42e7-8928-9923b0fabde7 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:17.673799 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5eb14-a417-42e7-8928-9923b0fabde7 None admin] PATH_INFO: `/v3/services` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:17.674563 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e5eb14-a417-42e7-8928-9923b0fabde7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:17.675944 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e5eb14-a417-42e7-8928-9923b0fabde7 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:17.750155 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 511/1020] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Jul 5 21:46:17 2022] POST /identity/v3/services => generated 242 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:46:18.291647 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59610e1-82e7-4ce2-89f2-282bbc6ac615 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:18.292045 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59610e1-82e7-4ce2-89f2-282bbc6ac615 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:18.292238 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59610e1-82e7-4ce2-89f2-282bbc6ac615 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:18.293642 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 510/1021] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:46:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:46:18.298898 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c826db-26b0-47ad-bef5-4ce542631ab1 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:18.299270 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c826db-26b0-47ad-bef5-4ce542631ab1 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:18.299634 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c826db-26b0-47ad-bef5-4ce542631ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:18.317585 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-03c826db-26b0-47ad-bef5-4ce542631ab1 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:46:18.319419 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-03c826db-26b0-47ad-bef5-4ce542631ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:46:18.396810 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 512/1022] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:46:18 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:46:18.421739 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59610e1-82e7-4ce2-89f2-282bbc6ac615 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:18.457860 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279af5a1-f3b4-4f04-9bda-e98ccbda5922 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:18.458634 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279af5a1-f3b4-4f04-9bda-e98ccbda5922 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:18.458634 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279af5a1-f3b4-4f04-9bda-e98ccbda5922 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:18.459896 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 513/1023] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:46:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:46:18.465023 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee876da-95a3-4906-a214-bbac12c4f205 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:18.465383 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee876da-95a3-4906-a214-bbac12c4f205 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:18.465735 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee876da-95a3-4906-a214-bbac12c4f205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:18.484411 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-cee876da-95a3-4906-a214-bbac12c4f205 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:46:18.485568 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:18.485691 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-cee876da-95a3-4906-a214-bbac12c4f205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:46:18.541884 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59610e1-82e7-4ce2-89f2-282bbc6ac615 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:18.561566 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 514/1024] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:46:18 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:46:18.582253 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff30dc-b192-4b1d-bdad-15c8068f71ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:18.583057 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff30dc-b192-4b1d-bdad-15c8068f71ae None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:18.583441 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff30dc-b192-4b1d-bdad-15c8068f71ae None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:18.583745 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff30dc-b192-4b1d-bdad-15c8068f71ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:18.584637 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee876da-95a3-4906-a214-bbac12c4f205 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:18.584974 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff30dc-b192-4b1d-bdad-15c8068f71ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:18.586734 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff30dc-b192-4b1d-bdad-15c8068f71ae None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:18.588580 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 511/1025] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:46:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:18.593807 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff30dc-b192-4b1d-bdad-15c8068f71ae None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:18.613541 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:18.692128 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee876da-95a3-4906-a214-bbac12c4f205 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:18.699347 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff30dc-b192-4b1d-bdad-15c8068f71ae None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:18.724901 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:18.728007 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a826bc-6f89-4831-bee6-78a2372fd108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:18.729363 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a826bc-6f89-4831-bee6-78a2372fd108 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:18.729656 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a826bc-6f89-4831-bee6-78a2372fd108 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:18.729938 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a826bc-6f89-4831-bee6-78a2372fd108 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:18.740553 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaeee74-faa6-4656-90e2-ee580e6c6db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:18.741240 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaeee74-faa6-4656-90e2-ee580e6c6db9 None admin] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:18.741530 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaeee74-faa6-4656-90e2-ee580e6c6db9 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:18.741812 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaeee74-faa6-4656-90e2-ee580e6c6db9 None admin] PATH_INFO: `/v3/users` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:18.742593 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaeee74-faa6-4656-90e2-ee580e6c6db9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:18.743292 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a826bc-6f89-4831-bee6-78a2372fd108 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:46:18.744034 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaeee74-faa6-4656-90e2-ee580e6c6db9 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:18.751683 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-b9a826bc-6f89-4831-bee6-78a2372fd108 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 21:46:18.751683 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:18.751683 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:18.751683 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:18.751683 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:18.751683 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:18.751683 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:18.751683 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:18.751683 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:18.751683 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:18.751683 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:18.751683 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:18.751683 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:46:18.751683 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:46:18.751683 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:46:18.751683 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:46:18.752900 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:46:18.752900 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:46:18.752900 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:46:18.752900 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:46:18.752900 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:18.752900 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:18.752900 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:46:18.752900 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:46:18.752900 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:46:18.752900 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:46:18.752900 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:46:18.752900 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:46:18.752900 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:46:18.752900 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:46:18.752900 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:46:18.752900 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:46:18.754044 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:46:18.754044 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:46:18.754044 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:46:18.754044 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:46:18.754044 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:46:18.754044 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:46:18.754044 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:46:18.754044 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:46:18.754044 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:46:18.754044 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:46:18.754044 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 21:46:18.754044 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:46:18.754812 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 515/1026] 10.222.0.30 () {56 vars in 1120 bytes} [Tue Jul 5 21:46:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:46:18.760799 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a826bc-6f89-4831-bee6-78a2372fd108 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:18.830614 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 512/1027] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:46:18 2022] POST /identity/v3/users => generated 285 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:46:18.852277 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:18.872676 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a826bc-6f89-4831-bee6-78a2372fd108 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:18.912721 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263c410-635c-475b-856e-0b5a2c4e43db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:18.913421 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263c410-635c-475b-856e-0b5a2c4e43db None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:18.913713 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263c410-635c-475b-856e-0b5a2c4e43db None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:18.913997 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263c410-635c-475b-856e-0b5a2c4e43db None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:18.914823 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4263c410-635c-475b-856e-0b5a2c4e43db None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:18.915137 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4263c410-635c-475b-856e-0b5a2c4e43db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:18.916564 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4263c410-635c-475b-856e-0b5a2c4e43db None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:18.925990 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 516/1028] 10.222.0.30 () {56 vars in 1115 bytes} [Tue Jul 5 21:46:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:46:18.932504 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaeee74-faa6-4656-90e2-ee580e6c6db9 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:19.042877 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaeee74-faa6-4656-90e2-ee580e6c6db9 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:19.080384 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e0c4c-2aa1-4453-865c-42e1beebe3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:19.081273 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e0c4c-2aa1-4453-865c-42e1beebe3b8 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:19.081488 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e0c4c-2aa1-4453-865c-42e1beebe3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:19.081771 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e0c4c-2aa1-4453-865c-42e1beebe3b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:19.093627 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e0c4c-2aa1-4453-865c-42e1beebe3b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:19.095152 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e0c4c-2aa1-4453-865c-42e1beebe3b8 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:19.113141 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-840e0c4c-2aa1-4453-865c-42e1beebe3b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:46:19.113141 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:19.113141 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:19.113141 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:19.113141 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:19.113141 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:19.113141 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:19.113141 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:19.113141 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:19.113141 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:19.113141 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:19.113141 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:19.113141 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:46:19.113141 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:46:19.113141 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:46:19.114413 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:46:19.114413 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:19.114413 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:19.114413 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:46:19.114413 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:46:19.114413 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:46:19.114413 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:46:19.114413 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:46:19.114413 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:46:19.114413 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:46:19.114413 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:46:19.114413 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:46:19.114413 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:46:19.114413 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:46:19.114413 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:46:19.114413 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:46:19.114413 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:46:19.116067 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:46:19.116067 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:46:19.116067 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:46:19.116067 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:46:19.116067 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 513/1029] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:46:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:46:19.122171 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263c410-635c-475b-856e-0b5a2c4e43db None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:19.224726 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263c410-635c-475b-856e-0b5a2c4e43db None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:19.260362 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226499ec-58a5-4e1f-936d-c19a3ba727c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:19.261036 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226499ec-58a5-4e1f-936d-c19a3ba727c0 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:19.261319 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226499ec-58a5-4e1f-936d-c19a3ba727c0 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:19.261596 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226499ec-58a5-4e1f-936d-c19a3ba727c0 None admin] PATH_INFO: `/v3/domains` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:19.262485 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226499ec-58a5-4e1f-936d-c19a3ba727c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:19.262796 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226499ec-58a5-4e1f-936d-c19a3ba727c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:19.264206 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226499ec-58a5-4e1f-936d-c19a3ba727c0 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:19.281335 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 517/1030] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:46:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:19.282731 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e0c4c-2aa1-4453-865c-42e1beebe3b8 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:19.315409 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:19.391592 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e0c4c-2aa1-4453-865c-42e1beebe3b8 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:19.426800 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb53dc-1258-4f5a-bd64-61965ea32c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:19.428254 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb53dc-1258-4f5a-bd64-61965ea32c96 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:19.428514 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb53dc-1258-4f5a-bd64-61965ea32c96 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:19.428791 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb53dc-1258-4f5a-bd64-61965ea32c96 None admin] PATH_INFO: `/v3/users/nova` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:19.436533 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb53dc-1258-4f5a-bd64-61965ea32c96 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:19.437986 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb53dc-1258-4f5a-bd64-61965ea32c96 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:19.452753 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-99bb53dc-1258-4f5a-bd64-61965ea32c96 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:46:19.452753 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:19.452753 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:19.452753 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:19.452753 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:19.452753 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:19.452753 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:19.452753 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:19.452753 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:19.452753 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:19.452753 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:19.452753 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:19.452753 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:46:19.452753 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:46:19.452753 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:46:19.452753 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:46:19.453931 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:19.453931 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:19.453931 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:46:19.453931 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:46:19.453931 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:46:19.453931 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:46:19.453931 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:46:19.453931 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:46:19.453931 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:46:19.453931 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:46:19.453931 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:46:19.453931 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:46:19.453931 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:46:19.453931 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:46:19.453931 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:46:19.453931 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:46:19.453931 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:46:19.453931 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:46:19.455486 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:46:19.455486 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:46:19.455486 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:46:19.455486 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:46:19.455486 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:46:19.455486 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:46:19.455486 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:46:19.455486 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:46:19.455486 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:46:19.455486 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:46:19.458580 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 514/1031] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Jul 5 21:46:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:46:19.459728 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226499ec-58a5-4e1f-936d-c19a3ba727c0 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:19.470785 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:19.573063 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226499ec-58a5-4e1f-936d-c19a3ba727c0 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:19.609206 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b285d7f-35fa-43e2-9d38-f39685d8f67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:19.610184 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b285d7f-35fa-43e2-9d38-f39685d8f67d None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:19.610773 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b285d7f-35fa-43e2-9d38-f39685d8f67d None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:19.611364 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b285d7f-35fa-43e2-9d38-f39685d8f67d None admin] PATH_INFO: `/v3/users` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:19.612378 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b285d7f-35fa-43e2-9d38-f39685d8f67d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:19.612862 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b285d7f-35fa-43e2-9d38-f39685d8f67d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:19.614496 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b285d7f-35fa-43e2-9d38-f39685d8f67d None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:19.633774 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 518/1032] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Jul 5 21:46:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:46:19.639531 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb53dc-1258-4f5a-bd64-61965ea32c96 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:19.736034 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:19.746402 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb53dc-1258-4f5a-bd64-61965ea32c96 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:19.782563 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a92d4-579c-4888-a214-8ca09e07005f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:19.783220 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a92d4-579c-4888-a214-8ca09e07005f None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:19.783512 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a92d4-579c-4888-a214-8ca09e07005f None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:19.783793 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a92d4-579c-4888-a214-8ca09e07005f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:19.838340 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c05b33-9167-4975-98a9-e04e424bc7e2 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:19.838661 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c05b33-9167-4975-98a9-e04e424bc7e2 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:19.838930 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c05b33-9167-4975-98a9-e04e424bc7e2 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:19.840543 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 519/1033] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:46:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:46:19.845128 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4a2a9-d1fc-4052-9671-f2f4d6484f83 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:19.845427 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4a2a9-d1fc-4052-9671-f2f4d6484f83 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:19.845716 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4a2a9-d1fc-4052-9671-f2f4d6484f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:19.855823 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a92d4-579c-4888-a214-8ca09e07005f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:19.857365 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a92d4-579c-4888-a214-8ca09e07005f None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:19.863449 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-a2e4a2a9-d1fc-4052-9671-f2f4d6484f83 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:46:19.865259 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-a2e4a2a9-d1fc-4052-9671-f2f4d6484f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:46:19.925122 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:19.933970 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 520/1034] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:46:19 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:46:19.956207 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:19.957275 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e4a2a9-d1fc-4052-9671-f2f4d6484f83 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:19.973349 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 515/1035] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:46:19 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:46:19.974934 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a92d4-579c-4888-a214-8ca09e07005f None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:20.077557 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e4a2a9-d1fc-4052-9671-f2f4d6484f83 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:20.084572 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a92d4-579c-4888-a214-8ca09e07005f None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:20.114013 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c48689-8884-456b-8613-846061be8d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:20.114875 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c48689-8884-456b-8613-846061be8d67 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:20.115169 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c48689-8884-456b-8613-846061be8d67 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:20.115458 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c48689-8884-456b-8613-846061be8d67 None admin] PATH_INFO: `/v3/services/image` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:20.116121 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c48689-8884-456b-8613-846061be8d67 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:20.117503 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c48689-8884-456b-8613-846061be8d67 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:20.123850 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd3ea47-5754-4bec-8217-ebcaf762811f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:20.124894 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3ea47-5754-4bec-8217-ebcaf762811f None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:20.125393 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3ea47-5754-4bec-8217-ebcaf762811f None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:20.125878 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3ea47-5754-4bec-8217-ebcaf762811f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:20.129397 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-c2c48689-8884-456b-8613-846061be8d67 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 21:46:20.129397 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:20.129397 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:46:20.129397 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:46:20.129397 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:46:20.129397 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:46:20.129397 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:46:20.129397 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:46:20.129397 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 21:46:20.129397 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:46:20.129397 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:46:20.129397 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:46:20.129397 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:20.129397 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:20.129397 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:20.129397 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:20.129397 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:20.136682 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:20.136682 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:20.136682 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:20.136682 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:20.136682 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:20.136682 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:20.136682 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:46:20.136682 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:46:20.136682 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:46:20.136682 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:46:20.136682 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:20.136682 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:20.136682 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:46:20.136682 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:46:20.136682 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:46:20.136682 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:46:20.137649 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:46:20.137649 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:46:20.137649 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:46:20.137649 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:46:20.137649 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:46:20.137649 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:46:20.137649 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:46:20.137649 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:46:20.137649 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:46:20.137649 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:46:20.137649 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:46:20.137649 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:46:20.137649 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 21:46:20.137649 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:46:20.137649 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 521/1036] 10.222.0.30 () {56 vars in 1105 bytes} [Tue Jul 5 21:46:19 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:46:20.138591 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c48689-8884-456b-8613-846061be8d67 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:20.138687 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd3ea47-5754-4bec-8217-ebcaf762811f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:20.139898 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd3ea47-5754-4bec-8217-ebcaf762811f None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:20.159925 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-9fd3ea47-5754-4bec-8217-ebcaf762811f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:46:20.159925 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:20.159925 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:20.159925 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:20.159925 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:20.159925 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:20.159925 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:20.159925 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:20.159925 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:20.159925 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:20.159925 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:20.159925 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:20.159925 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:46:20.159925 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:46:20.159925 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:46:20.160938 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:46:20.160938 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:20.160938 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:20.160938 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:46:20.160938 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:46:20.160938 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:46:20.160938 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:46:20.160938 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:46:20.160938 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:46:20.160938 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:46:20.160938 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:46:20.160938 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:46:20.160938 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:46:20.160938 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:46:20.160938 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:46:20.160938 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:46:20.160938 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:46:20.161956 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:46:20.161956 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:46:20.161956 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:46:20.161956 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:46:20.166280 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 516/1037] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:46:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:46:20.168149 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd3ea47-5754-4bec-8217-ebcaf762811f None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:20.204246 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:20.216821 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:20.247020 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c48689-8884-456b-8613-846061be8d67 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:20.277065 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd3ea47-5754-4bec-8217-ebcaf762811f None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:20.282783 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07754a2-2e1f-4666-8001-f1cc831c6eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:20.283496 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07754a2-2e1f-4666-8001-f1cc831c6eb3 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:20.283828 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07754a2-2e1f-4666-8001-f1cc831c6eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:20.284137 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07754a2-2e1f-4666-8001-f1cc831c6eb3 None admin] PATH_INFO: `/v3/services` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:20.284882 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07754a2-2e1f-4666-8001-f1cc831c6eb3 None admin] RBAC: Adding query filter params (name=image) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:20.285190 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07754a2-2e1f-4666-8001-f1cc831c6eb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:20.286855 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07754a2-2e1f-4666-8001-f1cc831c6eb3 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:20.292388 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 522/1038] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:46:20 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:46:20.297835 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07754a2-2e1f-4666-8001-f1cc831c6eb3 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:20.322460 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ead0d1-16c4-428a-811a-b978a1c60050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:20.323148 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ead0d1-16c4-428a-811a-b978a1c60050 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:20.323442 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ead0d1-16c4-428a-811a-b978a1c60050 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:20.323729 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ead0d1-16c4-428a-811a-b978a1c60050 None admin] PATH_INFO: `/v3/domains` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:20.324474 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ead0d1-16c4-428a-811a-b978a1c60050 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:20.324790 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ead0d1-16c4-428a-811a-b978a1c60050 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:20.326224 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ead0d1-16c4-428a-811a-b978a1c60050 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:20.338980 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 517/1039] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:46:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:20.344388 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ead0d1-16c4-428a-811a-b978a1c60050 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:20.409727 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07754a2-2e1f-4666-8001-f1cc831c6eb3 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:20.433038 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:20.446459 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e4864c-b722-4eb5-ba66-936a30d7c392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:20.447720 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4864c-b722-4eb5-ba66-936a30d7c392 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:20.447720 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4864c-b722-4eb5-ba66-936a30d7c392 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:20.447962 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4864c-b722-4eb5-ba66-936a30d7c392 None admin] PATH_INFO: `/v3/services` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:20.448494 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e4864c-b722-4eb5-ba66-936a30d7c392 None admin] RBAC: Adding query filter params (type=image) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:20.448812 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e4864c-b722-4eb5-ba66-936a30d7c392 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:20.450214 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e4864c-b722-4eb5-ba66-936a30d7c392 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:20.455333 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 523/1040] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:46:20 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:20.456341 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ead0d1-16c4-428a-811a-b978a1c60050 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:20.457962 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:20.462457 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e4864c-b722-4eb5-ba66-936a30d7c392 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:20.498400 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e5132-3df0-4777-8f8e-dedfe203ed7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:20.499237 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e5132-3df0-4777-8f8e-dedfe203ed7d None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:20.499603 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e5132-3df0-4777-8f8e-dedfe203ed7d None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:20.499883 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e5132-3df0-4777-8f8e-dedfe203ed7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:20.507240 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e5132-3df0-4777-8f8e-dedfe203ed7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:20.508820 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e5132-3df0-4777-8f8e-dedfe203ed7d None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:20.524129 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-c80e5132-3df0-4777-8f8e-dedfe203ed7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:46:20.524129 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:20.524129 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:20.524129 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:20.524129 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:20.524129 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:20.524129 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:20.524129 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:20.524129 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:20.524129 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:20.524129 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:20.524129 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:20.524129 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:46:20.524129 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:46:20.524129 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:46:20.525230 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:46:20.525230 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:20.525230 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:20.525230 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:46:20.525230 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:46:20.525230 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:46:20.525230 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:46:20.525230 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:46:20.525230 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:46:20.525230 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:46:20.525230 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:46:20.525230 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:46:20.525230 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:46:20.525230 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:46:20.525230 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:46:20.525230 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:46:20.525230 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:46:20.526603 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:46:20.526603 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:46:20.526603 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:46:20.526603 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:46:20.526603 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:46:20.526603 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:46:20.526603 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:46:20.526603 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:46:20.526603 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 518/1041] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:46:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:46:20.531148 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e5132-3df0-4777-8f8e-dedfe203ed7d None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:20.578756 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e4864c-b722-4eb5-ba66-936a30d7c392 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:20.614525 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceca855-6a2c-456b-a9e4-880edc42d3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:20.615887 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceca855-6a2c-456b-a9e4-880edc42d3e9 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:20.616403 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceca855-6a2c-456b-a9e4-880edc42d3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:20.616922 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceca855-6a2c-456b-a9e4-880edc42d3e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:20.618331 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceca855-6a2c-456b-a9e4-880edc42d3e9 None admin] RBAC: Adding query filter params (interface=public, service_id=419c5a5c8f8d434b8addd676e12a88ea, region_id=RegionOne) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:20.618657 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceca855-6a2c-456b-a9e4-880edc42d3e9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:20.620048 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceca855-6a2c-456b-a9e4-880edc42d3e9 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:20.625320 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 524/1042] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Jul 5 21:46:20 2022] GET /identity/v3/endpoints?service_id=419c5a5c8f8d434b8addd676e12a88ea&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:46:20.631475 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceca855-6a2c-456b-a9e4-880edc42d3e9 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:20.654783 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e5132-3df0-4777-8f8e-dedfe203ed7d None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:20.682443 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:20.692483 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6cf12-d959-4d25-b1d8-bfd3af717abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:20.693298 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6cf12-d959-4d25-b1d8-bfd3af717abd None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:20.693703 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6cf12-d959-4d25-b1d8-bfd3af717abd None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:20.693998 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6cf12-d959-4d25-b1d8-bfd3af717abd None admin] PATH_INFO: `/v3/projects` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:20.694826 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d6cf12-d959-4d25-b1d8-bfd3af717abd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:20.695148 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d6cf12-d959-4d25-b1d8-bfd3af717abd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:20.696581 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d6cf12-d959-4d25-b1d8-bfd3af717abd None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:20.709133 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 519/1043] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:46:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:46:20.715033 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6cf12-d959-4d25-b1d8-bfd3af717abd None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:20.739867 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:20.743384 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceca855-6a2c-456b-a9e4-880edc42d3e9 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:20.781040 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1030d431-4c7e-488c-95a8-e2dabcdf4442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:20.782072 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1030d431-4c7e-488c-95a8-e2dabcdf4442 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:20.782602 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1030d431-4c7e-488c-95a8-e2dabcdf4442 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:20.783116 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1030d431-4c7e-488c-95a8-e2dabcdf4442 None admin] PATH_INFO: `/v3/services` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:20.784133 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1030d431-4c7e-488c-95a8-e2dabcdf4442 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:20.785863 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1030d431-4c7e-488c-95a8-e2dabcdf4442 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:20.793487 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 525/1044] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Jul 5 21:46:20 2022] GET /identity/v3/services => generated 1957 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:46:20.836260 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6cf12-d959-4d25-b1d8-bfd3af717abd None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:20.886189 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d712cd9-702f-488a-8c26-8876fbe3ed98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:20.886805 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d712cd9-702f-488a-8c26-8876fbe3ed98 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:20.890154 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d712cd9-702f-488a-8c26-8876fbe3ed98 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:20.890154 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d712cd9-702f-488a-8c26-8876fbe3ed98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:20.890154 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d712cd9-702f-488a-8c26-8876fbe3ed98 None admin] RBAC: Adding query filter params (role.id=551482a278b94c70a5183d8bcfa58d9b, scope.project.id=93f20f89d0fc4bbf9cf557dd1e14d98d, user.id=f5d82e71aafe4b6ebcf60c23c050aafb) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:20.890154 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d712cd9-702f-488a-8c26-8876fbe3ed98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:20.890154 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d712cd9-702f-488a-8c26-8876fbe3ed98 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:20.897650 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 520/1045] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:46:20 2022] GET /identity/v3/role_assignments?user.id=f5d82e71aafe4b6ebcf60c23c050aafb&scope.project.id=93f20f89d0fc4bbf9cf557dd1e14d98d&role.id=551482a278b94c70a5183d8bcfa58d9b => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:46:20.990044 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c091b3-2425-4b2f-98b5-714777825379 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:20.990530 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c091b3-2425-4b2f-98b5-714777825379 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:20.990742 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c091b3-2425-4b2f-98b5-714777825379 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:20.992457 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 526/1046] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:46:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:46:20.998484 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042b032-92e5-418c-9932-7836d08636b2 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:20.999102 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042b032-92e5-418c-9932-7836d08636b2 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:20.999604 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042b032-92e5-418c-9932-7836d08636b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:21.023890 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-f042b032-92e5-418c-9932-7836d08636b2 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:46:21.025133 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-f042b032-92e5-418c-9932-7836d08636b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:46:21.106330 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 521/1047] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:46:20 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:46:21.130250 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c091b3-2425-4b2f-98b5-714777825379 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:21.247566 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c091b3-2425-4b2f-98b5-714777825379 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:21.263279 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:21.286382 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c641cee-289a-4fa6-ae57-67a88209f803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:21.287257 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c641cee-289a-4fa6-ae57-67a88209f803 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:21.287577 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c641cee-289a-4fa6-ae57-67a88209f803 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:21.287831 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c641cee-289a-4fa6-ae57-67a88209f803 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:21.299384 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c641cee-289a-4fa6-ae57-67a88209f803 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:46:21.307848 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-6c641cee-289a-4fa6-ae57-67a88209f803 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:46:21.307848 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:21.307848 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:21.307848 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:21.307848 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:21.307848 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:21.307848 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:21.307848 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:21.307848 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:21.307848 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:21.307848 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:21.307848 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:21.307848 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:46:21.307848 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:46:21.307848 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:46:21.307848 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:46:21.309093 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:46:21.309093 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:46:21.309093 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:46:21.309093 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:46:21.309093 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:21.309093 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:21.309093 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:46:21.309093 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:46:21.309093 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:46:21.309093 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:46:21.309093 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:46:21.309093 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:46:21.309093 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:46:21.309093 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:46:21.309093 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:46:21.309093 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:46:21.310075 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:46:21.310075 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:46:21.310075 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:46:21.310075 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:46:21.310075 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:46:21.310075 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:46:21.310075 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:46:21.310075 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:46:21.310075 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:46:21.310075 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:46:21.310075 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:46:21.310075 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:46:21.314102 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 527/1048] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:46:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:46:21.315363 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f042b032-92e5-418c-9932-7836d08636b2 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:21.335068 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:21.421408 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f042b032-92e5-418c-9932-7836d08636b2 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:21.457215 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee3f27-5741-49d0-a74e-9d9eafc9976a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:21.457971 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee3f27-5741-49d0-a74e-9d9eafc9976a None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:21.458278 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee3f27-5741-49d0-a74e-9d9eafc9976a None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:21.459280 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee3f27-5741-49d0-a74e-9d9eafc9976a None admin] PATH_INFO: `/v3/roles` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:21.460308 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adee3f27-5741-49d0-a74e-9d9eafc9976a None admin] RBAC: Adding query filter params (name=admin) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:21.460625 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adee3f27-5741-49d0-a74e-9d9eafc9976a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:21.462015 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adee3f27-5741-49d0-a74e-9d9eafc9976a None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:21.471074 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 522/1049] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:46:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:21.477159 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c641cee-289a-4fa6-ae57-67a88209f803 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:21.591841 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c641cee-289a-4fa6-ae57-67a88209f803 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:21.626656 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1e4fc-eb25-47ab-ae26-1338c2f9df45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:21.627542 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1e4fc-eb25-47ab-ae26-1338c2f9df45 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:21.627832 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1e4fc-eb25-47ab-ae26-1338c2f9df45 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:21.628114 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1e4fc-eb25-47ab-ae26-1338c2f9df45 None admin] PATH_INFO: `/v3/users/f70f62246ea34f9f90446fa6de349d8f` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:21.642027 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea1e4fc-eb25-47ab-ae26-1338c2f9df45 None admin] RBAC: Authorizing `identity:get_user(user_id=f70f62246ea34f9f90446fa6de349d8f)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:21.643507 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea1e4fc-eb25-47ab-ae26-1338c2f9df45 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:21.645371 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 528/1050] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:46:21 2022] GET /identity/v3/users/f70f62246ea34f9f90446fa6de349d8f => generated 285 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:21.651639 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee3f27-5741-49d0-a74e-9d9eafc9976a None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:21.730524 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:21.752640 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee3f27-5741-49d0-a74e-9d9eafc9976a None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:21.788066 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392dda52-cd75-4883-aa1c-4570dbce02b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:21.788929 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392dda52-cd75-4883-aa1c-4570dbce02b6 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:21.789395 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392dda52-cd75-4883-aa1c-4570dbce02b6 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:21.789864 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392dda52-cd75-4883-aa1c-4570dbce02b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:21.859940 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392dda52-cd75-4883-aa1c-4570dbce02b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:21.861616 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392dda52-cd75-4883-aa1c-4570dbce02b6 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:21.941557 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:21.970597 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 523/1051] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:46:21 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:46:21.971875 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1e4fc-eb25-47ab-ae26-1338c2f9df45 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:22.005439 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:22.079486 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1e4fc-eb25-47ab-ae26-1338c2f9df45 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:22.113447 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeaadc6-e591-47be-a12d-f0c46e7bdfa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:22.114266 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeaadc6-e591-47be-a12d-f0c46e7bdfa5 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:22.114555 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeaadc6-e591-47be-a12d-f0c46e7bdfa5 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:22.115583 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeaadc6-e591-47be-a12d-f0c46e7bdfa5 None admin] PATH_INFO: `/v3/projects/c8894364421e4fcfbe7a54e4cd82bf90` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:22.116783 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeaadc6-e591-47be-a12d-f0c46e7bdfa5 None admin] RBAC: Authorizing `identity:get_project(project_id=c8894364421e4fcfbe7a54e4cd82bf90)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:22.118245 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeaadc6-e591-47be-a12d-f0c46e7bdfa5 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:22.120149 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 529/1052] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:46:21 2022] GET /identity/v3/projects/c8894364421e4fcfbe7a54e4cd82bf90 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:46:22.125955 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392dda52-cd75-4883-aa1c-4570dbce02b6 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:22.226462 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392dda52-cd75-4883-aa1c-4570dbce02b6 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:22.261180 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3e0d0-8147-422b-92c4-090920eac9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:22.261831 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3e0d0-8147-422b-92c4-090920eac9bc None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:22.262120 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3e0d0-8147-422b-92c4-090920eac9bc None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:22.262424 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3e0d0-8147-422b-92c4-090920eac9bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:22.263311 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f3e0d0-8147-422b-92c4-090920eac9bc None admin] RBAC: Adding query filter params (role.id=e1c574c9973548ebb0e8d9e0656ccabd, scope.project.id=c8894364421e4fcfbe7a54e4cd82bf90, user.id=f70f62246ea34f9f90446fa6de349d8f) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:22.263667 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f3e0d0-8147-422b-92c4-090920eac9bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:22.265171 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f3e0d0-8147-422b-92c4-090920eac9bc None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:22.271007 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 524/1053] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:46:22 2022] GET /identity/v3/role_assignments?user.id=f70f62246ea34f9f90446fa6de349d8f&scope.project.id=c8894364421e4fcfbe7a54e4cd82bf90&role.id=e1c574c9973548ebb0e8d9e0656ccabd => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:22.905163 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b352b-54c3-404b-9d13-c0f8a1dbd21a None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:22.905668 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b352b-54c3-404b-9d13-c0f8a1dbd21a None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:22.905668 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b352b-54c3-404b-9d13-c0f8a1dbd21a None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:22.907233 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 530/1054] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:46:22.913324 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d568e-f476-4cf5-a2c5-b2fe50a6eca2 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:22.913785 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d568e-f476-4cf5-a2c5-b2fe50a6eca2 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:22.913968 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d568e-f476-4cf5-a2c5-b2fe50a6eca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:22.931286 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-c89d568e-f476-4cf5-a2c5-b2fe50a6eca2 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:46:22.932482 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-c89d568e-f476-4cf5-a2c5-b2fe50a6eca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:46:22.954535 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b706a6-498f-41ae-89b0-f38d615a02fb None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:22.954866 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b706a6-498f-41ae-89b0-f38d615a02fb None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:22.955096 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b706a6-498f-41ae-89b0-f38d615a02fb None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:22.956627 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 531/1055] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:46:22.962172 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f94379-f26b-46ce-8432-f57640eca1ad None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:22.962465 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f94379-f26b-46ce-8432-f57640eca1ad None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:22.962740 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f94379-f26b-46ce-8432-f57640eca1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:22.969652 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:22.980845 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-94f94379-f26b-46ce-8432-f57640eca1ad None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:46:22.982295 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-94f94379-f26b-46ce-8432-f57640eca1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:46:23.003662 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 525/1056] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:46:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:46:23.027189 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d568e-f476-4cf5-a2c5-b2fe50a6eca2 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:23.054649 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 532/1057] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:46:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:46:23.078139 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f94379-f26b-46ce-8432-f57640eca1ad None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:23.110370 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:23.132131 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d568e-f476-4cf5-a2c5-b2fe50a6eca2 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:23.167940 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa76f10-37f2-4546-93b5-8a1aa8133992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:23.168666 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa76f10-37f2-4546-93b5-8a1aa8133992 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:23.168958 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa76f10-37f2-4546-93b5-8a1aa8133992 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:23.169239 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa76f10-37f2-4546-93b5-8a1aa8133992 None admin] PATH_INFO: `/v3/services/image` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:23.169899 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa76f10-37f2-4546-93b5-8a1aa8133992 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:23.171320 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa76f10-37f2-4546-93b5-8a1aa8133992 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:23.183037 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-1aa76f10-37f2-4546-93b5-8a1aa8133992 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 21:46:23.183037 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:23.183037 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:46:23.183037 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:46:23.183037 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:46:23.183037 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:46:23.183037 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:46:23.183037 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:46:23.183037 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 21:46:23.183037 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:46:23.183037 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:46:23.183037 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:46:23.183037 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:23.183037 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:23.183037 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:23.183037 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:23.183037 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:23.184107 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:23.184107 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:23.184107 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:23.184107 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:23.184107 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:23.184107 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:23.184107 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:46:23.184107 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:46:23.184107 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:46:23.184107 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:46:23.184107 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:23.184107 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:23.184107 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:46:23.184107 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:46:23.184107 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:46:23.184107 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:46:23.185059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:46:23.185059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:46:23.185059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:46:23.185059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:46:23.185059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:46:23.185059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:46:23.185059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:46:23.185059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:46:23.185059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:46:23.185059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:46:23.185059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:46:23.185059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:46:23.185059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 21:46:23.185059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:46:23.185059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 526/1058] 10.222.0.30 () {56 vars in 1105 bytes} [Tue Jul 5 21:46:23 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:46:23.188687 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f94379-f26b-46ce-8432-f57640eca1ad None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:23.190120 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa76f10-37f2-4546-93b5-8a1aa8133992 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:23.225988 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818ac1f-778e-4f5c-bef9-e20d5c43845a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:23.226846 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818ac1f-778e-4f5c-bef9-e20d5c43845a None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:23.227139 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818ac1f-778e-4f5c-bef9-e20d5c43845a None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:23.227419 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818ac1f-778e-4f5c-bef9-e20d5c43845a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:23.229023 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:23.242808 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d818ac1f-778e-4f5c-bef9-e20d5c43845a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:46:23.251231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-d818ac1f-778e-4f5c-bef9-e20d5c43845a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 21:46:23.251231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:23.251231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:23.251231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:23.251231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:23.251231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:23.251231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:23.251231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:23.251231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:23.251231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:23.251231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:23.251231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:23.251231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:46:23.251231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:46:23.251231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:46:23.251231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:46:23.252474 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:46:23.252474 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:46:23.252474 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:46:23.252474 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:46:23.252474 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:23.252474 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:23.252474 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:46:23.252474 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:46:23.252474 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:46:23.252474 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:46:23.252474 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:46:23.252474 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:46:23.252474 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:46:23.252474 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:46:23.252474 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:46:23.252474 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:46:23.255969 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:46:23.255969 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:46:23.255969 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:46:23.255969 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:46:23.255969 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:46:23.255969 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:46:23.255969 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:46:23.255969 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:46:23.255969 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:46:23.255969 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:46:23.255969 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 21:46:23.255969 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:46:23.255969 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 533/1059] 10.222.0.30 () {56 vars in 1120 bytes} [Tue Jul 5 21:46:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:46:23.260054 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818ac1f-778e-4f5c-bef9-e20d5c43845a None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:23.306694 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa76f10-37f2-4546-93b5-8a1aa8133992 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:23.343108 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8126cf7-4f15-4c3d-86f3-4583c2261dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:23.343783 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8126cf7-4f15-4c3d-86f3-4583c2261dd8 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:23.344088 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8126cf7-4f15-4c3d-86f3-4583c2261dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:23.344349 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8126cf7-4f15-4c3d-86f3-4583c2261dd8 None admin] PATH_INFO: `/v3/services` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:23.345068 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8126cf7-4f15-4c3d-86f3-4583c2261dd8 None admin] RBAC: Adding query filter params (name=image) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:23.345377 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8126cf7-4f15-4c3d-86f3-4583c2261dd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:23.346827 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8126cf7-4f15-4c3d-86f3-4583c2261dd8 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:23.352007 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 527/1060] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:46:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:46:23.357810 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8126cf7-4f15-4c3d-86f3-4583c2261dd8 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:23.375324 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:23.387593 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818ac1f-778e-4f5c-bef9-e20d5c43845a None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:23.427670 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8fa68e-3901-445c-bd0e-b6e4e9bd8970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:23.428484 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fa68e-3901-445c-bd0e-b6e4e9bd8970 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:23.428775 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fa68e-3901-445c-bd0e-b6e4e9bd8970 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:23.429060 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fa68e-3901-445c-bd0e-b6e4e9bd8970 None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:23.429828 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8fa68e-3901-445c-bd0e-b6e4e9bd8970 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:23.430159 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8fa68e-3901-445c-bd0e-b6e4e9bd8970 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:23.431558 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8fa68e-3901-445c-bd0e-b6e4e9bd8970 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:23.439963 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 534/1061] 10.222.0.30 () {56 vars in 1115 bytes} [Tue Jul 5 21:46:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:46:23.446450 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8fa68e-3901-445c-bd0e-b6e4e9bd8970 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:23.464077 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:23.467449 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8126cf7-4f15-4c3d-86f3-4583c2261dd8 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:23.506881 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81678fce-eca7-4468-8f15-1daf1b9987c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:23.507990 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81678fce-eca7-4468-8f15-1daf1b9987c2 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:23.508479 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81678fce-eca7-4468-8f15-1daf1b9987c2 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:23.508930 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81678fce-eca7-4468-8f15-1daf1b9987c2 None admin] PATH_INFO: `/v3/services` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:23.509908 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81678fce-eca7-4468-8f15-1daf1b9987c2 None admin] RBAC: Adding query filter params (type=image) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:23.510543 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81678fce-eca7-4468-8f15-1daf1b9987c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:23.511922 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81678fce-eca7-4468-8f15-1daf1b9987c2 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:23.517427 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 528/1062] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:46:23 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:46:23.523381 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81678fce-eca7-4468-8f15-1daf1b9987c2 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:23.559552 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8fa68e-3901-445c-bd0e-b6e4e9bd8970 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:23.595723 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443df50-fe3b-49cb-b635-b3553244727f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:23.596533 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443df50-fe3b-49cb-b635-b3553244727f None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:23.596821 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443df50-fe3b-49cb-b635-b3553244727f None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:23.597104 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443df50-fe3b-49cb-b635-b3553244727f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:23.608608 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9443df50-fe3b-49cb-b635-b3553244727f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:23.609995 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9443df50-fe3b-49cb-b635-b3553244727f None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:23.627987 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-9443df50-fe3b-49cb-b635-b3553244727f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:46:23.627987 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:23.627987 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:23.627987 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:23.627987 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:23.627987 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:23.627987 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:23.627987 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:23.627987 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:23.627987 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:23.627987 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:23.627987 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:23.627987 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:46:23.627987 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:46:23.627987 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:46:23.629004 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:46:23.629004 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:23.629004 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:23.629004 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:46:23.629004 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:46:23.629004 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:46:23.629004 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:46:23.629004 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:46:23.629004 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:46:23.629004 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:46:23.629004 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:46:23.629004 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:46:23.629004 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:46:23.629004 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:46:23.629004 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:46:23.629004 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:46:23.629004 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:46:23.630024 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:46:23.630024 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:46:23.630024 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:46:23.630024 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:46:23.634289 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 535/1063] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:46:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:46:23.636178 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443df50-fe3b-49cb-b635-b3553244727f None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:23.641344 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:23.643908 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81678fce-eca7-4468-8f15-1daf1b9987c2 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:23.681604 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a65dcc-279c-43d6-ae69-3766c3cc4b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:23.682219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a65dcc-279c-43d6-ae69-3766c3cc4b74 None admin] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:23.682513 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a65dcc-279c-43d6-ae69-3766c3cc4b74 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:23.682799 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a65dcc-279c-43d6-ae69-3766c3cc4b74 None admin] PATH_INFO: `/v3/endpoints` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:23.683552 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a65dcc-279c-43d6-ae69-3766c3cc4b74 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:23.684921 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a65dcc-279c-43d6-ae69-3766c3cc4b74 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:23.744375 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443df50-fe3b-49cb-b635-b3553244727f None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:23.766594 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 529/1064] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Jul 5 21:46:23 2022] POST /identity/v3/endpoints => generated 327 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:46:23.790210 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb40ee-1018-478e-9663-85caf10a2670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:23.790895 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb40ee-1018-478e-9663-85caf10a2670 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:23.791188 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb40ee-1018-478e-9663-85caf10a2670 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:23.791471 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb40ee-1018-478e-9663-85caf10a2670 None admin] PATH_INFO: `/v3/domains` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:23.792224 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfb40ee-1018-478e-9663-85caf10a2670 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:23.792543 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfb40ee-1018-478e-9663-85caf10a2670 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:23.793987 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfb40ee-1018-478e-9663-85caf10a2670 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:23.814182 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 536/1065] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:46:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:46:23.815618 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a65dcc-279c-43d6-ae69-3766c3cc4b74 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:23.841613 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:23.932280 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a65dcc-279c-43d6-ae69-3766c3cc4b74 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:23.968908 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8bb5a-d789-429c-bd60-91b686fddfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:23.969724 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8bb5a-d789-429c-bd60-91b686fddfbe None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:23.970018 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8bb5a-d789-429c-bd60-91b686fddfbe None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:23.970331 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8bb5a-d789-429c-bd60-91b686fddfbe None admin] PATH_INFO: `/v3/users/nova` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:23.978095 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de8bb5a-d789-429c-bd60-91b686fddfbe None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:23.979844 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de8bb5a-d789-429c-bd60-91b686fddfbe None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:23.994889 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-0de8bb5a-d789-429c-bd60-91b686fddfbe None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:46:23.994889 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:23.994889 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:23.994889 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:23.994889 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:23.994889 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:23.994889 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:23.994889 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:23.994889 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:23.994889 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:23.994889 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:23.994889 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:23.994889 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:46:23.994889 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:46:23.994889 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:46:23.994889 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:46:23.996035 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:23.996035 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:23.996035 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:46:23.996035 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:46:23.996035 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:46:23.996035 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:46:23.996035 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:46:23.996035 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:46:23.996035 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:46:23.996035 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:46:23.996035 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:46:23.996035 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:46:23.996035 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:46:23.996035 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:46:23.996035 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:46:23.996035 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:46:23.996035 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:46:23.996035 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:46:23.997067 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:46:23.997067 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:46:23.997067 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:46:23.997067 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:46:23.997067 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:46:23.997067 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:46:23.997067 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:46:23.997067 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:46:23.997067 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:46:23.997067 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:46:23.997067 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 530/1066] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Jul 5 21:46:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:46:24.001842 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb40ee-1018-478e-9663-85caf10a2670 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:24.064661 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:24.107807 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb40ee-1018-478e-9663-85caf10a2670 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:24.142750 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62a3c0-fb28-4281-8d62-fa9317fb6825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:24.143438 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62a3c0-fb28-4281-8d62-fa9317fb6825 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:24.143733 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62a3c0-fb28-4281-8d62-fa9317fb6825 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:24.144021 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62a3c0-fb28-4281-8d62-fa9317fb6825 None admin] PATH_INFO: `/v3/users` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:24.144880 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b62a3c0-fb28-4281-8d62-fa9317fb6825 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:24.145197 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b62a3c0-fb28-4281-8d62-fa9317fb6825 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:24.147282 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b62a3c0-fb28-4281-8d62-fa9317fb6825 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:24.165790 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 537/1067] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Jul 5 21:46:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:46:24.171239 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8bb5a-d789-429c-bd60-91b686fddfbe None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:24.257826 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:24.279517 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8bb5a-d789-429c-bd60-91b686fddfbe None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:24.316482 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27b75b-506b-45a8-b43a-254cece697d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:24.317287 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27b75b-506b-45a8-b43a-254cece697d5 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:24.317577 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27b75b-506b-45a8-b43a-254cece697d5 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:24.317912 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27b75b-506b-45a8-b43a-254cece697d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:24.328594 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f27b75b-506b-45a8-b43a-254cece697d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:24.330061 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f27b75b-506b-45a8-b43a-254cece697d5 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:24.339184 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e833cc6-d557-4d09-b9c0-f8b71503dbca None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:24.339481 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e833cc6-d557-4d09-b9c0-f8b71503dbca None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:24.339767 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e833cc6-d557-4d09-b9c0-f8b71503dbca None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:24.341466 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 538/1068] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:46:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:46:24.346241 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a8920-c861-4206-8131-e2adc0f82dd8 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:24.346537 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a8920-c861-4206-8131-e2adc0f82dd8 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:24.346826 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a8920-c861-4206-8131-e2adc0f82dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:24.350400 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-0f27b75b-506b-45a8-b43a-254cece697d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:46:24.350400 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:24.350400 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:24.350400 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:24.350400 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:24.350400 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:24.350400 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:24.350400 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:24.350400 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:24.350400 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:24.350400 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:24.350400 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:24.350400 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:46:24.350400 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:46:24.350400 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:46:24.351359 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:46:24.351359 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:24.351359 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:24.351359 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:46:24.351359 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:46:24.351359 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:46:24.351359 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:46:24.351359 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:46:24.351359 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:46:24.351359 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:46:24.351359 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:46:24.351359 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:46:24.351359 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:46:24.351359 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:46:24.351359 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:46:24.351359 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:46:24.351359 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:46:24.352345 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:46:24.352345 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:46:24.352345 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:46:24.352345 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:46:24.352345 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 531/1069] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:46:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:46:24.357312 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27b75b-506b-45a8-b43a-254cece697d5 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:24.367843 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-538a8920-c861-4206-8131-e2adc0f82dd8 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:46:24.369065 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-538a8920-c861-4206-8131-e2adc0f82dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:46:24.444207 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 539/1070] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:46:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:46:24.461704 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27b75b-506b-45a8-b43a-254cece697d5 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:24.467213 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a8920-c861-4206-8131-e2adc0f82dd8 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:24.496216 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:24.502291 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c98ca2-9940-461d-951d-6f7d7a5d9466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:24.502965 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c98ca2-9940-461d-951d-6f7d7a5d9466 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:24.503285 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c98ca2-9940-461d-951d-6f7d7a5d9466 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:24.504221 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c98ca2-9940-461d-951d-6f7d7a5d9466 None admin] PATH_INFO: `/v3/domains` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:24.504377 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c98ca2-9940-461d-951d-6f7d7a5d9466 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:24.504546 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c98ca2-9940-461d-951d-6f7d7a5d9466 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:24.506471 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c98ca2-9940-461d-951d-6f7d7a5d9466 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:24.518609 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 532/1071] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:24.520722 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:24.524058 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c98ca2-9940-461d-951d-6f7d7a5d9466 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:24.584736 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a8920-c861-4206-8131-e2adc0f82dd8 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:24.622725 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422dfb4-878a-4022-8dd5-3f560b811dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:24.623533 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422dfb4-878a-4022-8dd5-3f560b811dc6 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:24.623827 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422dfb4-878a-4022-8dd5-3f560b811dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:24.624113 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422dfb4-878a-4022-8dd5-3f560b811dc6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:24.637420 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d422dfb4-878a-4022-8dd5-3f560b811dc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:46:24.639621 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c98ca2-9940-461d-951d-6f7d7a5d9466 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:24.647655 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-d422dfb4-878a-4022-8dd5-3f560b811dc6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:46:24.647655 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:24.647655 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:24.647655 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:24.647655 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:24.647655 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:24.647655 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:24.647655 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:24.647655 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:24.647655 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:24.647655 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:24.647655 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:24.647655 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:46:24.647655 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:46:24.647655 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:46:24.647655 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:46:24.648716 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:46:24.648716 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:46:24.648716 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:46:24.648716 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:46:24.648716 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:24.648716 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:24.648716 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:46:24.648716 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:46:24.648716 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:46:24.648716 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:46:24.648716 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:46:24.648716 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:46:24.648716 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:46:24.648716 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:46:24.648716 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:46:24.648716 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:46:24.649637 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:46:24.649637 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:46:24.649637 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:46:24.649637 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:46:24.649637 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:46:24.649637 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:46:24.649637 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:46:24.649637 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:46:24.649637 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:46:24.649637 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:46:24.649637 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:46:24.649637 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:46:24.649637 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 540/1072] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:46:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:46:24.656537 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422dfb4-878a-4022-8dd5-3f560b811dc6 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:24.678838 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee0f64-f64a-489e-a033-e697be6abc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:24.679742 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee0f64-f64a-489e-a033-e697be6abc57 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:24.679957 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee0f64-f64a-489e-a033-e697be6abc57 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:24.680213 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee0f64-f64a-489e-a033-e697be6abc57 None admin] PATH_INFO: `/v3/projects/service` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:24.687682 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee0f64-f64a-489e-a033-e697be6abc57 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:24.689125 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee0f64-f64a-489e-a033-e697be6abc57 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:24.703826 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-c4ee0f64-f64a-489e-a033-e697be6abc57 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:46:24.703826 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:24.703826 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:24.703826 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:24.703826 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:24.703826 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:24.703826 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:24.703826 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:24.703826 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:24.703826 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:24.703826 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:24.703826 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:24.703826 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:46:24.703826 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:46:24.703826 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:46:24.705020 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:46:24.705020 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:24.705020 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:24.705020 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:46:24.705020 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:46:24.705020 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:46:24.705020 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:46:24.705020 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:46:24.705020 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:46:24.705020 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:46:24.705020 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:46:24.705020 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:46:24.705020 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:46:24.705020 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:46:24.705020 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:46:24.705020 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:46:24.705020 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:46:24.706251 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:46:24.706251 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:46:24.706251 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:46:24.706251 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:46:24.706251 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:46:24.706251 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:46:24.706251 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:46:24.706251 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:46:24.706251 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 533/1073] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:46:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:46:24.710843 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee0f64-f64a-489e-a033-e697be6abc57 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:24.773392 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:24.774758 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422dfb4-878a-4022-8dd5-3f560b811dc6 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:24.784583 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:24.810438 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a294b-57b1-4de5-b41b-f2cdd746b12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:24.811117 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a294b-57b1-4de5-b41b-f2cdd746b12a None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:24.811414 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a294b-57b1-4de5-b41b-f2cdd746b12a None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:24.811716 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a294b-57b1-4de5-b41b-f2cdd746b12a None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:24.812463 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a294b-57b1-4de5-b41b-f2cdd746b12a None admin] RBAC: Adding query filter params (name=admin) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:24.812774 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a294b-57b1-4de5-b41b-f2cdd746b12a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:24.814157 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a294b-57b1-4de5-b41b-f2cdd746b12a None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:24.826963 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee0f64-f64a-489e-a033-e697be6abc57 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:24.829140 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 541/1074] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:46:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:46:24.829840 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a294b-57b1-4de5-b41b-f2cdd746b12a None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:24.864500 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a827a3c6-5736-4928-8792-b62c106f6d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:24.866909 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827a3c6-5736-4928-8792-b62c106f6d45 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:24.867200 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827a3c6-5736-4928-8792-b62c106f6d45 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:24.867481 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827a3c6-5736-4928-8792-b62c106f6d45 None admin] PATH_INFO: `/v3/projects` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:24.868287 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a827a3c6-5736-4928-8792-b62c106f6d45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:24.868603 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a827a3c6-5736-4928-8792-b62c106f6d45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:24.870046 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a827a3c6-5736-4928-8792-b62c106f6d45 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:24.883422 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 534/1075] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:46:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:46:24.889121 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a827a3c6-5736-4928-8792-b62c106f6d45 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:24.942400 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a294b-57b1-4de5-b41b-f2cdd746b12a None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:24.980260 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f8b3a-a91a-46b5-af8a-41ad0fd790f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:24.981153 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f8b3a-a91a-46b5-af8a-41ad0fd790f7 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:24.981439 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f8b3a-a91a-46b5-af8a-41ad0fd790f7 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:24.981717 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f8b3a-a91a-46b5-af8a-41ad0fd790f7 None admin] PATH_INFO: `/v3/users/f70f62246ea34f9f90446fa6de349d8f` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:24.982981 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f8b3a-a91a-46b5-af8a-41ad0fd790f7 None admin] RBAC: Authorizing `identity:get_user(user_id=f70f62246ea34f9f90446fa6de349d8f)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:24.984552 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f8b3a-a91a-46b5-af8a-41ad0fd790f7 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:24.986740 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 542/1076] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:46:24 2022] GET /identity/v3/users/f70f62246ea34f9f90446fa6de349d8f => generated 285 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:46:24.992602 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f8b3a-a91a-46b5-af8a-41ad0fd790f7 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:25.001049 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a827a3c6-5736-4928-8792-b62c106f6d45 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:25.015070 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:25.035477 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:25.040209 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff748b3a-fbee-42a5-9377-34f0d18d3875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:25.041053 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff748b3a-fbee-42a5-9377-34f0d18d3875 None admin] REQUEST_METHOD: `PUT` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:25.041341 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff748b3a-fbee-42a5-9377-34f0d18d3875 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:25.043306 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff748b3a-fbee-42a5-9377-34f0d18d3875 None admin] PATH_INFO: `/v3/projects/93f20f89d0fc4bbf9cf557dd1e14d98d/users/f5d82e71aafe4b6ebcf60c23c050aafb/roles/551482a278b94c70a5183d8bcfa58d9b` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:25.044290 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff748b3a-fbee-42a5-9377-34f0d18d3875 None admin] RBAC: Authorizing `identity:create_grant(project_id=93f20f89d0fc4bbf9cf557dd1e14d98d, user_id=f5d82e71aafe4b6ebcf60c23c050aafb, role_id=551482a278b94c70a5183d8bcfa58d9b)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:25.045779 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff748b3a-fbee-42a5-9377-34f0d18d3875 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:25.092514 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 535/1077] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:46:24 2022] PUT /identity/v3/projects/93f20f89d0fc4bbf9cf557dd1e14d98d/users/f5d82e71aafe4b6ebcf60c23c050aafb/roles/551482a278b94c70a5183d8bcfa58d9b => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:46:25.096745 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f8b3a-a91a-46b5-af8a-41ad0fd790f7 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:25.136364 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d6790-297f-4d17-bd29-e9b2d01a798c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:25.137254 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d6790-297f-4d17-bd29-e9b2d01a798c None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:25.137538 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d6790-297f-4d17-bd29-e9b2d01a798c None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:25.137825 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d6790-297f-4d17-bd29-e9b2d01a798c None admin] PATH_INFO: `/v3/projects/c8894364421e4fcfbe7a54e4cd82bf90` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:25.139111 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d6790-297f-4d17-bd29-e9b2d01a798c None admin] RBAC: Authorizing `identity:get_project(project_id=c8894364421e4fcfbe7a54e4cd82bf90)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:25.140581 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d6790-297f-4d17-bd29-e9b2d01a798c None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:25.142634 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 543/1078] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:46:24 2022] GET /identity/v3/projects/c8894364421e4fcfbe7a54e4cd82bf90 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:46:25.148830 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff748b3a-fbee-42a5-9377-34f0d18d3875 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:25.263940 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff748b3a-fbee-42a5-9377-34f0d18d3875 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:25.301099 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc25661-28d4-4297-9de5-0a9292aa747e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:25.301918 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc25661-28d4-4297-9de5-0a9292aa747e None admin] REQUEST_METHOD: `PUT` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:25.302263 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc25661-28d4-4297-9de5-0a9292aa747e None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:25.302546 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc25661-28d4-4297-9de5-0a9292aa747e None admin] PATH_INFO: `/v3/projects/c8894364421e4fcfbe7a54e4cd82bf90/users/f70f62246ea34f9f90446fa6de349d8f/roles/e1c574c9973548ebb0e8d9e0656ccabd` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:25.304568 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc25661-28d4-4297-9de5-0a9292aa747e None admin] RBAC: Authorizing `identity:create_grant(project_id=c8894364421e4fcfbe7a54e4cd82bf90, user_id=f70f62246ea34f9f90446fa6de349d8f, role_id=e1c574c9973548ebb0e8d9e0656ccabd)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:25.306020 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc25661-28d4-4297-9de5-0a9292aa747e None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:25.385299 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 536/1079] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:46:25 2022] PUT /identity/v3/projects/c8894364421e4fcfbe7a54e4cd82bf90/users/f70f62246ea34f9f90446fa6de349d8f/roles/e1c574c9973548ebb0e8d9e0656ccabd => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:46:25.872156 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f7080-410a-45d0-9a71-a08b3500bce6 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:25.872509 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f7080-410a-45d0-9a71-a08b3500bce6 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:25.872744 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f7080-410a-45d0-9a71-a08b3500bce6 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:25.874280 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 544/1080] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:46:25.879283 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205a3c1-9b0c-481a-9784-5d44cc6b1d52 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:25.879584 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205a3c1-9b0c-481a-9784-5d44cc6b1d52 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:25.879871 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205a3c1-9b0c-481a-9784-5d44cc6b1d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:25.896917 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-9205a3c1-9b0c-481a-9784-5d44cc6b1d52 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:46:25.898121 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-9205a3c1-9b0c-481a-9784-5d44cc6b1d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:46:25.926062 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:25.968089 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 537/1081] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:46:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:46:25.991292 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f7080-410a-45d0-9a71-a08b3500bce6 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:26.100481 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f7080-410a-45d0-9a71-a08b3500bce6 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:26.108916 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:26.135882 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5018b86-fe23-468f-865e-3e659de768b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:26.136459 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5018b86-fe23-468f-865e-3e659de768b2 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:26.136744 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5018b86-fe23-468f-865e-3e659de768b2 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:26.137024 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5018b86-fe23-468f-865e-3e659de768b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:26.207535 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5018b86-fe23-468f-865e-3e659de768b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:26.209075 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5018b86-fe23-468f-865e-3e659de768b2 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:26.314592 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 545/1082] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:46:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:46:26.320895 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205a3c1-9b0c-481a-9784-5d44cc6b1d52 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:26.422831 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205a3c1-9b0c-481a-9784-5d44cc6b1d52 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:26.456832 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7521d-6e22-4e74-86c4-0429ae503141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:26.457503 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7521d-6e22-4e74-86c4-0429ae503141 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:26.457794 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7521d-6e22-4e74-86c4-0429ae503141 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:26.458073 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7521d-6e22-4e74-86c4-0429ae503141 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:26.469268 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac7521d-6e22-4e74-86c4-0429ae503141 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:26.470774 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac7521d-6e22-4e74-86c4-0429ae503141 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:26.489415 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-3ac7521d-6e22-4e74-86c4-0429ae503141 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:46:26.489415 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:26.489415 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:26.489415 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:26.489415 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:26.489415 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:26.489415 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:26.489415 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:26.489415 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:26.489415 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:26.489415 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:26.489415 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:26.489415 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:46:26.489415 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:46:26.489415 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:46:26.490919 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:46:26.490919 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:26.490919 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:26.490919 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:46:26.490919 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:46:26.490919 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:46:26.490919 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:46:26.490919 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:46:26.490919 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:46:26.490919 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:46:26.490919 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:46:26.490919 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:46:26.490919 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:46:26.490919 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:46:26.490919 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:46:26.490919 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:46:26.490919 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:46:26.492042 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:46:26.492042 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:46:26.492042 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:46:26.492042 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:46:26.492042 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 538/1083] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:46:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:46:26.498189 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5018b86-fe23-468f-865e-3e659de768b2 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:26.509617 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:26.608594 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5018b86-fe23-468f-865e-3e659de768b2 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:26.644036 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e857093-289c-406d-a15a-9a3ce4c4de5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:26.644713 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e857093-289c-406d-a15a-9a3ce4c4de5e None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:26.645004 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e857093-289c-406d-a15a-9a3ce4c4de5e None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:26.645283 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e857093-289c-406d-a15a-9a3ce4c4de5e None admin] PATH_INFO: `/v3/domains` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:26.646048 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e857093-289c-406d-a15a-9a3ce4c4de5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:26.646398 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e857093-289c-406d-a15a-9a3ce4c4de5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:26.647842 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e857093-289c-406d-a15a-9a3ce4c4de5e None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:26.666251 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 546/1084] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:46:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:46:27.150746 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb657069-b81f-4fa3-a864-49647fef3c3a None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:27.151036 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb657069-b81f-4fa3-a864-49647fef3c3a None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:27.151318 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb657069-b81f-4fa3-a864-49647fef3c3a None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:27.152718 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 539/1085] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:46:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:46:27.157802 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac5f2a-abcb-4e27-bb70-3a25f0c21a7e None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:27.158295 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac5f2a-abcb-4e27-bb70-3a25f0c21a7e None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:27.158400 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac5f2a-abcb-4e27-bb70-3a25f0c21a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:27.174824 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-8aac5f2a-abcb-4e27-bb70-3a25f0c21a7e None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:46:27.176016 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-8aac5f2a-abcb-4e27-bb70-3a25f0c21a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:46:27.235047 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:27.243430 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 547/1086] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:46:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:46:27.267369 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb657069-b81f-4fa3-a864-49647fef3c3a None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:27.283142 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:27.373373 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb657069-b81f-4fa3-a864-49647fef3c3a None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:27.407351 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7afbd1-a587-42ef-94d1-e566e4c25557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:27.408085 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7afbd1-a587-42ef-94d1-e566e4c25557 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:27.408371 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7afbd1-a587-42ef-94d1-e566e4c25557 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:27.408650 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7afbd1-a587-42ef-94d1-e566e4c25557 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:27.419351 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7afbd1-a587-42ef-94d1-e566e4c25557 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:46:27.428279 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-fb7afbd1-a587-42ef-94d1-e566e4c25557 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 21:46:27.428279 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:27.428279 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:27.428279 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:27.428279 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:27.428279 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:27.428279 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:27.428279 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:27.428279 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:27.428279 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:27.428279 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:27.428279 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:27.428279 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:46:27.428279 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:46:27.428279 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:46:27.428279 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:46:27.429423 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:46:27.429423 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:46:27.429423 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:46:27.429423 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:46:27.429423 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:27.429423 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:27.429423 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:46:27.429423 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:46:27.429423 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:46:27.429423 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:46:27.429423 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:46:27.429423 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:46:27.429423 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:46:27.429423 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:46:27.429423 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:46:27.429423 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:46:27.430746 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:46:27.430746 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:46:27.430746 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:46:27.430746 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:46:27.430746 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:46:27.430746 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:46:27.430746 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:46:27.430746 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:46:27.430746 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:46:27.430746 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:46:27.430746 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 21:46:27.430746 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:46:27.430746 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 540/1087] 10.222.0.30 () {56 vars in 1120 bytes} [Tue Jul 5 21:46:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:46:27.435645 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac5f2a-abcb-4e27-bb70-3a25f0c21a7e None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:27.447063 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdebce3-6748-4327-90a4-9ad453a2678d None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:27.447363 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdebce3-6748-4327-90a4-9ad453a2678d None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:27.447643 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdebce3-6748-4327-90a4-9ad453a2678d None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:27.449015 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 541/1088] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:46:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:46:27.453996 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278e998-e287-4139-8251-a0381cf0b477 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:27.454332 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278e998-e287-4139-8251-a0381cf0b477 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:27.454619 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278e998-e287-4139-8251-a0381cf0b477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:27.471384 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-d278e998-e287-4139-8251-a0381cf0b477 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:46:27.472576 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-d278e998-e287-4139-8251-a0381cf0b477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:46:27.534391 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac5f2a-abcb-4e27-bb70-3a25f0c21a7e None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:27.540981 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 542/1089] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:46:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:46:27.565357 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278e998-e287-4139-8251-a0381cf0b477 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:27.569196 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:27.572283 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129c2be-f670-470e-9b55-75004aa57ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:27.578567 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129c2be-f670-470e-9b55-75004aa57ede None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:27.578567 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129c2be-f670-470e-9b55-75004aa57ede None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:27.578567 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129c2be-f670-470e-9b55-75004aa57ede None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:27.578567 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9129c2be-f670-470e-9b55-75004aa57ede None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:27.578567 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9129c2be-f670-470e-9b55-75004aa57ede None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:27.578567 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9129c2be-f670-470e-9b55-75004aa57ede None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:27.589444 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 548/1090] 10.222.0.30 () {56 vars in 1115 bytes} [Tue Jul 5 21:46:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:27.590484 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129c2be-f670-470e-9b55-75004aa57ede None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:27.648856 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:27.668974 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278e998-e287-4139-8251-a0381cf0b477 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:27.690854 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129c2be-f670-470e-9b55-75004aa57ede None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:27.703515 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34083999-6fd8-47cd-99f1-e12a106e71d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:27.704322 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34083999-6fd8-47cd-99f1-e12a106e71d3 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:27.704612 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34083999-6fd8-47cd-99f1-e12a106e71d3 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:27.704896 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34083999-6fd8-47cd-99f1-e12a106e71d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:27.716109 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34083999-6fd8-47cd-99f1-e12a106e71d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:46:27.723886 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-34083999-6fd8-47cd-99f1-e12a106e71d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:46:27.723886 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:27.723886 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:27.723886 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:27.723886 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:27.723886 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:27.723886 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:27.723886 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:27.723886 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:27.723886 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:27.723886 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:27.723886 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:27.723886 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:46:27.723886 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:46:27.723886 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:46:27.723886 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:46:27.725072 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:46:27.725072 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:46:27.725072 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:46:27.725072 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:46:27.725072 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:27.725072 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:27.725072 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:46:27.725072 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:46:27.725072 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:46:27.725072 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:46:27.725072 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:46:27.725072 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:46:27.725072 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:46:27.725072 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:46:27.725072 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:46:27.725072 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:46:27.726237 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:46:27.726237 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:46:27.726237 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:46:27.726237 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:46:27.726237 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:46:27.726237 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:46:27.726237 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:46:27.726237 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:46:27.726237 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:46:27.726237 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:46:27.726237 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:46:27.726237 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:46:27.726237 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 543/1091] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:46:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:46:27.728457 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8a946-ebf0-493c-aecd-4893546624b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:27.729511 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8a946-ebf0-493c-aecd-4893546624b3 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:27.729790 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8a946-ebf0-493c-aecd-4893546624b3 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:27.730077 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8a946-ebf0-493c-aecd-4893546624b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:27.731446 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34083999-6fd8-47cd-99f1-e12a106e71d3 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:27.741041 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8a946-ebf0-493c-aecd-4893546624b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:27.742563 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8a946-ebf0-493c-aecd-4893546624b3 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:27.763126 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-43a8a946-ebf0-493c-aecd-4893546624b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:46:27.763126 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:27.763126 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:27.763126 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:27.763126 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:27.763126 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:27.763126 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:27.763126 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:27.763126 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:27.763126 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:27.763126 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:27.763126 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:27.763126 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:46:27.763126 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:46:27.763126 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:46:27.764166 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:46:27.764166 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:27.764166 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:27.764166 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:46:27.764166 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:46:27.764166 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:46:27.764166 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:46:27.764166 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:46:27.764166 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:46:27.764166 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:46:27.764166 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:46:27.764166 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:46:27.764166 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:46:27.764166 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:46:27.764166 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:46:27.764166 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:46:27.764166 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:46:27.765146 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:46:27.765146 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:46:27.765146 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:46:27.765146 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:46:27.765146 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 549/1092] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:46:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:46:27.770067 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8a946-ebf0-493c-aecd-4893546624b3 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:27.797192 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:27.837059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34083999-6fd8-47cd-99f1-e12a106e71d3 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:27.871410 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8a946-ebf0-493c-aecd-4893546624b3 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:27.871613 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d23ad-6c43-400e-a11d-d731bdcbbca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:27.872193 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d23ad-6c43-400e-a11d-d731bdcbbca2 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:27.872486 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d23ad-6c43-400e-a11d-d731bdcbbca2 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:27.872773 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d23ad-6c43-400e-a11d-d731bdcbbca2 None admin] PATH_INFO: `/v3/roles` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:27.873534 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d23ad-6c43-400e-a11d-d731bdcbbca2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:27.873843 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d23ad-6c43-400e-a11d-d731bdcbbca2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:27.875264 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d23ad-6c43-400e-a11d-d731bdcbbca2 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:27.881696 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:27.883813 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 544/1093] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:46:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:27.889593 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d23ad-6c43-400e-a11d-d731bdcbbca2 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:27.905509 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca8118b-13ea-441c-bb05-a1be3d8dcfde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:27.906201 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8118b-13ea-441c-bb05-a1be3d8dcfde None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:27.906515 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8118b-13ea-441c-bb05-a1be3d8dcfde None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:27.906896 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8118b-13ea-441c-bb05-a1be3d8dcfde None admin] PATH_INFO: `/v3/domains` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:27.907525 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca8118b-13ea-441c-bb05-a1be3d8dcfde None admin] RBAC: Adding query filter params (name=Default) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:27.907832 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca8118b-13ea-441c-bb05-a1be3d8dcfde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:27.909306 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca8118b-13ea-441c-bb05-a1be3d8dcfde None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:27.921730 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 550/1094] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:46:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:46:27.927914 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca8118b-13ea-441c-bb05-a1be3d8dcfde None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:27.991121 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d23ad-6c43-400e-a11d-d731bdcbbca2 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:28.017502 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:28.026619 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca9c01-5b9f-48ec-a45c-8a68d862626b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:28.028051 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca9c01-5b9f-48ec-a45c-8a68d862626b None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:28.028051 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca9c01-5b9f-48ec-a45c-8a68d862626b None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:28.028051 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca9c01-5b9f-48ec-a45c-8a68d862626b None admin] PATH_INFO: `/v3/users/f70f62246ea34f9f90446fa6de349d8f` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:28.029198 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca8118b-13ea-441c-bb05-a1be3d8dcfde None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:28.029412 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca9c01-5b9f-48ec-a45c-8a68d862626b None admin] RBAC: Authorizing `identity:get_user(user_id=f70f62246ea34f9f90446fa6de349d8f)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:28.030885 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca9c01-5b9f-48ec-a45c-8a68d862626b None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:28.032541 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 545/1095] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:46:27 2022] GET /identity/v3/users/f70f62246ea34f9f90446fa6de349d8f => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:46:28.039027 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca9c01-5b9f-48ec-a45c-8a68d862626b None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:28.064412 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f017ec-4238-478a-8b61-a2e2a3908257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:28.065536 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f017ec-4238-478a-8b61-a2e2a3908257 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:28.065832 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f017ec-4238-478a-8b61-a2e2a3908257 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:28.066120 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f017ec-4238-478a-8b61-a2e2a3908257 None admin] PATH_INFO: `/v3/users/nova` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:28.073341 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f017ec-4238-478a-8b61-a2e2a3908257 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:28.074831 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f017ec-4238-478a-8b61-a2e2a3908257 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:28.089694 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-a9f017ec-4238-478a-8b61-a2e2a3908257 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:46:28.089694 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:28.089694 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:28.089694 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:28.089694 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:28.089694 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:28.089694 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:28.089694 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:28.089694 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:28.089694 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:28.089694 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:28.089694 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:28.089694 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:46:28.089694 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:46:28.089694 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:46:28.089694 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:46:28.095757 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:28.095757 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:28.095757 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:46:28.095757 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:46:28.095757 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:46:28.095757 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:46:28.095757 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:46:28.095757 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:46:28.095757 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:46:28.095757 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:46:28.095757 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:46:28.095757 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:46:28.095757 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:46:28.095757 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:46:28.095757 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:46:28.095757 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:46:28.095757 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:46:28.095757 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:46:28.097086 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:46:28.097086 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:46:28.097086 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:46:28.097086 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:46:28.097086 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:46:28.097086 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:46:28.097086 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:46:28.097086 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:46:28.097086 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 21:46:28.097086 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:46:28.097086 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 551/1096] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Jul 5 21:46:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:46:28.097086 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f017ec-4238-478a-8b61-a2e2a3908257 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:28.128137 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:28.144097 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca9c01-5b9f-48ec-a45c-8a68d862626b None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:28.178638 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4894a0d-b4f5-45eb-99f4-981bc033b2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:28.179259 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4894a0d-b4f5-45eb-99f4-981bc033b2ba None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:28.179554 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4894a0d-b4f5-45eb-99f4-981bc033b2ba None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:28.179841 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4894a0d-b4f5-45eb-99f4-981bc033b2ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:28.198516 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f017ec-4238-478a-8b61-a2e2a3908257 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:28.233563 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff81ff0-2a35-4689-8bca-5a106de79877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:28.234263 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff81ff0-2a35-4689-8bca-5a106de79877 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:28.234550 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff81ff0-2a35-4689-8bca-5a106de79877 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:28.234858 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff81ff0-2a35-4689-8bca-5a106de79877 None admin] PATH_INFO: `/v3/users` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:28.235673 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff81ff0-2a35-4689-8bca-5a106de79877 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:28.235984 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff81ff0-2a35-4689-8bca-5a106de79877 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:28.237421 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff81ff0-2a35-4689-8bca-5a106de79877 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:28.241406 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:28.249042 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4894a0d-b4f5-45eb-99f4-981bc033b2ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:28.250519 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4894a0d-b4f5-45eb-99f4-981bc033b2ba None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:28.254808 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 552/1097] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Jul 5 21:46:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:46:28.261308 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff81ff0-2a35-4689-8bca-5a106de79877 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:28.351398 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 546/1098] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:46:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:46:28.351650 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:28.357469 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4894a0d-b4f5-45eb-99f4-981bc033b2ba None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:28.363639 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff81ff0-2a35-4689-8bca-5a106de79877 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:28.400586 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9169c3e1-ace8-47a9-bc65-1503255d75a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:28.401559 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169c3e1-ace8-47a9-bc65-1503255d75a4 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:28.401854 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169c3e1-ace8-47a9-bc65-1503255d75a4 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:28.402389 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169c3e1-ace8-47a9-bc65-1503255d75a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:28.450586 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:28.457215 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4894a0d-b4f5-45eb-99f4-981bc033b2ba None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:28.469489 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9169c3e1-ace8-47a9-bc65-1503255d75a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:28.470979 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9169c3e1-ace8-47a9-bc65-1503255d75a4 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:28.492565 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb949c-f276-4d94-9351-ba488a0c5fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:28.493427 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb949c-f276-4d94-9351-ba488a0c5fa6 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:28.493714 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb949c-f276-4d94-9351-ba488a0c5fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:28.493992 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb949c-f276-4d94-9351-ba488a0c5fa6 None admin] PATH_INFO: `/v3/projects/c8894364421e4fcfbe7a54e4cd82bf90` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:28.495218 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bb949c-f276-4d94-9351-ba488a0c5fa6 None admin] RBAC: Authorizing `identity:get_project(project_id=c8894364421e4fcfbe7a54e4cd82bf90)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:28.496636 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bb949c-f276-4d94-9351-ba488a0c5fa6 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:28.498378 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 547/1099] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:46:28 2022] GET /identity/v3/projects/c8894364421e4fcfbe7a54e4cd82bf90 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:46:28.504482 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb949c-f276-4d94-9351-ba488a0c5fa6 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:28.564235 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:28.576698 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 553/1100] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:46:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 05 21:46:28.583177 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9169c3e1-ace8-47a9-bc65-1503255d75a4 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:28.606713 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb949c-f276-4d94-9351-ba488a0c5fa6 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:28.640768 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99335c84-4d95-4a4c-bf6a-20c48b3f3e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:28.641421 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99335c84-4d95-4a4c-bf6a-20c48b3f3e2d None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:28.641711 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99335c84-4d95-4a4c-bf6a-20c48b3f3e2d None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:28.641992 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99335c84-4d95-4a4c-bf6a-20c48b3f3e2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:28.642863 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99335c84-4d95-4a4c-bf6a-20c48b3f3e2d None admin] RBAC: Adding query filter params (role.id=e1c574c9973548ebb0e8d9e0656ccabd, scope.project.id=c8894364421e4fcfbe7a54e4cd82bf90, user.id=f70f62246ea34f9f90446fa6de349d8f) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:28.643178 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99335c84-4d95-4a4c-bf6a-20c48b3f3e2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:28.644615 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99335c84-4d95-4a4c-bf6a-20c48b3f3e2d None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:28.651341 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 548/1101] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:46:28 2022] GET /identity/v3/role_assignments?user.id=f70f62246ea34f9f90446fa6de349d8f&scope.project.id=c8894364421e4fcfbe7a54e4cd82bf90&role.id=e1c574c9973548ebb0e8d9e0656ccabd => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:46:28.689267 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9169c3e1-ace8-47a9-bc65-1503255d75a4 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:28.727136 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7955ca32-8466-44a1-9c5b-1a6969849b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:28.727858 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7955ca32-8466-44a1-9c5b-1a6969849b5b None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:28.728145 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7955ca32-8466-44a1-9c5b-1a6969849b5b None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:28.728423 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7955ca32-8466-44a1-9c5b-1a6969849b5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:28.740413 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7955ca32-8466-44a1-9c5b-1a6969849b5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:28.741894 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7955ca32-8466-44a1-9c5b-1a6969849b5b None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:28.761263 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-7955ca32-8466-44a1-9c5b-1a6969849b5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:46:28.761263 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:28.761263 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:28.761263 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:28.761263 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:28.761263 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:28.761263 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:28.761263 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:28.761263 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:28.761263 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:28.761263 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:28.761263 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:28.761263 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:46:28.761263 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:46:28.761263 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:46:28.762555 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:46:28.762555 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:28.762555 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:28.762555 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:46:28.762555 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:46:28.762555 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:46:28.762555 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:46:28.762555 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:46:28.762555 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:46:28.762555 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:46:28.762555 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:46:28.762555 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:46:28.762555 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:46:28.762555 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:46:28.762555 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:46:28.762555 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:46:28.762555 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:46:28.763606 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:46:28.763606 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:46:28.763606 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:46:28.763606 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:46:28.766327 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 554/1102] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:46:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:46:28.768405 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99335c84-4d95-4a4c-bf6a-20c48b3f3e2d None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:28.797852 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:28.875627 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99335c84-4d95-4a4c-bf6a-20c48b3f3e2d None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:28.911243 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30914895-c2dd-4420-b816-c6565f5ed847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:28.912428 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30914895-c2dd-4420-b816-c6565f5ed847 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:28.912717 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30914895-c2dd-4420-b816-c6565f5ed847 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:28.913000 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30914895-c2dd-4420-b816-c6565f5ed847 None admin] PATH_INFO: `/v3/domains` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:28.913735 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30914895-c2dd-4420-b816-c6565f5ed847 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:28.914048 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30914895-c2dd-4420-b816-c6565f5ed847 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:28.915454 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30914895-c2dd-4420-b816-c6565f5ed847 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:28.926744 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 549/1103] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:46:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:28.932894 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7955ca32-8466-44a1-9c5b-1a6969849b5b None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:28.975839 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:29.035097 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7955ca32-8466-44a1-9c5b-1a6969849b5b None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:29.069358 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fffea8-26a9-4a29-ab93-14dd0f613243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:29.070184 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fffea8-26a9-4a29-ab93-14dd0f613243 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:29.070480 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fffea8-26a9-4a29-ab93-14dd0f613243 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:29.070764 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fffea8-26a9-4a29-ab93-14dd0f613243 None admin] PATH_INFO: `/v3/projects/service` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:29.077473 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fffea8-26a9-4a29-ab93-14dd0f613243 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:29.078951 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fffea8-26a9-4a29-ab93-14dd0f613243 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:29.093278 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-d3fffea8-26a9-4a29-ab93-14dd0f613243 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:46:29.093278 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:29.093278 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:29.093278 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:29.093278 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:29.093278 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:29.093278 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:29.093278 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:29.093278 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:29.093278 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:29.093278 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:29.093278 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:29.093278 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:46:29.093278 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:46:29.093278 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:46:29.094330 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:46:29.094330 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:29.094330 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:29.094330 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:46:29.094330 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:46:29.094330 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:46:29.094330 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:46:29.094330 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:46:29.094330 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:46:29.094330 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:46:29.094330 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:46:29.094330 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:46:29.094330 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:46:29.094330 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:46:29.094330 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:46:29.094330 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:46:29.094330 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:46:29.095735 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:46:29.095735 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:46:29.095735 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:46:29.095735 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:46:29.095735 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:46:29.095735 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:46:29.095735 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:46:29.095735 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:46:29.095735 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 555/1104] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:46:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:46:29.100320 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30914895-c2dd-4420-b816-c6565f5ed847 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:29.186648 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:29.201725 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30914895-c2dd-4420-b816-c6565f5ed847 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:29.236413 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd92db1-50ed-4488-afec-4109e8a7b143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:29.237084 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd92db1-50ed-4488-afec-4109e8a7b143 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:29.237375 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd92db1-50ed-4488-afec-4109e8a7b143 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:29.237661 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd92db1-50ed-4488-afec-4109e8a7b143 None admin] PATH_INFO: `/v3/projects` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:29.238503 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd92db1-50ed-4488-afec-4109e8a7b143 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:29.238823 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd92db1-50ed-4488-afec-4109e8a7b143 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:29.240467 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd92db1-50ed-4488-afec-4109e8a7b143 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:29.252402 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 550/1105] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:46:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:29.259175 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fffea8-26a9-4a29-ab93-14dd0f613243 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:29.359235 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:29.362214 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fffea8-26a9-4a29-ab93-14dd0f613243 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:29.395711 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c752210-d4db-4ff8-b2ac-a0c9acf4d483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:29.397281 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c752210-d4db-4ff8-b2ac-a0c9acf4d483 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:29.397565 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c752210-d4db-4ff8-b2ac-a0c9acf4d483 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:29.397846 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c752210-d4db-4ff8-b2ac-a0c9acf4d483 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:29.398722 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c752210-d4db-4ff8-b2ac-a0c9acf4d483 None admin] RBAC: Adding query filter params (role.id=551482a278b94c70a5183d8bcfa58d9b, scope.project.id=93f20f89d0fc4bbf9cf557dd1e14d98d, user.id=f5d82e71aafe4b6ebcf60c23c050aafb) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:29.399036 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c752210-d4db-4ff8-b2ac-a0c9acf4d483 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:29.400482 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c752210-d4db-4ff8-b2ac-a0c9acf4d483 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:29.406656 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 556/1106] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:46:29 2022] GET /identity/v3/role_assignments?user.id=f5d82e71aafe4b6ebcf60c23c050aafb&scope.project.id=93f20f89d0fc4bbf9cf557dd1e14d98d&role.id=551482a278b94c70a5183d8bcfa58d9b => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:30.752802 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511dff5d-d150-47a2-8af2-1bb741fe7080 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:30.753368 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511dff5d-d150-47a2-8af2-1bb741fe7080 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:30.753368 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511dff5d-d150-47a2-8af2-1bb741fe7080 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:30.754780 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 551/1107] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:46:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:46:30.760448 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14921cea-5c95-46e1-9991-5b2bc4cee0d9 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:30.760848 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14921cea-5c95-46e1-9991-5b2bc4cee0d9 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:30.761013 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14921cea-5c95-46e1-9991-5b2bc4cee0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:30.778334 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-14921cea-5c95-46e1-9991-5b2bc4cee0d9 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:46:30.779524 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-14921cea-5c95-46e1-9991-5b2bc4cee0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:46:30.844712 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 557/1108] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:46:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:46:30.874677 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511dff5d-d150-47a2-8af2-1bb741fe7080 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:30.976168 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511dff5d-d150-47a2-8af2-1bb741fe7080 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:31.009409 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9477db-5f9e-4077-8ece-e0da6f510c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:31.010242 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9477db-5f9e-4077-8ece-e0da6f510c57 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:31.010533 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9477db-5f9e-4077-8ece-e0da6f510c57 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:31.010811 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9477db-5f9e-4077-8ece-e0da6f510c57 None admin] PATH_INFO: `/v3/domains/default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:31.012003 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9477db-5f9e-4077-8ece-e0da6f510c57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:31.013434 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9477db-5f9e-4077-8ece-e0da6f510c57 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:31.015075 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 552/1109] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:46:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:31.021227 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14921cea-5c95-46e1-9991-5b2bc4cee0d9 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:31.114185 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:31.120765 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14921cea-5c95-46e1-9991-5b2bc4cee0d9 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:31.156195 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc29b5-904c-44f1-af1e-a59b4d66c1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:31.157054 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc29b5-904c-44f1-af1e-a59b4d66c1dd None admin] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:31.157382 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc29b5-904c-44f1-af1e-a59b4d66c1dd None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:31.158037 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc29b5-904c-44f1-af1e-a59b4d66c1dd None admin] PATH_INFO: `/v3/users` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:31.158793 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc29b5-904c-44f1-af1e-a59b4d66c1dd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:31.160225 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc29b5-904c-44f1-af1e-a59b4d66c1dd None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:31.246457 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 558/1110] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:46:31 2022] POST /identity/v3/users => generated 286 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:46:33.296273 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c44cd4-c26a-4507-9d7c-b58e622f3e62 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:33.296858 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c44cd4-c26a-4507-9d7c-b58e622f3e62 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:33.296858 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c44cd4-c26a-4507-9d7c-b58e622f3e62 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:33.298319 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 553/1111] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:46:33.304504 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17205330-6df6-420d-969b-f70fa340f7e1 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:33.304942 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17205330-6df6-420d-969b-f70fa340f7e1 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:33.305055 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17205330-6df6-420d-969b-f70fa340f7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:33.322500 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-17205330-6df6-420d-969b-f70fa340f7e1 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:46:33.323686 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-17205330-6df6-420d-969b-f70fa340f7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:46:33.391424 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 559/1112] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:46:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:46:33.423006 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c44cd4-c26a-4507-9d7c-b58e622f3e62 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:33.439731 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:33.524653 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c44cd4-c26a-4507-9d7c-b58e622f3e62 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:33.559032 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426f209-5510-4786-996e-c99b200aee86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:33.559900 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426f209-5510-4786-996e-c99b200aee86 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:33.560190 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426f209-5510-4786-996e-c99b200aee86 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:33.560475 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426f209-5510-4786-996e-c99b200aee86 None admin] PATH_INFO: `/v3/roles/9bd598b07a9942b7a91c3a372f3cf094` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:33.561966 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e426f209-5510-4786-996e-c99b200aee86 None admin] RBAC: Authorizing `identity:get_role(role_id=9bd598b07a9942b7a91c3a372f3cf094)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:33.563385 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e426f209-5510-4786-996e-c99b200aee86 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:33.564774 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 554/1113] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:46:33 2022] GET /identity/v3/roles/9bd598b07a9942b7a91c3a372f3cf094 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:33.570949 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17205330-6df6-420d-969b-f70fa340f7e1 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:33.651858 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:33.671152 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17205330-6df6-420d-969b-f70fa340f7e1 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:33.707128 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3116664f-66a6-4118-9838-230e1655e7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:33.707995 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116664f-66a6-4118-9838-230e1655e7af None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:33.709083 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116664f-66a6-4118-9838-230e1655e7af None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:33.709365 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116664f-66a6-4118-9838-230e1655e7af None admin] PATH_INFO: `/v3/users/3552e3a314f34a2a8c68454a2bd45632` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:33.721774 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3116664f-66a6-4118-9838-230e1655e7af None admin] RBAC: Authorizing `identity:get_user(user_id=3552e3a314f34a2a8c68454a2bd45632)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:33.723243 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3116664f-66a6-4118-9838-230e1655e7af None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:33.725275 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 560/1114] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:46:33 2022] GET /identity/v3/users/3552e3a314f34a2a8c68454a2bd45632 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:33.731235 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426f209-5510-4786-996e-c99b200aee86 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:33.811859 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:33.830294 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426f209-5510-4786-996e-c99b200aee86 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:33.865116 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f8b3b-663c-48ee-a50a-219a4346d16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:33.865765 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f8b3b-663c-48ee-a50a-219a4346d16b None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:33.866049 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f8b3b-663c-48ee-a50a-219a4346d16b None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:33.866355 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f8b3b-663c-48ee-a50a-219a4346d16b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:33.932058 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665f8b3b-663c-48ee-a50a-219a4346d16b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:33.933500 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665f8b3b-663c-48ee-a50a-219a4346d16b None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:34.011453 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:34.029472 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 555/1115] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:46:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:46:34.035302 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3116664f-66a6-4118-9838-230e1655e7af None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:34.134977 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3116664f-66a6-4118-9838-230e1655e7af None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:34.168089 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd3e9a-02e8-419b-a54c-8a368552cea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:34.168944 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd3e9a-02e8-419b-a54c-8a368552cea1 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:34.169230 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd3e9a-02e8-419b-a54c-8a368552cea1 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:34.169511 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd3e9a-02e8-419b-a54c-8a368552cea1 None admin] PATH_INFO: `/v3/projects/c8894364421e4fcfbe7a54e4cd82bf90` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:34.170725 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dd3e9a-02e8-419b-a54c-8a368552cea1 None admin] RBAC: Authorizing `identity:get_project(project_id=c8894364421e4fcfbe7a54e4cd82bf90)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:34.172159 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dd3e9a-02e8-419b-a54c-8a368552cea1 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:34.173865 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 561/1116] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:46:34 2022] GET /identity/v3/projects/c8894364421e4fcfbe7a54e4cd82bf90 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:34.180473 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f8b3b-663c-48ee-a50a-219a4346d16b None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:34.277413 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f8b3b-663c-48ee-a50a-219a4346d16b None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:34.311223 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73db28-3cd1-48f4-abbc-d58cb977c80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:34.311865 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73db28-3cd1-48f4-abbc-d58cb977c80e None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:34.312150 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73db28-3cd1-48f4-abbc-d58cb977c80e None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:34.312428 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73db28-3cd1-48f4-abbc-d58cb977c80e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:34.313261 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e73db28-3cd1-48f4-abbc-d58cb977c80e None admin] RBAC: Adding query filter params (role.id=9bd598b07a9942b7a91c3a372f3cf094, scope.project.id=c8894364421e4fcfbe7a54e4cd82bf90, user.id=3552e3a314f34a2a8c68454a2bd45632) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:34.313575 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e73db28-3cd1-48f4-abbc-d58cb977c80e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:34.315114 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e73db28-3cd1-48f4-abbc-d58cb977c80e None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:34.321174 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 556/1117] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:46:34 2022] GET /identity/v3/role_assignments?user.id=3552e3a314f34a2a8c68454a2bd45632&scope.project.id=c8894364421e4fcfbe7a54e4cd82bf90&role.id=9bd598b07a9942b7a91c3a372f3cf094 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:46:36.390359 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197da69-8f79-458b-93ad-bfdcb9f8326a None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:36.390929 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197da69-8f79-458b-93ad-bfdcb9f8326a None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:36.390929 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197da69-8f79-458b-93ad-bfdcb9f8326a None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:36.392324 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 562/1118] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:46:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:46:36.397799 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f884a35-a783-4b80-bddf-7bf47a545fbf None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:36.398278 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f884a35-a783-4b80-bddf-7bf47a545fbf None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:36.398392 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f884a35-a783-4b80-bddf-7bf47a545fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:36.415519 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-1f884a35-a783-4b80-bddf-7bf47a545fbf None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:46:36.416705 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-1f884a35-a783-4b80-bddf-7bf47a545fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:46:36.458265 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:36.483347 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 557/1119] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:46:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:46:36.506621 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197da69-8f79-458b-93ad-bfdcb9f8326a None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:36.517669 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:36.611342 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197da69-8f79-458b-93ad-bfdcb9f8326a None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:36.644446 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c2c1f-f0e0-4a55-9d88-0b38257af371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:36.645251 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c2c1f-f0e0-4a55-9d88-0b38257af371 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:36.645562 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c2c1f-f0e0-4a55-9d88-0b38257af371 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:36.645859 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c2c1f-f0e0-4a55-9d88-0b38257af371 None admin] PATH_INFO: `/v3/roles/9bd598b07a9942b7a91c3a372f3cf094` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:36.647394 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898c2c1f-f0e0-4a55-9d88-0b38257af371 None admin] RBAC: Authorizing `identity:get_role(role_id=9bd598b07a9942b7a91c3a372f3cf094)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:36.648781 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898c2c1f-f0e0-4a55-9d88-0b38257af371 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:36.650189 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 563/1120] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:46:36 2022] GET /identity/v3/roles/9bd598b07a9942b7a91c3a372f3cf094 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:36.656067 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f884a35-a783-4b80-bddf-7bf47a545fbf None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:36.754935 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f884a35-a783-4b80-bddf-7bf47a545fbf None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:36.788913 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b77c991-8017-4ca4-87d4-df4b3d93af0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:36.789782 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77c991-8017-4ca4-87d4-df4b3d93af0e None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:36.790073 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77c991-8017-4ca4-87d4-df4b3d93af0e None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:36.790418 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77c991-8017-4ca4-87d4-df4b3d93af0e None admin] PATH_INFO: `/v3/users/3552e3a314f34a2a8c68454a2bd45632` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:36.791627 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b77c991-8017-4ca4-87d4-df4b3d93af0e None admin] RBAC: Authorizing `identity:get_user(user_id=3552e3a314f34a2a8c68454a2bd45632)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:36.793073 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b77c991-8017-4ca4-87d4-df4b3d93af0e None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:36.794752 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 558/1121] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:46:36 2022] GET /identity/v3/users/3552e3a314f34a2a8c68454a2bd45632 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:36.800566 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c2c1f-f0e0-4a55-9d88-0b38257af371 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:36.875880 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:36.900456 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c2c1f-f0e0-4a55-9d88-0b38257af371 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:36.934222 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f49b31-a779-4b2a-9366-32d2f0e19e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:36.935081 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f49b31-a779-4b2a-9366-32d2f0e19e15 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:36.935371 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f49b31-a779-4b2a-9366-32d2f0e19e15 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:36.935655 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f49b31-a779-4b2a-9366-32d2f0e19e15 None admin] PATH_INFO: `/v3/projects/c8894364421e4fcfbe7a54e4cd82bf90` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:36.936839 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f49b31-a779-4b2a-9366-32d2f0e19e15 None admin] RBAC: Authorizing `identity:get_project(project_id=c8894364421e4fcfbe7a54e4cd82bf90)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:36.938320 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f49b31-a779-4b2a-9366-32d2f0e19e15 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:36.940009 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 564/1122] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:46:36 2022] GET /identity/v3/projects/c8894364421e4fcfbe7a54e4cd82bf90 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:36.946933 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b77c991-8017-4ca4-87d4-df4b3d93af0e None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:36.992209 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:37.044971 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b77c991-8017-4ca4-87d4-df4b3d93af0e None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:37.078699 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d7c73-8425-432c-9dd1-9a20cdc608f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:37.079576 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d7c73-8425-432c-9dd1-9a20cdc608f1 None admin] REQUEST_METHOD: `PUT` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:37.079862 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d7c73-8425-432c-9dd1-9a20cdc608f1 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:37.080136 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d7c73-8425-432c-9dd1-9a20cdc608f1 None admin] PATH_INFO: `/v3/projects/c8894364421e4fcfbe7a54e4cd82bf90/users/3552e3a314f34a2a8c68454a2bd45632/roles/9bd598b07a9942b7a91c3a372f3cf094` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:37.082373 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08d7c73-8425-432c-9dd1-9a20cdc608f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8894364421e4fcfbe7a54e4cd82bf90, user_id=3552e3a314f34a2a8c68454a2bd45632, role_id=9bd598b07a9942b7a91c3a372f3cf094)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:37.083834 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08d7c73-8425-432c-9dd1-9a20cdc608f1 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:37.189482 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 559/1123] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:46:36 2022] PUT /identity/v3/projects/c8894364421e4fcfbe7a54e4cd82bf90/users/3552e3a314f34a2a8c68454a2bd45632/roles/9bd598b07a9942b7a91c3a372f3cf094 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:46:39.200643 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a6b72-9b1a-4e62-9392-9367ff73ac15 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:39.201209 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a6b72-9b1a-4e62-9392-9367ff73ac15 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:39.201209 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a6b72-9b1a-4e62-9392-9367ff73ac15 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:39.202666 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 565/1124] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:46:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:46:39.207880 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58f8e3-f2cd-4002-b4f1-74d0792cb470 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:39.208335 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58f8e3-f2cd-4002-b4f1-74d0792cb470 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:39.208438 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58f8e3-f2cd-4002-b4f1-74d0792cb470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:39.227160 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-3e58f8e3-f2cd-4002-b4f1-74d0792cb470 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:46:39.228358 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-3e58f8e3-f2cd-4002-b4f1-74d0792cb470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:46:39.294619 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 560/1125] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:46:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:46:39.318790 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a6b72-9b1a-4e62-9392-9367ff73ac15 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:39.421418 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a6b72-9b1a-4e62-9392-9367ff73ac15 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:39.455340 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc03696c-af9a-4141-81f5-0890102b916b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:39.456135 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03696c-af9a-4141-81f5-0890102b916b None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:39.456426 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03696c-af9a-4141-81f5-0890102b916b None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:39.456707 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03696c-af9a-4141-81f5-0890102b916b None admin] PATH_INFO: `/v3/roles/9bd598b07a9942b7a91c3a372f3cf094` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:39.458410 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc03696c-af9a-4141-81f5-0890102b916b None admin] RBAC: Authorizing `identity:get_role(role_id=9bd598b07a9942b7a91c3a372f3cf094)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:39.459795 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc03696c-af9a-4141-81f5-0890102b916b None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:39.461170 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 566/1126] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:46:39 2022] GET /identity/v3/roles/9bd598b07a9942b7a91c3a372f3cf094 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:39.466979 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58f8e3-f2cd-4002-b4f1-74d0792cb470 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:39.500644 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:39.564678 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58f8e3-f2cd-4002-b4f1-74d0792cb470 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:39.599941 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2ce40-e13d-40bd-b271-eb447db7615e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:39.600824 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2ce40-e13d-40bd-b271-eb447db7615e None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:39.601114 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2ce40-e13d-40bd-b271-eb447db7615e None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:39.601398 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2ce40-e13d-40bd-b271-eb447db7615e None admin] PATH_INFO: `/v3/users/3552e3a314f34a2a8c68454a2bd45632` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:39.602642 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a2ce40-e13d-40bd-b271-eb447db7615e None admin] RBAC: Authorizing `identity:get_user(user_id=3552e3a314f34a2a8c68454a2bd45632)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:39.604372 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a2ce40-e13d-40bd-b271-eb447db7615e None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:39.606033 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 561/1127] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:46:39 2022] GET /identity/v3/users/3552e3a314f34a2a8c68454a2bd45632 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:39.611793 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc03696c-af9a-4141-81f5-0890102b916b None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:39.625115 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:39.711026 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc03696c-af9a-4141-81f5-0890102b916b None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:39.744700 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b4f86-eeb5-4e3d-ab69-803e360733df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:39.745342 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b4f86-eeb5-4e3d-ab69-803e360733df None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:39.745634 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b4f86-eeb5-4e3d-ab69-803e360733df None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:39.745918 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b4f86-eeb5-4e3d-ab69-803e360733df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:39.813159 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85b4f86-eeb5-4e3d-ab69-803e360733df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:39.814646 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85b4f86-eeb5-4e3d-ab69-803e360733df None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:39.825409 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:39.911724 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 567/1128] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:46:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:46:39.917618 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2ce40-e13d-40bd-b271-eb447db7615e None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:40.016176 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2ce40-e13d-40bd-b271-eb447db7615e None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:40.017615 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:40.049065 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c4171-c9ee-4b19-b8d1-9035d5c01913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:40.049926 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c4171-c9ee-4b19-b8d1-9035d5c01913 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:40.050250 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c4171-c9ee-4b19-b8d1-9035d5c01913 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:40.050534 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c4171-c9ee-4b19-b8d1-9035d5c01913 None admin] PATH_INFO: `/v3/projects/c8894364421e4fcfbe7a54e4cd82bf90` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:40.052210 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c4171-c9ee-4b19-b8d1-9035d5c01913 None admin] RBAC: Authorizing `identity:get_project(project_id=c8894364421e4fcfbe7a54e4cd82bf90)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:40.053669 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c4171-c9ee-4b19-b8d1-9035d5c01913 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:40.055411 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 562/1129] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:46:39 2022] GET /identity/v3/projects/c8894364421e4fcfbe7a54e4cd82bf90 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:40.061446 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b4f86-eeb5-4e3d-ab69-803e360733df None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:40.158402 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b4f86-eeb5-4e3d-ab69-803e360733df None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:40.169221 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:40.191986 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ccdbfb-b5a3-4065-aa99-998998f8d83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:40.193159 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ccdbfb-b5a3-4065-aa99-998998f8d83d None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:40.193589 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ccdbfb-b5a3-4065-aa99-998998f8d83d None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:40.193876 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ccdbfb-b5a3-4065-aa99-998998f8d83d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:40.194746 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ccdbfb-b5a3-4065-aa99-998998f8d83d None admin] RBAC: Adding query filter params (role.id=9bd598b07a9942b7a91c3a372f3cf094, scope.project.id=c8894364421e4fcfbe7a54e4cd82bf90, user.id=3552e3a314f34a2a8c68454a2bd45632) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:40.195060 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ccdbfb-b5a3-4065-aa99-998998f8d83d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:40.196513 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ccdbfb-b5a3-4065-aa99-998998f8d83d None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:40.202832 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 568/1130] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:46:40 2022] GET /identity/v3/role_assignments?user.id=3552e3a314f34a2a8c68454a2bd45632&scope.project.id=c8894364421e4fcfbe7a54e4cd82bf90&role.id=9bd598b07a9942b7a91c3a372f3cf094 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:42.228295 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd73ff-c569-453b-8399-fd3894cb1fd5 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:42.229130 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd73ff-c569-453b-8399-fd3894cb1fd5 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:42.229130 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd73ff-c569-453b-8399-fd3894cb1fd5 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:42.230591 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 563/1131] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:46:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:46:42.235927 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16390de3-d963-4531-adef-bcc4c7ff79ae None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:42.236369 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16390de3-d963-4531-adef-bcc4c7ff79ae None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:42.236500 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16390de3-d963-4531-adef-bcc4c7ff79ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:42.253637 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-16390de3-d963-4531-adef-bcc4c7ff79ae None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:46:42.261641 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-16390de3-d963-4531-adef-bcc4c7ff79ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:46:42.322646 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 569/1132] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:46:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:46:42.361074 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd73ff-c569-453b-8399-fd3894cb1fd5 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:42.462034 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd73ff-c569-453b-8399-fd3894cb1fd5 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:42.496637 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9892a-2099-426a-93e4-e8de2971cd11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:42.497361 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9892a-2099-426a-93e4-e8de2971cd11 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:42.497651 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9892a-2099-426a-93e4-e8de2971cd11 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:42.497936 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9892a-2099-426a-93e4-e8de2971cd11 None admin] PATH_INFO: `/v3/domains/default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:42.499146 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f9892a-2099-426a-93e4-e8de2971cd11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:42.500591 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f9892a-2099-426a-93e4-e8de2971cd11 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:42.502239 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 564/1133] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:46:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:42.508031 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16390de3-d963-4531-adef-bcc4c7ff79ae None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:42.606141 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16390de3-d963-4531-adef-bcc4c7ff79ae None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:42.608426 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:42.642397 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d762bd-a1d9-4f85-aaa2-ace58e6ab141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:42.643061 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d762bd-a1d9-4f85-aaa2-ace58e6ab141 None admin] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:42.643358 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d762bd-a1d9-4f85-aaa2-ace58e6ab141 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:42.643644 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d762bd-a1d9-4f85-aaa2-ace58e6ab141 None admin] PATH_INFO: `/v3/projects` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:42.644369 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d762bd-a1d9-4f85-aaa2-ace58e6ab141 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:42.646332 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d762bd-a1d9-4f85-aaa2-ace58e6ab141 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:42.745513 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 570/1134] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Jul 5 21:46:42 2022] POST /identity/v3/projects => generated 311 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:46:44.795322 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f2ca6-beb9-4cc3-9b56-2764931fa9f8 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:44.795893 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f2ca6-beb9-4cc3-9b56-2764931fa9f8 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:44.795893 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f2ca6-beb9-4cc3-9b56-2764931fa9f8 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:44.797253 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 565/1135] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:46:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:46:44.803055 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f924c8-eb9d-4d0a-bd53-9e7810ffcc9c None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:44.803444 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f924c8-eb9d-4d0a-bd53-9e7810ffcc9c None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:44.803571 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f924c8-eb9d-4d0a-bd53-9e7810ffcc9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:44.820136 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-f8f924c8-eb9d-4d0a-bd53-9e7810ffcc9c None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:46:44.821334 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-f8f924c8-eb9d-4d0a-bd53-9e7810ffcc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:46:44.886953 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 571/1136] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:46:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:46:44.911946 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f2ca6-beb9-4cc3-9b56-2764931fa9f8 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:44.953165 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:45.013867 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f2ca6-beb9-4cc3-9b56-2764931fa9f8 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:45.052050 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29161b-3526-4fcc-b3d5-116817c632d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:45.052837 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29161b-3526-4fcc-b3d5-116817c632d8 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:45.053178 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29161b-3526-4fcc-b3d5-116817c632d8 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:45.053404 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29161b-3526-4fcc-b3d5-116817c632d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:45.054626 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c29161b-3526-4fcc-b3d5-116817c632d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:45.056077 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c29161b-3526-4fcc-b3d5-116817c632d8 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:45.057702 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 566/1137] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:46:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:45.063434 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f924c8-eb9d-4d0a-bd53-9e7810ffcc9c None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:45.147572 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:45.162963 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f924c8-eb9d-4d0a-bd53-9e7810ffcc9c None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:45.197846 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280428a-4d06-4eb1-9812-9ccdb1dacf95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:45.198584 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280428a-4d06-4eb1-9812-9ccdb1dacf95 None admin] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:45.198877 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280428a-4d06-4eb1-9812-9ccdb1dacf95 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:45.199159 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280428a-4d06-4eb1-9812-9ccdb1dacf95 None admin] PATH_INFO: `/v3/users` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:45.199870 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280428a-4d06-4eb1-9812-9ccdb1dacf95 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:45.201307 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280428a-4d06-4eb1-9812-9ccdb1dacf95 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:45.285843 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 572/1138] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:46:45 2022] POST /identity/v3/users => generated 286 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:46:47.356093 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d85273-cd8b-4f50-8b4c-729025aeb7c2 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:47.356678 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d85273-cd8b-4f50-8b4c-729025aeb7c2 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:47.356678 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d85273-cd8b-4f50-8b4c-729025aeb7c2 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:47.358021 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 567/1139] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:46:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:46:47.363181 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054fe97-b60f-4017-bbe5-993c662ecb94 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:47.363613 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054fe97-b60f-4017-bbe5-993c662ecb94 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:47.363763 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054fe97-b60f-4017-bbe5-993c662ecb94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:47.380809 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-9054fe97-b60f-4017-bbe5-993c662ecb94 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:46:47.382018 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-9054fe97-b60f-4017-bbe5-993c662ecb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:46:47.447943 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 573/1140] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:46:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:46:47.471744 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d85273-cd8b-4f50-8b4c-729025aeb7c2 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:47.575861 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d85273-cd8b-4f50-8b4c-729025aeb7c2 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:47.585570 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:47.612738 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f30c4f-ea5c-4efc-84aa-55db83c8ff7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:47.613498 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f30c4f-ea5c-4efc-84aa-55db83c8ff7c None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:47.613793 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f30c4f-ea5c-4efc-84aa-55db83c8ff7c None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:47.614120 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f30c4f-ea5c-4efc-84aa-55db83c8ff7c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:47.624772 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f30c4f-ea5c-4efc-84aa-55db83c8ff7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:46:47.633939 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-b9f30c4f-ea5c-4efc-84aa-55db83c8ff7c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:46:47.633939 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:47.633939 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:47.633939 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:47.633939 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:47.633939 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:47.633939 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:47.633939 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:47.633939 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:47.633939 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:47.633939 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:47.633939 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:47.633939 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:46:47.633939 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:46:47.633939 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:46:47.633939 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:46:47.635157 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:46:47.635157 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:46:47.635157 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:46:47.635157 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:46:47.635157 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:47.635157 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:47.635157 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:46:47.635157 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:46:47.635157 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:46:47.635157 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:46:47.635157 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:46:47.635157 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:46:47.635157 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:46:47.635157 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:46:47.635157 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:46:47.635157 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:46:47.636219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:46:47.636219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:46:47.636219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:46:47.636219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:46:47.636219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:46:47.636219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:46:47.636219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:46:47.636219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:46:47.636219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:46:47.636219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:46:47.636219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:46:47.636219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:46:47.636219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 568/1141] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:46:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:46:47.641576 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9054fe97-b60f-4017-bbe5-993c662ecb94 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:47.711021 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:47.739799 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9054fe97-b60f-4017-bbe5-993c662ecb94 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:47.774109 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4086f10-1801-4a7c-944a-b70d3b2922bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:47.774795 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4086f10-1801-4a7c-944a-b70d3b2922bb None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:47.775083 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4086f10-1801-4a7c-944a-b70d3b2922bb None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:47.775363 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4086f10-1801-4a7c-944a-b70d3b2922bb None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:47.776146 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4086f10-1801-4a7c-944a-b70d3b2922bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:47.776461 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4086f10-1801-4a7c-944a-b70d3b2922bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:47.777870 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4086f10-1801-4a7c-944a-b70d3b2922bb None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:47.785838 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 574/1142] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:46:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:47.791547 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f30c4f-ea5c-4efc-84aa-55db83c8ff7c None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:47.891091 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f30c4f-ea5c-4efc-84aa-55db83c8ff7c None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:47.924319 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f49d0-2589-4379-875e-10c465eb00cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:47.925180 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f49d0-2589-4379-875e-10c465eb00cf None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:47.925469 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f49d0-2589-4379-875e-10c465eb00cf None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:47.925749 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f49d0-2589-4379-875e-10c465eb00cf None admin] PATH_INFO: `/v3/users/c8b9b51d8d364b7ebedf220a8293d5db` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:47.938923 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f49d0-2589-4379-875e-10c465eb00cf None admin] RBAC: Authorizing `identity:get_user(user_id=c8b9b51d8d364b7ebedf220a8293d5db)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:47.940369 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f49d0-2589-4379-875e-10c465eb00cf None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:47.942018 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 569/1143] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:46:47 2022] GET /identity/v3/users/c8b9b51d8d364b7ebedf220a8293d5db => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:47.948313 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4086f10-1801-4a7c-944a-b70d3b2922bb None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:48.046740 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4086f10-1801-4a7c-944a-b70d3b2922bb None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:48.079951 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60139d34-23b1-4fdc-835e-222284c82fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:48.080596 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60139d34-23b1-4fdc-835e-222284c82fa1 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:48.080885 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60139d34-23b1-4fdc-835e-222284c82fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:48.081165 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60139d34-23b1-4fdc-835e-222284c82fa1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:48.084314 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:48.148508 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60139d34-23b1-4fdc-835e-222284c82fa1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:48.149896 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60139d34-23b1-4fdc-835e-222284c82fa1 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:48.246500 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 575/1144] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:46:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:46:48.252477 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f49d0-2589-4379-875e-10c465eb00cf None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:48.277921 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:48.351672 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f49d0-2589-4379-875e-10c465eb00cf None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:48.385698 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c9fb0-8bf0-430f-b39b-eb79b24c56b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:48.386591 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c9fb0-8bf0-430f-b39b-eb79b24c56b7 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:48.386876 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c9fb0-8bf0-430f-b39b-eb79b24c56b7 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:48.387151 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c9fb0-8bf0-430f-b39b-eb79b24c56b7 None admin] PATH_INFO: `/v3/projects/6495b07950e8461793d95e5f5cae9053` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:48.388336 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1c9fb0-8bf0-430f-b39b-eb79b24c56b7 None admin] RBAC: Authorizing `identity:get_project(project_id=6495b07950e8461793d95e5f5cae9053)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:48.389786 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1c9fb0-8bf0-430f-b39b-eb79b24c56b7 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:48.391513 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 570/1145] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:46:48 2022] GET /identity/v3/projects/6495b07950e8461793d95e5f5cae9053 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:48.397703 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60139d34-23b1-4fdc-835e-222284c82fa1 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:48.431781 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:48.505051 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60139d34-23b1-4fdc-835e-222284c82fa1 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:48.538487 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033e383-427e-4d02-b63c-f00de93e2532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:48.539137 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033e383-427e-4d02-b63c-f00de93e2532 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:48.539424 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033e383-427e-4d02-b63c-f00de93e2532 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:48.539702 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033e383-427e-4d02-b63c-f00de93e2532 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:48.540540 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d033e383-427e-4d02-b63c-f00de93e2532 None admin] RBAC: Adding query filter params (role.id=e1c574c9973548ebb0e8d9e0656ccabd, scope.project.id=6495b07950e8461793d95e5f5cae9053, user.id=c8b9b51d8d364b7ebedf220a8293d5db) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:48.540852 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d033e383-427e-4d02-b63c-f00de93e2532 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:48.542310 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d033e383-427e-4d02-b63c-f00de93e2532 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:48.547769 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 576/1146] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:46:48 2022] GET /identity/v3/role_assignments?user.id=c8b9b51d8d364b7ebedf220a8293d5db&scope.project.id=6495b07950e8461793d95e5f5cae9053&role.id=e1c574c9973548ebb0e8d9e0656ccabd => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:50.574557 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025437e-72ae-4bc8-9522-6cc269aefc9e None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:50.575035 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025437e-72ae-4bc8-9522-6cc269aefc9e None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:50.575159 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025437e-72ae-4bc8-9522-6cc269aefc9e None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:50.576495 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 571/1147] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:46:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:46:50.582046 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019f63c-9524-4dd8-9e23-c487651bf526 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:50.582499 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019f63c-9524-4dd8-9e23-c487651bf526 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:50.582636 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019f63c-9524-4dd8-9e23-c487651bf526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:50.600060 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-f019f63c-9524-4dd8-9e23-c487651bf526 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:46:50.601231 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-f019f63c-9524-4dd8-9e23-c487651bf526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:46:50.667667 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 577/1148] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:46:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:46:50.690530 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b025437e-72ae-4bc8-9522-6cc269aefc9e None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:50.782927 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:50.792914 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b025437e-72ae-4bc8-9522-6cc269aefc9e None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:50.826824 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfecd1b0-2869-423b-a6c0-91f3e51a9a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:50.827550 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecd1b0-2869-423b-a6c0-91f3e51a9a57 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:50.827842 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecd1b0-2869-423b-a6c0-91f3e51a9a57 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:50.828125 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecd1b0-2869-423b-a6c0-91f3e51a9a57 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:50.838395 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfecd1b0-2869-423b-a6c0-91f3e51a9a57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:46:50.846105 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-bfecd1b0-2869-423b-a6c0-91f3e51a9a57 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:46:50.846105 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:50.846105 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:50.846105 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:50.846105 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:50.846105 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:50.846105 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:50.846105 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:50.846105 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:50.846105 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:50.846105 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:50.846105 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:50.846105 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:46:50.846105 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:46:50.846105 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:46:50.846105 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:46:50.847323 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:46:50.847323 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:46:50.847323 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:46:50.847323 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:46:50.847323 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:50.847323 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:50.847323 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:46:50.847323 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:46:50.847323 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:46:50.847323 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:46:50.847323 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:46:50.847323 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:46:50.847323 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:46:50.847323 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:46:50.847323 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:46:50.847323 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:46:50.849693 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:46:50.849693 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:46:50.849693 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:46:50.849693 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:46:50.849693 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:46:50.849693 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:46:50.849693 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:46:50.849693 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:46:50.849693 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:46:50.849693 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:46:50.849693 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:46:50.849693 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:46:50.849693 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 572/1149] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:46:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:46:50.854341 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019f63c-9524-4dd8-9e23-c487651bf526 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:50.882492 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:50.952530 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019f63c-9524-4dd8-9e23-c487651bf526 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:50.986200 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ee900-ad93-46cb-ae4b-5f7ec9be70d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:50.986868 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ee900-ad93-46cb-ae4b-5f7ec9be70d4 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:50.987161 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ee900-ad93-46cb-ae4b-5f7ec9be70d4 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:50.987447 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ee900-ad93-46cb-ae4b-5f7ec9be70d4 None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:50.988203 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ee900-ad93-46cb-ae4b-5f7ec9be70d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:50.988515 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ee900-ad93-46cb-ae4b-5f7ec9be70d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:50.990062 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ee900-ad93-46cb-ae4b-5f7ec9be70d4 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:50.998102 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 578/1150] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:46:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:51.003780 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfecd1b0-2869-423b-a6c0-91f3e51a9a57 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:51.104207 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfecd1b0-2869-423b-a6c0-91f3e51a9a57 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:51.138754 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6701051c-3287-485a-a213-1bdde5946dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:51.139621 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701051c-3287-485a-a213-1bdde5946dae None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:51.139907 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701051c-3287-485a-a213-1bdde5946dae None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:51.140185 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701051c-3287-485a-a213-1bdde5946dae None admin] PATH_INFO: `/v3/users/c8b9b51d8d364b7ebedf220a8293d5db` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:51.141384 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6701051c-3287-485a-a213-1bdde5946dae None admin] RBAC: Authorizing `identity:get_user(user_id=c8b9b51d8d364b7ebedf220a8293d5db)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:51.142879 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6701051c-3287-485a-a213-1bdde5946dae None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:51.144527 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 573/1151] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:46:51 2022] GET /identity/v3/users/c8b9b51d8d364b7ebedf220a8293d5db => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:51.150465 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ee900-ad93-46cb-ae4b-5f7ec9be70d4 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:51.239855 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:51.249291 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ee900-ad93-46cb-ae4b-5f7ec9be70d4 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:51.282352 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0705d3-c0d1-4d0a-9b4b-295dcc99b97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:51.283209 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0705d3-c0d1-4d0a-9b4b-295dcc99b97d None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:51.283497 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0705d3-c0d1-4d0a-9b4b-295dcc99b97d None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:51.283779 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0705d3-c0d1-4d0a-9b4b-295dcc99b97d None admin] PATH_INFO: `/v3/projects/6495b07950e8461793d95e5f5cae9053` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:51.284966 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0705d3-c0d1-4d0a-9b4b-295dcc99b97d None admin] RBAC: Authorizing `identity:get_project(project_id=6495b07950e8461793d95e5f5cae9053)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:51.286470 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0705d3-c0d1-4d0a-9b4b-295dcc99b97d None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:51.288152 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 579/1152] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:46:51 2022] GET /identity/v3/projects/6495b07950e8461793d95e5f5cae9053 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:51.294499 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6701051c-3287-485a-a213-1bdde5946dae None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:51.318728 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:51.395890 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6701051c-3287-485a-a213-1bdde5946dae None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:51.429763 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca51b7c-1eac-4cd1-b5b1-8cea05058848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:51.430664 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca51b7c-1eac-4cd1-b5b1-8cea05058848 None admin] REQUEST_METHOD: `PUT` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:51.430952 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca51b7c-1eac-4cd1-b5b1-8cea05058848 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:51.431233 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca51b7c-1eac-4cd1-b5b1-8cea05058848 None admin] PATH_INFO: `/v3/projects/6495b07950e8461793d95e5f5cae9053/users/c8b9b51d8d364b7ebedf220a8293d5db/roles/e1c574c9973548ebb0e8d9e0656ccabd` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:51.433213 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca51b7c-1eac-4cd1-b5b1-8cea05058848 None admin] RBAC: Authorizing `identity:create_grant(project_id=6495b07950e8461793d95e5f5cae9053, user_id=c8b9b51d8d364b7ebedf220a8293d5db, role_id=e1c574c9973548ebb0e8d9e0656ccabd)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:51.434682 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca51b7c-1eac-4cd1-b5b1-8cea05058848 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:51.503308 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 574/1153] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:46:51 2022] PUT /identity/v3/projects/6495b07950e8461793d95e5f5cae9053/users/c8b9b51d8d364b7ebedf220a8293d5db/roles/e1c574c9973548ebb0e8d9e0656ccabd => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:46:53.505852 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d82cbd-3dd5-4cc7-917f-e71ca5239f7a None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:53.506448 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d82cbd-3dd5-4cc7-917f-e71ca5239f7a None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:53.506448 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d82cbd-3dd5-4cc7-917f-e71ca5239f7a None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:53.507857 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 580/1154] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:46:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:46:53.512937 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb8180-77d1-4787-b847-ea043e3d0be3 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:53.513367 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb8180-77d1-4787-b847-ea043e3d0be3 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:53.513516 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb8180-77d1-4787-b847-ea043e3d0be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:53.531330 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-a4eb8180-77d1-4787-b847-ea043e3d0be3 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:46:53.532559 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-a4eb8180-77d1-4787-b847-ea043e3d0be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:46:53.600683 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 575/1155] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:46:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:46:53.624895 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d82cbd-3dd5-4cc7-917f-e71ca5239f7a None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:53.727399 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d82cbd-3dd5-4cc7-917f-e71ca5239f7a None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:53.761228 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d805c54-1fb0-48dc-9ffe-a5cffea96bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:53.761956 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d805c54-1fb0-48dc-9ffe-a5cffea96bc1 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:53.762280 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d805c54-1fb0-48dc-9ffe-a5cffea96bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:53.762569 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d805c54-1fb0-48dc-9ffe-a5cffea96bc1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:53.774106 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d805c54-1fb0-48dc-9ffe-a5cffea96bc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:46:53.781671 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-8d805c54-1fb0-48dc-9ffe-a5cffea96bc1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:46:53.781671 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:53.781671 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:53.781671 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:53.781671 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:53.781671 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:53.781671 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:53.781671 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:53.781671 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:53.781671 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:53.781671 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:53.781671 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:53.781671 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:46:53.781671 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:46:53.781671 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:46:53.781671 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:46:53.782902 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:46:53.782902 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:46:53.782902 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:46:53.782902 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:46:53.782902 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:53.782902 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:53.782902 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:46:53.782902 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:46:53.782902 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:46:53.782902 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:46:53.782902 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:46:53.782902 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:46:53.782902 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:46:53.782902 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:46:53.782902 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:46:53.782902 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:46:53.784067 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:46:53.784067 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:46:53.784067 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:46:53.784067 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:46:53.784067 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:46:53.784067 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:46:53.784067 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:46:53.784067 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:46:53.784067 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:46:53.784067 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:46:53.784067 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:46:53.784067 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:46:53.784067 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 581/1156] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:46:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:46:53.789376 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb8180-77d1-4787-b847-ea043e3d0be3 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:53.800926 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:53.888484 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb8180-77d1-4787-b847-ea043e3d0be3 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:53.921809 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6b466-8fcc-4c20-b9a4-91e77494f987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:53.922497 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6b466-8fcc-4c20-b9a4-91e77494f987 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:53.922788 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6b466-8fcc-4c20-b9a4-91e77494f987 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:53.923068 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6b466-8fcc-4c20-b9a4-91e77494f987 None admin] PATH_INFO: `/v3/roles` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:53.923820 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6b466-8fcc-4c20-b9a4-91e77494f987 None admin] RBAC: Adding query filter params (name=admin) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:53.924129 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6b466-8fcc-4c20-b9a4-91e77494f987 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:53.925536 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6b466-8fcc-4c20-b9a4-91e77494f987 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:53.933657 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 576/1157] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:46:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:53.939371 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d805c54-1fb0-48dc-9ffe-a5cffea96bc1 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:53.959344 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:54.038261 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d805c54-1fb0-48dc-9ffe-a5cffea96bc1 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:54.071589 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d305247-146f-492f-876d-a83b443359c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:54.072442 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d305247-146f-492f-876d-a83b443359c0 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:54.072725 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d305247-146f-492f-876d-a83b443359c0 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:54.073003 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d305247-146f-492f-876d-a83b443359c0 None admin] PATH_INFO: `/v3/users/c8b9b51d8d364b7ebedf220a8293d5db` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:54.074210 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d305247-146f-492f-876d-a83b443359c0 None admin] RBAC: Authorizing `identity:get_user(user_id=c8b9b51d8d364b7ebedf220a8293d5db)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:54.075637 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d305247-146f-492f-876d-a83b443359c0 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:54.077244 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 582/1158] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:46:53 2022] GET /identity/v3/users/c8b9b51d8d364b7ebedf220a8293d5db => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:54.082921 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6b466-8fcc-4c20-b9a4-91e77494f987 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:54.152675 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:54.182484 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6b466-8fcc-4c20-b9a4-91e77494f987 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:54.216097 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2753672-2133-4c07-86ff-3ee8a2043cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:54.216745 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2753672-2133-4c07-86ff-3ee8a2043cf2 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:54.217032 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2753672-2133-4c07-86ff-3ee8a2043cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:54.217309 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2753672-2133-4c07-86ff-3ee8a2043cf2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:54.283841 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2753672-2133-4c07-86ff-3ee8a2043cf2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:54.285278 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2753672-2133-4c07-86ff-3ee8a2043cf2 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:54.351850 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:54.383143 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 577/1159] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:46:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:46:54.388934 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d305247-146f-492f-876d-a83b443359c0 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:54.472016 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:54.487108 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d305247-146f-492f-876d-a83b443359c0 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:54.521734 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8c7fb-c38f-431e-87e3-0df7709e4cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:54.522614 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8c7fb-c38f-431e-87e3-0df7709e4cc1 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:54.522902 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8c7fb-c38f-431e-87e3-0df7709e4cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:54.523179 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8c7fb-c38f-431e-87e3-0df7709e4cc1 None admin] PATH_INFO: `/v3/projects/6495b07950e8461793d95e5f5cae9053` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:54.524349 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f8c7fb-c38f-431e-87e3-0df7709e4cc1 None admin] RBAC: Authorizing `identity:get_project(project_id=6495b07950e8461793d95e5f5cae9053)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:54.525774 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f8c7fb-c38f-431e-87e3-0df7709e4cc1 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:54.527473 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 583/1160] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:46:54 2022] GET /identity/v3/projects/6495b07950e8461793d95e5f5cae9053 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:54.533453 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2753672-2133-4c07-86ff-3ee8a2043cf2 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:54.633333 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2753672-2133-4c07-86ff-3ee8a2043cf2 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:54.666747 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bcb546-c7e2-4137-88a3-b021e5ca5ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:54.667405 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bcb546-c7e2-4137-88a3-b021e5ca5ee3 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:54.667698 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bcb546-c7e2-4137-88a3-b021e5ca5ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:54.667982 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bcb546-c7e2-4137-88a3-b021e5ca5ee3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:54.668821 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bcb546-c7e2-4137-88a3-b021e5ca5ee3 None admin] RBAC: Adding query filter params (role.id=e1c574c9973548ebb0e8d9e0656ccabd, scope.project.id=6495b07950e8461793d95e5f5cae9053, user.id=c8b9b51d8d364b7ebedf220a8293d5db) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:54.669138 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bcb546-c7e2-4137-88a3-b021e5ca5ee3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:54.670610 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bcb546-c7e2-4137-88a3-b021e5ca5ee3 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:54.676471 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 578/1161] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:46:54 2022] GET /identity/v3/role_assignments?user.id=c8b9b51d8d364b7ebedf220a8293d5db&scope.project.id=6495b07950e8461793d95e5f5cae9053&role.id=e1c574c9973548ebb0e8d9e0656ccabd => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:56.714533 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12493507-005a-4671-8365-e886787f6758 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:56.715066 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12493507-005a-4671-8365-e886787f6758 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:56.715192 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12493507-005a-4671-8365-e886787f6758 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:56.716484 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 584/1162] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:46:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:46:56.721663 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4f2b8-8b88-43a2-976e-a88793b426e9 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:56.722080 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4f2b8-8b88-43a2-976e-a88793b426e9 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:56.722265 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4f2b8-8b88-43a2-976e-a88793b426e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:56.739404 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-8db4f2b8-8b88-43a2-976e-a88793b426e9 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:46:56.740601 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-8db4f2b8-8b88-43a2-976e-a88793b426e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:46:56.769601 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:56.807786 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 579/1163] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:46:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:46:56.830642 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12493507-005a-4671-8365-e886787f6758 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:56.931565 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12493507-005a-4671-8365-e886787f6758 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:56.965250 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c0e68-d97b-4dd5-b615-3109555accb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:56.965898 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c0e68-d97b-4dd5-b615-3109555accb7 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:56.966219 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c0e68-d97b-4dd5-b615-3109555accb7 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:56.966506 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c0e68-d97b-4dd5-b615-3109555accb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:56.990059 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:57.041296 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474c0e68-d97b-4dd5-b615-3109555accb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:57.043122 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474c0e68-d97b-4dd5-b615-3109555accb7 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:57.147089 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 585/1164] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:46:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:46:57.153148 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db4f2b8-8b88-43a2-976e-a88793b426e9 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:57.250944 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db4f2b8-8b88-43a2-976e-a88793b426e9 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:57.284280 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6aa35-04a1-498b-9ecc-529defe8a5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:57.285073 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6aa35-04a1-498b-9ecc-529defe8a5ee None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:57.285359 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6aa35-04a1-498b-9ecc-529defe8a5ee None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:57.285638 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6aa35-04a1-498b-9ecc-529defe8a5ee None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:57.292322 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6aa35-04a1-498b-9ecc-529defe8a5ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:57.293767 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6aa35-04a1-498b-9ecc-529defe8a5ee None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:57.308441 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-53e6aa35-04a1-498b-9ecc-529defe8a5ee None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 05 21:46:57.308441 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:57.308441 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 05 21:46:57.308441 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 05 21:46:57.308441 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:46:57.308441 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:46:57.308441 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:46:57.308441 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:46:57.308441 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 05 21:46:57.308441 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:46:57.308441 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:46:57.308441 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:46:57.308441 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:46:57.308441 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:46:57.308441 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:46:57.308441 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:46:57.308441 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:46:57.309803 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:46:57.309803 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:46:57.309803 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:46:57.309803 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:46:57.309803 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:46:57.309803 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:46:57.309803 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:46:57.309803 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:46:57.309803 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:46:57.309803 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:46:57.309803 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:46:57.309803 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:46:57.309803 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:46:57.309803 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:46:57.309803 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:46:57.309803 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:46:57.311077 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:46:57.311077 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:46:57.311077 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:46:57.311077 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:46:57.311077 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:46:57.311077 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:46:57.311077 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:46:57.311077 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:46:57.311077 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:46:57.311077 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:46:57.311077 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 05 21:46:57.311077 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:46:57.311077 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 05 21:46:57.311077 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:46:57.311077 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 580/1165] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Jul 5 21:46:57 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:46:57.315605 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c0e68-d97b-4dd5-b615-3109555accb7 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:57.370063 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:57.413741 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c0e68-d97b-4dd5-b615-3109555accb7 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:57.446418 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc418749-e3b7-42fd-9a42-077383ff3293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:57.447072 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc418749-e3b7-42fd-9a42-077383ff3293 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:57.447359 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc418749-e3b7-42fd-9a42-077383ff3293 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:57.447640 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc418749-e3b7-42fd-9a42-077383ff3293 None admin] PATH_INFO: `/v3/domains` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:57.448359 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc418749-e3b7-42fd-9a42-077383ff3293 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:46:57.448666 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc418749-e3b7-42fd-9a42-077383ff3293 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:57.450027 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc418749-e3b7-42fd-9a42-077383ff3293 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:57.457042 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 586/1166] 10.222.0.30 () {56 vars in 1115 bytes} [Tue Jul 5 21:46:57 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:46:59.457280 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bcb6c1-9bd0-40ad-9482-a3a31489b613 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:59.458482 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bcb6c1-9bd0-40ad-9482-a3a31489b613 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:59.458603 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bcb6c1-9bd0-40ad-9482-a3a31489b613 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:59.459955 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 581/1167] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:46:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:46:59.465081 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e6a55-ca36-4063-b1b4-0b61c318e569 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:59.465520 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e6a55-ca36-4063-b1b4-0b61c318e569 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:59.465651 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e6a55-ca36-4063-b1b4-0b61c318e569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:59.483077 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-2f6e6a55-ca36-4063-b1b4-0b61c318e569 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:46:59.484265 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-2f6e6a55-ca36-4063-b1b4-0b61c318e569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:46:59.549514 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 587/1168] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:46:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:46:59.572748 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bcb6c1-9bd0-40ad-9482-a3a31489b613 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:46:59.602355 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:46:59.675137 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bcb6c1-9bd0-40ad-9482-a3a31489b613 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:46:59.708114 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12788272-643d-4274-b52b-dcd8219ddc17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:46:59.708712 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12788272-643d-4274-b52b-dcd8219ddc17 None admin] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:46:59.708998 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12788272-643d-4274-b52b-dcd8219ddc17 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:46:59.709276 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12788272-643d-4274-b52b-dcd8219ddc17 None admin] PATH_INFO: `/v3/domains` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:46:59.710016 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12788272-643d-4274-b52b-dcd8219ddc17 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:46:59.711410 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12788272-643d-4274-b52b-dcd8219ddc17 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:46:59.801226 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 582/1169] 10.222.0.30 () {60 vars in 1138 bytes} [Tue Jul 5 21:46:59 2022] POST /identity/v3/domains => generated 267 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:47:01.857401 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b95599f-28bc-45c3-b27e-f1ce6e4e874c None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:47:01.857940 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b95599f-28bc-45c3-b27e-f1ce6e4e874c None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:47:01.857940 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b95599f-28bc-45c3-b27e-f1ce6e4e874c None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:47:01.859326 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 588/1170] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:47:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:47:01.864453 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc6acc-70c9-4b2c-92be-5867ad35d814 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:47:01.864836 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc6acc-70c9-4b2c-92be-5867ad35d814 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:47:01.865012 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc6acc-70c9-4b2c-92be-5867ad35d814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:47:01.881938 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-28cc6acc-70c9-4b2c-92be-5867ad35d814 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:47:01.883173 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-28cc6acc-70c9-4b2c-92be-5867ad35d814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:47:01.948148 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 583/1171] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:47:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:47:01.971518 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b95599f-28bc-45c3-b27e-f1ce6e4e874c None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:47:02.022740 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:47:02.074560 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b95599f-28bc-45c3-b27e-f1ce6e4e874c None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:47:02.108764 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d083e23-164b-454a-acfb-5414db7432ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:47:02.109569 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d083e23-164b-454a-acfb-5414db7432ab None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:47:02.109862 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d083e23-164b-454a-acfb-5414db7432ab None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:47:02.110174 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d083e23-164b-454a-acfb-5414db7432ab None admin] PATH_INFO: `/v3/domains/76d07ae6b7f14efbb56412e0f648f59a` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:47:02.121134 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d083e23-164b-454a-acfb-5414db7432ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=76d07ae6b7f14efbb56412e0f648f59a)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:47:02.122624 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d083e23-164b-454a-acfb-5414db7432ab None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:47:02.124294 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 589/1172] 10.222.0.30 () {56 vars in 1183 bytes} [Tue Jul 5 21:47:01 2022] GET /identity/v3/domains/76d07ae6b7f14efbb56412e0f648f59a => generated 267 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:47:02.131007 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc6acc-70c9-4b2c-92be-5867ad35d814 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:47:02.149032 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:47:02.230015 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc6acc-70c9-4b2c-92be-5867ad35d814 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:47:02.263834 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6502cc9-bddd-4658-b7a7-609184322b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:47:02.264490 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6502cc9-bddd-4658-b7a7-609184322b9d None admin] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:47:02.264777 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6502cc9-bddd-4658-b7a7-609184322b9d None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:47:02.265057 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6502cc9-bddd-4658-b7a7-609184322b9d None admin] PATH_INFO: `/v3/projects` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:47:02.265869 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6502cc9-bddd-4658-b7a7-609184322b9d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:47:02.267440 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6502cc9-bddd-4658-b7a7-609184322b9d None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:47:02.332094 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 584/1173] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Jul 5 21:47:02 2022] POST /identity/v3/projects => generated 361 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:47:04.381940 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f98b0-aebb-448b-a051-fe0bba830e1c None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:47:04.382535 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f98b0-aebb-448b-a051-fe0bba830e1c None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:47:04.382644 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f98b0-aebb-448b-a051-fe0bba830e1c None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:47:04.384004 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 590/1174] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:47:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:47:04.389096 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b5400-1b4e-4e7a-84f3-05efb16465dc None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:47:04.389504 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b5400-1b4e-4e7a-84f3-05efb16465dc None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:47:04.389667 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b5400-1b4e-4e7a-84f3-05efb16465dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:47:04.407101 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-303b5400-1b4e-4e7a-84f3-05efb16465dc None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:47:04.408291 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-303b5400-1b4e-4e7a-84f3-05efb16465dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:47:04.468712 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:47:04.473823 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 585/1175] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:47:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:47:04.498726 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f98b0-aebb-448b-a051-fe0bba830e1c None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:47:04.603880 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f98b0-aebb-448b-a051-fe0bba830e1c None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:47:04.612842 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:47:04.637390 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1221e28-cb48-4586-8b55-9af0ee28529e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:47:04.638215 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1221e28-cb48-4586-8b55-9af0ee28529e None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:47:04.638506 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1221e28-cb48-4586-8b55-9af0ee28529e None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:47:04.638815 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1221e28-cb48-4586-8b55-9af0ee28529e None admin] PATH_INFO: `/v3/domains/76d07ae6b7f14efbb56412e0f648f59a` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:47:04.640297 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1221e28-cb48-4586-8b55-9af0ee28529e None admin] RBAC: Authorizing `identity:get_domain(domain_id=76d07ae6b7f14efbb56412e0f648f59a)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:47:04.641880 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1221e28-cb48-4586-8b55-9af0ee28529e None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:47:04.643775 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 591/1176] 10.222.0.30 () {56 vars in 1183 bytes} [Tue Jul 5 21:47:04 2022] GET /identity/v3/domains/76d07ae6b7f14efbb56412e0f648f59a => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:47:04.650018 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b5400-1b4e-4e7a-84f3-05efb16465dc None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:47:04.750200 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b5400-1b4e-4e7a-84f3-05efb16465dc None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:47:04.783634 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f709fa-75d7-468f-bfd0-01328ed0e793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:47:04.784303 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f709fa-75d7-468f-bfd0-01328ed0e793 None admin] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:47:04.784596 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f709fa-75d7-468f-bfd0-01328ed0e793 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:47:04.784878 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f709fa-75d7-468f-bfd0-01328ed0e793 None admin] PATH_INFO: `/v3/users` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:47:04.786249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f709fa-75d7-468f-bfd0-01328ed0e793 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:47:04.787863 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f709fa-75d7-468f-bfd0-01328ed0e793 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:47:04.862547 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 586/1177] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:47:04 2022] POST /identity/v3/users => generated 311 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:47:06.947851 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac28ec4-7a32-49d4-8b2a-e7f80169b534 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:47:06.948389 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac28ec4-7a32-49d4-8b2a-e7f80169b534 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:47:06.948495 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac28ec4-7a32-49d4-8b2a-e7f80169b534 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:47:06.949819 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 592/1178] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:47:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:47:06.954965 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4bd0b-8db3-4b3a-be40-96074d313faa None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:47:06.955383 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4bd0b-8db3-4b3a-be40-96074d313faa None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:47:06.955542 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4bd0b-8db3-4b3a-be40-96074d313faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:47:06.972840 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-26b4bd0b-8db3-4b3a-be40-96074d313faa None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:47:06.974810 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-26b4bd0b-8db3-4b3a-be40-96074d313faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:47:07.024157 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:47:07.041969 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 587/1179] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:47:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:47:07.066050 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac28ec4-7a32-49d4-8b2a-e7f80169b534 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:47:07.166287 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac28ec4-7a32-49d4-8b2a-e7f80169b534 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:47:07.199309 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a66475-6778-4f91-84ab-d7ed55a282bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:47:07.200036 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a66475-6778-4f91-84ab-d7ed55a282bd None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:47:07.200325 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a66475-6778-4f91-84ab-d7ed55a282bd None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:47:07.200605 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a66475-6778-4f91-84ab-d7ed55a282bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:47:07.211797 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a66475-6778-4f91-84ab-d7ed55a282bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:47:07.219381 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-63a66475-6778-4f91-84ab-d7ed55a282bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:47:07.219381 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:47:07.219381 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:47:07.219381 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:47:07.219381 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:47:07.219381 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:47:07.219381 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:47:07.219381 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:47:07.219381 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:47:07.219381 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:47:07.219381 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:47:07.219381 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:47:07.219381 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:47:07.219381 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:47:07.219381 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:47:07.219381 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:47:07.220581 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:47:07.220581 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:47:07.220581 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:47:07.220581 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:47:07.220581 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:47:07.220581 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:47:07.220581 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:47:07.220581 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:47:07.220581 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:47:07.220581 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:47:07.220581 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:47:07.220581 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:47:07.220581 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:47:07.220581 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:47:07.220581 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:47:07.220581 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:47:07.221722 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:47:07.221722 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:47:07.221722 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:47:07.221722 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:47:07.221722 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:47:07.221722 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:47:07.221722 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:47:07.221722 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:47:07.221722 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:47:07.221722 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:47:07.221722 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:47:07.221722 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:47:07.221722 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 593/1180] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:47:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:47:07.226758 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4bd0b-8db3-4b3a-be40-96074d313faa None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:47:07.323776 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4bd0b-8db3-4b3a-be40-96074d313faa None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:47:07.357471 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f0380-573a-4c9b-8851-9ab278c3e06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:47:07.358156 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f0380-573a-4c9b-8851-9ab278c3e06b None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:47:07.358451 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f0380-573a-4c9b-8851-9ab278c3e06b None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:47:07.358731 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f0380-573a-4c9b-8851-9ab278c3e06b None admin] PATH_INFO: `/v3/roles` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:47:07.359479 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f0380-573a-4c9b-8851-9ab278c3e06b None admin] RBAC: Adding query filter params (name=admin) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:47:07.359787 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f0380-573a-4c9b-8851-9ab278c3e06b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:47:07.361157 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f0380-573a-4c9b-8851-9ab278c3e06b None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:47:07.369250 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 588/1181] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:47:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:47:07.375079 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a66475-6778-4f91-84ab-d7ed55a282bd None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:47:07.410050 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:47:07.475118 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a66475-6778-4f91-84ab-d7ed55a282bd None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:47:07.508655 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b82f27-ed15-470f-81d4-60f2dc8ffa6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:47:07.509515 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b82f27-ed15-470f-81d4-60f2dc8ffa6a None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:47:07.509807 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b82f27-ed15-470f-81d4-60f2dc8ffa6a None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:47:07.510090 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b82f27-ed15-470f-81d4-60f2dc8ffa6a None admin] PATH_INFO: `/v3/users/f3e1d393e2c74a639d558b4e0b5f58f8` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:47:07.523693 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b82f27-ed15-470f-81d4-60f2dc8ffa6a None admin] RBAC: Authorizing `identity:get_user(user_id=f3e1d393e2c74a639d558b4e0b5f58f8)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:47:07.525138 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b82f27-ed15-470f-81d4-60f2dc8ffa6a None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:47:07.526824 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 594/1182] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:47:07 2022] GET /identity/v3/users/f3e1d393e2c74a639d558b4e0b5f58f8 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:47:07.532514 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f0380-573a-4c9b-8851-9ab278c3e06b None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:47:07.580370 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:47:07.634907 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f0380-573a-4c9b-8851-9ab278c3e06b None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:47:07.666985 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c5814-e4de-4208-91c4-eea0dfc28fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:47:07.667628 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c5814-e4de-4208-91c4-eea0dfc28fa2 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:47:07.667917 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c5814-e4de-4208-91c4-eea0dfc28fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:47:07.668197 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c5814-e4de-4208-91c4-eea0dfc28fa2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:47:07.733851 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c5814-e4de-4208-91c4-eea0dfc28fa2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:47:07.735268 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c5814-e4de-4208-91c4-eea0dfc28fa2 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:47:07.779154 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:47:07.830374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 589/1183] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:47:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:47:07.836796 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b82f27-ed15-470f-81d4-60f2dc8ffa6a None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:47:07.927985 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:47:07.934636 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b82f27-ed15-470f-81d4-60f2dc8ffa6a None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:47:07.968839 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d02f2d-67a4-477c-8898-db51479ee724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:47:07.969696 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d02f2d-67a4-477c-8898-db51479ee724 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:47:07.969981 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d02f2d-67a4-477c-8898-db51479ee724 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:47:07.970286 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d02f2d-67a4-477c-8898-db51479ee724 None admin] PATH_INFO: `/v3/projects/e3afd43b976f4ca19b447ba43aa2a38f` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:47:07.971474 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d02f2d-67a4-477c-8898-db51479ee724 None admin] RBAC: Authorizing `identity:get_project(project_id=e3afd43b976f4ca19b447ba43aa2a38f)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:47:07.972897 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d02f2d-67a4-477c-8898-db51479ee724 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:47:07.974737 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 595/1184] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:47:07 2022] GET /identity/v3/projects/e3afd43b976f4ca19b447ba43aa2a38f => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:47:07.981060 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c5814-e4de-4208-91c4-eea0dfc28fa2 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:47:08.077923 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c5814-e4de-4208-91c4-eea0dfc28fa2 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:47:08.112129 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb4526-035f-476f-b8e8-913a8c251c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:47:08.112793 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb4526-035f-476f-b8e8-913a8c251c39 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:47:08.113077 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb4526-035f-476f-b8e8-913a8c251c39 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:47:08.113352 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb4526-035f-476f-b8e8-913a8c251c39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:47:08.114291 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bb4526-035f-476f-b8e8-913a8c251c39 None admin] RBAC: Adding query filter params (role.id=e1c574c9973548ebb0e8d9e0656ccabd, scope.project.id=e3afd43b976f4ca19b447ba43aa2a38f, user.id=f3e1d393e2c74a639d558b4e0b5f58f8) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:47:08.114603 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bb4526-035f-476f-b8e8-913a8c251c39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:47:08.116022 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bb4526-035f-476f-b8e8-913a8c251c39 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:47:08.121323 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 590/1185] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:47:07 2022] GET /identity/v3/role_assignments?user.id=f3e1d393e2c74a639d558b4e0b5f58f8&scope.project.id=e3afd43b976f4ca19b447ba43aa2a38f&role.id=e1c574c9973548ebb0e8d9e0656ccabd => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:47:10.116122 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b23b1-2445-4eb7-8a59-f803dffcdf6c None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:47:10.116708 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b23b1-2445-4eb7-8a59-f803dffcdf6c None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:47:10.116708 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b23b1-2445-4eb7-8a59-f803dffcdf6c None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:47:10.118098 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 596/1186] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:47:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:47:10.123437 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beccf041-b8c4-4544-988c-95f9d4716db9 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:47:10.123871 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beccf041-b8c4-4544-988c-95f9d4716db9 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:47:10.124016 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beccf041-b8c4-4544-988c-95f9d4716db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:47:10.141225 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-beccf041-b8c4-4544-988c-95f9d4716db9 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:47:10.142461 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-beccf041-b8c4-4544-988c-95f9d4716db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:47:10.145281 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:47:10.209819 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 591/1187] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:47:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:47:10.233052 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b23b1-2445-4eb7-8a59-f803dffcdf6c None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:47:10.332961 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b23b1-2445-4eb7-8a59-f803dffcdf6c None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:47:10.366612 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3382e-2ea7-43d4-a4de-edfa719a2a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:47:10.367336 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3382e-2ea7-43d4-a4de-edfa719a2a26 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:47:10.367626 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3382e-2ea7-43d4-a4de-edfa719a2a26 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:47:10.367908 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3382e-2ea7-43d4-a4de-edfa719a2a26 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:47:10.377905 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f3382e-2ea7-43d4-a4de-edfa719a2a26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:47:10.386066 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-d6f3382e-2ea7-43d4-a4de-edfa719a2a26 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:47:10.386066 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:47:10.386066 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:47:10.386066 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:47:10.386066 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:47:10.386066 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:47:10.386066 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:47:10.386066 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:47:10.386066 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:47:10.386066 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:47:10.386066 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:47:10.386066 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:47:10.386066 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:47:10.386066 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:47:10.386066 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:47:10.386066 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:47:10.387237 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:47:10.387237 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:47:10.387237 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:47:10.387237 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:47:10.387237 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:47:10.387237 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:47:10.387237 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:47:10.387237 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:47:10.387237 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:47:10.387237 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:47:10.387237 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:47:10.387237 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:47:10.387237 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:47:10.387237 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:47:10.387237 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:47:10.387237 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:47:10.388425 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:47:10.388425 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:47:10.388425 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:47:10.388425 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:47:10.388425 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:47:10.388425 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:47:10.388425 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:47:10.388425 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:47:10.388425 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:47:10.388425 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:47:10.388425 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:47:10.388425 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:47:10.388425 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 597/1188] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:47:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:47:10.396511 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beccf041-b8c4-4544-988c-95f9d4716db9 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:47:10.494853 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beccf041-b8c4-4544-988c-95f9d4716db9 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:47:10.529090 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611c5d2-cd44-487c-9a63-600ab49c3491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:47:10.529754 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611c5d2-cd44-487c-9a63-600ab49c3491 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:47:10.530046 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611c5d2-cd44-487c-9a63-600ab49c3491 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:47:10.530361 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611c5d2-cd44-487c-9a63-600ab49c3491 None admin] PATH_INFO: `/v3/roles` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:47:10.531121 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3611c5d2-cd44-487c-9a63-600ab49c3491 None admin] RBAC: Adding query filter params (name=admin) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:47:10.531437 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3611c5d2-cd44-487c-9a63-600ab49c3491 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:47:10.532818 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3611c5d2-cd44-487c-9a63-600ab49c3491 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:47:10.541046 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 592/1189] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:47:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:47:10.546924 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3382e-2ea7-43d4-a4de-edfa719a2a26 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:47:10.574106 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:47:10.649340 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3382e-2ea7-43d4-a4de-edfa719a2a26 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:47:10.682695 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431b7ef-6db9-4928-8133-ebf471878641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:47:10.683558 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431b7ef-6db9-4928-8133-ebf471878641 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:47:10.683843 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431b7ef-6db9-4928-8133-ebf471878641 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:47:10.684120 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431b7ef-6db9-4928-8133-ebf471878641 None admin] PATH_INFO: `/v3/users/f3e1d393e2c74a639d558b4e0b5f58f8` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:47:10.685305 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7431b7ef-6db9-4928-8133-ebf471878641 None admin] RBAC: Authorizing `identity:get_user(user_id=f3e1d393e2c74a639d558b4e0b5f58f8)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:47:10.686778 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7431b7ef-6db9-4928-8133-ebf471878641 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:47:10.688408 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 598/1190] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:47:10 2022] GET /identity/v3/users/f3e1d393e2c74a639d558b4e0b5f58f8 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:47:10.695115 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611c5d2-cd44-487c-9a63-600ab49c3491 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:47:10.697987 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:47:10.794187 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611c5d2-cd44-487c-9a63-600ab49c3491 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:47:10.827219 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c56cb4-9381-43e7-9477-82aeb03c703c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:47:10.828071 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c56cb4-9381-43e7-9477-82aeb03c703c None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:47:10.828360 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c56cb4-9381-43e7-9477-82aeb03c703c None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:47:10.828638 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c56cb4-9381-43e7-9477-82aeb03c703c None admin] PATH_INFO: `/v3/projects/e3afd43b976f4ca19b447ba43aa2a38f` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:47:10.829814 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c56cb4-9381-43e7-9477-82aeb03c703c None admin] RBAC: Authorizing `identity:get_project(project_id=e3afd43b976f4ca19b447ba43aa2a38f)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:47:10.831276 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c56cb4-9381-43e7-9477-82aeb03c703c None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:47:10.833184 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 593/1191] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:47:10 2022] GET /identity/v3/projects/e3afd43b976f4ca19b447ba43aa2a38f => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:47:10.839230 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431b7ef-6db9-4928-8133-ebf471878641 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:47:10.928961 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:47:10.938260 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431b7ef-6db9-4928-8133-ebf471878641 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:47:10.971471 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032bb3f-61c0-41f6-a9bd-3d0af9dc7de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:47:10.972352 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032bb3f-61c0-41f6-a9bd-3d0af9dc7de9 None admin] REQUEST_METHOD: `PUT` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:47:10.972636 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032bb3f-61c0-41f6-a9bd-3d0af9dc7de9 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:47:10.973437 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032bb3f-61c0-41f6-a9bd-3d0af9dc7de9 None admin] PATH_INFO: `/v3/projects/e3afd43b976f4ca19b447ba43aa2a38f/users/f3e1d393e2c74a639d558b4e0b5f58f8/roles/e1c574c9973548ebb0e8d9e0656ccabd` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:47:10.975423 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032bb3f-61c0-41f6-a9bd-3d0af9dc7de9 None admin] RBAC: Authorizing `identity:create_grant(project_id=e3afd43b976f4ca19b447ba43aa2a38f, user_id=f3e1d393e2c74a639d558b4e0b5f58f8, role_id=e1c574c9973548ebb0e8d9e0656ccabd)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:47:10.976848 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032bb3f-61c0-41f6-a9bd-3d0af9dc7de9 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:47:11.045164 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 599/1192] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:47:10 2022] PUT /identity/v3/projects/e3afd43b976f4ca19b447ba43aa2a38f/users/f3e1d393e2c74a639d558b4e0b5f58f8/roles/e1c574c9973548ebb0e8d9e0656ccabd => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:47:13.044268 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f255957-71e0-4448-be89-99c378cdf5c0 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:47:13.044835 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f255957-71e0-4448-be89-99c378cdf5c0 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:47:13.044835 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f255957-71e0-4448-be89-99c378cdf5c0 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:47:13.046232 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 594/1193] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:47:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:47:13.052217 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d24e2c-d3d1-4e87-9727-633b3c971c47 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:47:13.052646 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d24e2c-d3d1-4e87-9727-633b3c971c47 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:47:13.052811 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d24e2c-d3d1-4e87-9727-633b3c971c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:47:13.070112 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-c5d24e2c-d3d1-4e87-9727-633b3c971c47 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:47:13.071348 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-c5d24e2c-d3d1-4e87-9727-633b3c971c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:47:13.137019 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 600/1194] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:47:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:47:13.160121 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f255957-71e0-4448-be89-99c378cdf5c0 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:47:13.232355 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:47:13.263454 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f255957-71e0-4448-be89-99c378cdf5c0 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:47:13.296692 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c210d-5760-42c0-a7a8-ba3714b6722e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:47:13.297414 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c210d-5760-42c0-a7a8-ba3714b6722e None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:47:13.297701 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c210d-5760-42c0-a7a8-ba3714b6722e None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:47:13.297982 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c210d-5760-42c0-a7a8-ba3714b6722e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:47:13.308616 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c210d-5760-42c0-a7a8-ba3714b6722e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:47:13.316340 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-d99c210d-5760-42c0-a7a8-ba3714b6722e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:47:13.316340 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:47:13.316340 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:47:13.316340 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:47:13.316340 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:47:13.316340 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:47:13.316340 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:47:13.316340 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:47:13.316340 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:47:13.316340 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:47:13.316340 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:47:13.316340 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:47:13.316340 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:47:13.316340 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:47:13.316340 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:47:13.316340 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:47:13.317612 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:47:13.317612 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:47:13.317612 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:47:13.317612 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:47:13.317612 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:47:13.317612 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:47:13.317612 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:47:13.317612 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:47:13.317612 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:47:13.317612 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:47:13.317612 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:47:13.317612 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:47:13.317612 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:47:13.317612 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:47:13.317612 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:47:13.317612 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:47:13.318902 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:47:13.318902 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:47:13.318902 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:47:13.318902 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:47:13.318902 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:47:13.318902 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:47:13.318902 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:47:13.318902 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:47:13.318902 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:47:13.318902 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:47:13.318902 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:47:13.318902 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:47:13.318902 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 595/1195] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:47:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:47:13.323668 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d24e2c-d3d1-4e87-9727-633b3c971c47 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:47:13.402348 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:47:13.421371 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d24e2c-d3d1-4e87-9727-633b3c971c47 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:47:13.455141 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7012eed0-4df0-4872-88e3-59f54344696c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:47:13.455806 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012eed0-4df0-4872-88e3-59f54344696c None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:47:13.456092 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012eed0-4df0-4872-88e3-59f54344696c None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:47:13.456375 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012eed0-4df0-4872-88e3-59f54344696c None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:47:13.457138 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7012eed0-4df0-4872-88e3-59f54344696c None admin] RBAC: Adding query filter params (name=admin) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:47:13.457800 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7012eed0-4df0-4872-88e3-59f54344696c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:47:13.459228 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7012eed0-4df0-4872-88e3-59f54344696c None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:47:13.467910 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 601/1196] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:47:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:47:13.474608 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c210d-5760-42c0-a7a8-ba3714b6722e None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:47:13.575315 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c210d-5760-42c0-a7a8-ba3714b6722e None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:47:13.604267 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:47:13.609850 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce84ca3-fa99-4d6b-8471-adadc3007adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:47:13.610788 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce84ca3-fa99-4d6b-8471-adadc3007adb None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:47:13.615949 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce84ca3-fa99-4d6b-8471-adadc3007adb None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:47:13.615949 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce84ca3-fa99-4d6b-8471-adadc3007adb None admin] PATH_INFO: `/v3/users/f3e1d393e2c74a639d558b4e0b5f58f8` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:47:13.615949 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce84ca3-fa99-4d6b-8471-adadc3007adb None admin] RBAC: Authorizing `identity:get_user(user_id=f3e1d393e2c74a639d558b4e0b5f58f8)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:47:13.615949 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce84ca3-fa99-4d6b-8471-adadc3007adb None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:47:13.615949 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 596/1197] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Jul 5 21:47:13 2022] GET /identity/v3/users/f3e1d393e2c74a639d558b4e0b5f58f8 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:47:13.621579 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7012eed0-4df0-4872-88e3-59f54344696c None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:47:13.720499 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7012eed0-4df0-4872-88e3-59f54344696c None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:47:13.754874 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8d874-9457-42dc-a55b-7a392f37a11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:47:13.755522 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8d874-9457-42dc-a55b-7a392f37a11f None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:47:13.755813 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8d874-9457-42dc-a55b-7a392f37a11f None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:47:13.756099 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8d874-9457-42dc-a55b-7a392f37a11f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:47:13.767836 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:47:13.823793 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e8d874-9457-42dc-a55b-7a392f37a11f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:47:13.825176 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e8d874-9457-42dc-a55b-7a392f37a11f None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:47:13.922512 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 602/1198] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:47:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:47:13.928388 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce84ca3-fa99-4d6b-8471-adadc3007adb None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:47:14.027725 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce84ca3-fa99-4d6b-8471-adadc3007adb None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:47:14.060428 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea8bb9b-a7ef-42a2-bb10-aa0a6f14bd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:47:14.061280 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8bb9b-a7ef-42a2-bb10-aa0a6f14bd35 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:47:14.061562 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8bb9b-a7ef-42a2-bb10-aa0a6f14bd35 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:47:14.061834 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8bb9b-a7ef-42a2-bb10-aa0a6f14bd35 None admin] PATH_INFO: `/v3/projects/e3afd43b976f4ca19b447ba43aa2a38f` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:47:14.063074 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea8bb9b-a7ef-42a2-bb10-aa0a6f14bd35 None admin] RBAC: Authorizing `identity:get_project(project_id=e3afd43b976f4ca19b447ba43aa2a38f)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:47:14.064509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea8bb9b-a7ef-42a2-bb10-aa0a6f14bd35 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:47:14.066230 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 597/1199] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Jul 5 21:47:13 2022] GET /identity/v3/projects/e3afd43b976f4ca19b447ba43aa2a38f => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:47:14.072834 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8d874-9457-42dc-a55b-7a392f37a11f None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:47:14.115430 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:47:14.171004 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8d874-9457-42dc-a55b-7a392f37a11f None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:47:14.204162 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1ced18-7cf8-49dd-89ba-892bd9e65182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:47:14.204809 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ced18-7cf8-49dd-89ba-892bd9e65182 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:47:14.205093 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ced18-7cf8-49dd-89ba-892bd9e65182 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:47:14.205370 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ced18-7cf8-49dd-89ba-892bd9e65182 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:47:14.206233 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1ced18-7cf8-49dd-89ba-892bd9e65182 None admin] RBAC: Adding query filter params (role.id=e1c574c9973548ebb0e8d9e0656ccabd, scope.project.id=e3afd43b976f4ca19b447ba43aa2a38f, user.id=f3e1d393e2c74a639d558b4e0b5f58f8) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:47:14.206549 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1ced18-7cf8-49dd-89ba-892bd9e65182 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:47:14.208785 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1ced18-7cf8-49dd-89ba-892bd9e65182 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:47:14.214515 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 603/1200] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:47:14 2022] GET /identity/v3/role_assignments?user.id=f3e1d393e2c74a639d558b4e0b5f58f8&scope.project.id=e3afd43b976f4ca19b447ba43aa2a38f&role.id=e1c574c9973548ebb0e8d9e0656ccabd => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:47:24.056354 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=67 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:47:24.211888 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=47 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:26.705975 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418e6a6-91d0-4159-bb85-f29eaebe4ae7 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:26.706640 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418e6a6-91d0-4159-bb85-f29eaebe4ae7 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:26.706640 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418e6a6-91d0-4159-bb85-f29eaebe4ae7 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:26.707974 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 598/1201] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:48:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:48:26.713116 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9ef75-7333-411b-ba9f-1b8b35c27160 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:26.713543 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9ef75-7333-411b-ba9f-1b8b35c27160 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:26.713682 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9ef75-7333-411b-ba9f-1b8b35c27160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:26.731181 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-d5a9ef75-7333-411b-ba9f-1b8b35c27160 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:48:26.732965 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-d5a9ef75-7333-411b-ba9f-1b8b35c27160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:48:26.799599 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 604/1202] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:48:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:48:26.824537 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0418e6a6-91d0-4159-bb85-f29eaebe4ae7 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:26.928452 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0418e6a6-91d0-4159-bb85-f29eaebe4ae7 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:26.964574 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3044c1d-d071-4d2b-9c96-49edc4dc7f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:26.965369 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3044c1d-d071-4d2b-9c96-49edc4dc7f35 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:26.965656 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3044c1d-d071-4d2b-9c96-49edc4dc7f35 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:26.965937 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3044c1d-d071-4d2b-9c96-49edc4dc7f35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:26.976553 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3044c1d-d071-4d2b-9c96-49edc4dc7f35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:26.977995 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3044c1d-d071-4d2b-9c96-49edc4dc7f35 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:26.995522 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-a3044c1d-d071-4d2b-9c96-49edc4dc7f35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:48:26.995522 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:48:26.995522 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:48:26.995522 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:48:26.995522 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:48:26.995522 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:48:26.995522 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:48:26.995522 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:48:26.995522 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:48:26.995522 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:48:26.995522 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:48:26.995522 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:48:26.995522 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:48:26.995522 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:48:26.995522 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:48:26.996794 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:48:26.996794 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:48:26.996794 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:48:26.996794 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:48:26.996794 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:48:26.996794 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:48:26.996794 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:48:26.996794 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:48:26.996794 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:48:26.996794 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:48:26.996794 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:48:26.996794 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:48:26.996794 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:48:26.996794 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:48:26.996794 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:48:26.996794 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:48:26.996794 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:48:27.004713 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:48:27.004713 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:48:27.004713 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:48:27.004713 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:48:27.004713 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 599/1203] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:48:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:48:27.005145 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9ef75-7333-411b-ba9f-1b8b35c27160 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:27.101998 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9ef75-7333-411b-ba9f-1b8b35c27160 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:27.132142 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:27.138845 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44d20c-8bea-4983-afd0-746e8f51eed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:27.139523 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44d20c-8bea-4983-afd0-746e8f51eed8 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:27.139810 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44d20c-8bea-4983-afd0-746e8f51eed8 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:27.140092 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44d20c-8bea-4983-afd0-746e8f51eed8 None admin] PATH_INFO: `/v3/domains` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:27.140823 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a44d20c-8bea-4983-afd0-746e8f51eed8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:48:27.141132 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a44d20c-8bea-4983-afd0-746e8f51eed8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:27.142546 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a44d20c-8bea-4983-afd0-746e8f51eed8 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:27.159212 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 605/1204] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:48:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:48:27.160340 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3044c1d-d071-4d2b-9c96-49edc4dc7f35 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:27.213881 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:27.261549 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3044c1d-d071-4d2b-9c96-49edc4dc7f35 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:27.296093 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f2dd3-ef99-4dc5-8436-07f2ca8fda7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:27.296768 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f2dd3-ef99-4dc5-8436-07f2ca8fda7d None admin] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:27.297063 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f2dd3-ef99-4dc5-8436-07f2ca8fda7d None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:27.297398 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f2dd3-ef99-4dc5-8436-07f2ca8fda7d None admin] PATH_INFO: `/v3/users` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:27.298090 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7f2dd3-ef99-4dc5-8436-07f2ca8fda7d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:27.299583 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7f2dd3-ef99-4dc5-8436-07f2ca8fda7d None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:27.364778 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 600/1205] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Jul 5 21:48:27 2022] POST /identity/v3/users => generated 251 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:48:29.421951 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7a45b-e3e5-41e2-9b21-ccc7e7d9a131 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:29.422581 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7a45b-e3e5-41e2-9b21-ccc7e7d9a131 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:29.422581 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7a45b-e3e5-41e2-9b21-ccc7e7d9a131 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:29.423962 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 606/1206] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:48:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:48:29.429168 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e2e0a-1a2c-45ef-aa12-319edce370a2 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:29.429611 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e2e0a-1a2c-45ef-aa12-319edce370a2 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:29.429718 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e2e0a-1a2c-45ef-aa12-319edce370a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:29.447667 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-fd4e2e0a-1a2c-45ef-aa12-319edce370a2 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:48:29.449130 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-fd4e2e0a-1a2c-45ef-aa12-319edce370a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:48:29.519326 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 601/1207] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:48:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:48:29.543562 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7a45b-e3e5-41e2-9b21-ccc7e7d9a131 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:29.646668 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7a45b-e3e5-41e2-9b21-ccc7e7d9a131 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:29.681045 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a7b103-5ec1-4364-a827-707de7898697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:29.681778 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7b103-5ec1-4364-a827-707de7898697 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:29.682065 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7b103-5ec1-4364-a827-707de7898697 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:29.682375 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7b103-5ec1-4364-a827-707de7898697 None admin] PATH_INFO: `/v3/roles/service` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:29.693127 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a7b103-5ec1-4364-a827-707de7898697 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:48:29.700930 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-76a7b103-5ec1-4364-a827-707de7898697 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:48:29.700930 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:48:29.700930 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:48:29.700930 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:48:29.700930 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:48:29.700930 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:48:29.700930 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:48:29.700930 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:48:29.700930 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:48:29.700930 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:48:29.700930 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:48:29.700930 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:48:29.700930 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:48:29.700930 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:48:29.700930 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:48:29.700930 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:48:29.702336 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:48:29.702336 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:48:29.702336 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:48:29.702336 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:48:29.702336 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:48:29.702336 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:48:29.702336 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:48:29.702336 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:48:29.702336 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:48:29.702336 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:48:29.702336 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:48:29.702336 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:48:29.702336 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:48:29.702336 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:48:29.702336 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:48:29.702336 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:48:29.703541 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:48:29.703541 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:48:29.703541 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:48:29.703541 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:48:29.703541 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:48:29.703541 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:48:29.703541 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:48:29.703541 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:48:29.703541 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:48:29.703541 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:48:29.703541 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:48:29.703541 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:48:29.703541 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 607/1208] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:48:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:48:29.708505 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e2e0a-1a2c-45ef-aa12-319edce370a2 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:29.749806 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:29.810277 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e2e0a-1a2c-45ef-aa12-319edce370a2 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:29.845701 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb476060-a622-4e42-858f-c8fa747b4d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:29.846395 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb476060-a622-4e42-858f-c8fa747b4d33 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:29.846680 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb476060-a622-4e42-858f-c8fa747b4d33 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:29.846959 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb476060-a622-4e42-858f-c8fa747b4d33 None admin] PATH_INFO: `/v3/roles` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:29.847715 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb476060-a622-4e42-858f-c8fa747b4d33 None admin] RBAC: Adding query filter params (name=service) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:48:29.848025 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb476060-a622-4e42-858f-c8fa747b4d33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:29.849397 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb476060-a622-4e42-858f-c8fa747b4d33 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:29.857910 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 602/1209] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:48:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:48:29.863587 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a7b103-5ec1-4364-a827-707de7898697 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:29.913018 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:29.960761 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a7b103-5ec1-4364-a827-707de7898697 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:29.994912 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1335247a-aa49-48bf-b2ca-bc43b41f96b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:29.995701 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335247a-aa49-48bf-b2ca-bc43b41f96b5 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:29.995987 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335247a-aa49-48bf-b2ca-bc43b41f96b5 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:29.996267 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335247a-aa49-48bf-b2ca-bc43b41f96b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:30.007403 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1335247a-aa49-48bf-b2ca-bc43b41f96b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:30.011972 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1335247a-aa49-48bf-b2ca-bc43b41f96b5 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:30.027035 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-1335247a-aa49-48bf-b2ca-bc43b41f96b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:48:30.027035 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:48:30.027035 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:48:30.027035 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:48:30.027035 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:48:30.027035 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:48:30.027035 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:48:30.027035 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:48:30.027035 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:48:30.027035 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:48:30.027035 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:48:30.027035 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:48:30.027035 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:48:30.027035 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:48:30.027035 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:48:30.031757 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:48:30.031757 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:48:30.031757 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:48:30.031757 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:48:30.031757 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:48:30.031757 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:48:30.031757 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:48:30.031757 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:48:30.031757 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:48:30.031757 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:48:30.031757 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:48:30.031757 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:48:30.031757 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:48:30.031757 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:48:30.031757 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:48:30.031757 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:48:30.031757 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:48:30.033062 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:48:30.033062 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:48:30.033062 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:48:30.033062 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:48:30.033062 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 608/1210] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:48:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:48:30.034306 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb476060-a622-4e42-858f-c8fa747b4d33 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:30.134425 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:30.137265 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb476060-a622-4e42-858f-c8fa747b4d33 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:30.171415 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa35069-d5c6-4167-8817-51b14e8c2720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:30.172089 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa35069-d5c6-4167-8817-51b14e8c2720 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:30.172380 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa35069-d5c6-4167-8817-51b14e8c2720 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:30.172660 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa35069-d5c6-4167-8817-51b14e8c2720 None admin] PATH_INFO: `/v3/domains` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:30.173390 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa35069-d5c6-4167-8817-51b14e8c2720 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:48:30.173700 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa35069-d5c6-4167-8817-51b14e8c2720 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:30.175109 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa35069-d5c6-4167-8817-51b14e8c2720 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:30.187462 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 603/1211] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:48:30.193142 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1335247a-aa49-48bf-b2ca-bc43b41f96b5 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:30.292445 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1335247a-aa49-48bf-b2ca-bc43b41f96b5 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:30.293899 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:30.328345 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715ab2e-4cab-4fe5-b6b4-7ec9f12b209b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:30.329238 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715ab2e-4cab-4fe5-b6b4-7ec9f12b209b None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:30.329770 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715ab2e-4cab-4fe5-b6b4-7ec9f12b209b None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:30.330255 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715ab2e-4cab-4fe5-b6b4-7ec9f12b209b None admin] PATH_INFO: `/v3/users/placement` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:30.337829 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5715ab2e-4cab-4fe5-b6b4-7ec9f12b209b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:30.339326 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5715ab2e-4cab-4fe5-b6b4-7ec9f12b209b None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:30.354482 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-5715ab2e-4cab-4fe5-b6b4-7ec9f12b209b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 21:48:30.354482 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:48:30.354482 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:48:30.354482 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:48:30.354482 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:48:30.354482 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:48:30.354482 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:48:30.354482 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:48:30.354482 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:48:30.354482 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:48:30.354482 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:48:30.354482 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:48:30.354482 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:48:30.354482 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:48:30.354482 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:48:30.354482 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:48:30.355840 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:48:30.355840 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:48:30.355840 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:48:30.355840 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:48:30.355840 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:48:30.355840 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:48:30.355840 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:48:30.355840 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:48:30.355840 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:48:30.355840 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:48:30.355840 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:48:30.355840 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:48:30.355840 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:48:30.355840 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:48:30.355840 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:48:30.355840 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:48:30.355840 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:48:30.355840 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:48:30.357437 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:48:30.357437 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:48:30.357437 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:48:30.357437 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:48:30.357437 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:48:30.357437 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:48:30.357437 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:48:30.357437 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:48:30.357437 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 21:48:30.357437 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:48:30.357437 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 609/1212] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:48:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:48:30.362141 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa35069-d5c6-4167-8817-51b14e8c2720 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:30.461092 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa35069-d5c6-4167-8817-51b14e8c2720 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:30.495619 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01bd5f2-441c-42cc-95a8-d1d3b4571456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:30.496292 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bd5f2-441c-42cc-95a8-d1d3b4571456 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:30.496582 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bd5f2-441c-42cc-95a8-d1d3b4571456 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:30.496862 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bd5f2-441c-42cc-95a8-d1d3b4571456 None admin] PATH_INFO: `/v3/users` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:30.498550 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01bd5f2-441c-42cc-95a8-d1d3b4571456 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:48:30.498871 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01bd5f2-441c-42cc-95a8-d1d3b4571456 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:30.500306 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01bd5f2-441c-42cc-95a8-d1d3b4571456 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:30.518208 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 604/1213] 10.222.0.30 () {56 vars in 1143 bytes} [Tue Jul 5 21:48:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:48:30.524004 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715ab2e-4cab-4fe5-b6b4-7ec9f12b209b None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:30.626582 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715ab2e-4cab-4fe5-b6b4-7ec9f12b209b None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:30.660190 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca966be0-04a8-4b27-9365-769801b462e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:30.660894 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca966be0-04a8-4b27-9365-769801b462e9 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:30.661180 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca966be0-04a8-4b27-9365-769801b462e9 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:30.661461 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca966be0-04a8-4b27-9365-769801b462e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:30.692646 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:30.728879 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca966be0-04a8-4b27-9365-769801b462e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:30.730644 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca966be0-04a8-4b27-9365-769801b462e9 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:30.826894 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 610/1214] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:48:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 05 21:48:30.832703 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01bd5f2-441c-42cc-95a8-d1d3b4571456 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:30.851392 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:30.932315 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01bd5f2-441c-42cc-95a8-d1d3b4571456 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:30.966868 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d082b-0a61-4717-b1c2-ea133f68e78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:30.967760 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d082b-0a61-4717-b1c2-ea133f68e78c None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:30.968046 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d082b-0a61-4717-b1c2-ea133f68e78c None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:30.968327 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d082b-0a61-4717-b1c2-ea133f68e78c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:30.978396 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915d082b-0a61-4717-b1c2-ea133f68e78c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:30.980089 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915d082b-0a61-4717-b1c2-ea133f68e78c None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:30.998111 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-915d082b-0a61-4717-b1c2-ea133f68e78c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:48:30.998111 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:48:30.998111 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:48:30.998111 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:48:30.998111 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:48:30.998111 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:48:30.998111 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:48:30.998111 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:48:30.998111 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:48:30.998111 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:48:30.998111 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:48:30.998111 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:48:30.998111 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:48:30.998111 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:48:30.998111 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:48:30.999302 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:48:30.999302 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:48:30.999302 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:48:30.999302 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:48:30.999302 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:48:30.999302 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:48:30.999302 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:48:30.999302 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:48:30.999302 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:48:30.999302 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:48:30.999302 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:48:30.999302 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:48:30.999302 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:48:30.999302 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:48:30.999302 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:48:30.999302 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:48:30.999302 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:48:31.000458 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:48:31.000458 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:48:31.000458 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:48:31.000458 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:48:31.000458 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 605/1215] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:48:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:48:31.005175 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca966be0-04a8-4b27-9365-769801b462e9 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:31.066145 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:31.105246 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca966be0-04a8-4b27-9365-769801b462e9 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:31.139725 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b509a-1dca-4f70-b244-cde2b14698f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:31.140392 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b509a-1dca-4f70-b244-cde2b14698f8 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:31.140682 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b509a-1dca-4f70-b244-cde2b14698f8 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:31.140966 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b509a-1dca-4f70-b244-cde2b14698f8 None admin] PATH_INFO: `/v3/domains` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:31.141697 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b509a-1dca-4f70-b244-cde2b14698f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:48:31.142009 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b509a-1dca-4f70-b244-cde2b14698f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:31.143429 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b509a-1dca-4f70-b244-cde2b14698f8 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:31.155334 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 611/1216] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:48:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:48:31.161054 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d082b-0a61-4717-b1c2-ea133f68e78c None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:31.231130 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:31.261481 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d082b-0a61-4717-b1c2-ea133f68e78c None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:31.295090 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6588be-004c-40e2-9235-abb996b42f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:31.295876 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6588be-004c-40e2-9235-abb996b42f67 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:31.296160 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6588be-004c-40e2-9235-abb996b42f67 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:31.296438 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6588be-004c-40e2-9235-abb996b42f67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:31.303084 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6588be-004c-40e2-9235-abb996b42f67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:31.304516 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6588be-004c-40e2-9235-abb996b42f67 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:31.318836 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-ed6588be-004c-40e2-9235-abb996b42f67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:48:31.318836 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:48:31.318836 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:48:31.318836 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:48:31.318836 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:48:31.318836 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:48:31.318836 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:48:31.318836 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:48:31.318836 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:48:31.318836 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:48:31.318836 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:48:31.318836 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:48:31.318836 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:48:31.318836 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:48:31.318836 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:48:31.320567 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:48:31.320567 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:48:31.320567 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:48:31.320567 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:48:31.320567 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:48:31.320567 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:48:31.320567 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:48:31.320567 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:48:31.320567 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:48:31.320567 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:48:31.320567 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:48:31.320567 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:48:31.320567 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:48:31.320567 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:48:31.320567 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:48:31.320567 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:48:31.320567 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:48:31.321784 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:48:31.321784 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:48:31.321784 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:48:31.321784 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:48:31.321784 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:48:31.321784 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:48:31.321784 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:48:31.321784 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:48:31.321784 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 606/1217] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:48:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:48:31.326658 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b509a-1dca-4f70-b244-cde2b14698f8 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:31.429534 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b509a-1dca-4f70-b244-cde2b14698f8 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:31.453175 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:31.464406 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88efeca5-f213-4dc5-9a1c-2151cd4fce0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:31.465077 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efeca5-f213-4dc5-9a1c-2151cd4fce0c None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:31.465365 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efeca5-f213-4dc5-9a1c-2151cd4fce0c None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:31.465648 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efeca5-f213-4dc5-9a1c-2151cd4fce0c None admin] PATH_INFO: `/v3/projects` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:31.467068 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88efeca5-f213-4dc5-9a1c-2151cd4fce0c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:48:31.467468 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88efeca5-f213-4dc5-9a1c-2151cd4fce0c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:31.468917 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88efeca5-f213-4dc5-9a1c-2151cd4fce0c None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:31.481318 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 612/1218] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:48:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:48:31.487445 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6588be-004c-40e2-9235-abb996b42f67 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:31.587274 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6588be-004c-40e2-9235-abb996b42f67 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:31.615458 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:31.621224 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e45975-1074-4839-9ad4-aa34b27dd231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:31.621859 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e45975-1074-4839-9ad4-aa34b27dd231 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:31.622167 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e45975-1074-4839-9ad4-aa34b27dd231 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:31.622584 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e45975-1074-4839-9ad4-aa34b27dd231 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:31.623424 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e45975-1074-4839-9ad4-aa34b27dd231 None admin] RBAC: Adding query filter params (role.id=1884e658df064cc2a232687c678d8618, scope.project.id=93f20f89d0fc4bbf9cf557dd1e14d98d, user.id=c289d4b42dec4fe382e35c3f9faa21c8) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:48:31.623733 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e45975-1074-4839-9ad4-aa34b27dd231 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:31.625157 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e45975-1074-4839-9ad4-aa34b27dd231 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:31.630509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 607/1219] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:48:31 2022] GET /identity/v3/role_assignments?user.id=c289d4b42dec4fe382e35c3f9faa21c8&scope.project.id=93f20f89d0fc4bbf9cf557dd1e14d98d&role.id=1884e658df064cc2a232687c678d8618 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:48:33.706703 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0442bb-1042-4765-af62-2f84ee9dafb7 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:33.707295 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0442bb-1042-4765-af62-2f84ee9dafb7 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:33.707295 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0442bb-1042-4765-af62-2f84ee9dafb7 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:33.708673 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 613/1220] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:48:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:48:33.713869 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb24f32-cb7e-4654-a746-eb566814131c None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:33.714313 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb24f32-cb7e-4654-a746-eb566814131c None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:33.714506 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb24f32-cb7e-4654-a746-eb566814131c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:33.732980 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-cfb24f32-cb7e-4654-a746-eb566814131c None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:48:33.736124 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-cfb24f32-cb7e-4654-a746-eb566814131c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:48:33.799947 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 608/1221] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:48:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:48:33.822903 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0442bb-1042-4765-af62-2f84ee9dafb7 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:33.926670 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0442bb-1042-4765-af62-2f84ee9dafb7 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:33.960830 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d235c-a765-494a-a3fe-7156a4ed19fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:33.961624 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d235c-a765-494a-a3fe-7156a4ed19fe None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:33.961911 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d235c-a765-494a-a3fe-7156a4ed19fe None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:33.962219 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d235c-a765-494a-a3fe-7156a4ed19fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:33.972358 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8d235c-a765-494a-a3fe-7156a4ed19fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:48:33.980349 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-5a8d235c-a765-494a-a3fe-7156a4ed19fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:48:33.980349 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:48:33.980349 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:48:33.980349 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:48:33.980349 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:48:33.980349 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:48:33.980349 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:48:33.980349 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:48:33.980349 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:48:33.980349 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:48:33.980349 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:48:33.980349 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:48:33.980349 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:48:33.980349 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:48:33.980349 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:48:33.980349 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:48:33.981658 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:48:33.981658 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:48:33.981658 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:48:33.981658 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:48:33.981658 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:48:33.981658 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:48:33.981658 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:48:33.981658 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:48:33.981658 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:48:33.981658 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:48:33.981658 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:48:33.981658 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:48:33.981658 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:48:33.981658 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:48:33.981658 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:48:33.981658 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:48:33.982633 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:48:33.982633 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:48:33.982633 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:48:33.982633 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:48:33.982633 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:48:33.982633 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:48:33.982633 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:48:33.982633 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:48:33.982633 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:48:33.982633 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:48:33.982633 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:48:33.982633 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:48:33.982633 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 614/1222] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:48:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:48:33.987875 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb24f32-cb7e-4654-a746-eb566814131c None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:34.085417 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb24f32-cb7e-4654-a746-eb566814131c None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:34.110149 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:34.120486 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5931213-f3b2-4361-956a-450fce8ac95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:34.121149 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5931213-f3b2-4361-956a-450fce8ac95c None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:34.121436 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5931213-f3b2-4361-956a-450fce8ac95c None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:34.121717 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5931213-f3b2-4361-956a-450fce8ac95c None admin] PATH_INFO: `/v3/roles` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:34.122501 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5931213-f3b2-4361-956a-450fce8ac95c None admin] RBAC: Adding query filter params (name=service) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:48:34.122811 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5931213-f3b2-4361-956a-450fce8ac95c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:34.124202 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5931213-f3b2-4361-956a-450fce8ac95c None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:34.133819 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 609/1223] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:48:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:48:34.139630 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d235c-a765-494a-a3fe-7156a4ed19fe None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:34.183283 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:34.240449 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d235c-a765-494a-a3fe-7156a4ed19fe None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:34.274294 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93807db-92f4-4d3a-938f-15e23ec03a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:34.275086 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93807db-92f4-4d3a-938f-15e23ec03a1e None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:34.275378 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93807db-92f4-4d3a-938f-15e23ec03a1e None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:34.275668 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93807db-92f4-4d3a-938f-15e23ec03a1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:34.287155 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93807db-92f4-4d3a-938f-15e23ec03a1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:34.288612 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93807db-92f4-4d3a-938f-15e23ec03a1e None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:34.306917 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-f93807db-92f4-4d3a-938f-15e23ec03a1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:48:34.306917 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:48:34.306917 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:48:34.306917 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:48:34.306917 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:48:34.306917 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:48:34.306917 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:48:34.306917 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:48:34.306917 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:48:34.306917 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:48:34.306917 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:48:34.306917 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:48:34.306917 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:48:34.306917 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:48:34.306917 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:48:34.308157 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:48:34.308157 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:48:34.308157 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:48:34.308157 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:48:34.308157 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:48:34.308157 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:48:34.308157 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:48:34.308157 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:48:34.308157 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:48:34.308157 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:48:34.308157 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:48:34.308157 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:48:34.308157 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:48:34.308157 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:48:34.308157 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:48:34.308157 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:48:34.308157 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:48:34.309614 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:48:34.309614 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:48:34.309614 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:48:34.309614 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:48:34.309614 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 615/1224] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:48:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:48:34.314891 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5931213-f3b2-4361-956a-450fce8ac95c None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:34.415341 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5931213-f3b2-4361-956a-450fce8ac95c None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:34.448723 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89810d72-9d00-4870-a704-90bfed556a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:34.449466 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89810d72-9d00-4870-a704-90bfed556a34 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:34.449675 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89810d72-9d00-4870-a704-90bfed556a34 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:34.449958 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89810d72-9d00-4870-a704-90bfed556a34 None admin] PATH_INFO: `/v3/domains` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:34.450723 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89810d72-9d00-4870-a704-90bfed556a34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:48:34.453943 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89810d72-9d00-4870-a704-90bfed556a34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:34.453943 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89810d72-9d00-4870-a704-90bfed556a34 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:34.464657 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 610/1225] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:48:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:48:34.471253 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93807db-92f4-4d3a-938f-15e23ec03a1e None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:34.567029 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:34.573891 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93807db-92f4-4d3a-938f-15e23ec03a1e None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:34.609841 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4362e7-d9d5-4a2b-9535-2a0fabfffc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:34.610690 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4362e7-d9d5-4a2b-9535-2a0fabfffc32 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:34.610983 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4362e7-d9d5-4a2b-9535-2a0fabfffc32 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:34.611265 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4362e7-d9d5-4a2b-9535-2a0fabfffc32 None admin] PATH_INFO: `/v3/users/placement` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:34.619097 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4362e7-d9d5-4a2b-9535-2a0fabfffc32 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:34.620664 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4362e7-d9d5-4a2b-9535-2a0fabfffc32 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:34.635122 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-2c4362e7-d9d5-4a2b-9535-2a0fabfffc32 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 21:48:34.635122 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:48:34.635122 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:48:34.635122 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:48:34.635122 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:48:34.635122 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:48:34.635122 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:48:34.635122 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:48:34.635122 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:48:34.635122 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:48:34.635122 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:48:34.635122 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:48:34.635122 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:48:34.635122 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:48:34.635122 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:48:34.635122 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:48:34.636349 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:48:34.636349 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:48:34.636349 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:48:34.636349 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:48:34.636349 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:48:34.636349 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:48:34.636349 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:48:34.636349 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:48:34.636349 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:48:34.636349 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:48:34.636349 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:48:34.636349 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:48:34.636349 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:48:34.636349 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:48:34.636349 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:48:34.636349 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:48:34.636349 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:48:34.636349 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:48:34.637606 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:48:34.637606 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:48:34.637606 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:48:34.637606 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:48:34.637606 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:48:34.637606 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:48:34.637606 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:48:34.637606 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:48:34.637606 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 21:48:34.637606 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:48:34.637606 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 616/1226] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:48:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:48:34.642782 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89810d72-9d00-4870-a704-90bfed556a34 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:34.691386 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:34.743983 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89810d72-9d00-4870-a704-90bfed556a34 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:34.779796 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd418b-7a09-4159-bd09-85fe73c987d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:34.780691 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd418b-7a09-4159-bd09-85fe73c987d2 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:34.780983 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd418b-7a09-4159-bd09-85fe73c987d2 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:34.781274 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd418b-7a09-4159-bd09-85fe73c987d2 None admin] PATH_INFO: `/v3/users` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:34.782136 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cd418b-7a09-4159-bd09-85fe73c987d2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:48:34.782475 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cd418b-7a09-4159-bd09-85fe73c987d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:34.783910 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cd418b-7a09-4159-bd09-85fe73c987d2 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:34.801668 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 611/1227] 10.222.0.30 () {56 vars in 1143 bytes} [Tue Jul 5 21:48:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:48:34.807475 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4362e7-d9d5-4a2b-9535-2a0fabfffc32 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:34.908109 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4362e7-d9d5-4a2b-9535-2a0fabfffc32 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:34.941782 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b4221-5cc6-4765-ab5b-5455ddd245d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:34.942555 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b4221-5cc6-4765-ab5b-5455ddd245d3 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:34.942846 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b4221-5cc6-4765-ab5b-5455ddd245d3 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:34.943130 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b4221-5cc6-4765-ab5b-5455ddd245d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:34.955235 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872b4221-5cc6-4765-ab5b-5455ddd245d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:34.963674 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872b4221-5cc6-4765-ab5b-5455ddd245d3 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:34.973631 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-872b4221-5cc6-4765-ab5b-5455ddd245d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:48:34.973631 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:48:34.973631 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:48:34.973631 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:48:34.973631 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:48:34.973631 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:48:34.973631 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:48:34.973631 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:48:34.973631 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:48:34.973631 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:48:34.973631 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:48:34.973631 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:48:34.973631 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:48:34.973631 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:48:34.973631 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:48:34.974800 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:48:34.974800 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:48:34.974800 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:48:34.974800 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:48:34.974800 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:48:34.974800 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:48:34.974800 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:48:34.974800 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:48:34.974800 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:48:34.974800 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:48:34.974800 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:48:34.974800 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:48:34.974800 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:48:34.974800 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:48:34.974800 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:48:34.974800 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:48:34.974800 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:48:34.975832 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:48:34.975832 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:48:34.975832 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:48:34.975832 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:48:34.975832 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 617/1228] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:48:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:48:34.980989 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd418b-7a09-4159-bd09-85fe73c987d2 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:35.081134 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd418b-7a09-4159-bd09-85fe73c987d2 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:35.083492 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:35.115695 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71424e34-f906-4f73-8ae9-c58319890186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:35.116353 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71424e34-f906-4f73-8ae9-c58319890186 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:35.116650 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71424e34-f906-4f73-8ae9-c58319890186 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:35.116930 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71424e34-f906-4f73-8ae9-c58319890186 None admin] PATH_INFO: `/v3/domains` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:35.117663 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71424e34-f906-4f73-8ae9-c58319890186 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:48:35.117976 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71424e34-f906-4f73-8ae9-c58319890186 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:35.119382 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71424e34-f906-4f73-8ae9-c58319890186 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:35.131164 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 612/1229] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:48:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:48:35.136992 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b4221-5cc6-4765-ab5b-5455ddd245d3 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:35.147055 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:35.239512 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b4221-5cc6-4765-ab5b-5455ddd245d3 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:35.273170 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec6a63-e9f7-49a5-9319-98df810ee66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:35.273967 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec6a63-e9f7-49a5-9319-98df810ee66d None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:35.274297 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec6a63-e9f7-49a5-9319-98df810ee66d None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:35.274581 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec6a63-e9f7-49a5-9319-98df810ee66d None admin] PATH_INFO: `/v3/projects/service` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:35.281990 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec6a63-e9f7-49a5-9319-98df810ee66d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:35.283517 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec6a63-e9f7-49a5-9319-98df810ee66d None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:35.297918 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-e7ec6a63-e9f7-49a5-9319-98df810ee66d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:48:35.297918 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:48:35.297918 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:48:35.297918 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:48:35.297918 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:48:35.297918 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:48:35.297918 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:48:35.297918 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:48:35.297918 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:48:35.297918 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:48:35.297918 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:48:35.297918 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:48:35.297918 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:48:35.297918 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:48:35.297918 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:48:35.298925 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:48:35.298925 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:48:35.298925 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:48:35.298925 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:48:35.298925 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:48:35.298925 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:48:35.298925 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:48:35.298925 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:48:35.298925 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:48:35.298925 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:48:35.298925 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:48:35.298925 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:48:35.298925 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:48:35.298925 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:48:35.298925 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:48:35.298925 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:48:35.298925 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:48:35.299933 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:48:35.299933 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:48:35.299933 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:48:35.299933 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:48:35.299933 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:48:35.299933 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:48:35.299933 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:48:35.299933 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:48:35.299933 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 618/1230] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:48:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:48:35.305111 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71424e34-f906-4f73-8ae9-c58319890186 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:35.410997 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71424e34-f906-4f73-8ae9-c58319890186 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:35.444773 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2307f729-ac53-475a-9ba4-7e60e7aee05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:35.445439 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307f729-ac53-475a-9ba4-7e60e7aee05d None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:35.445727 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307f729-ac53-475a-9ba4-7e60e7aee05d None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:35.446008 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307f729-ac53-475a-9ba4-7e60e7aee05d None admin] PATH_INFO: `/v3/projects` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:35.446841 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2307f729-ac53-475a-9ba4-7e60e7aee05d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:48:35.447157 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2307f729-ac53-475a-9ba4-7e60e7aee05d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:35.448621 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2307f729-ac53-475a-9ba4-7e60e7aee05d None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:35.461291 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 613/1231] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:48:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:48:35.467637 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec6a63-e9f7-49a5-9319-98df810ee66d None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:35.533988 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:35.568254 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec6a63-e9f7-49a5-9319-98df810ee66d None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:35.602027 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a6e1e5-1f63-4168-b716-351ed1afc50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:35.602945 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6e1e5-1f63-4168-b716-351ed1afc50e None admin] REQUEST_METHOD: `PUT` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:35.603254 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6e1e5-1f63-4168-b716-351ed1afc50e None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:35.603520 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6e1e5-1f63-4168-b716-351ed1afc50e None admin] PATH_INFO: `/v3/projects/93f20f89d0fc4bbf9cf557dd1e14d98d/users/c289d4b42dec4fe382e35c3f9faa21c8/roles/1884e658df064cc2a232687c678d8618` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:35.618906 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a6e1e5-1f63-4168-b716-351ed1afc50e None admin] RBAC: Authorizing `identity:create_grant(project_id=93f20f89d0fc4bbf9cf557dd1e14d98d, user_id=c289d4b42dec4fe382e35c3f9faa21c8, role_id=1884e658df064cc2a232687c678d8618)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:35.620362 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a6e1e5-1f63-4168-b716-351ed1afc50e None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:35.787872 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 619/1232] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:48:35 2022] PUT /identity/v3/projects/93f20f89d0fc4bbf9cf557dd1e14d98d/users/c289d4b42dec4fe382e35c3f9faa21c8/roles/1884e658df064cc2a232687c678d8618 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:48:38.011225 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941a7bc-606f-460f-ac0a-4a788a0dcb1e None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:38.011819 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941a7bc-606f-460f-ac0a-4a788a0dcb1e None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:38.011819 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941a7bc-606f-460f-ac0a-4a788a0dcb1e None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:38.013167 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 614/1233] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:48:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:48:38.019228 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb011a-6859-4d07-bc5e-0edd80195d09 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:38.019652 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb011a-6859-4d07-bc5e-0edd80195d09 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:38.019832 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb011a-6859-4d07-bc5e-0edd80195d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:38.036226 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-5dfb011a-6859-4d07-bc5e-0edd80195d09 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:48:38.037480 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-5dfb011a-6859-4d07-bc5e-0edd80195d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:48:38.104424 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 620/1234] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:48:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:48:38.129247 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941a7bc-606f-460f-ac0a-4a788a0dcb1e None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:38.155828 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:38.235727 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941a7bc-606f-460f-ac0a-4a788a0dcb1e None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:38.276433 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a00d17-5b14-4637-a13f-b27e454af8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:38.277188 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a00d17-5b14-4637-a13f-b27e454af8a4 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:38.277692 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a00d17-5b14-4637-a13f-b27e454af8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:38.277816 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a00d17-5b14-4637-a13f-b27e454af8a4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:38.288381 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a00d17-5b14-4637-a13f-b27e454af8a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:48:38.296846 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-d0a00d17-5b14-4637-a13f-b27e454af8a4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:48:38.296846 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:48:38.296846 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:48:38.296846 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:48:38.296846 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:48:38.296846 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:48:38.296846 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:48:38.296846 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:48:38.296846 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:48:38.296846 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:48:38.296846 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:48:38.296846 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:48:38.296846 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:48:38.296846 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:48:38.296846 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:48:38.296846 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:48:38.302935 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:48:38.302935 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:48:38.302935 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:48:38.302935 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:48:38.302935 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:48:38.302935 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:48:38.302935 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:48:38.302935 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:48:38.302935 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:48:38.302935 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:48:38.302935 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:48:38.302935 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:48:38.302935 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:48:38.302935 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:48:38.302935 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:48:38.302935 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:48:38.304120 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:48:38.304120 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:48:38.304120 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:48:38.304120 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:48:38.304120 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:48:38.304120 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:48:38.304120 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:48:38.304120 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:48:38.304120 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:48:38.304120 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:48:38.304120 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 21:48:38.304120 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:48:38.304120 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 615/1235] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Jul 5 21:48:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:48:38.306152 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb011a-6859-4d07-bc5e-0edd80195d09 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:38.356183 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:38.411160 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb011a-6859-4d07-bc5e-0edd80195d09 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:38.444855 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3efd94-c93e-4caf-832b-7bc40975b7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:38.445531 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3efd94-c93e-4caf-832b-7bc40975b7f7 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:38.445817 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3efd94-c93e-4caf-832b-7bc40975b7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:38.446096 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3efd94-c93e-4caf-832b-7bc40975b7f7 None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:38.446886 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3efd94-c93e-4caf-832b-7bc40975b7f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:48:38.447194 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3efd94-c93e-4caf-832b-7bc40975b7f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:38.448569 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3efd94-c93e-4caf-832b-7bc40975b7f7 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:38.459190 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 621/1236] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Jul 5 21:48:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:48:38.465170 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a00d17-5b14-4637-a13f-b27e454af8a4 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:38.554052 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:38.571545 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a00d17-5b14-4637-a13f-b27e454af8a4 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:38.606648 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dfc08f-9d83-4470-81a1-5ab35a0ba56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:38.607446 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfc08f-9d83-4470-81a1-5ab35a0ba56e None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:38.607730 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfc08f-9d83-4470-81a1-5ab35a0ba56e None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:38.608654 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfc08f-9d83-4470-81a1-5ab35a0ba56e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:38.619674 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dfc08f-9d83-4470-81a1-5ab35a0ba56e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:38.621214 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dfc08f-9d83-4470-81a1-5ab35a0ba56e None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:38.642628 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-63dfc08f-9d83-4470-81a1-5ab35a0ba56e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:48:38.642628 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:48:38.642628 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:48:38.642628 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:48:38.642628 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:48:38.642628 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:48:38.642628 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:48:38.642628 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:48:38.642628 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:48:38.642628 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:48:38.642628 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:48:38.642628 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:48:38.642628 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:48:38.642628 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:48:38.642628 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:48:38.643838 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:48:38.643838 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:48:38.643838 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:48:38.643838 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:48:38.643838 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:48:38.643838 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:48:38.643838 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:48:38.643838 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:48:38.643838 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:48:38.643838 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:48:38.643838 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:48:38.643838 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:48:38.643838 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:48:38.643838 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:48:38.643838 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:48:38.643838 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:48:38.643838 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:48:38.645342 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:48:38.645342 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:48:38.645342 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:48:38.645342 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:48:38.645342 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 616/1237] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:48:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:48:38.649775 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3efd94-c93e-4caf-832b-7bc40975b7f7 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:38.757489 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3efd94-c93e-4caf-832b-7bc40975b7f7 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:38.768008 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:38.794015 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73625d4-2d0e-403a-a441-03e90d8ae8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:38.794716 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73625d4-2d0e-403a-a441-03e90d8ae8d6 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:38.795003 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73625d4-2d0e-403a-a441-03e90d8ae8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:38.795283 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73625d4-2d0e-403a-a441-03e90d8ae8d6 None admin] PATH_INFO: `/v3/domains` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:38.796613 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73625d4-2d0e-403a-a441-03e90d8ae8d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:48:38.796924 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73625d4-2d0e-403a-a441-03e90d8ae8d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:38.798405 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73625d4-2d0e-403a-a441-03e90d8ae8d6 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:38.810289 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 622/1238] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:48:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:48:38.815935 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dfc08f-9d83-4470-81a1-5ab35a0ba56e None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:38.925818 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dfc08f-9d83-4470-81a1-5ab35a0ba56e None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:38.960034 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455ac64-9b74-47f9-872d-d8155130ad7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:38.960837 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455ac64-9b74-47f9-872d-d8155130ad7e None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:38.961126 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455ac64-9b74-47f9-872d-d8155130ad7e None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:38.961405 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455ac64-9b74-47f9-872d-d8155130ad7e None admin] PATH_INFO: `/v3/users/placement` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:38.964068 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:38.969265 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455ac64-9b74-47f9-872d-d8155130ad7e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:38.970884 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455ac64-9b74-47f9-872d-d8155130ad7e None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:38.986249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-7455ac64-9b74-47f9-872d-d8155130ad7e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 21:48:38.986249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:48:38.986249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:48:38.986249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:48:38.986249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:48:38.986249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:48:38.986249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:48:38.986249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:48:38.986249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:48:38.986249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:48:38.986249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:48:38.986249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:48:38.986249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:48:38.986249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:48:38.986249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:48:38.986249 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:48:38.987401 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:48:38.987401 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:48:38.987401 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:48:38.987401 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:48:38.987401 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:48:38.987401 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:48:38.987401 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:48:38.987401 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:48:38.987401 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:48:38.987401 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:48:38.987401 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:48:38.987401 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:48:38.987401 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:48:38.987401 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:48:38.987401 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:48:38.987401 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:48:38.987401 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:48:38.987401 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:48:38.988890 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:48:38.988890 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:48:38.988890 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:48:38.988890 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:48:38.988890 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:48:38.988890 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:48:38.988890 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:48:38.988890 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:48:38.988890 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 21:48:38.988890 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:48:38.988890 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 617/1239] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:48:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:48:38.993228 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73625d4-2d0e-403a-a441-03e90d8ae8d6 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:39.094192 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73625d4-2d0e-403a-a441-03e90d8ae8d6 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:39.128465 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b2a6e-61f9-4c17-be18-1f953eac388f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:39.129142 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b2a6e-61f9-4c17-be18-1f953eac388f None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:39.129432 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b2a6e-61f9-4c17-be18-1f953eac388f None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:39.129712 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b2a6e-61f9-4c17-be18-1f953eac388f None admin] PATH_INFO: `/v3/users` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:39.130631 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b2a6e-61f9-4c17-be18-1f953eac388f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:48:39.130956 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b2a6e-61f9-4c17-be18-1f953eac388f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:39.132391 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b2a6e-61f9-4c17-be18-1f953eac388f None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:39.154577 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 623/1240] 10.222.0.30 () {56 vars in 1143 bytes} [Tue Jul 5 21:48:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:48:39.160649 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455ac64-9b74-47f9-872d-d8155130ad7e None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:39.265181 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455ac64-9b74-47f9-872d-d8155130ad7e None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:39.299366 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357fa57b-6aa7-4c24-86b5-50dfbb81be29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:39.300023 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357fa57b-6aa7-4c24-86b5-50dfbb81be29 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:39.300361 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357fa57b-6aa7-4c24-86b5-50dfbb81be29 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:39.300639 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357fa57b-6aa7-4c24-86b5-50dfbb81be29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:39.367909 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:39.375069 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357fa57b-6aa7-4c24-86b5-50dfbb81be29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:39.376529 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357fa57b-6aa7-4c24-86b5-50dfbb81be29 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:39.476901 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 618/1241] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:48:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:48:39.485286 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b2a6e-61f9-4c17-be18-1f953eac388f None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:39.513318 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:39.586870 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b2a6e-61f9-4c17-be18-1f953eac388f None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:39.621786 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1987ad8b-27bc-4f4f-a1eb-d5fcfd8c27c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:39.622567 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987ad8b-27bc-4f4f-a1eb-d5fcfd8c27c8 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:39.622855 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987ad8b-27bc-4f4f-a1eb-d5fcfd8c27c8 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:39.623141 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987ad8b-27bc-4f4f-a1eb-d5fcfd8c27c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:39.633940 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1987ad8b-27bc-4f4f-a1eb-d5fcfd8c27c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:39.638026 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1987ad8b-27bc-4f4f-a1eb-d5fcfd8c27c8 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:39.653689 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-1987ad8b-27bc-4f4f-a1eb-d5fcfd8c27c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:48:39.653689 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:48:39.653689 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:48:39.653689 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:48:39.653689 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:48:39.653689 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:48:39.653689 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:48:39.653689 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:48:39.653689 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:48:39.653689 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:48:39.653689 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:48:39.653689 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:48:39.653689 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:48:39.653689 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:48:39.653689 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:48:39.655364 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:48:39.655364 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:48:39.655364 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:48:39.655364 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:48:39.655364 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:48:39.655364 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:48:39.655364 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:48:39.655364 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:48:39.655364 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:48:39.655364 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:48:39.655364 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:48:39.655364 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:48:39.655364 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:48:39.655364 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:48:39.655364 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:48:39.655364 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:48:39.655364 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:48:39.656357 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:48:39.656357 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:48:39.656357 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:48:39.656357 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:48:39.656357 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 624/1242] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:48:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:48:39.661682 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357fa57b-6aa7-4c24-86b5-50dfbb81be29 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:39.757262 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:39.763222 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357fa57b-6aa7-4c24-86b5-50dfbb81be29 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:39.798888 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc9c1c-0858-4268-8b8a-8390b811e3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:39.799559 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc9c1c-0858-4268-8b8a-8390b811e3df None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:39.799849 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc9c1c-0858-4268-8b8a-8390b811e3df None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:39.800133 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc9c1c-0858-4268-8b8a-8390b811e3df None admin] PATH_INFO: `/v3/domains` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:39.800867 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adc9c1c-0858-4268-8b8a-8390b811e3df None admin] RBAC: Adding query filter params (name=Default) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:48:39.801182 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adc9c1c-0858-4268-8b8a-8390b811e3df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:39.802652 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adc9c1c-0858-4268-8b8a-8390b811e3df None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:39.818893 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 619/1243] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:48:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:48:39.820069 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1987ad8b-27bc-4f4f-a1eb-d5fcfd8c27c8 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:39.900589 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:39.923100 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1987ad8b-27bc-4f4f-a1eb-d5fcfd8c27c8 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:39.958925 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d402465-a602-455e-8694-ea0985256a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:39.959720 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d402465-a602-455e-8694-ea0985256a6b None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:39.960007 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d402465-a602-455e-8694-ea0985256a6b None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:39.960285 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d402465-a602-455e-8694-ea0985256a6b None admin] PATH_INFO: `/v3/projects/service` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:39.966959 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d402465-a602-455e-8694-ea0985256a6b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:39.968453 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d402465-a602-455e-8694-ea0985256a6b None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:39.985137 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-4d402465-a602-455e-8694-ea0985256a6b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:48:39.985137 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:48:39.985137 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:48:39.985137 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:48:39.985137 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:48:39.985137 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:48:39.985137 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:48:39.985137 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:48:39.985137 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:48:39.985137 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:48:39.985137 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:48:39.985137 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:48:39.985137 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:48:39.985137 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:48:39.985137 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:48:39.986471 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:48:39.986471 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:48:39.986471 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:48:39.986471 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:48:39.986471 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:48:39.986471 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:48:39.986471 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:48:39.986471 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:48:39.986471 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:48:39.986471 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:48:39.986471 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:48:39.986471 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:48:39.986471 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:48:39.986471 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:48:39.986471 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:48:39.986471 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:48:39.986471 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:48:39.987773 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:48:39.987773 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:48:39.987773 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:48:39.987773 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:48:39.987773 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:48:39.987773 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:48:39.987773 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:48:39.987773 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:48:39.987773 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 625/1244] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:48:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:48:39.992203 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc9c1c-0858-4268-8b8a-8390b811e3df None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:40.102479 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc9c1c-0858-4268-8b8a-8390b811e3df None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:40.138037 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6055196-66cf-476b-87a0-2ca01d884f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:40.138736 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6055196-66cf-476b-87a0-2ca01d884f65 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:40.139030 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6055196-66cf-476b-87a0-2ca01d884f65 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:40.140421 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6055196-66cf-476b-87a0-2ca01d884f65 None admin] PATH_INFO: `/v3/projects` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:40.141246 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6055196-66cf-476b-87a0-2ca01d884f65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:48:40.141567 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6055196-66cf-476b-87a0-2ca01d884f65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:40.143058 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6055196-66cf-476b-87a0-2ca01d884f65 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:40.160087 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 620/1245] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:48:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:48:40.166018 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d402465-a602-455e-8694-ea0985256a6b None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:40.277063 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d402465-a602-455e-8694-ea0985256a6b None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:40.313281 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f21bd6-4b3e-4290-a6ec-31bacdd16282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:40.313952 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f21bd6-4b3e-4290-a6ec-31bacdd16282 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:40.314276 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f21bd6-4b3e-4290-a6ec-31bacdd16282 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:40.314564 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f21bd6-4b3e-4290-a6ec-31bacdd16282 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:40.315418 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f21bd6-4b3e-4290-a6ec-31bacdd16282 None admin] RBAC: Adding query filter params (role.id=1884e658df064cc2a232687c678d8618, scope.project.id=93f20f89d0fc4bbf9cf557dd1e14d98d, user.id=c289d4b42dec4fe382e35c3f9faa21c8) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:48:40.315734 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f21bd6-4b3e-4290-a6ec-31bacdd16282 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:40.317220 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f21bd6-4b3e-4290-a6ec-31bacdd16282 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:40.323487 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 626/1246] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:48:40 2022] GET /identity/v3/role_assignments?user.id=c289d4b42dec4fe382e35c3f9faa21c8&scope.project.id=93f20f89d0fc4bbf9cf557dd1e14d98d&role.id=1884e658df064cc2a232687c678d8618 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:48:42.430432 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4c17a-b8f5-418e-97d0-6602868a21c4 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:42.431032 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4c17a-b8f5-418e-97d0-6602868a21c4 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:42.431032 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4c17a-b8f5-418e-97d0-6602868a21c4 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:42.432437 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 621/1247] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:48:42.438364 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cdabca-aa33-4ab1-a8ac-fec10cb68b2d None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:42.438811 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cdabca-aa33-4ab1-a8ac-fec10cb68b2d None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:42.438943 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cdabca-aa33-4ab1-a8ac-fec10cb68b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:42.444092 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:42.456831 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-13cdabca-aa33-4ab1-a8ac-fec10cb68b2d None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:48:42.458022 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-13cdabca-aa33-4ab1-a8ac-fec10cb68b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:48:42.527777 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 627/1248] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:48:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:48:42.552030 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4c17a-b8f5-418e-97d0-6602868a21c4 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:42.570856 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:42.656599 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4c17a-b8f5-418e-97d0-6602868a21c4 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:42.691322 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52c352-e926-4f77-b75a-a6f3971d4e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:42.692060 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52c352-e926-4f77-b75a-a6f3971d4e8f None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:42.692610 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52c352-e926-4f77-b75a-a6f3971d4e8f None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:42.692900 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52c352-e926-4f77-b75a-a6f3971d4e8f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:42.704234 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d52c352-e926-4f77-b75a-a6f3971d4e8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:48:42.712343 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-4d52c352-e926-4f77-b75a-a6f3971d4e8f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:48:42.712343 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:48:42.712343 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:48:42.712343 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:48:42.712343 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:48:42.712343 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:48:42.712343 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:48:42.712343 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:48:42.712343 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:48:42.712343 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:48:42.712343 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:48:42.712343 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:48:42.712343 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:48:42.712343 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:48:42.712343 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:48:42.712343 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:48:42.713538 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:48:42.713538 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:48:42.713538 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:48:42.713538 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:48:42.713538 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:48:42.713538 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:48:42.713538 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:48:42.713538 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:48:42.713538 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:48:42.713538 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:48:42.713538 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:48:42.713538 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:48:42.713538 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:48:42.713538 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:48:42.713538 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:48:42.713538 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:48:42.714509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:48:42.714509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:48:42.714509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:48:42.714509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:48:42.714509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:48:42.714509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:48:42.714509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:48:42.714509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:48:42.714509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:48:42.714509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:48:42.714509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:48:42.714509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:48:42.714509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 622/1249] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:48:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:48:42.720396 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cdabca-aa33-4ab1-a8ac-fec10cb68b2d None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:42.818497 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cdabca-aa33-4ab1-a8ac-fec10cb68b2d None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:42.848516 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:42.853293 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f06ce-20bb-4422-be16-ceefc73290bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:42.853963 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f06ce-20bb-4422-be16-ceefc73290bf None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:42.854288 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f06ce-20bb-4422-be16-ceefc73290bf None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:42.854574 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f06ce-20bb-4422-be16-ceefc73290bf None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:42.855644 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f06ce-20bb-4422-be16-ceefc73290bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:48:42.855947 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f06ce-20bb-4422-be16-ceefc73290bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:42.857312 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f06ce-20bb-4422-be16-ceefc73290bf None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:42.865378 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 628/1250] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:48:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:48:42.871214 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52c352-e926-4f77-b75a-a6f3971d4e8f None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:42.953568 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:42.975860 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52c352-e926-4f77-b75a-a6f3971d4e8f None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:43.010118 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d2f1b-becb-42ba-8b6f-5909d67a6f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:43.010932 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d2f1b-becb-42ba-8b6f-5909d67a6f23 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:43.011220 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d2f1b-becb-42ba-8b6f-5909d67a6f23 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:43.011496 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d2f1b-becb-42ba-8b6f-5909d67a6f23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:43.022896 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d2f1b-becb-42ba-8b6f-5909d67a6f23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:43.027724 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d2f1b-becb-42ba-8b6f-5909d67a6f23 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:43.041740 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-dc1d2f1b-becb-42ba-8b6f-5909d67a6f23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:48:43.041740 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:48:43.041740 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:48:43.041740 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:48:43.041740 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:48:43.041740 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:48:43.041740 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:48:43.041740 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:48:43.041740 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:48:43.041740 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:48:43.041740 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:48:43.041740 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:48:43.041740 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:48:43.041740 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:48:43.041740 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:48:43.042913 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:48:43.042913 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:48:43.042913 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:48:43.042913 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:48:43.042913 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:48:43.042913 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:48:43.042913 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:48:43.042913 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:48:43.042913 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:48:43.042913 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:48:43.042913 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:48:43.042913 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:48:43.042913 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:48:43.042913 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:48:43.042913 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:48:43.042913 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:48:43.042913 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:48:43.044208 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:48:43.044208 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:48:43.044208 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:48:43.044208 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:48:43.044208 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 623/1251] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:48:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:48:43.048769 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f06ce-20bb-4422-be16-ceefc73290bf None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:43.149330 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f06ce-20bb-4422-be16-ceefc73290bf None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:43.183411 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e6f33-d737-46bf-aa1e-59ccedfdcafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:43.184082 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e6f33-d737-46bf-aa1e-59ccedfdcafc None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:43.184372 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e6f33-d737-46bf-aa1e-59ccedfdcafc None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:43.184650 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e6f33-d737-46bf-aa1e-59ccedfdcafc None admin] PATH_INFO: `/v3/domains` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:43.185379 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e6f33-d737-46bf-aa1e-59ccedfdcafc None admin] RBAC: Adding query filter params (name=Default) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:48:43.185686 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e6f33-d737-46bf-aa1e-59ccedfdcafc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:43.187735 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e6f33-d737-46bf-aa1e-59ccedfdcafc None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:43.199523 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 629/1252] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:48:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:48:43.206362 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d2f1b-becb-42ba-8b6f-5909d67a6f23 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:43.307022 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d2f1b-becb-42ba-8b6f-5909d67a6f23 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:43.333059 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:43.340803 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a09996-6cd5-4d71-9220-37385cefbcc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:43.341600 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a09996-6cd5-4d71-9220-37385cefbcc7 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:43.341888 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a09996-6cd5-4d71-9220-37385cefbcc7 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:43.342336 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a09996-6cd5-4d71-9220-37385cefbcc7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:43.349769 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a09996-6cd5-4d71-9220-37385cefbcc7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:43.351241 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a09996-6cd5-4d71-9220-37385cefbcc7 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:43.366428 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-d4a09996-6cd5-4d71-9220-37385cefbcc7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 21:48:43.366428 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:48:43.366428 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:48:43.366428 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:48:43.366428 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:48:43.366428 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:48:43.366428 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:48:43.366428 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:48:43.366428 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:48:43.366428 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:48:43.366428 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:48:43.366428 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:48:43.366428 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:48:43.366428 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:48:43.366428 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:48:43.366428 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:48:43.368975 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:48:43.368975 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:48:43.368975 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:48:43.368975 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:48:43.368975 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:48:43.368975 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:48:43.368975 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:48:43.368975 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:48:43.368975 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:48:43.368975 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:48:43.368975 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:48:43.368975 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:48:43.368975 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:48:43.368975 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:48:43.368975 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:48:43.368975 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:48:43.368975 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:48:43.368975 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:48:43.370232 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:48:43.370232 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:48:43.370232 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:48:43.370232 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:48:43.370232 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:48:43.370232 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:48:43.370232 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:48:43.370232 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:48:43.370232 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 21:48:43.370232 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:48:43.370232 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 624/1253] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:48:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:48:43.374239 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e6f33-d737-46bf-aa1e-59ccedfdcafc None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:43.429552 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:43.474011 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e6f33-d737-46bf-aa1e-59ccedfdcafc None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:43.508682 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f007359-26e8-4d17-b939-a1c61b9ef9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:43.509357 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f007359-26e8-4d17-b939-a1c61b9ef9ec None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:43.509652 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f007359-26e8-4d17-b939-a1c61b9ef9ec None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:43.509968 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f007359-26e8-4d17-b939-a1c61b9ef9ec None admin] PATH_INFO: `/v3/users` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:43.510858 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f007359-26e8-4d17-b939-a1c61b9ef9ec None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:48:43.511179 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f007359-26e8-4d17-b939-a1c61b9ef9ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:43.512672 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f007359-26e8-4d17-b939-a1c61b9ef9ec None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:43.530768 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 630/1254] 10.222.0.30 () {56 vars in 1143 bytes} [Tue Jul 5 21:48:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:48:43.540294 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a09996-6cd5-4d71-9220-37385cefbcc7 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:43.639869 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a09996-6cd5-4d71-9220-37385cefbcc7 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:43.673451 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bcf9cd-152e-4cd6-90e7-1c78630db10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:43.674103 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcf9cd-152e-4cd6-90e7-1c78630db10c None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:43.674431 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcf9cd-152e-4cd6-90e7-1c78630db10c None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:43.674714 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcf9cd-152e-4cd6-90e7-1c78630db10c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:43.731586 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:43.743984 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bcf9cd-152e-4cd6-90e7-1c78630db10c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:43.745456 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bcf9cd-152e-4cd6-90e7-1c78630db10c None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:43.844714 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 625/1255] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:48:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:48:43.850680 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f007359-26e8-4d17-b939-a1c61b9ef9ec None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:43.950336 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f007359-26e8-4d17-b939-a1c61b9ef9ec None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:43.964026 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:43.985260 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff15b3-0332-478b-8d9b-10f05acf81cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:43.985995 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff15b3-0332-478b-8d9b-10f05acf81cb None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:43.986315 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff15b3-0332-478b-8d9b-10f05acf81cb None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:43.992321 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff15b3-0332-478b-8d9b-10f05acf81cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:43.996846 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff15b3-0332-478b-8d9b-10f05acf81cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:43.998986 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff15b3-0332-478b-8d9b-10f05acf81cb None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:44.016931 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-2dff15b3-0332-478b-8d9b-10f05acf81cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:48:44.016931 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:48:44.016931 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:48:44.016931 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:48:44.016931 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:48:44.016931 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:48:44.016931 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:48:44.016931 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:48:44.016931 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:48:44.016931 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:48:44.016931 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:48:44.016931 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:48:44.016931 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:48:44.016931 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:48:44.016931 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:48:44.018091 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:48:44.018091 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:48:44.018091 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:48:44.018091 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:48:44.018091 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:48:44.018091 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:48:44.018091 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:48:44.018091 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:48:44.018091 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:48:44.018091 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:48:44.018091 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:48:44.018091 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:48:44.018091 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:48:44.018091 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:48:44.018091 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:48:44.018091 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:48:44.018091 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:48:44.019133 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:48:44.019133 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:48:44.019133 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:48:44.019133 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:48:44.019133 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 631/1256] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:48:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:48:44.023941 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bcf9cd-152e-4cd6-90e7-1c78630db10c None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:44.114729 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:44.126611 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bcf9cd-152e-4cd6-90e7-1c78630db10c None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:44.161865 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ab428-79b0-4445-a9b8-49677a45f010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:44.162550 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ab428-79b0-4445-a9b8-49677a45f010 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:44.162839 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ab428-79b0-4445-a9b8-49677a45f010 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:44.163120 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ab428-79b0-4445-a9b8-49677a45f010 None admin] PATH_INFO: `/v3/domains` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:44.163957 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910ab428-79b0-4445-a9b8-49677a45f010 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:48:44.164266 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910ab428-79b0-4445-a9b8-49677a45f010 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:44.165635 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910ab428-79b0-4445-a9b8-49677a45f010 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:44.177018 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 626/1257] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:48:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:48:44.182800 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff15b3-0332-478b-8d9b-10f05acf81cb None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:44.286599 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff15b3-0332-478b-8d9b-10f05acf81cb None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:44.320438 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500034f-e766-4780-b508-4c0a5d6ef79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:44.321234 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500034f-e766-4780-b508-4c0a5d6ef79b None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:44.321523 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500034f-e766-4780-b508-4c0a5d6ef79b None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:44.321806 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500034f-e766-4780-b508-4c0a5d6ef79b None admin] PATH_INFO: `/v3/projects/service` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:44.329373 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3500034f-e766-4780-b508-4c0a5d6ef79b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:44.330839 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3500034f-e766-4780-b508-4c0a5d6ef79b None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:44.345177 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-3500034f-e766-4780-b508-4c0a5d6ef79b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:48:44.345177 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:48:44.345177 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:48:44.345177 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:48:44.345177 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:48:44.345177 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:48:44.345177 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:48:44.345177 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:48:44.345177 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:48:44.345177 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:48:44.345177 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:48:44.345177 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:48:44.345177 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:48:44.345177 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:48:44.345177 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:48:44.346425 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:48:44.346425 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:48:44.346425 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:48:44.346425 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:48:44.346425 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:48:44.346425 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:48:44.346425 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:48:44.346425 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:48:44.346425 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:48:44.346425 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:48:44.346425 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:48:44.346425 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:48:44.346425 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:48:44.346425 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:48:44.346425 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:48:44.346425 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:48:44.346425 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:48:44.347591 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:48:44.347591 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:48:44.347591 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:48:44.347591 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:48:44.347591 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:48:44.347591 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:48:44.347591 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:48:44.347591 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:48:44.347591 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 632/1258] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:48:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:48:44.352595 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ab428-79b0-4445-a9b8-49677a45f010 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:44.454086 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ab428-79b0-4445-a9b8-49677a45f010 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:44.488378 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dba11e-4863-4841-bb38-f51b7d3ff3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:44.489038 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dba11e-4863-4841-bb38-f51b7d3ff3f3 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:44.489327 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dba11e-4863-4841-bb38-f51b7d3ff3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:44.489607 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dba11e-4863-4841-bb38-f51b7d3ff3f3 None admin] PATH_INFO: `/v3/projects` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:44.490447 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dba11e-4863-4841-bb38-f51b7d3ff3f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:48:44.490761 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dba11e-4863-4841-bb38-f51b7d3ff3f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:44.492198 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dba11e-4863-4841-bb38-f51b7d3ff3f3 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:44.505001 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 627/1259] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:48:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:48:44.511257 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500034f-e766-4780-b508-4c0a5d6ef79b None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:44.538083 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:44.614944 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500034f-e766-4780-b508-4c0a5d6ef79b None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:44.649502 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba47404-abb0-40e8-8067-6565d23c9b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:44.650158 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba47404-abb0-40e8-8067-6565d23c9b5b None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:44.650450 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba47404-abb0-40e8-8067-6565d23c9b5b None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:44.650729 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba47404-abb0-40e8-8067-6565d23c9b5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:44.651563 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba47404-abb0-40e8-8067-6565d23c9b5b None admin] RBAC: Adding query filter params (role.id=e1c574c9973548ebb0e8d9e0656ccabd, scope.project.id=93f20f89d0fc4bbf9cf557dd1e14d98d, user.id=c289d4b42dec4fe382e35c3f9faa21c8) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:48:44.651876 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba47404-abb0-40e8-8067-6565d23c9b5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:44.653314 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba47404-abb0-40e8-8067-6565d23c9b5b None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:44.658809 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 633/1260] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:48:44 2022] GET /identity/v3/role_assignments?user.id=c289d4b42dec4fe382e35c3f9faa21c8&scope.project.id=93f20f89d0fc4bbf9cf557dd1e14d98d&role.id=e1c574c9973548ebb0e8d9e0656ccabd => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:48:46.677077 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc51c5-5bc8-466c-b1d3-f7cbb139cb20 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:46.677644 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc51c5-5bc8-466c-b1d3-f7cbb139cb20 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:46.677758 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc51c5-5bc8-466c-b1d3-f7cbb139cb20 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:46.679105 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 628/1261] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:48:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:48:46.684373 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d43581-d7be-4e65-9d48-429304ceaa18 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:46.684784 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d43581-d7be-4e65-9d48-429304ceaa18 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:46.684945 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d43581-d7be-4e65-9d48-429304ceaa18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:46.703146 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-44d43581-d7be-4e65-9d48-429304ceaa18 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:48:46.704358 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-44d43581-d7be-4e65-9d48-429304ceaa18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:48:46.772038 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 634/1262] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:48:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:48:46.794639 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc51c5-5bc8-466c-b1d3-f7cbb139cb20 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:46.805942 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:46.898673 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc51c5-5bc8-466c-b1d3-f7cbb139cb20 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:46.933272 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d87304-3e7b-4025-beb8-97dcdb2e6871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:46.934066 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d87304-3e7b-4025-beb8-97dcdb2e6871 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:46.934386 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d87304-3e7b-4025-beb8-97dcdb2e6871 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:46.934676 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d87304-3e7b-4025-beb8-97dcdb2e6871 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:46.945275 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d87304-3e7b-4025-beb8-97dcdb2e6871 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:48:46.953017 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-f7d87304-3e7b-4025-beb8-97dcdb2e6871 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:48:46.953017 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:48:46.953017 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:48:46.953017 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:48:46.953017 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:48:46.953017 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:48:46.953017 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:48:46.953017 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:48:46.953017 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:48:46.953017 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:48:46.953017 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:48:46.953017 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:48:46.953017 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:48:46.953017 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:48:46.953017 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:48:46.953017 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:48:46.954379 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:48:46.954379 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:48:46.954379 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:48:46.954379 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:48:46.954379 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:48:46.954379 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:48:46.954379 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:48:46.954379 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:48:46.954379 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:48:46.954379 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:48:46.954379 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:48:46.954379 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:48:46.954379 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:48:46.954379 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:48:46.954379 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:48:46.954379 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:48:46.955313 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:48:46.955313 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:48:46.955313 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:48:46.955313 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:48:46.955313 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:48:46.955313 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:48:46.955313 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:48:46.955313 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:48:46.955313 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:48:46.955313 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:48:46.955313 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:48:46.955313 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:48:46.955313 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 629/1263] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:48:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:48:46.960371 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d43581-d7be-4e65-9d48-429304ceaa18 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:46.979627 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:47.063208 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d43581-d7be-4e65-9d48-429304ceaa18 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:47.098945 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1e033-0764-4071-8601-00f7d6a40527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:47.099624 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1e033-0764-4071-8601-00f7d6a40527 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:47.099920 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1e033-0764-4071-8601-00f7d6a40527 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:47.100209 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1e033-0764-4071-8601-00f7d6a40527 None admin] PATH_INFO: `/v3/roles` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:47.101043 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1e033-0764-4071-8601-00f7d6a40527 None admin] RBAC: Adding query filter params (name=admin) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:48:47.101391 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1e033-0764-4071-8601-00f7d6a40527 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:47.102814 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1e033-0764-4071-8601-00f7d6a40527 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:47.111375 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 635/1264] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:48:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:48:47.117408 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d87304-3e7b-4025-beb8-97dcdb2e6871 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:47.184802 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:47.217992 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d87304-3e7b-4025-beb8-97dcdb2e6871 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:47.250927 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1546c35c-b6aa-40f6-a0e0-2a849a47e2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:47.251718 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546c35c-b6aa-40f6-a0e0-2a849a47e2d2 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:47.252010 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546c35c-b6aa-40f6-a0e0-2a849a47e2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:47.252295 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546c35c-b6aa-40f6-a0e0-2a849a47e2d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:47.262709 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1546c35c-b6aa-40f6-a0e0-2a849a47e2d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:47.265115 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1546c35c-b6aa-40f6-a0e0-2a849a47e2d2 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:47.281956 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-1546c35c-b6aa-40f6-a0e0-2a849a47e2d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:48:47.281956 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:48:47.281956 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:48:47.281956 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:48:47.281956 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:48:47.281956 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:48:47.281956 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:48:47.281956 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:48:47.281956 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:48:47.281956 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:48:47.281956 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:48:47.281956 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:48:47.281956 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:48:47.281956 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:48:47.281956 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:48:47.283007 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:48:47.283007 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:48:47.283007 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:48:47.283007 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:48:47.283007 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:48:47.283007 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:48:47.283007 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:48:47.283007 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:48:47.283007 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:48:47.283007 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:48:47.283007 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:48:47.283007 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:48:47.283007 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:48:47.283007 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:48:47.283007 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:48:47.283007 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:48:47.283007 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:48:47.284091 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:48:47.284091 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:48:47.284091 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:48:47.284091 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:48:47.284091 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 630/1265] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:48:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:48:47.289080 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1e033-0764-4071-8601-00f7d6a40527 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:47.372565 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:47.391799 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1e033-0764-4071-8601-00f7d6a40527 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:47.429926 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e9d7c-c77f-48b3-b32d-4ea4e0967314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:47.430639 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e9d7c-c77f-48b3-b32d-4ea4e0967314 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:47.430944 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e9d7c-c77f-48b3-b32d-4ea4e0967314 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:47.431234 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e9d7c-c77f-48b3-b32d-4ea4e0967314 None admin] PATH_INFO: `/v3/domains` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:47.431976 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3e9d7c-c77f-48b3-b32d-4ea4e0967314 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:48:47.432316 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3e9d7c-c77f-48b3-b32d-4ea4e0967314 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:47.433761 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3e9d7c-c77f-48b3-b32d-4ea4e0967314 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:47.445744 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 636/1266] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:48:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:48:47.451741 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1546c35c-b6aa-40f6-a0e0-2a849a47e2d2 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:47.554683 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1546c35c-b6aa-40f6-a0e0-2a849a47e2d2 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:47.575186 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:47.589160 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a821b-1b8e-453e-9a19-0279b6e89f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:47.589994 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a821b-1b8e-453e-9a19-0279b6e89f74 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:47.590325 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a821b-1b8e-453e-9a19-0279b6e89f74 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:47.590611 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a821b-1b8e-453e-9a19-0279b6e89f74 None admin] PATH_INFO: `/v3/users/placement` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:47.598866 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a821b-1b8e-453e-9a19-0279b6e89f74 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:47.600325 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a821b-1b8e-453e-9a19-0279b6e89f74 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:47.615901 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-de5a821b-1b8e-453e-9a19-0279b6e89f74 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 21:48:47.615901 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:48:47.615901 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:48:47.615901 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:48:47.615901 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:48:47.615901 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:48:47.615901 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:48:47.615901 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:48:47.615901 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:48:47.615901 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:48:47.615901 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:48:47.615901 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:48:47.615901 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:48:47.615901 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:48:47.615901 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:48:47.615901 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:48:47.617092 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:48:47.617092 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:48:47.617092 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:48:47.617092 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:48:47.617092 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:48:47.617092 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:48:47.617092 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:48:47.617092 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:48:47.617092 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:48:47.617092 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:48:47.617092 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:48:47.617092 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:48:47.617092 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:48:47.617092 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:48:47.617092 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:48:47.617092 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:48:47.617092 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:48:47.617092 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:48:47.618196 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:48:47.618196 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:48:47.618196 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:48:47.618196 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:48:47.618196 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:48:47.618196 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:48:47.618196 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:48:47.618196 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:48:47.618196 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 21:48:47.618196 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:48:47.618196 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 631/1267] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:48:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:48:47.632240 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e9d7c-c77f-48b3-b32d-4ea4e0967314 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:47.726328 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e9d7c-c77f-48b3-b32d-4ea4e0967314 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:47.761437 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283e68d-1b8d-44c4-b5db-6f1f997e4858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:47.762107 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283e68d-1b8d-44c4-b5db-6f1f997e4858 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:47.762430 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283e68d-1b8d-44c4-b5db-6f1f997e4858 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:47.762709 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283e68d-1b8d-44c4-b5db-6f1f997e4858 None admin] PATH_INFO: `/v3/users` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:47.763641 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5283e68d-1b8d-44c4-b5db-6f1f997e4858 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:48:47.763966 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5283e68d-1b8d-44c4-b5db-6f1f997e4858 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:47.765401 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5283e68d-1b8d-44c4-b5db-6f1f997e4858 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:47.774417 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:47.783823 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 637/1268] 10.222.0.30 () {56 vars in 1143 bytes} [Tue Jul 5 21:48:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:48:47.789720 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a821b-1b8e-453e-9a19-0279b6e89f74 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:47.892970 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a821b-1b8e-453e-9a19-0279b6e89f74 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:47.926807 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f1841-ce32-48a8-889d-2b30e5ce2a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:47.927601 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f1841-ce32-48a8-889d-2b30e5ce2a41 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:47.927892 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f1841-ce32-48a8-889d-2b30e5ce2a41 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:47.928174 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f1841-ce32-48a8-889d-2b30e5ce2a41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:47.938802 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f1841-ce32-48a8-889d-2b30e5ce2a41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:47.940259 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f1841-ce32-48a8-889d-2b30e5ce2a41 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:47.957941 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-419f1841-ce32-48a8-889d-2b30e5ce2a41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:48:47.957941 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:48:47.957941 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:48:47.957941 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:48:47.957941 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:48:47.957941 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:48:47.957941 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:48:47.957941 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:48:47.957941 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:48:47.957941 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:48:47.957941 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:48:47.957941 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:48:47.957941 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:48:47.957941 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:48:47.957941 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:48:47.959110 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:48:47.959110 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:48:47.959110 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:48:47.959110 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:48:47.959110 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:48:47.959110 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:48:47.959110 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:48:47.959110 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:48:47.959110 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:48:47.959110 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:48:47.959110 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:48:47.959110 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:48:47.959110 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:48:47.959110 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:48:47.959110 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:48:47.959110 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:48:47.959110 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:48:47.960312 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:48:47.960312 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:48:47.960312 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:48:47.960312 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:48:47.960312 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 632/1269] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:48:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 21:48:47.965138 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283e68d-1b8d-44c4-b5db-6f1f997e4858 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:48.081378 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283e68d-1b8d-44c4-b5db-6f1f997e4858 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:48.116874 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7785f4d-62bb-42aa-a320-cd8bc6cb6497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:48.117586 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7785f4d-62bb-42aa-a320-cd8bc6cb6497 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:48.117872 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7785f4d-62bb-42aa-a320-cd8bc6cb6497 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:48.118176 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7785f4d-62bb-42aa-a320-cd8bc6cb6497 None admin] PATH_INFO: `/v3/domains` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:48.118904 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7785f4d-62bb-42aa-a320-cd8bc6cb6497 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:48:48.119211 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7785f4d-62bb-42aa-a320-cd8bc6cb6497 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:48.120587 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7785f4d-62bb-42aa-a320-cd8bc6cb6497 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:48.132001 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 638/1270] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:48:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:48:48.137866 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f1841-ce32-48a8-889d-2b30e5ce2a41 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:48.171621 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:48.240611 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f1841-ce32-48a8-889d-2b30e5ce2a41 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:48.276199 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d923f-bae8-4b06-a8e6-79aee391c004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:48.277001 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d923f-bae8-4b06-a8e6-79aee391c004 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:48.277294 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d923f-bae8-4b06-a8e6-79aee391c004 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:48.277576 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d923f-bae8-4b06-a8e6-79aee391c004 None admin] PATH_INFO: `/v3/projects/service` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:48.284637 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d923f-bae8-4b06-a8e6-79aee391c004 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:48.286067 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d923f-bae8-4b06-a8e6-79aee391c004 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:48.300017 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-d11d923f-bae8-4b06-a8e6-79aee391c004 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:48:48.300017 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:48:48.300017 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:48:48.300017 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:48:48.300017 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:48:48.300017 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:48:48.300017 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:48:48.300017 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:48:48.300017 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:48:48.300017 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:48:48.300017 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:48:48.300017 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:48:48.300017 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:48:48.300017 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:48:48.300017 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:48:48.301263 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:48:48.301263 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:48:48.301263 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:48:48.301263 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:48:48.301263 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:48:48.301263 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:48:48.301263 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:48:48.301263 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:48:48.301263 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:48:48.301263 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:48:48.301263 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:48:48.301263 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:48:48.301263 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:48:48.301263 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:48:48.301263 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:48:48.301263 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:48:48.301263 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:48:48.302530 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:48:48.302530 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:48:48.302530 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:48:48.302530 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:48:48.302530 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:48:48.302530 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:48:48.302530 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:48:48.302530 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:48:48.302530 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 633/1271] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:48:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:48:48.307237 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7785f4d-62bb-42aa-a320-cd8bc6cb6497 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:48.368144 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:48.424863 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7785f4d-62bb-42aa-a320-cd8bc6cb6497 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:48.461782 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f30649-1e95-491d-8a86-a6c7c2313824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:48.462488 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f30649-1e95-491d-8a86-a6c7c2313824 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:48.462783 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f30649-1e95-491d-8a86-a6c7c2313824 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:48.463066 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f30649-1e95-491d-8a86-a6c7c2313824 None admin] PATH_INFO: `/v3/projects` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:48.463874 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f30649-1e95-491d-8a86-a6c7c2313824 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:48:48.464192 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f30649-1e95-491d-8a86-a6c7c2313824 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:48.465739 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f30649-1e95-491d-8a86-a6c7c2313824 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:48.478348 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 639/1272] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:48:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:48:48.484846 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d923f-bae8-4b06-a8e6-79aee391c004 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:48.579038 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:48.587538 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d923f-bae8-4b06-a8e6-79aee391c004 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:48.621179 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e780d772-b47a-4f53-becc-b71309a08b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:48.622079 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780d772-b47a-4f53-becc-b71309a08b18 None admin] REQUEST_METHOD: `PUT` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:48.622399 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780d772-b47a-4f53-becc-b71309a08b18 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:48.622683 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780d772-b47a-4f53-becc-b71309a08b18 None admin] PATH_INFO: `/v3/projects/93f20f89d0fc4bbf9cf557dd1e14d98d/users/c289d4b42dec4fe382e35c3f9faa21c8/roles/e1c574c9973548ebb0e8d9e0656ccabd` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:48.625421 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e780d772-b47a-4f53-becc-b71309a08b18 None admin] RBAC: Authorizing `identity:create_grant(project_id=93f20f89d0fc4bbf9cf557dd1e14d98d, user_id=c289d4b42dec4fe382e35c3f9faa21c8, role_id=e1c574c9973548ebb0e8d9e0656ccabd)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:48.626983 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e780d772-b47a-4f53-becc-b71309a08b18 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:48.828056 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 634/1273] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Jul 5 21:48:48 2022] PUT /identity/v3/projects/93f20f89d0fc4bbf9cf557dd1e14d98d/users/c289d4b42dec4fe382e35c3f9faa21c8/roles/e1c574c9973548ebb0e8d9e0656ccabd => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:48:50.880430 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569fd1d-4ca8-45c8-8335-7d50c6100471 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:50.880947 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569fd1d-4ca8-45c8-8335-7d50c6100471 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:50.880947 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569fd1d-4ca8-45c8-8335-7d50c6100471 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:50.882337 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 640/1274] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:48:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:48:50.887626 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971086a3-e2ef-4fce-b177-205968710c7c None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:50.888078 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971086a3-e2ef-4fce-b177-205968710c7c None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:50.888186 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971086a3-e2ef-4fce-b177-205968710c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:50.905136 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-971086a3-e2ef-4fce-b177-205968710c7c None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:48:50.906359 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-971086a3-e2ef-4fce-b177-205968710c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:48:50.972948 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 635/1275] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:48:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 21:48:50.999325 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d569fd1d-4ca8-45c8-8335-7d50c6100471 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:51.103804 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d569fd1d-4ca8-45c8-8335-7d50c6100471 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:51.121695 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:51.139503 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c78a3-ef4e-4dff-9ad2-169e7cfc8d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:51.140235 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c78a3-ef4e-4dff-9ad2-169e7cfc8d75 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:51.140525 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c78a3-ef4e-4dff-9ad2-169e7cfc8d75 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:51.140805 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c78a3-ef4e-4dff-9ad2-169e7cfc8d75 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:51.150826 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765c78a3-ef4e-4dff-9ad2-169e7cfc8d75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 21:48:51.159280 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-765c78a3-ef4e-4dff-9ad2-169e7cfc8d75 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:48:51.159280 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:48:51.159280 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:48:51.159280 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:48:51.159280 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:48:51.159280 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:48:51.159280 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:48:51.159280 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:48:51.159280 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:48:51.159280 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:48:51.159280 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:48:51.159280 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:48:51.159280 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 21:48:51.159280 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 21:48:51.159280 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 21:48:51.159280 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 21:48:51.160489 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 21:48:51.160489 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 21:48:51.160489 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 21:48:51.160489 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 21:48:51.160489 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:48:51.160489 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:48:51.160489 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:48:51.160489 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:48:51.160489 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:48:51.160489 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:48:51.160489 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:48:51.160489 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:48:51.160489 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:48:51.160489 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:48:51.160489 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:48:51.160489 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:48:51.161500 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:48:51.161500 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:48:51.161500 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:48:51.161500 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:48:51.161500 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 21:48:51.161500 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 21:48:51.161500 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 21:48:51.161500 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 21:48:51.161500 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 21:48:51.161500 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 21:48:51.161500 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 21:48:51.161500 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:48:51.161500 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 641/1276] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Jul 5 21:48:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:48:51.166595 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971086a3-e2ef-4fce-b177-205968710c7c None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:51.249623 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:51.267831 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971086a3-e2ef-4fce-b177-205968710c7c None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:51.302393 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb1947-04e5-4354-8aa9-5e28dbbc75ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:51.303064 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb1947-04e5-4354-8aa9-5e28dbbc75ad None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:51.303350 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb1947-04e5-4354-8aa9-5e28dbbc75ad None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:51.303624 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb1947-04e5-4354-8aa9-5e28dbbc75ad None admin] PATH_INFO: `/v3/roles` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:51.304369 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abb1947-04e5-4354-8aa9-5e28dbbc75ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:48:51.304674 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abb1947-04e5-4354-8aa9-5e28dbbc75ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:51.306044 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abb1947-04e5-4354-8aa9-5e28dbbc75ad None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:51.315498 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 636/1277] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Jul 5 21:48:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:48:51.321366 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c78a3-ef4e-4dff-9ad2-169e7cfc8d75 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:51.422510 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c78a3-ef4e-4dff-9ad2-169e7cfc8d75 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:51.457113 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d60193-0ed7-4cfe-8e81-76d8c15a5669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:51.457906 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d60193-0ed7-4cfe-8e81-76d8c15a5669 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:51.458222 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d60193-0ed7-4cfe-8e81-76d8c15a5669 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:51.458506 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d60193-0ed7-4cfe-8e81-76d8c15a5669 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:51.469434 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d60193-0ed7-4cfe-8e81-76d8c15a5669 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:51.470895 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d60193-0ed7-4cfe-8e81-76d8c15a5669 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:51.488104 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-01d60193-0ed7-4cfe-8e81-76d8c15a5669 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:48:51.488104 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:48:51.488104 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:48:51.488104 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:48:51.488104 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:48:51.488104 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:48:51.488104 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:48:51.488104 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:48:51.488104 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:48:51.488104 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:48:51.488104 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:48:51.488104 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:48:51.488104 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:48:51.488104 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:48:51.488104 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:48:51.489396 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:48:51.489396 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:48:51.489396 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:48:51.489396 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:48:51.489396 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:48:51.489396 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:48:51.489396 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:48:51.489396 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:48:51.489396 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:48:51.489396 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:48:51.489396 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:48:51.489396 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:48:51.489396 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:48:51.489396 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:48:51.489396 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:48:51.489396 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:48:51.489396 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:48:51.494390 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:48:51.494390 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:48:51.494390 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:48:51.494390 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:48:51.494390 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 642/1278] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:48:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:48:51.495286 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb1947-04e5-4354-8aa9-5e28dbbc75ad None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:51.598960 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb1947-04e5-4354-8aa9-5e28dbbc75ad None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:51.633180 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde2332-ab28-48ce-b58b-62f22634b76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:51.633836 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde2332-ab28-48ce-b58b-62f22634b76e None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:51.634121 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde2332-ab28-48ce-b58b-62f22634b76e None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:51.634430 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde2332-ab28-48ce-b58b-62f22634b76e None admin] PATH_INFO: `/v3/domains` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:51.635158 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bde2332-ab28-48ce-b58b-62f22634b76e None admin] RBAC: Adding query filter params (name=Default) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:48:51.635468 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bde2332-ab28-48ce-b58b-62f22634b76e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:51.636839 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bde2332-ab28-48ce-b58b-62f22634b76e None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:51.649371 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 637/1279] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:48:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:48:51.655901 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d60193-0ed7-4cfe-8e81-76d8c15a5669 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:51.687336 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:51.757050 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d60193-0ed7-4cfe-8e81-76d8c15a5669 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:51.790587 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b937f-aab4-4d54-a397-ee2934f7437a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:51.791541 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b937f-aab4-4d54-a397-ee2934f7437a None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:51.791828 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b937f-aab4-4d54-a397-ee2934f7437a None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:51.792105 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b937f-aab4-4d54-a397-ee2934f7437a None admin] PATH_INFO: `/v3/users/placement` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:51.800017 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b937f-aab4-4d54-a397-ee2934f7437a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:51.801490 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b937f-aab4-4d54-a397-ee2934f7437a None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:51.816911 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-fe1b937f-aab4-4d54-a397-ee2934f7437a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 21:48:51.816911 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:48:51.816911 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:48:51.816911 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:48:51.816911 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:48:51.816911 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:48:51.816911 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:48:51.816911 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:48:51.816911 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:48:51.816911 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:48:51.816911 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:48:51.816911 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:48:51.816911 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 21:48:51.816911 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 21:48:51.816911 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 21:48:51.816911 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 21:48:51.818187 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:48:51.818187 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:48:51.818187 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 21:48:51.818187 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:48:51.818187 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 21:48:51.818187 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 21:48:51.818187 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:48:51.818187 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:48:51.818187 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:48:51.818187 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:48:51.818187 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:48:51.818187 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:48:51.818187 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:48:51.818187 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:48:51.818187 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:48:51.818187 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:48:51.818187 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:48:51.818187 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:48:51.819534 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:48:51.819534 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:48:51.819534 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 21:48:51.819534 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 21:48:51.819534 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 21:48:51.819534 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 21:48:51.819534 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 21:48:51.819534 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 21:48:51.819534 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 21:48:51.819534 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:48:51.821043 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 643/1280] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:48:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:48:51.824120 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde2332-ab28-48ce-b58b-62f22634b76e None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:51.828716 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:51.926840 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde2332-ab28-48ce-b58b-62f22634b76e None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:51.963319 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c33df0-d573-4db4-8bca-a6bff4b12779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:51.963990 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c33df0-d573-4db4-8bca-a6bff4b12779 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:51.967456 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c33df0-d573-4db4-8bca-a6bff4b12779 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:51.967456 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c33df0-d573-4db4-8bca-a6bff4b12779 None admin] PATH_INFO: `/v3/users` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:51.967456 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c33df0-d573-4db4-8bca-a6bff4b12779 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:48:51.967456 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c33df0-d573-4db4-8bca-a6bff4b12779 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:51.967456 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c33df0-d573-4db4-8bca-a6bff4b12779 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:51.984748 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 638/1281] 10.222.0.30 () {56 vars in 1143 bytes} [Tue Jul 5 21:48:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:48:51.990693 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b937f-aab4-4d54-a397-ee2934f7437a None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:52.081968 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:52.091222 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b937f-aab4-4d54-a397-ee2934f7437a None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:52.124358 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d45208-d348-4588-8ccf-7e11926fde3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:52.125005 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d45208-d348-4588-8ccf-7e11926fde3e None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:52.125296 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d45208-d348-4588-8ccf-7e11926fde3e None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:52.125579 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d45208-d348-4588-8ccf-7e11926fde3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:52.193284 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d45208-d348-4588-8ccf-7e11926fde3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:52.195126 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d45208-d348-4588-8ccf-7e11926fde3e None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:52.285256 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:52.296398 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 644/1282] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Jul 5 21:48:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 21:48:52.302457 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c33df0-d573-4db4-8bca-a6bff4b12779 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:52.365870 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:52.406229 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c33df0-d573-4db4-8bca-a6bff4b12779 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:52.439369 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1757ec4f-9de7-4779-a1c5-a0fc209e721e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:52.440170 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757ec4f-9de7-4779-a1c5-a0fc209e721e None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:52.440460 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757ec4f-9de7-4779-a1c5-a0fc209e721e None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:52.440747 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757ec4f-9de7-4779-a1c5-a0fc209e721e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:52.452625 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1757ec4f-9de7-4779-a1c5-a0fc209e721e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:52.454142 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1757ec4f-9de7-4779-a1c5-a0fc209e721e None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:52.472354 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-1757ec4f-9de7-4779-a1c5-a0fc209e721e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:48:52.472354 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:48:52.472354 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:48:52.472354 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:48:52.472354 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:48:52.472354 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:48:52.472354 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:48:52.472354 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:48:52.472354 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:48:52.472354 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:48:52.472354 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:48:52.472354 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:48:52.472354 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 21:48:52.472354 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 21:48:52.472354 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 21:48:52.477403 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 21:48:52.477403 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:48:52.477403 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:48:52.477403 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:48:52.477403 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:48:52.477403 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:48:52.477403 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:48:52.477403 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:48:52.477403 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:48:52.477403 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:48:52.477403 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:48:52.477403 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:48:52.477403 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:48:52.477403 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:48:52.477403 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:48:52.477403 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:48:52.477403 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:48:52.478632 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 21:48:52.478632 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 21:48:52.478632 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 21:48:52.478632 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:48:52.478632 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 639/1283] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Jul 5 21:48:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:48:52.479655 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d45208-d348-4588-8ccf-7e11926fde3e None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:52.578973 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d45208-d348-4588-8ccf-7e11926fde3e None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:52.613900 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eeda9a-98f5-4cbe-9d9a-a0575ab1fbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:52.614589 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eeda9a-98f5-4cbe-9d9a-a0575ab1fbf8 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:52.614876 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eeda9a-98f5-4cbe-9d9a-a0575ab1fbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:52.615155 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eeda9a-98f5-4cbe-9d9a-a0575ab1fbf8 None admin] PATH_INFO: `/v3/domains` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:52.615878 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eeda9a-98f5-4cbe-9d9a-a0575ab1fbf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:48:52.616189 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eeda9a-98f5-4cbe-9d9a-a0575ab1fbf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:52.617553 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eeda9a-98f5-4cbe-9d9a-a0575ab1fbf8 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:52.628819 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 645/1284] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Jul 5 21:48:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:48:52.634689 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1757ec4f-9de7-4779-a1c5-a0fc209e721e None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:52.743330 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1757ec4f-9de7-4779-a1c5-a0fc209e721e None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:52.758115 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:52.778577 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1090e4-18c1-4110-a371-758c885455c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:52.779366 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1090e4-18c1-4110-a371-758c885455c0 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:52.779659 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1090e4-18c1-4110-a371-758c885455c0 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:52.779940 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1090e4-18c1-4110-a371-758c885455c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:52.786618 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1090e4-18c1-4110-a371-758c885455c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:52.788064 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1090e4-18c1-4110-a371-758c885455c0 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:52.803284 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application [None req-5b1090e4-18c1-4110-a371-758c885455c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:48:52.803284 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:48:52.803284 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:48:52.803284 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:48:52.803284 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:48:52.803284 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:48:52.803284 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:48:52.803284 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:48:52.803284 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:48:52.803284 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:48:52.803284 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:48:52.803284 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:48:52.803284 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 21:48:52.803284 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 21:48:52.803284 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 21:48:52.804406 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 21:48:52.804406 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:48:52.804406 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:48:52.804406 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:48:52.804406 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:48:52.804406 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:48:52.804406 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:48:52.804406 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:48:52.804406 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application with Lock( Jul 05 21:48:52.804406 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:48:52.804406 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:48:52.804406 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:48:52.804406 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:48:52.804406 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:48:52.804406 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:48:52.804406 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:48:52.804406 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:48:52.805622 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 21:48:52.805622 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 21:48:52.805622 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 21:48:52.805622 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 21:48:52.805622 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 21:48:52.805622 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 21:48:52.805622 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 21:48:52.805622 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: ERROR keystone.server.flask.application Jul 05 21:48:52.805622 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 640/1285] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Jul 5 21:48:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:48:52.810542 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eeda9a-98f5-4cbe-9d9a-a0575ab1fbf8 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:52.862551 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:52.913860 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eeda9a-98f5-4cbe-9d9a-a0575ab1fbf8 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:52.947971 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90772de1-17b2-454d-a087-7961403481ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:52.948677 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90772de1-17b2-454d-a087-7961403481ae None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:52.949537 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90772de1-17b2-454d-a087-7961403481ae None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:52.949820 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90772de1-17b2-454d-a087-7961403481ae None admin] PATH_INFO: `/v3/projects` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:52.950645 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90772de1-17b2-454d-a087-7961403481ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:48:52.950957 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90772de1-17b2-454d-a087-7961403481ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:52.953204 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90772de1-17b2-454d-a087-7961403481ae None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:52.966239 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 646/1286] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Jul 5 21:48:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:48:52.972422 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1090e4-18c1-4110-a371-758c885455c0 None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:53.079899 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1090e4-18c1-4110-a371-758c885455c0 None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:53.113925 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de7282-9c94-460d-af4f-3b1238f99d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:53.114602 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de7282-9c94-460d-af4f-3b1238f99d74 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:53.114892 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de7282-9c94-460d-af4f-3b1238f99d74 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:53.115169 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de7282-9c94-460d-af4f-3b1238f99d74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:53.116000 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8de7282-9c94-460d-af4f-3b1238f99d74 None admin] RBAC: Adding query filter params (role.id=e1c574c9973548ebb0e8d9e0656ccabd, scope.project.id=93f20f89d0fc4bbf9cf557dd1e14d98d, user.id=c289d4b42dec4fe382e35c3f9faa21c8) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:48:53.116317 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8de7282-9c94-460d-af4f-3b1238f99d74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:53.117881 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8de7282-9c94-460d-af4f-3b1238f99d74 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:53.124405 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 641/1287] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Jul 5 21:48:52 2022] GET /identity/v3/role_assignments?user.id=c289d4b42dec4fe382e35c3f9faa21c8&scope.project.id=93f20f89d0fc4bbf9cf557dd1e14d98d&role.id=e1c574c9973548ebb0e8d9e0656ccabd => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:48:55.169036 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb836f4-2af9-4675-b40f-b3d75e4c6883 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:55.169583 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb836f4-2af9-4675-b40f-b3d75e4c6883 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:55.169583 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb836f4-2af9-4675-b40f-b3d75e4c6883 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:55.171850 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 647/1288] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:48:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:48:55.177307 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ad1f4-78cc-4f59-b7d4-989ba114ec73 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:55.177737 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ad1f4-78cc-4f59-b7d4-989ba114ec73 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:55.177875 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ad1f4-78cc-4f59-b7d4-989ba114ec73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:55.194861 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-0f1ad1f4-78cc-4f59-b7d4-989ba114ec73 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:48:55.196349 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-0f1ad1f4-78cc-4f59-b7d4-989ba114ec73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:48:55.226739 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:55.264383 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 642/1289] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:48:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:48:55.287238 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb836f4-2af9-4675-b40f-b3d75e4c6883 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:55.396785 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb836f4-2af9-4675-b40f-b3d75e4c6883 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:55.410146 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:55.436098 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a6e85-1d4e-4592-a23f-c6296bc7348b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:55.436965 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a6e85-1d4e-4592-a23f-c6296bc7348b None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:55.437352 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a6e85-1d4e-4592-a23f-c6296bc7348b None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:55.437759 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a6e85-1d4e-4592-a23f-c6296bc7348b None admin] PATH_INFO: `/v3/services/placement` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:55.438485 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a6e85-1d4e-4592-a23f-c6296bc7348b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:55.439909 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a6e85-1d4e-4592-a23f-c6296bc7348b None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:55.453719 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-3d9a6e85-1d4e-4592-a23f-c6296bc7348b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 21:48:55.453719 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:48:55.453719 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:48:55.453719 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:48:55.453719 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:48:55.453719 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:48:55.453719 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:48:55.453719 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:48:55.453719 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 21:48:55.453719 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:48:55.453719 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:48:55.453719 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:48:55.453719 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:48:55.453719 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:48:55.453719 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:48:55.453719 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:48:55.453719 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:48:55.455306 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:48:55.455306 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:48:55.455306 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:48:55.455306 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:48:55.455306 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:48:55.455306 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:48:55.455306 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:48:55.455306 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:48:55.455306 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:48:55.455306 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:48:55.455306 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:48:55.455306 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:48:55.455306 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:48:55.455306 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:48:55.455306 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:48:55.455306 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:48:55.456298 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:48:55.456298 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:48:55.456298 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:48:55.456298 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:48:55.456298 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:48:55.456298 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:48:55.456298 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:48:55.456298 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:48:55.456298 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:48:55.456298 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:48:55.456298 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:48:55.456298 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:48:55.456298 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 21:48:55.456298 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:48:55.456298 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 648/1290] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Jul 5 21:48:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:48:55.462242 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ad1f4-78cc-4f59-b7d4-989ba114ec73 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:55.575150 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ad1f4-78cc-4f59-b7d4-989ba114ec73 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:55.613384 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d59d1a-cb91-4f2e-9a0b-672be4706053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:55.614065 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d59d1a-cb91-4f2e-9a0b-672be4706053 None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:55.614380 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d59d1a-cb91-4f2e-9a0b-672be4706053 None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:55.614724 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d59d1a-cb91-4f2e-9a0b-672be4706053 None admin] PATH_INFO: `/v3/services` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:55.615451 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d59d1a-cb91-4f2e-9a0b-672be4706053 None admin] RBAC: Adding query filter params (name=placement) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:48:55.615765 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d59d1a-cb91-4f2e-9a0b-672be4706053 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:55.617160 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d59d1a-cb91-4f2e-9a0b-672be4706053 None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:55.622836 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 643/1291] 10.222.0.30 () {56 vars in 1116 bytes} [Tue Jul 5 21:48:55 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:48:55.629602 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a6e85-1d4e-4592-a23f-c6296bc7348b None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:55.740883 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a6e85-1d4e-4592-a23f-c6296bc7348b None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:55.776718 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0fb66e-4228-4e6f-bcd6-28ec7235ea4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:55.777403 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fb66e-4228-4e6f-bcd6-28ec7235ea4f None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:55.777697 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fb66e-4228-4e6f-bcd6-28ec7235ea4f None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:55.777984 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fb66e-4228-4e6f-bcd6-28ec7235ea4f None admin] PATH_INFO: `/v3/services` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:55.778748 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0fb66e-4228-4e6f-bcd6-28ec7235ea4f None admin] RBAC: Adding query filter params (type=placement) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:48:55.779069 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0fb66e-4228-4e6f-bcd6-28ec7235ea4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:55.780813 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0fb66e-4228-4e6f-bcd6-28ec7235ea4f None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:55.785671 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 649/1292] 10.222.0.30 () {56 vars in 1116 bytes} [Tue Jul 5 21:48:55 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:48:57.823098 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e8885-7472-4128-9147-ac189fee9ce8 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:57.823636 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e8885-7472-4128-9147-ac189fee9ce8 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:57.823636 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e8885-7472-4128-9147-ac189fee9ce8 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:57.824980 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 644/1293] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:48:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:48:57.830848 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d94f3-fe72-474e-bd20-ef795a4afbfd None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:57.831288 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d94f3-fe72-474e-bd20-ef795a4afbfd None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:57.831474 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d94f3-fe72-474e-bd20-ef795a4afbfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:57.849149 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-f24d94f3-fe72-474e-bd20-ef795a4afbfd None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:48:57.850391 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-f24d94f3-fe72-474e-bd20-ef795a4afbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:48:57.880162 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:57.918473 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 650/1294] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:48:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:48:57.942353 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e8885-7472-4128-9147-ac189fee9ce8 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:48:57.974191 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:48:58.045789 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e8885-7472-4128-9147-ac189fee9ce8 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:48:58.080674 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c63cfff-7560-4707-a422-7147ee6b14ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:48:58.081283 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63cfff-7560-4707-a422-7147ee6b14ee None admin] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:48:58.081574 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63cfff-7560-4707-a422-7147ee6b14ee None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:48:58.081857 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63cfff-7560-4707-a422-7147ee6b14ee None admin] PATH_INFO: `/v3/services` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:48:58.082637 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c63cfff-7560-4707-a422-7147ee6b14ee None admin] RBAC: Authorizing `identity:create_service()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:48:58.084027 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c63cfff-7560-4707-a422-7147ee6b14ee None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:48:58.130501 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 645/1295] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Jul 5 21:48:57 2022] POST /identity/v3/services => generated 246 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:49:00.159439 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5f808-0b4f-483e-a565-9d954815ecdf None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:49:00.187551 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5f808-0b4f-483e-a565-9d954815ecdf None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:49:00.187551 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5f808-0b4f-483e-a565-9d954815ecdf None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:49:00.187551 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 651/1296] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:49:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:49:00.187889 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b4e11-6426-4037-83d2-6896ca1158ab None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:49:00.187889 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b4e11-6426-4037-83d2-6896ca1158ab None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:49:00.187889 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b4e11-6426-4037-83d2-6896ca1158ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:49:00.187889 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-a57b4e11-6426-4037-83d2-6896ca1158ab None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:49:00.188556 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-a57b4e11-6426-4037-83d2-6896ca1158ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:49:00.262210 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 646/1297] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:49:00 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:49:00.285966 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5f808-0b4f-483e-a565-9d954815ecdf None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:49:00.389374 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5f808-0b4f-483e-a565-9d954815ecdf None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:49:00.424121 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff47da-c39c-4c28-bcd1-6931d1056a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:49:00.424859 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff47da-c39c-4c28-bcd1-6931d1056a09 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:49:00.425147 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff47da-c39c-4c28-bcd1-6931d1056a09 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:49:00.425426 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff47da-c39c-4c28-bcd1-6931d1056a09 None admin] PATH_INFO: `/v3/services/placement` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:49:00.426082 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff47da-c39c-4c28-bcd1-6931d1056a09 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:49:00.427489 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff47da-c39c-4c28-bcd1-6931d1056a09 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:49:00.439253 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-4bff47da-c39c-4c28-bcd1-6931d1056a09 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 21:49:00.439253 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:49:00.439253 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:49:00.439253 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:49:00.439253 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:49:00.439253 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:49:00.439253 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:49:00.439253 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:49:00.439253 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 21:49:00.439253 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:49:00.439253 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:49:00.439253 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:49:00.439253 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:49:00.439253 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:49:00.439253 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:49:00.439253 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:49:00.439253 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:49:00.440599 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:49:00.440599 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:49:00.440599 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:49:00.440599 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:49:00.440599 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:49:00.440599 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:49:00.440599 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:49:00.440599 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:49:00.440599 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:49:00.440599 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:49:00.440599 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:49:00.440599 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:49:00.440599 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:49:00.440599 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:49:00.440599 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:49:00.440599 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:49:00.441794 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:49:00.441794 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:49:00.441794 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:49:00.441794 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:49:00.441794 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:49:00.441794 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:49:00.441794 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:49:00.441794 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:49:00.441794 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:49:00.441794 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:49:00.441794 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:49:00.441794 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:49:00.441794 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 21:49:00.441794 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:49:00.441794 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 652/1298] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Jul 5 21:49:00 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:49:00.446830 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b4e11-6426-4037-83d2-6896ca1158ab None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:49:00.465362 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:49:00.546070 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b4e11-6426-4037-83d2-6896ca1158ab None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:49:00.582749 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77670e50-ee03-462b-8a98-a575d2decb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:49:00.583415 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77670e50-ee03-462b-8a98-a575d2decb2f None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:49:00.583702 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77670e50-ee03-462b-8a98-a575d2decb2f None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:49:00.583981 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77670e50-ee03-462b-8a98-a575d2decb2f None admin] PATH_INFO: `/v3/services` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:49:00.584729 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77670e50-ee03-462b-8a98-a575d2decb2f None admin] RBAC: Adding query filter params (name=placement) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:49:00.585043 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77670e50-ee03-462b-8a98-a575d2decb2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:49:00.586487 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77670e50-ee03-462b-8a98-a575d2decb2f None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:49:00.591711 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 647/1299] 10.222.0.30 () {56 vars in 1116 bytes} [Tue Jul 5 21:49:00 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:49:00.598352 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff47da-c39c-4c28-bcd1-6931d1056a09 None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:49:00.630071 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:49:00.698188 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff47da-c39c-4c28-bcd1-6931d1056a09 None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:49:00.732118 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21013e53-4756-45e7-b9ee-64b413a38112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:49:00.732838 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21013e53-4756-45e7-b9ee-64b413a38112 None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:49:00.733128 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21013e53-4756-45e7-b9ee-64b413a38112 None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:49:00.733409 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21013e53-4756-45e7-b9ee-64b413a38112 None admin] PATH_INFO: `/v3/endpoints` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:49:00.734236 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21013e53-4756-45e7-b9ee-64b413a38112 None admin] RBAC: Adding query filter params (interface=public, service_id=c1feee3654fc4f268c4c82847eb4b4e5, region_id=RegionOne) {{(pid=244269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:49:00.734555 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21013e53-4756-45e7-b9ee-64b413a38112 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:49:00.735932 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21013e53-4756-45e7-b9ee-64b413a38112 None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:49:00.740926 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 653/1300] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Jul 5 21:49:00 2022] GET /identity/v3/endpoints?service_id=c1feee3654fc4f268c4c82847eb4b4e5&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:49:00.746656 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77670e50-ee03-462b-8a98-a575d2decb2f None admin] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:49:00.828847 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:49:00.846579 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77670e50-ee03-462b-8a98-a575d2decb2f None admin] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:49:00.882029 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98411594-3684-41a2-8002-5061f991d75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:49:00.882719 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98411594-3684-41a2-8002-5061f991d75d None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:49:00.883017 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98411594-3684-41a2-8002-5061f991d75d None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:49:00.883397 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98411594-3684-41a2-8002-5061f991d75d None admin] PATH_INFO: `/v3/services` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:49:00.884084 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98411594-3684-41a2-8002-5061f991d75d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:49:00.885445 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98411594-3684-41a2-8002-5061f991d75d None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:49:00.892605 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 648/1301] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Jul 5 21:49:00 2022] GET /identity/v3/services => generated 2191 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:49:02.924114 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55ad86-0eac-480d-a83c-8a1b561efc51 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:49:02.924646 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55ad86-0eac-480d-a83c-8a1b561efc51 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:49:02.924646 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55ad86-0eac-480d-a83c-8a1b561efc51 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:49:02.925991 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 654/1302] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:49:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:49:02.931322 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b0414-e0f9-402b-8601-53a259fae29e None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:49:02.931776 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b0414-e0f9-402b-8601-53a259fae29e None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:49:02.931881 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b0414-e0f9-402b-8601-53a259fae29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:49:02.949433 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-8d5b0414-e0f9-402b-8601-53a259fae29e None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:49:02.950674 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-8d5b0414-e0f9-402b-8601-53a259fae29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:49:03.017696 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 649/1303] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:49:02 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 21:49:03.040949 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55ad86-0eac-480d-a83c-8a1b561efc51 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:49:03.138386 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:49:03.145247 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55ad86-0eac-480d-a83c-8a1b561efc51 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:49:03.179274 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9444a2-cfc2-467c-b323-a98da5cc498c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:49:03.180004 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9444a2-cfc2-467c-b323-a98da5cc498c None admin] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:49:03.180289 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9444a2-cfc2-467c-b323-a98da5cc498c None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:49:03.180568 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9444a2-cfc2-467c-b323-a98da5cc498c None admin] PATH_INFO: `/v3/services/placement` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:49:03.181219 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9444a2-cfc2-467c-b323-a98da5cc498c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:49:03.182624 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9444a2-cfc2-467c-b323-a98da5cc498c None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:49:03.194557 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application [None req-0c9444a2-cfc2-467c-b323-a98da5cc498c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 21:49:03.194557 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:49:03.194557 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 21:49:03.194557 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 21:49:03.194557 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 21:49:03.194557 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 21:49:03.194557 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 21:49:03.194557 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:49:03.194557 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 21:49:03.194557 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:49:03.194557 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 21:49:03.194557 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:49:03.194557 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 21:49:03.194557 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 21:49:03.194557 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 21:49:03.194557 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 21:49:03.194557 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 21:49:03.195817 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 21:49:03.195817 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 21:49:03.195817 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 21:49:03.195817 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 21:49:03.195817 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 21:49:03.195817 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 21:49:03.195817 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 21:49:03.195817 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 21:49:03.195817 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 21:49:03.195817 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 21:49:03.195817 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 21:49:03.195817 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 21:49:03.195817 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 21:49:03.195817 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 21:49:03.195817 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 21:49:03.195817 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 21:49:03.196924 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 21:49:03.196924 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application with Lock( Jul 05 21:49:03.196924 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 21:49:03.196924 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self._enter() Jul 05 21:49:03.196924 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 21:49:03.196924 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 21:49:03.196924 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 21:49:03.196924 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application return self.creator() Jul 05 21:49:03.196924 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 21:49:03.196924 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application created_value = creator( Jul 05 21:49:03.196924 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 21:49:03.196924 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 21:49:03.196924 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 21:49:03.196924 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: ERROR keystone.server.flask.application Jul 05 21:49:03.196924 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 655/1304] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Jul 5 21:49:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 21:49:03.202423 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b0414-e0f9-402b-8601-53a259fae29e None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:49:03.278434 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:49:03.301524 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b0414-e0f9-402b-8601-53a259fae29e None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:49:03.335859 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b94f89-0d71-442a-bbc5-2ed913bedf4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:49:03.336520 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b94f89-0d71-442a-bbc5-2ed913bedf4f None admin] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:49:03.336808 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b94f89-0d71-442a-bbc5-2ed913bedf4f None admin] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:49:03.337090 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b94f89-0d71-442a-bbc5-2ed913bedf4f None admin] PATH_INFO: `/v3/services` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:49:03.337798 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b94f89-0d71-442a-bbc5-2ed913bedf4f None admin] RBAC: Adding query filter params (name=placement) {{(pid=244268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:49:03.338109 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b94f89-0d71-442a-bbc5-2ed913bedf4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:49:03.339512 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b94f89-0d71-442a-bbc5-2ed913bedf4f None admin] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:49:03.345177 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 650/1305] 10.222.0.30 () {56 vars in 1116 bytes} [Tue Jul 5 21:49:03 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:49:03.350968 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9444a2-cfc2-467c-b323-a98da5cc498c None admin] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:49:03.450656 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9444a2-cfc2-467c-b323-a98da5cc498c None admin] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:49:03.484359 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a16fd-126b-4eae-8e20-9fb224e2c94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e928873ee4f41c0a59c6b30ce6b0806', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:49:03.488595 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a16fd-126b-4eae-8e20-9fb224e2c94a None admin] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:49:03.488595 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a16fd-126b-4eae-8e20-9fb224e2c94a None admin] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:49:03.488595 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a16fd-126b-4eae-8e20-9fb224e2c94a None admin] PATH_INFO: `/v3/endpoints` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:49:03.488595 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a16fd-126b-4eae-8e20-9fb224e2c94a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:49:03.488595 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a16fd-126b-4eae-8e20-9fb224e2c94a None admin] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:49:03.604935 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 656/1306] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Jul 5 21:49:03 2022] POST /identity/v3/endpoints => generated 331 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:49:13.353029 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=30 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:49:13.600060 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:55:31.597838 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d030da2-5279-47aa-a58d-8960bdb2981d None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:55:31.598467 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d030da2-5279-47aa-a58d-8960bdb2981d None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:55:31.598467 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d030da2-5279-47aa-a58d-8960bdb2981d None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:55:31.599740 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 651/1307] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:55:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:55:31.605303 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c55b5-86e5-47be-84dd-bec303de5596 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:55:31.606109 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c55b5-86e5-47be-84dd-bec303de5596 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:55:31.606581 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c55b5-86e5-47be-84dd-bec303de5596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:55:31.765462 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-3f1c55b5-86e5-47be-84dd-bec303de5596 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:55:31.766752 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-3f1c55b5-86e5-47be-84dd-bec303de5596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:55:31.974161 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 657/1308] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:55:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:55:32.020456 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01369f0b-9a3a-4fe9-904e-2089c2e355b9 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:55:32.021002 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01369f0b-9a3a-4fe9-904e-2089c2e355b9 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:55:32.021441 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01369f0b-9a3a-4fe9-904e-2089c2e355b9 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:55:32.023306 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 652/1309] 10.222.0.30 () {54 vars in 964 bytes} [Tue Jul 5 21:55:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:55:32.030361 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b0811-069b-49e3-8d7e-8539d33c7358 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:55:32.030684 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b0811-069b-49e3-8d7e-8539d33c7358 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:55:32.030975 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b0811-069b-49e3-8d7e-8539d33c7358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:55:32.128434 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-825b0811-069b-49e3-8d7e-8539d33c7358 None None] MFA Rules not processed for user `b59ded30d64d4eeca95c949259faf5ae`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:55:32.129852 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-825b0811-069b-49e3-8d7e-8539d33c7358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:55:32.155387 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:55:32.229837 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 658/1310] 10.222.0.30 () {58 vars in 1061 bytes} [Tue Jul 5 21:55:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:55:32.239557 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01369f0b-9a3a-4fe9-904e-2089c2e355b9 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:55:32.241332 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-01369f0b-9a3a-4fe9-904e-2089c2e355b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:55:32.465737 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01369f0b-9a3a-4fe9-904e-2089c2e355b9 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:55:32.544262 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ebee2e-3aba-4cb6-bbdf-61becf581522 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59ded30d64d4eeca95c949259faf5ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93f20f89d0fc4bbf9cf557dd1e14d98d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:55:32.545020 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebee2e-3aba-4cb6-bbdf-61becf581522 service neutron] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:55:32.545214 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebee2e-3aba-4cb6-bbdf-61becf581522 service neutron] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:55:32.545517 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebee2e-3aba-4cb6-bbdf-61becf581522 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:55:32.547741 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-b6ebee2e-3aba-4cb6-bbdf-61becf581522 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:55:32.625670 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:55:32.708563 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ebee2e-3aba-4cb6-bbdf-61becf581522 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:55:32.710444 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ebee2e-3aba-4cb6-bbdf-61becf581522 service neutron] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:55:32.738964 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 653/1311] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:55:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:55:35.156529 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e918162a-459d-4486-ad32-8d1ae958d335 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:55:35.157151 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e918162a-459d-4486-ad32-8d1ae958d335 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:55:35.157151 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e918162a-459d-4486-ad32-8d1ae958d335 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:55:35.158572 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 659/1312] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:55:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:55:35.164023 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb2567-d857-4bf2-9c43-4b6eb358e259 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:55:35.164430 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb2567-d857-4bf2-9c43-4b6eb358e259 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:55:35.164790 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb2567-d857-4bf2-9c43-4b6eb358e259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:55:35.248448 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-22fb2567-d857-4bf2-9c43-4b6eb358e259 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:55:35.249704 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-22fb2567-d857-4bf2-9c43-4b6eb358e259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:55:35.355209 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 654/1313] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:55:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:55:35.394705 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e918162a-459d-4486-ad32-8d1ae958d335 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:55:35.396504 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-e918162a-459d-4486-ad32-8d1ae958d335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:55:35.507453 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e918162a-459d-4486-ad32-8d1ae958d335 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:55:35.583413 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:55:35.586074 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407368e-611f-4885-aaca-82d29b6ce8a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59ded30d64d4eeca95c949259faf5ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93f20f89d0fc4bbf9cf557dd1e14d98d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:55:35.586766 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407368e-611f-4885-aaca-82d29b6ce8a1 service neutron] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:55:35.587053 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407368e-611f-4885-aaca-82d29b6ce8a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:55:35.588023 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407368e-611f-4885-aaca-82d29b6ce8a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:55:35.589964 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-6407368e-611f-4885-aaca-82d29b6ce8a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:55:35.707247 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6407368e-611f-4885-aaca-82d29b6ce8a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:55:35.708711 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6407368e-611f-4885-aaca-82d29b6ce8a1 service neutron] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:55:35.726916 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 660/1314] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:55:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:55:38.218685 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dad5fe-fdcd-47ff-a2d7-4ce0c6ad9827 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:55:38.219184 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dad5fe-fdcd-47ff-a2d7-4ce0c6ad9827 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:55:38.219282 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dad5fe-fdcd-47ff-a2d7-4ce0c6ad9827 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:55:38.220657 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 655/1315] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:55:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:55:38.226015 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb75a43-ad67-4e40-9129-b8909c036964 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:55:38.226459 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb75a43-ad67-4e40-9129-b8909c036964 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:55:38.226674 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb75a43-ad67-4e40-9129-b8909c036964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:55:38.294596 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-9cb75a43-ad67-4e40-9129-b8909c036964 None None] MFA Rules not processed for user `c408cf8653cd44348de851d3fa6f8d63`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:55:38.295880 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-9cb75a43-ad67-4e40-9129-b8909c036964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:55:38.347223 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:55:38.392560 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 661/1316] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:55:38 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:55:38.432898 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dad5fe-fdcd-47ff-a2d7-4ce0c6ad9827 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:55:38.434497 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-f8dad5fe-fdcd-47ff-a2d7-4ce0c6ad9827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:55:38.444240 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:55:38.538264 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dad5fe-fdcd-47ff-a2d7-4ce0c6ad9827 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:55:38.612560 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3bf15-82be-491a-b918-964d11b2fa96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59ded30d64d4eeca95c949259faf5ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93f20f89d0fc4bbf9cf557dd1e14d98d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:55:38.613218 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3bf15-82be-491a-b918-964d11b2fa96 service neutron] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:55:38.613515 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3bf15-82be-491a-b918-964d11b2fa96 service neutron] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:55:38.613800 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3bf15-82be-491a-b918-964d11b2fa96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:55:38.615510 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-f2d3bf15-82be-491a-b918-964d11b2fa96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:55:38.679377 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:55:38.727191 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d3bf15-82be-491a-b918-964d11b2fa96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:55:38.728672 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d3bf15-82be-491a-b918-964d11b2fa96 service neutron] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:55:38.747258 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 656/1317] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:55:38 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:55:41.592536 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba63a4e-64d5-4004-a89f-e1d47eedf887 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:55:41.593101 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba63a4e-64d5-4004-a89f-e1d47eedf887 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:55:41.593101 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba63a4e-64d5-4004-a89f-e1d47eedf887 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:55:41.594547 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 662/1318] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:55:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:55:41.599741 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe81517-c446-4588-9dc3-77f221a96d9c None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:55:41.600142 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe81517-c446-4588-9dc3-77f221a96d9c None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:55:41.600318 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe81517-c446-4588-9dc3-77f221a96d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:55:41.666471 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-dbe81517-c446-4588-9dc3-77f221a96d9c None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:55:41.667805 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-dbe81517-c446-4588-9dc3-77f221a96d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:55:41.765384 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 657/1319] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:55:41 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:55:41.802960 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba63a4e-64d5-4004-a89f-e1d47eedf887 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:55:41.804461 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-1ba63a4e-64d5-4004-a89f-e1d47eedf887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:55:41.909095 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba63a4e-64d5-4004-a89f-e1d47eedf887 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:55:41.981591 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d4251-9ed3-4966-b551-0b95e84c6ff1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59ded30d64d4eeca95c949259faf5ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93f20f89d0fc4bbf9cf557dd1e14d98d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:55:41.982259 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d4251-9ed3-4966-b551-0b95e84c6ff1 service neutron] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:55:41.982549 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d4251-9ed3-4966-b551-0b95e84c6ff1 service neutron] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:55:41.982828 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d4251-9ed3-4966-b551-0b95e84c6ff1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:55:41.984744 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-729d4251-9ed3-4966-b551-0b95e84c6ff1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:55:41.992101 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:55:42.094458 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729d4251-9ed3-4966-b551-0b95e84c6ff1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:55:42.095859 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729d4251-9ed3-4966-b551-0b95e84c6ff1 service neutron] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:55:42.116172 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 663/1320] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:55:41 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:55:45.164140 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a500e0b-e064-47f3-931b-eebf42a5b5cb None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:55:45.164706 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a500e0b-e064-47f3-931b-eebf42a5b5cb None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:55:45.164815 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a500e0b-e064-47f3-931b-eebf42a5b5cb None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:55:45.166226 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 658/1321] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:55:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:55:45.171603 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7bc91-7b0d-4e5e-97dc-0154d1fa25c5 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:55:45.172035 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7bc91-7b0d-4e5e-97dc-0154d1fa25c5 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:55:45.172181 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7bc91-7b0d-4e5e-97dc-0154d1fa25c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:55:45.237672 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-f5a7bc91-7b0d-4e5e-97dc-0154d1fa25c5 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:55:45.238922 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-f5a7bc91-7b0d-4e5e-97dc-0154d1fa25c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:55:45.297893 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:55:45.340489 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 664/1322] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:55:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:55:45.391900 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6afea8-944f-43e3-bf3a-fb88d8085bc6 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:55:45.392193 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6afea8-944f-43e3-bf3a-fb88d8085bc6 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:55:45.392472 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6afea8-944f-43e3-bf3a-fb88d8085bc6 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:55:45.393886 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 659/1323] 10.222.0.30 () {54 vars in 964 bytes} [Tue Jul 5 21:55:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:55:45.400973 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89104555-7437-48ea-92b2-d8fc855ae40a None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:55:45.401368 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89104555-7437-48ea-92b2-d8fc855ae40a None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:55:45.401719 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89104555-7437-48ea-92b2-d8fc855ae40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:55:45.487420 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-89104555-7437-48ea-92b2-d8fc855ae40a None None] MFA Rules not processed for user `b59ded30d64d4eeca95c949259faf5ae`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:55:45.488665 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-89104555-7437-48ea-92b2-d8fc855ae40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:55:45.577209 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 665/1324] 10.222.0.30 () {58 vars in 1061 bytes} [Tue Jul 5 21:55:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:55:45.586482 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6afea8-944f-43e3-bf3a-fb88d8085bc6 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:55:45.588214 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-1a6afea8-944f-43e3-bf3a-fb88d8085bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:55:45.608172 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:55:45.700008 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6afea8-944f-43e3-bf3a-fb88d8085bc6 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:55:45.776989 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9efaa35-0ac7-464a-b33f-3da22122c543 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59ded30d64d4eeca95c949259faf5ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93f20f89d0fc4bbf9cf557dd1e14d98d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:55:45.777648 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efaa35-0ac7-464a-b33f-3da22122c543 service neutron] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:55:45.777938 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efaa35-0ac7-464a-b33f-3da22122c543 service neutron] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:55:45.778245 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efaa35-0ac7-464a-b33f-3da22122c543 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:55:45.779917 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-f9efaa35-0ac7-464a-b33f-3da22122c543 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:55:45.854275 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:55:45.893990 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9efaa35-0ac7-464a-b33f-3da22122c543 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:55:45.895463 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9efaa35-0ac7-464a-b33f-3da22122c543 service neutron] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:55:45.913289 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 660/1325] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:55:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:55:48.253600 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71d0d3-b038-443b-91f9-c688a5f42e76 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:55:48.254196 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71d0d3-b038-443b-91f9-c688a5f42e76 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:55:48.254196 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71d0d3-b038-443b-91f9-c688a5f42e76 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:55:48.255586 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 666/1326] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:55:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:55:48.261564 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f92112-356c-4de8-9e53-cb277cd9427c None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:55:48.262055 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f92112-356c-4de8-9e53-cb277cd9427c None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:55:48.262300 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f92112-356c-4de8-9e53-cb277cd9427c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:55:48.336731 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-52f92112-356c-4de8-9e53-cb277cd9427c None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:55:48.338870 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-52f92112-356c-4de8-9e53-cb277cd9427c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:55:48.437407 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 661/1327] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:55:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:55:48.474207 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a71d0d3-b038-443b-91f9-c688a5f42e76 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:55:48.475770 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-4a71d0d3-b038-443b-91f9-c688a5f42e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:55:48.537148 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:55:48.582094 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a71d0d3-b038-443b-91f9-c688a5f42e76 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:55:48.655994 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96421a5e-2515-414f-bee5-ee92ca48bed3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59ded30d64d4eeca95c949259faf5ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93f20f89d0fc4bbf9cf557dd1e14d98d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:55:48.656591 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96421a5e-2515-414f-bee5-ee92ca48bed3 service neutron] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:55:48.656879 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96421a5e-2515-414f-bee5-ee92ca48bed3 service neutron] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:55:48.657158 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96421a5e-2515-414f-bee5-ee92ca48bed3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:55:48.658915 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-96421a5e-2515-414f-bee5-ee92ca48bed3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:55:48.765577 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:55:48.768011 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96421a5e-2515-414f-bee5-ee92ca48bed3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:55:48.769458 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96421a5e-2515-414f-bee5-ee92ca48bed3 service neutron] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:55:48.788968 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 667/1328] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:55:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:55:50.870262 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb790c-c431-41a6-bfeb-159786245893 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:55:50.870783 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb790c-c431-41a6-bfeb-159786245893 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:55:50.870783 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb790c-c431-41a6-bfeb-159786245893 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:55:50.872144 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 662/1329] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:55:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:55:50.877634 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ef746-eded-43a9-ab14-c549a6a07d2f None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:55:50.878077 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ef746-eded-43a9-ab14-c549a6a07d2f None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:55:50.878240 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ef746-eded-43a9-ab14-c549a6a07d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:55:50.942848 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-0b5ef746-eded-43a9-ab14-c549a6a07d2f None None] MFA Rules not processed for user `c408cf8653cd44348de851d3fa6f8d63`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:55:50.944084 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-0b5ef746-eded-43a9-ab14-c549a6a07d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:55:51.039917 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 668/1330] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:55:50 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:55:51.078300 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb790c-c431-41a6-bfeb-159786245893 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:55:51.079847 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-f5eb790c-c431-41a6-bfeb-159786245893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:55:51.111395 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:55:51.184525 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb790c-c431-41a6-bfeb-159786245893 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:55:51.257733 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9ee9e-5262-447c-a434-a3a45c13762a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59ded30d64d4eeca95c949259faf5ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93f20f89d0fc4bbf9cf557dd1e14d98d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:55:51.258466 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9ee9e-5262-447c-a434-a3a45c13762a service neutron] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:55:51.258759 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9ee9e-5262-447c-a434-a3a45c13762a service neutron] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:55:51.259034 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9ee9e-5262-447c-a434-a3a45c13762a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:55:51.260745 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-f7a9ee9e-5262-447c-a434-a3a45c13762a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:55:51.337748 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:55:51.369578 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a9ee9e-5262-447c-a434-a3a45c13762a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:55:51.371044 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a9ee9e-5262-447c-a434-a3a45c13762a service neutron] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:55:51.389192 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 663/1331] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:55:51 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:55:54.010866 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe608a-9940-493f-8b5b-70e01bd0a228 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:55:54.011462 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe608a-9940-493f-8b5b-70e01bd0a228 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:55:54.011462 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe608a-9940-493f-8b5b-70e01bd0a228 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:55:54.012817 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 669/1332] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:55:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:55:54.018027 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8776ebd-a48e-43bc-bab5-b3c31396d23b None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:55:54.018501 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8776ebd-a48e-43bc-bab5-b3c31396d23b None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:55:54.018630 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8776ebd-a48e-43bc-bab5-b3c31396d23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:55:54.084462 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-a8776ebd-a48e-43bc-bab5-b3c31396d23b None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:55:54.085687 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-a8776ebd-a48e-43bc-bab5-b3c31396d23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:55:54.182463 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 664/1333] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:55:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:55:54.218771 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe608a-9940-493f-8b5b-70e01bd0a228 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:55:54.220368 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-48fe608a-9940-493f-8b5b-70e01bd0a228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:55:54.291405 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:55:54.325530 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe608a-9940-493f-8b5b-70e01bd0a228 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:55:54.398798 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf39f6-fb20-4d3e-9dbc-045a97d27d41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59ded30d64d4eeca95c949259faf5ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93f20f89d0fc4bbf9cf557dd1e14d98d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:55:54.399532 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf39f6-fb20-4d3e-9dbc-045a97d27d41 service neutron] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:55:54.399875 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf39f6-fb20-4d3e-9dbc-045a97d27d41 service neutron] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:55:54.400107 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf39f6-fb20-4d3e-9dbc-045a97d27d41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:55:54.401788 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-2baf39f6-fb20-4d3e-9dbc-045a97d27d41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:55:54.511408 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baf39f6-fb20-4d3e-9dbc-045a97d27d41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:55:54.512882 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baf39f6-fb20-4d3e-9dbc-045a97d27d41 service neutron] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:55:54.523041 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:55:54.531293 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 670/1334] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:55:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:55:56.608468 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44d865-c180-46ee-9821-b4c21cab70e3 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:55:56.609020 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44d865-c180-46ee-9821-b4c21cab70e3 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:55:56.609020 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44d865-c180-46ee-9821-b4c21cab70e3 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:55:56.610733 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 665/1335] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:55:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:55:56.615850 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e00c3-f73f-40e2-8d5a-8109ac191989 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:55:56.616289 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e00c3-f73f-40e2-8d5a-8109ac191989 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:55:56.616425 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e00c3-f73f-40e2-8d5a-8109ac191989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:55:56.681364 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-ad6e00c3-f73f-40e2-8d5a-8109ac191989 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:55:56.682791 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-ad6e00c3-f73f-40e2-8d5a-8109ac191989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:55:56.779427 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 671/1336] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:55:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:55:56.819133 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44d865-c180-46ee-9821-b4c21cab70e3 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:55:56.820675 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-ef44d865-c180-46ee-9821-b4c21cab70e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:55:56.863257 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:55:56.927969 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44d865-c180-46ee-9821-b4c21cab70e3 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:55:56.999919 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fecd69-f811-4efe-90a0-50a4aa6f361a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59ded30d64d4eeca95c949259faf5ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93f20f89d0fc4bbf9cf557dd1e14d98d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:55:57.000566 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fecd69-f811-4efe-90a0-50a4aa6f361a service neutron] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:55:57.000851 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fecd69-f811-4efe-90a0-50a4aa6f361a service neutron] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:55:57.001130 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fecd69-f811-4efe-90a0-50a4aa6f361a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:55:57.002793 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-61fecd69-f811-4efe-90a0-50a4aa6f361a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:55:57.089477 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:55:57.114794 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fecd69-f811-4efe-90a0-50a4aa6f361a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:55:57.116243 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fecd69-f811-4efe-90a0-50a4aa6f361a service neutron] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:55:57.134826 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 666/1337] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:55:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:55:59.757273 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b196969e-0ed2-41aa-a000-ee970fb8f253 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:55:59.757891 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b196969e-0ed2-41aa-a000-ee970fb8f253 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:55:59.757891 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b196969e-0ed2-41aa-a000-ee970fb8f253 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:55:59.759627 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 672/1338] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:55:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:55:59.765058 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a421220-7deb-462a-b3d7-529c4c1fa031 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:55:59.765525 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a421220-7deb-462a-b3d7-529c4c1fa031 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:55:59.765620 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a421220-7deb-462a-b3d7-529c4c1fa031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:55:59.831122 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-4a421220-7deb-462a-b3d7-529c4c1fa031 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:55:59.832279 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-4a421220-7deb-462a-b3d7-529c4c1fa031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:55:59.929951 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 667/1339] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:55:59 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:55:59.965879 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b196969e-0ed2-41aa-a000-ee970fb8f253 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:55:59.967468 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-b196969e-0ed2-41aa-a000-ee970fb8f253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:56:00.043903 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:56:00.071493 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b196969e-0ed2-41aa-a000-ee970fb8f253 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:56:00.145003 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49512e9-3f38-4d75-b803-61861ed377c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59ded30d64d4eeca95c949259faf5ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93f20f89d0fc4bbf9cf557dd1e14d98d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:56:00.145595 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49512e9-3f38-4d75-b803-61861ed377c5 service neutron] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:00.145882 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49512e9-3f38-4d75-b803-61861ed377c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:00.146188 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49512e9-3f38-4d75-b803-61861ed377c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:00.147845 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-c49512e9-3f38-4d75-b803-61861ed377c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:56:00.259164 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49512e9-3f38-4d75-b803-61861ed377c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:56:00.260847 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49512e9-3f38-4d75-b803-61861ed377c5 service neutron] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:56:00.278936 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 673/1340] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:55:59 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:56:04.551504 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922a671-c3f2-4cb2-bbab-816b2b43e12a None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:04.552003 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922a671-c3f2-4cb2-bbab-816b2b43e12a None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:04.552099 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922a671-c3f2-4cb2-bbab-816b2b43e12a None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:04.557630 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 668/1341] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:56:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:56:04.561017 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a0521-eaa1-436f-9cae-079d9de67a30 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:04.562057 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a0521-eaa1-436f-9cae-079d9de67a30 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:04.562378 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a0521-eaa1-436f-9cae-079d9de67a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:04.568581 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=100 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:56:04.642258 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-cc9a0521-eaa1-436f-9cae-079d9de67a30 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:56:04.643601 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-cc9a0521-eaa1-436f-9cae-079d9de67a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:56:04.769266 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 674/1342] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:56:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:56:04.808777 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d922a671-c3f2-4cb2-bbab-816b2b43e12a None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:56:04.811283 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-d922a671-c3f2-4cb2-bbab-816b2b43e12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:56:04.864087 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:56:04.911165 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d922a671-c3f2-4cb2-bbab-816b2b43e12a None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:56:04.917898 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb340f30-876a-4324-bd12-b76376f63da0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59ded30d64d4eeca95c949259faf5ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93f20f89d0fc4bbf9cf557dd1e14d98d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:56:04.918602 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb340f30-876a-4324-bd12-b76376f63da0 service neutron] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:04.921427 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb340f30-876a-4324-bd12-b76376f63da0 service neutron] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:04.921741 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb340f30-876a-4324-bd12-b76376f63da0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:04.935391 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb340f30-876a-4324-bd12-b76376f63da0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:56:04.936874 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb340f30-876a-4324-bd12-b76376f63da0 service neutron] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:56:04.947366 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 669/1343] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:56:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:56:08.057237 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55b3a4-9e5e-4cfd-bb31-1baf12bc1de4 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:08.057819 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55b3a4-9e5e-4cfd-bb31-1baf12bc1de4 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:08.057941 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55b3a4-9e5e-4cfd-bb31-1baf12bc1de4 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:08.059399 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 675/1344] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:56:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:56:08.064808 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a771d708-1dc9-4c28-9bff-ad8914551de6 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:08.065229 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a771d708-1dc9-4c28-9bff-ad8914551de6 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:08.065392 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a771d708-1dc9-4c28-9bff-ad8914551de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:08.094490 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-a771d708-1dc9-4c28-9bff-ad8914551de6 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:56:08.095711 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-a771d708-1dc9-4c28-9bff-ad8914551de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:56:08.178207 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 670/1345] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:56:08 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:56:08.215994 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b55b3a4-9e5e-4cfd-bb31-1baf12bc1de4 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:56:08.226709 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b55b3a4-9e5e-4cfd-bb31-1baf12bc1de4 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:56:08.230901 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd5fcc-d2c1-4295-a418-bd0a36027f47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59ded30d64d4eeca95c949259faf5ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93f20f89d0fc4bbf9cf557dd1e14d98d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:56:08.231550 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd5fcc-d2c1-4295-a418-bd0a36027f47 service neutron] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:08.231838 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd5fcc-d2c1-4295-a418-bd0a36027f47 service neutron] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:08.232119 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd5fcc-d2c1-4295-a418-bd0a36027f47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:08.241420 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd5fcc-d2c1-4295-a418-bd0a36027f47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:56:08.243527 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd5fcc-d2c1-4295-a418-bd0a36027f47 service neutron] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:56:08.253226 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 676/1346] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:56:08 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:56:12.550170 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76660afa-9a09-44e5-99ce-512477e91b4d None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:12.550624 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76660afa-9a09-44e5-99ce-512477e91b4d None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:12.550729 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76660afa-9a09-44e5-99ce-512477e91b4d None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:12.552290 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 671/1347] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:56:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:56:12.558059 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d68597-9eee-4559-9f2e-10f874da723d None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:12.558591 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d68597-9eee-4559-9f2e-10f874da723d None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:12.558591 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d68597-9eee-4559-9f2e-10f874da723d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:12.576703 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-e2d68597-9eee-4559-9f2e-10f874da723d None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:56:12.577916 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-e2d68597-9eee-4559-9f2e-10f874da723d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:56:12.586010 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 677/1348] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:56:12.624442 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76660afa-9a09-44e5-99ce-512477e91b4d None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:56:12.636950 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76660afa-9a09-44e5-99ce-512477e91b4d None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:56:12.640651 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1b5c73-f69c-4de8-9930-4e8eebabf677 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59ded30d64d4eeca95c949259faf5ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93f20f89d0fc4bbf9cf557dd1e14d98d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:56:12.641314 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b5c73-f69c-4de8-9930-4e8eebabf677 service neutron] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:12.641605 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b5c73-f69c-4de8-9930-4e8eebabf677 service neutron] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:12.641886 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b5c73-f69c-4de8-9930-4e8eebabf677 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:12.652092 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1b5c73-f69c-4de8-9930-4e8eebabf677 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:56:12.653539 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1b5c73-f69c-4de8-9930-4e8eebabf677 service neutron] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:56:12.663652 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 672/1349] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:56:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:56:17.888328 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b92fbc-3079-48ee-bfe6-108a973f6307 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:17.889239 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b92fbc-3079-48ee-bfe6-108a973f6307 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:17.889694 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b92fbc-3079-48ee-bfe6-108a973f6307 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:17.891571 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 678/1350] 10.222.0.30 () {54 vars in 921 bytes} [Tue Jul 5 21:56:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:56:17.896676 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc30aa1-e8e9-4bea-93da-97b9b98ae23f None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:17.897447 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc30aa1-e8e9-4bea-93da-97b9b98ae23f None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:17.897907 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc30aa1-e8e9-4bea-93da-97b9b98ae23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:17.978915 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-afc30aa1-e8e9-4bea-93da-97b9b98ae23f None None] MFA Rules not processed for user `c289d4b42dec4fe382e35c3f9faa21c8`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:56:17.980405 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-afc30aa1-e8e9-4bea-93da-97b9b98ae23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:56:18.011505 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:56:18.074698 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 673/1351] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Jul 5 21:56:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:56:22.247035 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a09e7-bc22-4b72-b542-085c4f4c5049 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:22.247587 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a09e7-bc22-4b72-b542-085c4f4c5049 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:22.247587 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a09e7-bc22-4b72-b542-085c4f4c5049 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:22.249264 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 679/1352] 10.222.0.30 () {54 vars in 921 bytes} [Tue Jul 5 21:56:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:56:22.254451 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c427bb-a6cf-4892-9d50-f589e2166d6f None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:22.255321 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c427bb-a6cf-4892-9d50-f589e2166d6f None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:22.255832 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c427bb-a6cf-4892-9d50-f589e2166d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:22.276369 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-45c427bb-a6cf-4892-9d50-f589e2166d6f None None] MFA Rules not processed for user `c289d4b42dec4fe382e35c3f9faa21c8`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:56:22.277594 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-45c427bb-a6cf-4892-9d50-f589e2166d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:56:22.286719 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 674/1353] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Jul 5 21:56:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:56:22.571613 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=72 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:56:23.894227 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebde6e-f1c7-4577-b8a4-84312ec5d084 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:23.894849 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebde6e-f1c7-4577-b8a4-84312ec5d084 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:23.894849 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebde6e-f1c7-4577-b8a4-84312ec5d084 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:23.896308 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 680/1354] 10.222.0.30 () {54 vars in 921 bytes} [Tue Jul 5 21:56:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:56:23.902406 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0041ae-f44c-454e-83de-0761185d6e91 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:23.902859 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0041ae-f44c-454e-83de-0761185d6e91 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:23.902968 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0041ae-f44c-454e-83de-0761185d6e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:23.921389 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-df0041ae-f44c-454e-83de-0761185d6e91 None None] MFA Rules not processed for user `c289d4b42dec4fe382e35c3f9faa21c8`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:56:23.922694 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-df0041ae-f44c-454e-83de-0761185d6e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:56:23.931319 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 675/1355] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Jul 5 21:56:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:56:27.569621 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac18832-ae40-42cf-a1a2-dfbc58411210 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:27.570390 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac18832-ae40-42cf-a1a2-dfbc58411210 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:27.570390 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac18832-ae40-42cf-a1a2-dfbc58411210 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:27.571992 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 681/1356] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:56:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:56:27.577743 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2de3c9-1d08-46f5-ac3a-7e48c5397f7b None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:27.578301 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2de3c9-1d08-46f5-ac3a-7e48c5397f7b None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:27.578569 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2de3c9-1d08-46f5-ac3a-7e48c5397f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:27.605875 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-8a2de3c9-1d08-46f5-ac3a-7e48c5397f7b None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:56:27.607441 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-8a2de3c9-1d08-46f5-ac3a-7e48c5397f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:56:27.616849 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 676/1357] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:56:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:56:27.674813 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e3793-b9e2-4af1-8cc5-9d323fa87dde None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:27.675699 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e3793-b9e2-4af1-8cc5-9d323fa87dde None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:27.676599 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e3793-b9e2-4af1-8cc5-9d323fa87dde None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:27.679676 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 682/1358] 10.222.0.30 () {54 vars in 961 bytes} [Tue Jul 5 21:56:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:56:27.688763 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea81f1-e2b2-44c3-8896-e650a070da74 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:27.689057 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea81f1-e2b2-44c3-8896-e650a070da74 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:27.689545 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea81f1-e2b2-44c3-8896-e650a070da74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:27.747981 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-12ea81f1-e2b2-44c3-8896-e650a070da74 None None] MFA Rules not processed for user `f5d82e71aafe4b6ebcf60c23c050aafb`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:56:27.749574 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-12ea81f1-e2b2-44c3-8896-e650a070da74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:56:27.840603 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 677/1359] 10.222.0.30 () {58 vars in 1058 bytes} [Tue Jul 5 21:56:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:56:27.848511 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e3793-b9e2-4af1-8cc5-9d323fa87dde None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:56:27.865033 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e3793-b9e2-4af1-8cc5-9d323fa87dde None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:56:27.871034 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3313649e-9db0-4500-a0a1-3b98fa516e90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d82e71aafe4b6ebcf60c23c050aafb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93f20f89d0fc4bbf9cf557dd1e14d98d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:56:27.871868 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313649e-9db0-4500-a0a1-3b98fa516e90 service nova] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:27.872317 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313649e-9db0-4500-a0a1-3b98fa516e90 service nova] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:27.872755 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313649e-9db0-4500-a0a1-3b98fa516e90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:27.882599 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3313649e-9db0-4500-a0a1-3b98fa516e90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:56:27.885348 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3313649e-9db0-4500-a0a1-3b98fa516e90 service nova] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:56:27.896584 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 683/1360] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:56:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:56:30.183944 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43003d65-d2cd-47d1-a88c-bea67e8c80a3 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:30.184424 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43003d65-d2cd-47d1-a88c-bea67e8c80a3 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:30.184509 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43003d65-d2cd-47d1-a88c-bea67e8c80a3 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:30.186091 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 678/1361] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:56:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:56:30.191198 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c039f75-3571-4f71-99d3-f4da426f8550 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:30.191630 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c039f75-3571-4f71-99d3-f4da426f8550 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:30.191774 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c039f75-3571-4f71-99d3-f4da426f8550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:30.211962 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-9c039f75-3571-4f71-99d3-f4da426f8550 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:56:30.214007 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-9c039f75-3571-4f71-99d3-f4da426f8550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:56:30.222159 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 684/1362] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:56:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:56:30.267193 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43003d65-d2cd-47d1-a88c-bea67e8c80a3 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:56:30.281887 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43003d65-d2cd-47d1-a88c-bea67e8c80a3 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:56:30.287643 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f848452a-fd40-48f7-857e-c04f6fe08e36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d82e71aafe4b6ebcf60c23c050aafb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93f20f89d0fc4bbf9cf557dd1e14d98d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:56:30.288289 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848452a-fd40-48f7-857e-c04f6fe08e36 service nova] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:30.288581 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848452a-fd40-48f7-857e-c04f6fe08e36 service nova] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:30.288870 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848452a-fd40-48f7-857e-c04f6fe08e36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:30.298107 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f848452a-fd40-48f7-857e-c04f6fe08e36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:56:30.299747 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f848452a-fd40-48f7-857e-c04f6fe08e36 service nova] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:56:30.310602 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 679/1363] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:56:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:56:32.858190 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112a82b-2d3b-459e-8ccd-f1e4a4d6d65b None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:32.859054 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112a82b-2d3b-459e-8ccd-f1e4a4d6d65b None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:32.859480 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112a82b-2d3b-459e-8ccd-f1e4a4d6d65b None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:32.865453 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 685/1364] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:56:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 21:56:32.868803 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ad408-0259-4ff0-92d7-efb3e75221b6 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:32.869327 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ad408-0259-4ff0-92d7-efb3e75221b6 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:32.869748 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ad408-0259-4ff0-92d7-efb3e75221b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:32.894664 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-485ad408-0259-4ff0-92d7-efb3e75221b6 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:56:32.895895 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-485ad408-0259-4ff0-92d7-efb3e75221b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:56:32.904767 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 680/1365] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:56:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:56:32.950386 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d1447-60f5-4908-86b9-a52675e6328a None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:32.950676 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d1447-60f5-4908-86b9-a52675e6328a None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:32.950957 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d1447-60f5-4908-86b9-a52675e6328a None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:32.952396 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 686/1366] 10.222.0.30 () {54 vars in 961 bytes} [Tue Jul 5 21:56:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:56:32.957919 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da881f-c539-4be0-9e26-f459e8b93ff4 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:32.958251 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da881f-c539-4be0-9e26-f459e8b93ff4 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:32.958537 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da881f-c539-4be0-9e26-f459e8b93ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:32.977102 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-e8da881f-c539-4be0-9e26-f459e8b93ff4 None None] MFA Rules not processed for user `f5d82e71aafe4b6ebcf60c23c050aafb`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:56:32.978331 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-e8da881f-c539-4be0-9e26-f459e8b93ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:56:32.987848 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 681/1367] 10.222.0.30 () {58 vars in 1058 bytes} [Tue Jul 5 21:56:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:56:32.996091 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d1447-60f5-4908-86b9-a52675e6328a None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:56:33.010843 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d1447-60f5-4908-86b9-a52675e6328a None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:56:33.016341 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967dd9f0-d847-4fbc-957d-fa39fd3cd8ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d82e71aafe4b6ebcf60c23c050aafb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93f20f89d0fc4bbf9cf557dd1e14d98d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:56:33.017048 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967dd9f0-d847-4fbc-957d-fa39fd3cd8ca service nova] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:33.017398 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967dd9f0-d847-4fbc-957d-fa39fd3cd8ca service nova] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:33.017743 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967dd9f0-d847-4fbc-957d-fa39fd3cd8ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:33.026449 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967dd9f0-d847-4fbc-957d-fa39fd3cd8ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:56:33.028041 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967dd9f0-d847-4fbc-957d-fa39fd3cd8ca service nova] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:56:33.037719 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 687/1368] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:56:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 21:56:35.318151 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc1164-f980-43e2-b59a-faaaea489359 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:35.318698 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc1164-f980-43e2-b59a-faaaea489359 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:35.318786 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc1164-f980-43e2-b59a-faaaea489359 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:35.321030 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 682/1369] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:56:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:56:35.325898 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67fe40-c55c-43e5-b314-51bd4d8832a6 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:35.326376 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67fe40-c55c-43e5-b314-51bd4d8832a6 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:35.326492 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67fe40-c55c-43e5-b314-51bd4d8832a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:35.345633 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-ba67fe40-c55c-43e5-b314-51bd4d8832a6 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:56:35.347308 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-ba67fe40-c55c-43e5-b314-51bd4d8832a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:56:35.356197 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 688/1370] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:56:35.401651 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc1164-f980-43e2-b59a-faaaea489359 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:56:35.417474 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc1164-f980-43e2-b59a-faaaea489359 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:56:35.423428 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e646fb4-85d4-4750-bb97-cacb954a8031 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d82e71aafe4b6ebcf60c23c050aafb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93f20f89d0fc4bbf9cf557dd1e14d98d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:56:35.424201 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e646fb4-85d4-4750-bb97-cacb954a8031 service nova] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:35.424615 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e646fb4-85d4-4750-bb97-cacb954a8031 service nova] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:35.425035 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e646fb4-85d4-4750-bb97-cacb954a8031 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:35.434099 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e646fb4-85d4-4750-bb97-cacb954a8031 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:56:35.435830 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e646fb4-85d4-4750-bb97-cacb954a8031 service nova] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:56:35.448043 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 683/1371] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:56:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:56:35.955876 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df76d8f-1ae6-471a-ab2b-fbe80f8d7f85 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:35.956180 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df76d8f-1ae6-471a-ab2b-fbe80f8d7f85 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:35.956442 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df76d8f-1ae6-471a-ab2b-fbe80f8d7f85 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:35.957969 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 689/1372] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:56:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:56:35.963797 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3776a0e-7434-42aa-a6fd-3fa8b4e88d7f None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:35.964095 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3776a0e-7434-42aa-a6fd-3fa8b4e88d7f None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:35.964379 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3776a0e-7434-42aa-a6fd-3fa8b4e88d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:35.982908 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-e3776a0e-7434-42aa-a6fd-3fa8b4e88d7f None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:56:35.984118 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-e3776a0e-7434-42aa-a6fd-3fa8b4e88d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:56:36.000040 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 684/1373] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:56:36.362753 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3cd57-cff0-4e60-a16f-b7901ec9de5d None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:36.363581 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3cd57-cff0-4e60-a16f-b7901ec9de5d None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:36.364049 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3cd57-cff0-4e60-a16f-b7901ec9de5d None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:36.365584 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 690/1374] 10.222.0.30 () {54 vars in 963 bytes} [Tue Jul 5 21:56:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:56:36.371746 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2bc8b9-32b8-418a-8499-1703c9a6f054 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:36.372532 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2bc8b9-32b8-418a-8499-1703c9a6f054 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:36.372979 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2bc8b9-32b8-418a-8499-1703c9a6f054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:36.386013 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=100 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:56:36.425514 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-ac2bc8b9-32b8-418a-8499-1703c9a6f054 None None] MFA Rules not processed for user `b7f6902012fd4a9283c73b9e2394e0b0`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:56:36.426997 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-ac2bc8b9-32b8-418a-8499-1703c9a6f054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:56:36.491242 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 685/1375] 10.222.0.30 () {58 vars in 1060 bytes} [Tue Jul 5 21:56:36 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:56:36.499770 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d3cd57-cff0-4e60-a16f-b7901ec9de5d None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:56:36.512064 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d3cd57-cff0-4e60-a16f-b7901ec9de5d None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:56:36.517901 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94bb0ff-0bc8-450a-b46c-3db10bbf0482 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7f6902012fd4a9283c73b9e2394e0b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93f20f89d0fc4bbf9cf557dd1e14d98d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:56:36.519175 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bb0ff-0bc8-450a-b46c-3db10bbf0482 service cinder] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:36.519820 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bb0ff-0bc8-450a-b46c-3db10bbf0482 service cinder] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:36.520392 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bb0ff-0bc8-450a-b46c-3db10bbf0482 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:36.530864 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94bb0ff-0bc8-450a-b46c-3db10bbf0482 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:56:36.532504 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94bb0ff-0bc8-450a-b46c-3db10bbf0482 service cinder] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:56:36.550835 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 691/1376] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:56:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:56:37.661220 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292dab2-bb5f-486b-8aab-e946140cf6c7 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:37.661791 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292dab2-bb5f-486b-8aab-e946140cf6c7 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:37.661911 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292dab2-bb5f-486b-8aab-e946140cf6c7 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:37.663275 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 686/1377] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:56:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:56:37.669179 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70f2c0-35fb-4525-8fcf-d43bc19797ae None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:37.669598 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70f2c0-35fb-4525-8fcf-d43bc19797ae None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:37.669863 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70f2c0-35fb-4525-8fcf-d43bc19797ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:37.688039 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-fe70f2c0-35fb-4525-8fcf-d43bc19797ae None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:56:37.689264 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-fe70f2c0-35fb-4525-8fcf-d43bc19797ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:56:37.698016 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 692/1378] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:56:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:56:37.743253 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292dab2-bb5f-486b-8aab-e946140cf6c7 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:56:37.757839 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292dab2-bb5f-486b-8aab-e946140cf6c7 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:56:37.763559 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2653fe5c-612b-4913-9674-3289fe06f153 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d82e71aafe4b6ebcf60c23c050aafb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93f20f89d0fc4bbf9cf557dd1e14d98d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:56:37.764204 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653fe5c-612b-4913-9674-3289fe06f153 service nova] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:37.764495 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653fe5c-612b-4913-9674-3289fe06f153 service nova] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:37.764780 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653fe5c-612b-4913-9674-3289fe06f153 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:37.773324 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2653fe5c-612b-4913-9674-3289fe06f153 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:56:37.775093 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2653fe5c-612b-4913-9674-3289fe06f153 service nova] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:56:37.785121 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 687/1379] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:56:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:56:39.990675 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794cb32-d847-453c-80c2-e168398b69e1 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:39.991184 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794cb32-d847-453c-80c2-e168398b69e1 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:39.991184 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794cb32-d847-453c-80c2-e168398b69e1 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:39.992798 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 693/1380] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:56:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:56:39.997995 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271e78f-a7e9-4974-8856-ac7930a82c49 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:39.998447 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271e78f-a7e9-4974-8856-ac7930a82c49 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:39.998612 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271e78f-a7e9-4974-8856-ac7930a82c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:40.017049 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-b271e78f-a7e9-4974-8856-ac7930a82c49 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:56:40.018415 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-b271e78f-a7e9-4974-8856-ac7930a82c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:56:40.028729 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 688/1381] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:56:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:56:40.072216 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b794cb32-d847-453c-80c2-e168398b69e1 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:56:40.087556 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b794cb32-d847-453c-80c2-e168398b69e1 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:56:40.093154 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d091c7-f0a7-4671-8c8c-610c6f11c013 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d82e71aafe4b6ebcf60c23c050aafb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93f20f89d0fc4bbf9cf557dd1e14d98d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:56:40.093780 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d091c7-f0a7-4671-8c8c-610c6f11c013 service nova] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:40.094065 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d091c7-f0a7-4671-8c8c-610c6f11c013 service nova] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:40.094375 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d091c7-f0a7-4671-8c8c-610c6f11c013 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:40.102908 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d091c7-f0a7-4671-8c8c-610c6f11c013 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:56:40.104500 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d091c7-f0a7-4671-8c8c-610c6f11c013 service nova] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:56:40.114311 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 694/1382] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:56:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:56:42.382345 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a600c-7650-43de-b0db-902a7e076e60 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:42.383569 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a600c-7650-43de-b0db-902a7e076e60 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:42.384134 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a600c-7650-43de-b0db-902a7e076e60 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:42.385880 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 689/1383] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:56:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:56:42.391664 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c74da-43ea-41b8-ba99-0c2fa8693e80 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:42.392263 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c74da-43ea-41b8-ba99-0c2fa8693e80 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:42.392263 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c74da-43ea-41b8-ba99-0c2fa8693e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:42.412045 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-031c74da-43ea-41b8-ba99-0c2fa8693e80 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:56:42.413304 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-031c74da-43ea-41b8-ba99-0c2fa8693e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:56:42.423284 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 695/1384] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:56:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:56:42.468533 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a600c-7650-43de-b0db-902a7e076e60 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:56:42.485284 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a600c-7650-43de-b0db-902a7e076e60 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:56:42.491229 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715251d9-a684-4396-8881-159b1c836722 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d82e71aafe4b6ebcf60c23c050aafb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93f20f89d0fc4bbf9cf557dd1e14d98d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:56:42.492538 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715251d9-a684-4396-8881-159b1c836722 service nova] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:42.493217 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715251d9-a684-4396-8881-159b1c836722 service nova] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:42.493217 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715251d9-a684-4396-8881-159b1c836722 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:42.502661 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715251d9-a684-4396-8881-159b1c836722 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:56:42.504374 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715251d9-a684-4396-8881-159b1c836722 service nova] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:56:42.515383 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 690/1385] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:56:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:56:44.576911 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4bb551-da2e-4380-b887-06fe8d5e97c2 None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:44.577503 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4bb551-da2e-4380-b887-06fe8d5e97c2 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:44.577503 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4bb551-da2e-4380-b887-06fe8d5e97c2 None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:44.578937 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 696/1386] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:56:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:56:44.584135 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31936853-dff9-4f12-b17d-f1f90ac00e22 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:44.584607 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31936853-dff9-4f12-b17d-f1f90ac00e22 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:44.584738 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31936853-dff9-4f12-b17d-f1f90ac00e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:44.603923 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-31936853-dff9-4f12-b17d-f1f90ac00e22 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:56:44.605124 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-31936853-dff9-4f12-b17d-f1f90ac00e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:56:44.613203 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 691/1387] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:56:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:56:44.657093 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4bb551-da2e-4380-b887-06fe8d5e97c2 None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:56:44.672115 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4bb551-da2e-4380-b887-06fe8d5e97c2 None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:56:44.677721 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88224d1e-507b-495f-bbb0-03884960cfea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d82e71aafe4b6ebcf60c23c050aafb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93f20f89d0fc4bbf9cf557dd1e14d98d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:56:44.678410 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88224d1e-507b-495f-bbb0-03884960cfea service nova] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:44.678705 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88224d1e-507b-495f-bbb0-03884960cfea service nova] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:44.678991 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88224d1e-507b-495f-bbb0-03884960cfea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:44.688394 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88224d1e-507b-495f-bbb0-03884960cfea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:56:44.690012 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88224d1e-507b-495f-bbb0-03884960cfea service nova] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:56:44.700599 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 697/1388] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:56:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:56:46.419729 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2d13b-7a98-4422-85a4-b1439d379204 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:46.420316 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2d13b-7a98-4422-85a4-b1439d379204 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:46.420316 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2d13b-7a98-4422-85a4-b1439d379204 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:46.421714 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 692/1389] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:56:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:56:46.427097 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c80d8-f9f2-44cc-b473-25687211e004 None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:46.427552 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c80d8-f9f2-44cc-b473-25687211e004 None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:46.427666 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c80d8-f9f2-44cc-b473-25687211e004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:46.446842 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-658c80d8-f9f2-44cc-b473-25687211e004 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:56:46.448058 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-658c80d8-f9f2-44cc-b473-25687211e004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:56:46.456162 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 698/1390] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:56:46.513254 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e2bb9-e047-472c-a1b9-7c0d8319a881 None None] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:46.513547 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e2bb9-e047-472c-a1b9-7c0d8319a881 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:46.513832 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e2bb9-e047-472c-a1b9-7c0d8319a881 None None] PATH_INFO: `/` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:46.515257 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 693/1391] 10.222.0.30 () {54 vars in 962 bytes} [Tue Jul 5 21:56:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:56:46.520411 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620631cd-07bc-4fc7-8725-e680e390e16c None None] REQUEST_METHOD: `POST` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:46.520700 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620631cd-07bc-4fc7-8725-e680e390e16c None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:46.520979 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620631cd-07bc-4fc7-8725-e680e390e16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:46.572255 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.auth.core [None req-620631cd-07bc-4fc7-8725-e680e390e16c None None] MFA Rules not processed for user `8688d3d1cf62416da18c3ffb0b79ec54`. Rule list: `[]` (Enabled: `True`). {{(pid=244269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:56:46.573458 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.fernet_utils [None req-620631cd-07bc-4fc7-8725-e680e390e16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:56:46.635152 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 699/1392] 10.222.0.30 () {58 vars in 1059 bytes} [Tue Jul 5 21:56:46 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:56:46.642764 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e2bb9-e047-472c-a1b9-7c0d8319a881 None None] Authenticating user token {{(pid=244268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:56:46.654309 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e2bb9-e047-472c-a1b9-7c0d8319a881 None None] Validating token access rules against request {{(pid=244268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:56:46.657847 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26583e51-50b4-48d1-a367-b4fc81df796f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8688d3d1cf62416da18c3ffb0b79ec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93f20f89d0fc4bbf9cf557dd1e14d98d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:56:46.658518 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26583e51-50b4-48d1-a367-b4fc81df796f service glance] REQUEST_METHOD: `GET` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:46.658808 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26583e51-50b4-48d1-a367-b4fc81df796f service glance] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:46.659301 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26583e51-50b4-48d1-a367-b4fc81df796f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:46.668615 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26583e51-50b4-48d1-a367-b4fc81df796f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:56:46.670116 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26583e51-50b4-48d1-a367-b4fc81df796f service glance] RBAC: Authorization granted {{(pid=244268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:56:46.679784 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 694/1393] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:56:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:56:47.011147 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f4d39-d7b2-4e6d-b284-3ebb89f0da3d None None] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:47.011445 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f4d39-d7b2-4e6d-b284-3ebb89f0da3d None None] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:47.011730 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f4d39-d7b2-4e6d-b284-3ebb89f0da3d None None] PATH_INFO: `/` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:47.013283 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 700/1394] 10.222.0.30 () {54 vars in 926 bytes} [Tue Jul 5 21:56:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:56:47.018476 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541cb31c-80e8-4fb6-b53d-c6d08c9593e0 None None] REQUEST_METHOD: `POST` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:47.018776 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541cb31c-80e8-4fb6-b53d-c6d08c9593e0 None None] SCRIPT_NAME: `/identity` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:47.019072 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541cb31c-80e8-4fb6-b53d-c6d08c9593e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=244268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:47.037274 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.auth.core [None req-541cb31c-80e8-4fb6-b53d-c6d08c9593e0 None None] MFA Rules not processed for user `1e928873ee4f41c0a59c6b30ce6b0806`. Rule list: `[]` (Enabled: `True`). {{(pid=244268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:56:47.038502 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG keystone.common.fernet_utils [None req-541cb31c-80e8-4fb6-b53d-c6d08c9593e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=244268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:56:47.047129 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: [pid: 244268|app: 0|req: 695/1395] 10.222.0.30 () {58 vars in 1023 bytes} [Tue Jul 5 21:56:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:56:47.091319 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f4d39-d7b2-4e6d-b284-3ebb89f0da3d None None] Authenticating user token {{(pid=244269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:56:47.107206 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f4d39-d7b2-4e6d-b284-3ebb89f0da3d None None] Validating token access rules against request {{(pid=244269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:56:47.113035 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6dbfe-7725-49c3-82d3-53f5a52e6a43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d82e71aafe4b6ebcf60c23c050aafb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93f20f89d0fc4bbf9cf557dd1e14d98d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=244269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:56:47.113693 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6dbfe-7725-49c3-82d3-53f5a52e6a43 service nova] REQUEST_METHOD: `GET` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:56:47.113986 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6dbfe-7725-49c3-82d3-53f5a52e6a43 service nova] SCRIPT_NAME: `/identity` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:56:47.114308 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6dbfe-7725-49c3-82d3-53f5a52e6a43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=244269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:56:47.123175 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d6dbfe-7725-49c3-82d3-53f5a52e6a43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:56:47.124773 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d6dbfe-7725-49c3-82d3-53f5a52e6a43 service nova] RBAC: Authorization granted {{(pid=244269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:56:47.134949 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: [pid: 244269|app: 0|req: 701/1396] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Jul 5 21:56:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 21:56:57.032155 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: DEBUG dbcounter [-] [244268] Writing DB stats keystone:SELECT=63 {{(pid=244268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:56:57.130814 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: DEBUG dbcounter [-] [244269] Writing DB stats keystone:SELECT=89 {{(pid=244269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:57:15.532640 dv-cinder-847335-3-iscsi systemd[1]: Stopping Devstack devstack@keystone.service... Jul 05 21:57:15.533198 dv-cinder-847335-3-iscsi devstack@keystone.service[244256]: Tue Jul 5 21:57:15 2022 - graceful shutdown triggered... Jul 05 21:57:15.533780 dv-cinder-847335-3-iscsi devstack@keystone.service[244269]: Gracefully killing worker 2 (pid: 244269)... Jul 05 21:57:15.534248 dv-cinder-847335-3-iscsi devstack@keystone.service[244268]: Gracefully killing worker 1 (pid: 244268)... Jul 05 21:57:16.534333 dv-cinder-847335-3-iscsi devstack@keystone.service[244256]: worker 1 buried after 1 seconds Jul 05 21:57:16.534333 dv-cinder-847335-3-iscsi devstack@keystone.service[244256]: worker 2 buried after 1 seconds Jul 05 21:57:16.534333 dv-cinder-847335-3-iscsi devstack@keystone.service[244256]: goodbye to uWSGI. Jul 05 21:57:16.535929 dv-cinder-847335-3-iscsi systemd[1]: devstack@keystone.service: Succeeded. Jul 05 21:57:16.536480 dv-cinder-847335-3-iscsi systemd[1]: Stopped Devstack devstack@keystone.service.